Sep 22 15:30:37 devstack cinder-volume[75263]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 22 15:30:37 devstack cinder-volume[75263]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 22 15:30:37 devstack cinder-volume[75263]: we strongly recommend against using it for new projects. Sep 22 15:30:37 devstack cinder-volume[75263]: If you are already using Eventlet, we recommend migrating to a different Sep 22 15:30:37 devstack cinder-volume[75263]: framework. For more detail see Sep 22 15:30:37 devstack cinder-volume[75263]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 22 15:30:37 devstack cinder-volume[75263]: import eventlet # noqa Sep 22 15:30:40 devstack cinder-volume[75263]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75263) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 22 15:30:40 devstack cinder-volume[75263]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75263) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 22 15:30:40 devstack cinder-volume[75263]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75263) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 22 15:30:41 devstack cinder-volume[75263]: INFO dbcounter [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] Registered counter for database cinder Sep 22 15:30:41 devstack cinder-volume[75263]: DEBUG oslo_db.sqlalchemy.engines [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75263) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 22 15:30:41 devstack cinder-volume[75263]: DEBUG dbcounter [-] [75263] Writer thread running {{(pid=75263) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 22 15:30:41 devstack cinder-volume[75263]: INFO cinder.rpc [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 22 15:30:41 devstack cinder-volume[75263]: INFO cinder.rpc [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 22 15:30:42 devstack cinder-volume[75263]: DEBUG oslo_db.sqlalchemy.engines [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75263) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 22 15:30:42 devstack cinder-volume[75263]: INFO cinder.volume.manager [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] Determined volume DB was empty at startup. Sep 22 15:30:42 devstack cinder-volume[75263]: DEBUG cinder.volume.manager [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75263) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 22 15:30:42 devstack cinder-volume[75263]: INFO cinder.volume.manager [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 22 15:30:42 devstack cinder-volume[75263]: WARNING stevedore.named [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 22 15:30:42 devstack cinder-volume[75263]: WARNING castellan.key_manager [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 22 15:30:42 devstack cinder-volume[75263]: WARNING cinder.keymgr.conf_key_mgr [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 22 15:30:42 devstack cinder-volume[75263]: DEBUG cinder.volume.drivers.lvm [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75263) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Sep 22 15:30:42 devstack cinder-volume[75263]: DEBUG oslo_concurrency.processutils [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:30:42 devstack cinder-volume[75263]: DEBUG oslo_concurrency.processutils [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] CMD "cinder-rtstool verify" returned: 0 in 0.439s {{(pid=75263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:30:42 devstack cinder-volume[75263]: DEBUG oslo_db.sqlalchemy.engines [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75263) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 22 15:30:42 devstack cinder-volume[75263]: INFO cinder.rpc [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Sep 22 15:30:42 devstack cinder-volume[75263]: INFO cinder.rpc [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Sep 22 15:30:42 devstack cinder-volume[75263]: WARNING stevedore.named [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 22 15:30:42 devstack cinder-volume[75263]: WARNING castellan.key_manager [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 22 15:30:42 devstack cinder-volume[75263]: INFO cinder.volume.manager [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Sep 22 15:30:42 devstack cinder-volume[75263]: DEBUG oslo_db.sqlalchemy.engines [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75263) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 22 15:30:42 devstack cinder-volume[75263]: INFO oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] Starting 1 workers Sep 22 15:30:42 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] Started child 75442 {{(pid=75263) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 22 15:30:42 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] Full set of CONF: {{(pid=75263) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 22 15:30:42 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] ******************************************************************************** {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 22 15:30:42 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] Configuration options gathered from: {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 22 15:30:42 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 22 15:30:42 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 22 15:30:42 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] ================================================================================ {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 22 15:30:42 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] allow_availability_zone_fallback = False {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:30:42 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] allow_compression_on_image_upload = False {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:30:42 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] allowed_direct_url_schemes = [] {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:30:42 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] api_rate_limit = True {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:30:42 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] auth_strategy = keystone {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:30:42 devstack cinder-volume[75442]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0) Sep 22 15:30:42 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] az_cache_duration = 3600 {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:30:42 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] backend_availability_zone = None {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:30:42 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] backend_host = None {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:30:42 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] backend_name = None {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:30:42 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] backend_stats_polling_interval = 60 {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:30:42 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] backup_api_class = cinder.backup.api.API {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:30:42 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:30:42 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] backup_name_template = backup-%s {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:30:42 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] backup_use_same_host = False {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:30:42 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] backup_use_temp_snapshot = False {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:30:42 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] chap_password = **** {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:30:42 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] chap_username = {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:30:42 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:30:42 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] cinder_internal_tenant_project_id = eb8a2d6d7e6541fb9d06a0a3594619ee {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:30:42 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] cinder_internal_tenant_user_id = 5e260e248dfc45758401c916d6596d08 {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:30:42 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] cloned_volume_same_az = True {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:30:42 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] cluster = None {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:30:42 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] compression_format = gzip {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:30:42 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] compute_api_class = cinder.compute.nova.API {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:30:42 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] config_dir = [] {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:30:42 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:30:42 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] config_source = [] {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:30:42 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:30:42 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] control_exchange = openstack {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:30:42 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] debug = True {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:30:42 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] default_availability_zone = None {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:30:42 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] default_group_type = None {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:30:42 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:30:42 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] default_volume_type = lvmdriver-1 {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:30:42 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] disk_geometry = None {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:30:42 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] driver_client_cert = None {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:30:42 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] driver_client_cert_key = None {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:30:42 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] driver_data_namespace = None {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:30:42 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] driver_ssl_cert_path = None {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:30:42 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] driver_ssl_cert_verify = False {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:30:42 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] driver_use_ssl = False {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:30:42 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] enable_force_upload = False {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:30:42 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] enable_new_services = True {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:30:42 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] enable_unsupported_driver = False {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:30:42 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] enabled_backends = ['lvmdriver-1'] {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:30:42 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] enforce_multipath_for_image_xfer = False {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:30:42 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] filter_function = None {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:30:42 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] glance_api_insecure = False {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:30:42 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] glance_api_servers = ['http://192.168.122.247/image'] {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:30:42 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] glance_api_ssl_compression = False {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:30:42 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] glance_ca_certificates_file = None {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:30:42 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] glance_catalog_info = image:glance:publicURL {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:30:42 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] glance_certfile = None {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:30:42 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:30:42 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] glance_keyfile = None {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:30:42 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] glance_num_retries = 3 {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:30:42 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] glance_request_timeout = None {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:30:42 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] goodness_function = None {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:30:42 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] graceful_shutdown_timeout = 5 {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:30:42 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] group_api_class = cinder.group.api.API {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:30:42 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] host = devstack {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:30:42 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] image_compress_on_upload = True {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:30:42 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] image_conversion_address_space_limit = 1 {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:30:42 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] image_conversion_cpu_limit = 60 {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:30:42 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:30:42 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] image_conversion_disable = False {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:30:42 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] image_introspection_address_space_limit = 1 {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:30:42 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] image_introspection_cpu_limit = 60 {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:30:42 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] image_upload_use_cinder_backend = False {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:30:42 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] image_upload_use_internal_tenant = False {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:30:42 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] image_volume_cache_enabled = False {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:30:42 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] image_volume_cache_max_count = 0 {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:30:42 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] image_volume_cache_max_size_gb = 0 {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:30:42 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] init_host_max_objects_retrieval = 0 {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:30:42 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] instance_format = [instance: %(uuid)s] {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:30:42 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:30:42 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] iscsi_target_flags = {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:30:42 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] iscsi_write_cache = on {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:30:42 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] iser_helper = tgtadm {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:30:42 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] iser_ip_address = 192.168.122.247 {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:30:42 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] iser_port = 3260 {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:30:42 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:30:42 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] log_color = False {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:30:42 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] log_config_append = None {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:30:42 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:30:42 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] log_dir = None {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:30:42 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] log_file = None {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:30:42 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] log_options = True {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:30:42 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] log_rotate_interval = 1 {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:30:42 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] log_rotate_interval_type = days {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:30:42 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] log_rotation_type = none {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:30:42 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:30:42 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:30:42 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:30:42 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:30:42 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:30:42 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] max_age = 0 {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:30:42 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] max_logfile_count = 30 {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:30:42 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] max_logfile_size_mb = 200 {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:30:42 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] max_over_subscription_ratio = 20.0 {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:30:42 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] message_reap_interval = 86400 {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:30:42 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] message_ttl = 2592000 {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:30:42 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] migration_create_volume_timeout_secs = 300 {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:30:42 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] monkey_patch = False {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:30:42 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] monkey_patch_modules = [] {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:30:42 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] my_ip = 192.168.122.247 {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:30:42 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] no_snapshot_gb_quota = False {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:30:42 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] num_iser_scan_tries = 3 {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:30:42 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] num_shell_tries = 3 {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:30:42 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] num_volume_device_scan_tries = 3 {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:30:42 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] nvmeof_conn_info_version = 1 {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:30:42 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] nvmet_ns_id = 10 {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:30:42 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] nvmet_port_id = 1 {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:30:42 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] osapi_max_limit = 1000 {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:30:42 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] osapi_volume_ext_list = [] {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:30:42 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:30:42 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] osapi_volume_listen = 0.0.0.0 {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:30:42 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] osapi_volume_listen_port = 8776 {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:30:42 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] osapi_volume_use_ssl = False {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:30:42 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] osapi_volume_workers = None {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:30:42 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] per_volume_size_limit = -1 {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:30:42 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] periodic_fuzzy_delay = 60 {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:30:42 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] periodic_interval = 60 {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:30:42 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] project_id_regex = [0-9a-f\-]+ {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:30:42 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] public_endpoint = None {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:30:42 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] publish_errors = False {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:30:42 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] quota_backup_gigabytes = 1000 {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:30:42 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] quota_backups = 10 {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:30:42 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:30:42 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] quota_gigabytes = 1000 {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:30:42 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] quota_groups = 10 {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:30:42 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] quota_snapshots = 10 {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:30:42 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] quota_volumes = 10 {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:30:42 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] rate_limit_burst = 0 {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:30:42 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] rate_limit_except_level = CRITICAL {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:30:42 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] rate_limit_interval = 0 {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:30:42 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] reinit_driver_count = 3 {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:30:42 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] replication_device = **** {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:30:42 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] report_discard_supported = False {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:30:42 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] report_interval = 120 {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:30:42 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] reservation_clean_interval = 86400 {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:30:42 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] reservation_expire = 86400 {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:30:42 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] reserved_image_namespaces = [] {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:30:42 devstack cinder-volume[75442]: INFO cinder.volume.manager [None req-4299f593-99bc-465e-b66e-324c4c682fa8 None None] Starting volume driver LVMVolumeDriver (3.0.0) Sep 22 15:30:42 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] reserved_percentage = 0 {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:30:42 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:30:42 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:30:42 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] rpc_response_timeout = 120 {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:30:42 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] run_external_periodic_tasks = True {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:30:42 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:30:42 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] scst_target_driver = iscsi {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:30:42 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] scst_target_iqn_name = None {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:30:42 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] service_down_time = 720 {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:30:42 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] shell_completion = None {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:30:42 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] snapshot_name_template = snapshot-%s {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:30:42 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] snapshot_same_host = True {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:30:42 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] split_loggers = False {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:30:42 devstack cinder-volume[75442]: DEBUG oslo_concurrency.processutils [None req-4299f593-99bc-465e-b66e-324c4c682fa8 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75442) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:30:42 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] state_path = /opt/stack/data/cinder {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:30:42 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] storage_availability_zone = nova {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:30:42 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] storage_protocol = iSCSI {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:30:42 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] syslog_log_facility = LOG_USER {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:30:42 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] target_helper = lioadm {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:30:42 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] target_ip_address = 192.168.122.247 {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:30:42 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] target_port = 3260 {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:30:42 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:30:42 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] target_protocol = iscsi {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:30:42 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] target_secondary_ip_addresses = [] {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:30:42 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] trace_flags = None {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:30:42 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] transfer_api_class = cinder.transfer.api.API {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:30:42 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] transport_url = **** {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:30:42 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] until_refresh = 0 {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:30:42 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] use_chap_auth = False {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:30:42 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] use_default_quota_class = True {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:30:42 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] use_journal = False {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:30:42 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] use_json = False {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:30:42 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] use_multipath_for_image_xfer = False {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:30:42 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] use_stderr = False {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:30:42 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] use_syslog = False {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:30:42 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] verify_glance_signatures = enabled {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:30:42 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:30:42 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] volume_api_class = cinder.volume.api.API {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:30:42 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] volume_backend_name = None {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:30:42 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] volume_clear = zero {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:30:42 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] volume_clear_ionice = None {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:30:42 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] volume_clear_size = 0 {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:30:42 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:30:42 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] volume_copy_bps_limit = 0 {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:30:42 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] volume_dd_blocksize = 1M {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:30:42 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:30:42 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] volume_name_template = volume-%s {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:30:42 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] volume_service_inithost_offload = False {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:30:42 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] volume_usage_audit_period = month {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:30:42 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:30:42 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] zoning_mode = None {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:30:42 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] oslo_concurrency.disable_process_locking = False {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:42 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:42 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:42 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:42 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:42 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:42 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:42 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:42 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:42 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:42 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] keystone_authtoken.auth_section = None {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:42 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] keystone_authtoken.auth_type = password {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] keystone_authtoken.auth_version = None {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] keystone_authtoken.cache = None {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] keystone_authtoken.certfile = None {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] keystone_authtoken.delay_auth_decision = False {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] keystone_authtoken.http_connect_timeout = None {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] keystone_authtoken.include_service_catalog = True {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] keystone_authtoken.insecure = False {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] keystone_authtoken.interface = public {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] keystone_authtoken.keyfile = None {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] keystone_authtoken.memcache_password = **** {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75442]: DEBUG oslo_concurrency.processutils [None req-4299f593-99bc-465e-b66e-324c4c682fa8 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.040s {{(pid=75442) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] keystone_authtoken.memcache_username = None {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] keystone_authtoken.region_name = None {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] keystone_authtoken.service_token_roles_required = True {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] keystone_authtoken.service_type = None {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] keystone_authtoken.token_cache_time = 300 {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.247/identity {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] cache.backend = dogpile.cache.null {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] cache.backend_argument = **** {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75442]: DEBUG oslo_concurrency.processutils [None req-4299f593-99bc-465e-b66e-324c4c682fa8 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75442) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] cache.backend_expiration_time = None {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] cache.config_prefix = cache.oslo {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] cache.debug_cache_backend = False {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] cache.enable_retry_client = False {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] cache.enable_socket_keepalive = False {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] cache.enabled = False {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] cache.expiration_time = 600 {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] cache.hashclient_retry_attempts = 2 {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] cache.memcache_dead_retry = 300 {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] cache.memcache_pool_maxsize = 10 {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] cache.memcache_sasl_enabled = False {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] cache.password = **** {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] cache.proxies = [] {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] cache.redis_db = 0 {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] cache.redis_sentinel_service_name = mymaster {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] cache.redis_server = localhost:6379 {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] cache.retry_attempts = 2 {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] cache.retry_delay = 0.0 {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] cache.socket_keepalive_count = 1 {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] cache.socket_keepalive_idle = 1 {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] cache.socket_keepalive_interval = 1 {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] cache.socket_timeout = 1.0 {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] cache.tls_allowed_ciphers = None {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] cache.tls_cafile = None {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] cache.tls_certfile = None {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] cache.tls_enabled = False {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] cache.tls_keyfile = None {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] cache.username = None {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] coordination.backend_url = **** {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] database.asyncio_connection = **** {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] database.asyncio_slave_connection = **** {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] database.backend = sqlalchemy {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] database.connection = **** {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] database.connection_debug = 0 {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] database.connection_parameters = {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] database.connection_recycle_time = 3600 {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] database.connection_trace = False {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] database.db_inc_retry_interval = True {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] database.db_max_retries = 20 {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] database.db_max_retry_interval = 10 {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] database.db_retry_interval = 1 {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] database.max_overflow = 50 {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] database.max_pool_size = 5 {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] database.max_retries = 10 {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] database.mysql_wsrep_sync_wait = None {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] database.pool_timeout = None {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] database.retry_interval = 10 {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] database.slave_connection = **** {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] database.sqlite_synchronous = True {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] database.synchronous_reader = True {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] database.use_db_reconnect = False {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] oslo_messaging_tracing.insecure = False {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] profiler.connection_string = messaging:// {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] profiler.enabled = False {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] profiler.es_doc_type = notification {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] profiler.es_scroll_size = 10000 {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] profiler.es_scroll_time = 2m {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] profiler.filter_error_trace = False {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] profiler.hmac_keys = **** {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] profiler.sentinel_service_name = mymaster {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] profiler.socket_timeout = 0.1 {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] profiler.trace_requests = False {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] profiler.trace_sqlalchemy = False {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] profiler_jaeger.process_tags = {} {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] profiler_jaeger.service_name_prefix = None {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] profiler_otlp.service_name_prefix = None {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] oslo_policy.enforce_new_defaults = True {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] oslo_policy.policy_default_rule = default {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] oslo_policy.policy_file = policy.yaml {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] oslo_policy.remote_timeout = 60.0 {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] privsep_osbrick.group = None {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] privsep_osbrick.helper_command = None {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75442]: DEBUG oslo_concurrency.processutils [None req-4299f593-99bc-465e-b66e-324c4c682fa8 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.036s {{(pid=75442) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] privsep_osbrick.user = None {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75442]: DEBUG oslo_concurrency.processutils [None req-4299f593-99bc-465e-b66e-324c4c682fa8 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75442) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] cinder_sys_admin.group = None {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] cinder_sys_admin.helper_command = None {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] cinder_sys_admin.user = None {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] service_user.auth_section = None {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] service_user.auth_type = password {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] service_user.cafile = None {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] service_user.certfile = None {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] service_user.collect_timing = False {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] service_user.insecure = False {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] service_user.keyfile = None {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] service_user.send_service_user_token = True {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] service_user.split_loggers = False {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] service_user.timeout = None {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] service_user.tls_ciphers = None {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] service_user.tls_min_version = None {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] glance.auth_section = None {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] glance.auth_type = password {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] glance.certfile = None {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] glance.collect_timing = False {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] glance.insecure = False {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] glance.keyfile = None {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] glance.region_name = None {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] glance.split_loggers = False {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] glance.timeout = None {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] glance.tls_ciphers = None {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] glance.tls_min_version = None {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] backend_defaults.backend_availability_zone = None {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] backend_defaults.chap_password = **** {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] backend_defaults.chap_username = {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] backend_defaults.disk_geometry = None {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] backend_defaults.driver_client_cert = None {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] backend_defaults.driver_client_cert_key = None {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] backend_defaults.driver_data_namespace = None {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] backend_defaults.driver_use_ssl = False {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] backend_defaults.enable_unsupported_driver = False {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] backend_defaults.extra_capabilities = {} {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] backend_defaults.filter_function = None {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] backend_defaults.goodness_function = None {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] backend_defaults.iscsi_target_flags = {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] backend_defaults.iscsi_write_cache = on {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] backend_defaults.iser_helper = tgtadm {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] backend_defaults.iser_ip_address = 192.168.122.247 {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] backend_defaults.iser_port = 3260 {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] backend_defaults.lvm_mirrors = 0 {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] backend_defaults.lvm_share_target = False {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] backend_defaults.lvm_type = auto {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] backend_defaults.num_shell_tries = 3 {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] backend_defaults.nvmet_port_id = 1 {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] backend_defaults.replication_device = **** {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] backend_defaults.report_discard_supported = False {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] backend_defaults.reserved_percentage = 0 {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] backend_defaults.scst_target_driver = iscsi {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] backend_defaults.scst_target_iqn_name = None {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] backend_defaults.storage_protocol = iSCSI {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] backend_defaults.target_helper = tgtadm {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75442]: DEBUG oslo_concurrency.processutils [None req-4299f593-99bc-465e-b66e-324c4c682fa8 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.032s {{(pid=75442) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] backend_defaults.target_ip_address = 192.168.122.247 {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] backend_defaults.target_port = 3260 {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75442]: DEBUG oslo_concurrency.processutils [None req-4299f593-99bc-465e-b66e-324c4c682fa8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=75442) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] backend_defaults.target_protocol = iscsi {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] backend_defaults.trace_flags = None {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] backend_defaults.unique_fqdn_network = True {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] backend_defaults.use_chap_auth = False {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] backend_defaults.volume_backend_name = None {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] backend_defaults.volume_clear = zero {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] backend_defaults.volume_clear_ionice = None {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] backend_defaults.volume_clear_size = 0 {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] backend_defaults.volume_group = cinder-volumes {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] oslo_reports.file_event_handler = None {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] oslo_reports.log_dir = None {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] lvmdriver-1.backend_availability_zone = None {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] lvmdriver-1.backend_host = None {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] lvmdriver-1.chap_password = **** {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] lvmdriver-1.chap_username = None {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] lvmdriver-1.chiscsi_conf = None {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] lvmdriver-1.disk_geometry = None {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] lvmdriver-1.driver_client_cert = None {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] lvmdriver-1.driver_data_namespace = None {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] lvmdriver-1.driver_use_ssl = None {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] lvmdriver-1.extra_capabilities = None {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] lvmdriver-1.filter_function = None {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] lvmdriver-1.goodness_function = None {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] lvmdriver-1.iser_helper = None {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] lvmdriver-1.iser_ip_address = None {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] lvmdriver-1.iser_port = None {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] lvmdriver-1.iser_target_prefix = None {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] lvmdriver-1.lvm_conf_file = None {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] lvmdriver-1.lvm_mirrors = None {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] lvmdriver-1.lvm_share_target = None {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] lvmdriver-1.lvm_type = auto {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] lvmdriver-1.num_shell_tries = None {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] lvmdriver-1.nvmet_port_id = None {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] lvmdriver-1.replication_device = **** {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] lvmdriver-1.report_discard_supported = None {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] lvmdriver-1.reserved_percentage = None {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] lvmdriver-1.scst_target_driver = None {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] lvmdriver-1.storage_protocol = None {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] lvmdriver-1.target_helper = lioadm {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] lvmdriver-1.target_ip_address = None {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] lvmdriver-1.target_port = 3260 {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] lvmdriver-1.target_protocol = iscsi {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] lvmdriver-1.trace_flags = None {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] lvmdriver-1.use_chap_auth = None {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] lvmdriver-1.volume_clear = zero {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] lvmdriver-1.volume_clear_size = None {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] lvmdriver-1.volumes_dir = None {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack sudo[75527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Sep 22 15:30:43 devstack sudo[75527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] oslo_messaging_rabbit.ssl = False {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] oslo_messaging_rabbit.ssl_version = {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] oslo_messaging_notifications.driver = [] {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] oslo_messaging_notifications.retry = -1 {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] oslo_messaging_notifications.transport_url = **** {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] key_manager.fixed_key = **** {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] barbican.barbican_api_version = None {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] barbican.barbican_endpoint = None {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] barbican.barbican_endpoint_type = public {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] barbican.barbican_region_name = None {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] barbican.cafile = None {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] barbican.certfile = None {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] barbican.collect_timing = False {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] barbican.insecure = False {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] barbican.keyfile = None {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] barbican.number_of_retries = 60 {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] barbican.retry_delay = 1 {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] barbican.send_service_user_token = False {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] barbican.split_loggers = False {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] barbican.timeout = None {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] barbican.tls_ciphers = None {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] barbican.tls_min_version = None {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] barbican.verify_ssl = True {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] barbican.verify_ssl_path = None {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] barbican_service_user.auth_section = None {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] barbican_service_user.auth_type = None {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] barbican_service_user.cafile = None {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] barbican_service_user.certfile = None {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] barbican_service_user.collect_timing = False {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] barbican_service_user.insecure = False {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] barbican_service_user.keyfile = None {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] barbican_service_user.split_loggers = False {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] barbican_service_user.timeout = None {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] barbican_service_user.tls_ciphers = None {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] barbican_service_user.tls_min_version = None {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] vault.approle_role_id = **** {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] vault.approle_secret_id = **** {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] vault.auth_method = approle {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] vault.auth_path = None {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] vault.kv_mountpoint = secret {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] vault.kv_path = None {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] vault.kv_version = 2 {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] vault.namespace = None {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] vault.root_token_id = **** {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] vault.ssl_ca_crt_file = None {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] vault.timeout = 60.0 {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] vault.token_file = None {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] vault.token_role = None {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] vault.use_ssl = False {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:30:43 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] ******************************************************************************** {{(pid=75263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 22 15:30:43 devstack sudo[75527]: pam_unix(sudo:session): session closed for user root Sep 22 15:30:43 devstack cinder-volume[75442]: DEBUG oslo_concurrency.processutils [None req-4299f593-99bc-465e-b66e-324c4c682fa8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.308s {{(pid=75442) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:30:43 devstack cinder-volume[75442]: DEBUG oslo_concurrency.processutils [None req-4299f593-99bc-465e-b66e-324c4c682fa8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75442) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:30:43 devstack sudo[75622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 22 15:30:43 devstack sudo[75622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:30:43 devstack sudo[75622]: pam_unix(sudo:session): session closed for user root Sep 22 15:30:43 devstack cinder-volume[75442]: DEBUG oslo_concurrency.processutils [None req-4299f593-99bc-465e-b66e-324c4c682fa8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.271s {{(pid=75442) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:30:43 devstack cinder-volume[75442]: DEBUG oslo_concurrency.processutils [None req-4299f593-99bc-465e-b66e-324c4c682fa8 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=75442) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 22 15:30:43 devstack cinder-volume[75442]: INFO cinder.brick.local_dev.lvm [None req-4299f593-99bc-465e-b66e-324c4c682fa8 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Sep 22 15:30:43 devstack cinder-volume[75442]: DEBUG oslo_concurrency.processutils [None req-4299f593-99bc-465e-b66e-324c4c682fa8 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75442) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:30:43 devstack cinder-volume[75442]: DEBUG oslo_concurrency.processutils [None req-4299f593-99bc-465e-b66e-324c4c682fa8 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=75442) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:30:43 devstack cinder-volume[75442]: DEBUG oslo_concurrency.processutils [None req-4299f593-99bc-465e-b66e-324c4c682fa8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75442) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:30:43 devstack sudo[75711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 22 15:30:43 devstack sudo[75711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:30:43 devstack sudo[75711]: pam_unix(sudo:session): session closed for user root Sep 22 15:30:43 devstack cinder-volume[75442]: DEBUG oslo_concurrency.processutils [None req-4299f593-99bc-465e-b66e-324c4c682fa8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.260s {{(pid=75442) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:30:43 devstack cinder-volume[75442]: DEBUG cinder.brick.local_dev.lvm [None req-4299f593-99bc-465e-b66e-324c4c682fa8 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=75442) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Sep 22 15:30:43 devstack cinder-volume[75442]: DEBUG oslo_concurrency.processutils [None req-4299f593-99bc-465e-b66e-324c4c682fa8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75442) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:30:43 devstack sudo[75794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 22 15:30:43 devstack sudo[75794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:30:44 devstack sudo[75794]: pam_unix(sudo:session): session closed for user root Sep 22 15:30:44 devstack cinder-volume[75442]: DEBUG oslo_concurrency.processutils [None req-4299f593-99bc-465e-b66e-324c4c682fa8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.585s {{(pid=75442) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:30:44 devstack cinder-volume[75442]: DEBUG oslo_concurrency.processutils [None req-4299f593-99bc-465e-b66e-324c4c682fa8 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75442) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:30:44 devstack cinder-volume[75442]: DEBUG oslo_concurrency.processutils [None req-4299f593-99bc-465e-b66e-324c4c682fa8 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=75442) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:30:44 devstack cinder-volume[75442]: DEBUG oslo_concurrency.processutils [None req-4299f593-99bc-465e-b66e-324c4c682fa8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75442) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:30:44 devstack sudo[76027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 22 15:30:44 devstack sudo[76027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:30:44 devstack sudo[76027]: pam_unix(sudo:session): session closed for user root Sep 22 15:30:44 devstack cinder-volume[75442]: DEBUG oslo_concurrency.processutils [None req-4299f593-99bc-465e-b66e-324c4c682fa8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.276s {{(pid=75442) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:30:44 devstack cinder-volume[75442]: DEBUG oslo_concurrency.processutils [None req-4299f593-99bc-465e-b66e-324c4c682fa8 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75442) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:30:44 devstack cinder-volume[75442]: DEBUG oslo_concurrency.processutils [None req-4299f593-99bc-465e-b66e-324c4c682fa8 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.021s {{(pid=75442) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:30:44 devstack cinder-volume[75442]: DEBUG oslo_concurrency.processutils [None req-4299f593-99bc-465e-b66e-324c4c682fa8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=75442) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:30:44 devstack sudo[76031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Sep 22 15:30:44 devstack sudo[76031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:30:45 devstack sudo[76031]: pam_unix(sudo:session): session closed for user root Sep 22 15:30:45 devstack cinder-volume[75442]: DEBUG oslo_concurrency.processutils [None req-4299f593-99bc-465e-b66e-324c4c682fa8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.328s {{(pid=75442) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:30:45 devstack cinder-volume[75442]: DEBUG oslo_concurrency.processutils [None req-4299f593-99bc-465e-b66e-324c4c682fa8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75442) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:30:45 devstack sudo[76114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 22 15:30:45 devstack sudo[76114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:30:45 devstack sudo[76114]: pam_unix(sudo:session): session closed for user root Sep 22 15:30:45 devstack cinder-volume[75442]: DEBUG oslo_concurrency.processutils [None req-4299f593-99bc-465e-b66e-324c4c682fa8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.256s {{(pid=75442) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:30:45 devstack cinder-volume[75442]: DEBUG oslo_concurrency.processutils [None req-4299f593-99bc-465e-b66e-324c4c682fa8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75442) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:30:45 devstack sudo[76117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 22 15:30:45 devstack sudo[76117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:30:45 devstack sudo[76117]: pam_unix(sudo:session): session closed for user root Sep 22 15:30:45 devstack cinder-volume[75442]: DEBUG oslo_concurrency.processutils [None req-4299f593-99bc-465e-b66e-324c4c682fa8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.309s {{(pid=75442) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:30:45 devstack cinder-volume[75442]: DEBUG oslo_concurrency.processutils [None req-4299f593-99bc-465e-b66e-324c4c682fa8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75442) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:30:45 devstack sudo[76156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 22 15:30:45 devstack sudo[76156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:30:46 devstack sudo[76156]: pam_unix(sudo:session): session closed for user root Sep 22 15:30:46 devstack cinder-volume[75442]: DEBUG oslo_concurrency.processutils [None req-4299f593-99bc-465e-b66e-324c4c682fa8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.326s {{(pid=75442) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:30:46 devstack cinder-volume[75442]: DEBUG oslo_concurrency.processutils [None req-4299f593-99bc-465e-b66e-324c4c682fa8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75442) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:30:46 devstack sudo[76209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 22 15:30:46 devstack sudo[76209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:30:46 devstack sudo[76209]: pam_unix(sudo:session): session closed for user root Sep 22 15:30:46 devstack cinder-volume[75442]: DEBUG oslo_concurrency.processutils [None req-4299f593-99bc-465e-b66e-324c4c682fa8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.287s {{(pid=75442) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:30:46 devstack cinder-volume[75442]: DEBUG oslo_concurrency.processutils [None req-4299f593-99bc-465e-b66e-324c4c682fa8 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75442) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:30:46 devstack cinder-volume[75442]: DEBUG oslo_concurrency.processutils [None req-4299f593-99bc-465e-b66e-324c4c682fa8 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=75442) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:30:46 devstack cinder-volume[75442]: DEBUG oslo_concurrency.processutils [None req-4299f593-99bc-465e-b66e-324c4c682fa8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75442) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:30:46 devstack sudo[76214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 22 15:30:46 devstack sudo[76214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:30:46 devstack sudo[76214]: pam_unix(sudo:session): session closed for user root Sep 22 15:30:46 devstack cinder-volume[75442]: DEBUG oslo_concurrency.processutils [None req-4299f593-99bc-465e-b66e-324c4c682fa8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.286s {{(pid=75442) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:30:46 devstack cinder-volume[75442]: INFO cinder.volume.drivers.lvm [None req-4299f593-99bc-465e-b66e-324c4c682fa8 None None] Enabling LVM thin provisioning by default because a thin pool exists. Sep 22 15:30:46 devstack cinder-volume[75442]: DEBUG oslo_concurrency.processutils [None req-4299f593-99bc-465e-b66e-324c4c682fa8 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75442) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:30:46 devstack cinder-volume[75442]: DEBUG oslo_concurrency.processutils [None req-4299f593-99bc-465e-b66e-324c4c682fa8 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=75442) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:30:46 devstack cinder-volume[75442]: DEBUG oslo_concurrency.processutils [None req-4299f593-99bc-465e-b66e-324c4c682fa8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75442) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:30:46 devstack sudo[76218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 22 15:30:46 devstack sudo[76218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:30:47 devstack sudo[76218]: pam_unix(sudo:session): session closed for user root Sep 22 15:30:47 devstack cinder-volume[75442]: DEBUG oslo_concurrency.processutils [None req-4299f593-99bc-465e-b66e-324c4c682fa8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.287s {{(pid=75442) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:30:47 devstack cinder-volume[75442]: DEBUG cinder.volume.drivers.lvm [None req-4299f593-99bc-465e-b66e-324c4c682fa8 None None] Updating volume stats {{(pid=75442) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 22 15:30:47 devstack cinder-volume[75442]: DEBUG oslo_concurrency.processutils [None req-4299f593-99bc-465e-b66e-324c4c682fa8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75442) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:30:47 devstack sudo[76221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 22 15:30:47 devstack sudo[76221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:30:47 devstack sudo[76221]: pam_unix(sudo:session): session closed for user root Sep 22 15:30:47 devstack cinder-volume[75442]: DEBUG oslo_concurrency.processutils [None req-4299f593-99bc-465e-b66e-324c4c682fa8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.292s {{(pid=75442) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:30:47 devstack cinder-volume[75442]: DEBUG oslo_concurrency.processutils [None req-4299f593-99bc-465e-b66e-324c4c682fa8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75442) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:30:47 devstack sudo[76224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 22 15:30:47 devstack sudo[76224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:30:47 devstack sudo[76224]: pam_unix(sudo:session): session closed for user root Sep 22 15:30:47 devstack cinder-volume[75442]: DEBUG oslo_concurrency.processutils [None req-4299f593-99bc-465e-b66e-324c4c682fa8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.274s {{(pid=75442) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:30:47 devstack cinder-volume[75442]: DEBUG oslo_concurrency.processutils [None req-4299f593-99bc-465e-b66e-324c4c682fa8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75442) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:30:47 devstack sudo[76234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 22 15:30:47 devstack sudo[76234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:30:47 devstack sudo[76234]: pam_unix(sudo:session): session closed for user root Sep 22 15:30:47 devstack cinder-volume[75442]: DEBUG oslo_concurrency.processutils [None req-4299f593-99bc-465e-b66e-324c4c682fa8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.245s {{(pid=75442) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:30:47 devstack cinder-volume[75442]: DEBUG oslo_concurrency.processutils [None req-4299f593-99bc-465e-b66e-324c4c682fa8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75442) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:30:47 devstack sudo[76237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 22 15:30:47 devstack sudo[76237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:30:48 devstack sudo[76237]: pam_unix(sudo:session): session closed for user root Sep 22 15:30:48 devstack cinder-volume[75442]: DEBUG oslo_concurrency.processutils [None req-4299f593-99bc-465e-b66e-324c4c682fa8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.271s {{(pid=75442) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:30:48 devstack cinder-volume[75442]: INFO cinder.volume.driver [None req-4299f593-99bc-465e-b66e-324c4c682fa8 None None] Driver hasn't implemented _init_vendor_properties() Sep 22 15:30:48 devstack cinder-volume[75442]: DEBUG cinder.volume.driver [None req-4299f593-99bc-465e-b66e-324c4c682fa8 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=75442) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 22 15:30:48 devstack cinder-volume[75442]: DEBUG oslo_db.sqlalchemy.engines [None req-4299f593-99bc-465e-b66e-324c4c682fa8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75442) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 22 15:30:48 devstack cinder-volume[75442]: DEBUG dbcounter [-] [75442] Writer thread running {{(pid=75442) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 22 15:30:48 devstack cinder-volume[75442]: DEBUG cinder.db.api [None req-4299f593-99bc-465e-b66e-324c4c682fa8 None None] Building query based on filter {{(pid=75442) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 22 15:30:48 devstack cinder-volume[75442]: DEBUG cinder.image.image_utils [None req-4299f593-99bc-465e-b66e-324c4c682fa8 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=75442) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Sep 22 15:30:48 devstack cinder-volume[75442]: INFO cinder.keymgr.migration [None req-963fd1f1-4daf-46ea-89df-e85481b52f6d None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 22 15:30:48 devstack cinder-volume[75442]: DEBUG cinder.volume.drivers.lvm [None req-4299f593-99bc-465e-b66e-324c4c682fa8 None None] Updating volume stats {{(pid=75442) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 22 15:30:48 devstack cinder-volume[75442]: DEBUG oslo_concurrency.processutils [None req-4299f593-99bc-465e-b66e-324c4c682fa8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75442) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:30:48 devstack sudo[76242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 22 15:30:48 devstack sudo[76242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:30:48 devstack sudo[76242]: pam_unix(sudo:session): session closed for user root Sep 22 15:30:48 devstack cinder-volume[75442]: DEBUG oslo_concurrency.processutils [None req-4299f593-99bc-465e-b66e-324c4c682fa8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.249s {{(pid=75442) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:30:48 devstack cinder-volume[75442]: DEBUG oslo_concurrency.processutils [None req-4299f593-99bc-465e-b66e-324c4c682fa8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75442) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:30:48 devstack sudo[76245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 22 15:30:48 devstack sudo[76245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:30:48 devstack sudo[76245]: pam_unix(sudo:session): session closed for user root Sep 22 15:30:48 devstack cinder-volume[75442]: DEBUG oslo_concurrency.processutils [None req-4299f593-99bc-465e-b66e-324c4c682fa8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.264s {{(pid=75442) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:30:48 devstack cinder-volume[75442]: DEBUG oslo_concurrency.processutils [None req-4299f593-99bc-465e-b66e-324c4c682fa8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75442) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:30:48 devstack sudo[76248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 22 15:30:48 devstack sudo[76248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:30:49 devstack sudo[76248]: pam_unix(sudo:session): session closed for user root Sep 22 15:30:49 devstack cinder-volume[75442]: DEBUG oslo_concurrency.processutils [None req-4299f593-99bc-465e-b66e-324c4c682fa8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.272s {{(pid=75442) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:30:49 devstack cinder-volume[75442]: DEBUG oslo_concurrency.processutils [None req-4299f593-99bc-465e-b66e-324c4c682fa8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75442) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:30:49 devstack sudo[76251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 22 15:30:49 devstack sudo[76251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:30:49 devstack sudo[76251]: pam_unix(sudo:session): session closed for user root Sep 22 15:30:49 devstack cinder-volume[75442]: DEBUG oslo_concurrency.processutils [None req-4299f593-99bc-465e-b66e-324c4c682fa8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.247s {{(pid=75442) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:30:49 devstack cinder-volume[75442]: DEBUG cinder.manager [None req-4299f593-99bc-465e-b66e-324c4c682fa8 None None] Notifying Schedulers of capabilities ... {{(pid=75442) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 15:30:49 devstack cinder-volume[75442]: INFO cinder.volume.manager [None req-4299f593-99bc-465e-b66e-324c4c682fa8 None None] Driver initialization completed successfully. Sep 22 15:30:49 devstack cinder-volume[75442]: INFO cinder.manager [None req-4299f593-99bc-465e-b66e-324c4c682fa8 None None] Initiating service 2 cleanup Sep 22 15:30:49 devstack cinder-volume[75442]: INFO cinder.manager [None req-4299f593-99bc-465e-b66e-324c4c682fa8 None None] Service 2 cleanup completed. Sep 22 15:30:49 devstack cinder-volume[75442]: DEBUG cinder.service [None req-4299f593-99bc-465e-b66e-324c4c682fa8 None None] Creating RPC server for service cinder-volume {{(pid=75442) start /opt/stack/cinder/cinder/service.py:231}} Sep 22 15:30:49 devstack cinder-volume[75442]: DEBUG cinder.service [None req-4299f593-99bc-465e-b66e-324c4c682fa8 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=75442) start /opt/stack/cinder/cinder/service.py:237}} Sep 22 15:30:49 devstack cinder-volume[75442]: INFO cinder.volume.manager [None req-4299f593-99bc-465e-b66e-324c4c682fa8 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Sep 22 15:30:49 devstack cinder-volume[75442]: DEBUG cinder.volume.drivers.lvm [None req-4299f593-99bc-465e-b66e-324c4c682fa8 None None] Updating volume stats {{(pid=75442) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 22 15:30:49 devstack cinder-volume[75442]: DEBUG oslo_concurrency.processutils [None req-4299f593-99bc-465e-b66e-324c4c682fa8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75442) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:30:49 devstack sudo[76256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 22 15:30:49 devstack sudo[76256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:30:49 devstack sudo[76256]: pam_unix(sudo:session): session closed for user root Sep 22 15:30:49 devstack cinder-volume[75442]: DEBUG oslo_concurrency.processutils [None req-4299f593-99bc-465e-b66e-324c4c682fa8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.299s {{(pid=75442) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:30:49 devstack cinder-volume[75442]: DEBUG oslo_concurrency.processutils [None req-4299f593-99bc-465e-b66e-324c4c682fa8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75442) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:30:49 devstack sudo[76262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 22 15:30:49 devstack sudo[76262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:30:50 devstack sudo[76262]: pam_unix(sudo:session): session closed for user root Sep 22 15:30:50 devstack cinder-volume[75442]: DEBUG oslo_concurrency.processutils [None req-4299f593-99bc-465e-b66e-324c4c682fa8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.304s {{(pid=75442) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:30:50 devstack cinder-volume[75442]: DEBUG oslo_concurrency.processutils [None req-4299f593-99bc-465e-b66e-324c4c682fa8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75442) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:30:50 devstack sudo[76268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 22 15:30:50 devstack sudo[76268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:30:50 devstack sudo[76268]: pam_unix(sudo:session): session closed for user root Sep 22 15:30:50 devstack cinder-volume[75442]: DEBUG oslo_concurrency.processutils [None req-4299f593-99bc-465e-b66e-324c4c682fa8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.260s {{(pid=75442) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:30:50 devstack cinder-volume[75442]: DEBUG oslo_concurrency.processutils [None req-4299f593-99bc-465e-b66e-324c4c682fa8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75442) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:30:50 devstack sudo[76271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 22 15:30:50 devstack sudo[76271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:30:50 devstack sudo[76271]: pam_unix(sudo:session): session closed for user root Sep 22 15:30:50 devstack cinder-volume[75442]: DEBUG oslo_concurrency.processutils [None req-4299f593-99bc-465e-b66e-324c4c682fa8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.276s {{(pid=75442) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:30:50 devstack cinder-volume[75442]: INFO cinder.volume.manager [None req-4299f593-99bc-465e-b66e-324c4c682fa8 None None] Driver post RPC initialization completed successfully. Sep 22 15:30:52 devstack cinder-volume[75263]: DEBUG dbcounter [-] [75263] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75263) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 22 15:30:59 devstack cinder-volume[75442]: DEBUG dbcounter [-] [75442] Writing DB stats cinder:SELECT=3 {{(pid=75442) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 22 15:31:00 devstack cinder-volume[75442]: DEBUG dbcounter [-] [75442] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=75442) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 22 15:31:44 devstack cinder-volume[75442]: DEBUG oslo_service.periodic_task [None req-2a3ff956-3254-4ec2-97a2-f3872926622a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75442) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 22 15:31:44 devstack cinder-volume[75442]: DEBUG cinder.volume.drivers.lvm [None req-2a3ff956-3254-4ec2-97a2-f3872926622a None None] Updating volume stats {{(pid=75442) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 22 15:31:44 devstack cinder-volume[75442]: DEBUG oslo_concurrency.processutils [None req-2a3ff956-3254-4ec2-97a2-f3872926622a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75442) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:31:44 devstack sudo[78219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 22 15:31:44 devstack sudo[78219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:31:44 devstack sudo[78219]: pam_unix(sudo:session): session closed for user root Sep 22 15:31:44 devstack cinder-volume[75442]: DEBUG oslo_concurrency.processutils [None req-2a3ff956-3254-4ec2-97a2-f3872926622a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.265s {{(pid=75442) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:31:44 devstack cinder-volume[75442]: DEBUG oslo_concurrency.processutils [None req-2a3ff956-3254-4ec2-97a2-f3872926622a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75442) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:31:44 devstack sudo[78246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 22 15:31:44 devstack sudo[78246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:31:45 devstack sudo[78246]: pam_unix(sudo:session): session closed for user root Sep 22 15:31:45 devstack cinder-volume[75442]: DEBUG oslo_concurrency.processutils [None req-2a3ff956-3254-4ec2-97a2-f3872926622a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.254s {{(pid=75442) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:31:45 devstack cinder-volume[75442]: DEBUG oslo_concurrency.processutils [None req-2a3ff956-3254-4ec2-97a2-f3872926622a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75442) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:31:45 devstack sudo[78249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 22 15:31:45 devstack sudo[78249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:31:45 devstack sudo[78249]: pam_unix(sudo:session): session closed for user root Sep 22 15:31:45 devstack cinder-volume[75442]: DEBUG oslo_concurrency.processutils [None req-2a3ff956-3254-4ec2-97a2-f3872926622a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.247s {{(pid=75442) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:31:45 devstack cinder-volume[75442]: DEBUG oslo_concurrency.processutils [None req-2a3ff956-3254-4ec2-97a2-f3872926622a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75442) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:31:45 devstack sudo[78252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 22 15:31:45 devstack sudo[78252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:31:45 devstack sudo[78252]: pam_unix(sudo:session): session closed for user root Sep 22 15:31:45 devstack cinder-volume[75442]: DEBUG oslo_concurrency.processutils [None req-2a3ff956-3254-4ec2-97a2-f3872926622a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.261s {{(pid=75442) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:31:45 devstack cinder-volume[75442]: DEBUG cinder.manager [None req-2a3ff956-3254-4ec2-97a2-f3872926622a None None] Notifying Schedulers of capabilities ... {{(pid=75442) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 15:31:45 devstack cinder-volume[75442]: DEBUG oslo_service.periodic_task [None req-2a3ff956-3254-4ec2-97a2-f3872926622a None None] Running periodic task VolumeManager._thread_info {{(pid=75442) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 22 15:31:45 devstack cinder-volume[75442]: DEBUG cinder.volume.manager [None req-2a3ff956-3254-4ec2-97a2-f3872926622a None None] thread count: 6 {{(pid=75442) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 22 15:31:45 devstack cinder-volume[75442]: DEBUG cinder.volume.manager [None req-2a3ff956-3254-4ec2-97a2-f3872926622a None None] thread info: [<_MainThread(MainThread, started 136315836764288)>, , , , , ] {{(pid=75442) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 22 15:32:44 devstack cinder-volume[75442]: DEBUG oslo_service.periodic_task [None req-2a3ff956-3254-4ec2-97a2-f3872926622a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75442) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 22 15:32:44 devstack cinder-volume[75442]: DEBUG cinder.volume.drivers.lvm [None req-2a3ff956-3254-4ec2-97a2-f3872926622a None None] Updating volume stats {{(pid=75442) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 22 15:32:44 devstack cinder-volume[75442]: DEBUG oslo_concurrency.processutils [None req-2a3ff956-3254-4ec2-97a2-f3872926622a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75442) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:32:44 devstack sudo[81547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 22 15:32:44 devstack sudo[81547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:32:44 devstack sudo[81547]: pam_unix(sudo:session): session closed for user root Sep 22 15:32:44 devstack cinder-volume[75442]: DEBUG oslo_concurrency.processutils [None req-2a3ff956-3254-4ec2-97a2-f3872926622a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.261s {{(pid=75442) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:32:44 devstack cinder-volume[75442]: DEBUG oslo_concurrency.processutils [None req-2a3ff956-3254-4ec2-97a2-f3872926622a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75442) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:32:44 devstack sudo[81550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 22 15:32:44 devstack sudo[81550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:32:45 devstack sudo[81550]: pam_unix(sudo:session): session closed for user root Sep 22 15:32:45 devstack cinder-volume[75442]: DEBUG oslo_concurrency.processutils [None req-2a3ff956-3254-4ec2-97a2-f3872926622a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.288s {{(pid=75442) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:32:45 devstack cinder-volume[75442]: DEBUG oslo_concurrency.processutils [None req-2a3ff956-3254-4ec2-97a2-f3872926622a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75442) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:32:45 devstack sudo[81554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 22 15:32:45 devstack sudo[81554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:32:45 devstack sudo[81554]: pam_unix(sudo:session): session closed for user root Sep 22 15:32:45 devstack cinder-volume[75442]: DEBUG oslo_concurrency.processutils [None req-2a3ff956-3254-4ec2-97a2-f3872926622a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.255s {{(pid=75442) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:32:45 devstack cinder-volume[75442]: DEBUG oslo_concurrency.processutils [None req-2a3ff956-3254-4ec2-97a2-f3872926622a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75442) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:32:45 devstack sudo[81558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 22 15:32:45 devstack sudo[81558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:32:45 devstack sudo[81558]: pam_unix(sudo:session): session closed for user root Sep 22 15:32:45 devstack cinder-volume[75442]: DEBUG oslo_concurrency.processutils [None req-2a3ff956-3254-4ec2-97a2-f3872926622a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.278s {{(pid=75442) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:32:45 devstack cinder-volume[75442]: DEBUG cinder.manager [None req-2a3ff956-3254-4ec2-97a2-f3872926622a None None] Notifying Schedulers of capabilities ... {{(pid=75442) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 15:32:45 devstack cinder-volume[75442]: DEBUG oslo_service.periodic_task [None req-2a3ff956-3254-4ec2-97a2-f3872926622a None None] Running periodic task VolumeManager._thread_info {{(pid=75442) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 22 15:32:45 devstack cinder-volume[75442]: DEBUG cinder.volume.manager [None req-2a3ff956-3254-4ec2-97a2-f3872926622a None None] thread count: 6 {{(pid=75442) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 22 15:32:45 devstack cinder-volume[75442]: DEBUG cinder.volume.manager [None req-2a3ff956-3254-4ec2-97a2-f3872926622a None None] thread info: [<_MainThread(MainThread, started 136315836764288)>, , , , , ] {{(pid=75442) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 22 15:33:00 devstack cinder-volume[75442]: DEBUG dbcounter [-] [75442] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=75442) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 22 15:33:44 devstack cinder-volume[75442]: DEBUG oslo_service.periodic_task [None req-2a3ff956-3254-4ec2-97a2-f3872926622a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75442) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 22 15:33:44 devstack cinder-volume[75442]: DEBUG cinder.volume.drivers.lvm [None req-2a3ff956-3254-4ec2-97a2-f3872926622a None None] Updating volume stats {{(pid=75442) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 22 15:33:44 devstack cinder-volume[75442]: DEBUG oslo_concurrency.processutils [None req-2a3ff956-3254-4ec2-97a2-f3872926622a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75442) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:33:44 devstack sudo[83479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 22 15:33:44 devstack sudo[83479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:33:44 devstack sudo[83479]: pam_unix(sudo:session): session closed for user root Sep 22 15:33:44 devstack cinder-volume[75442]: DEBUG oslo_concurrency.processutils [None req-2a3ff956-3254-4ec2-97a2-f3872926622a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.275s {{(pid=75442) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:33:44 devstack cinder-volume[75442]: DEBUG oslo_concurrency.processutils [None req-2a3ff956-3254-4ec2-97a2-f3872926622a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75442) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:33:44 devstack sudo[83512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 22 15:33:44 devstack sudo[83512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:33:45 devstack sudo[83512]: pam_unix(sudo:session): session closed for user root Sep 22 15:33:45 devstack cinder-volume[75442]: DEBUG oslo_concurrency.processutils [None req-2a3ff956-3254-4ec2-97a2-f3872926622a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.251s {{(pid=75442) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:33:45 devstack cinder-volume[75442]: DEBUG oslo_concurrency.processutils [None req-2a3ff956-3254-4ec2-97a2-f3872926622a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75442) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:33:45 devstack sudo[83523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 22 15:33:45 devstack sudo[83523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:33:45 devstack sudo[83523]: pam_unix(sudo:session): session closed for user root Sep 22 15:33:45 devstack cinder-volume[75442]: DEBUG oslo_concurrency.processutils [None req-2a3ff956-3254-4ec2-97a2-f3872926622a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.269s {{(pid=75442) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:33:45 devstack cinder-volume[75442]: DEBUG oslo_concurrency.processutils [None req-2a3ff956-3254-4ec2-97a2-f3872926622a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75442) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:33:45 devstack sudo[83536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 22 15:33:45 devstack sudo[83536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:33:45 devstack sudo[83536]: pam_unix(sudo:session): session closed for user root Sep 22 15:33:45 devstack cinder-volume[75442]: DEBUG oslo_concurrency.processutils [None req-2a3ff956-3254-4ec2-97a2-f3872926622a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.257s {{(pid=75442) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:33:45 devstack cinder-volume[75442]: DEBUG cinder.manager [None req-2a3ff956-3254-4ec2-97a2-f3872926622a None None] Notifying Schedulers of capabilities ... {{(pid=75442) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 15:33:45 devstack cinder-volume[75442]: DEBUG oslo_service.periodic_task [None req-2a3ff956-3254-4ec2-97a2-f3872926622a None None] Running periodic task VolumeManager._thread_info {{(pid=75442) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 22 15:33:45 devstack cinder-volume[75442]: DEBUG cinder.volume.manager [None req-2a3ff956-3254-4ec2-97a2-f3872926622a None None] thread count: 6 {{(pid=75442) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 22 15:33:45 devstack cinder-volume[75442]: DEBUG cinder.volume.manager [None req-2a3ff956-3254-4ec2-97a2-f3872926622a None None] thread info: [<_MainThread(MainThread, started 136315836764288)>, , , , , ] {{(pid=75442) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 22 15:34:44 devstack cinder-volume[75442]: DEBUG oslo_service.periodic_task [None req-2a3ff956-3254-4ec2-97a2-f3872926622a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75442) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 22 15:34:44 devstack cinder-volume[75442]: DEBUG cinder.volume.drivers.lvm [None req-2a3ff956-3254-4ec2-97a2-f3872926622a None None] Updating volume stats {{(pid=75442) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 22 15:34:44 devstack cinder-volume[75442]: DEBUG oslo_concurrency.processutils [None req-2a3ff956-3254-4ec2-97a2-f3872926622a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75442) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:34:44 devstack sudo[84797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 22 15:34:44 devstack sudo[84797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:34:44 devstack sudo[84797]: pam_unix(sudo:session): session closed for user root Sep 22 15:34:44 devstack cinder-volume[75442]: DEBUG oslo_concurrency.processutils [None req-2a3ff956-3254-4ec2-97a2-f3872926622a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.262s {{(pid=75442) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:34:44 devstack cinder-volume[75442]: DEBUG oslo_concurrency.processutils [None req-2a3ff956-3254-4ec2-97a2-f3872926622a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75442) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:34:44 devstack sudo[84800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 22 15:34:44 devstack sudo[84800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:34:45 devstack sudo[84800]: pam_unix(sudo:session): session closed for user root Sep 22 15:34:45 devstack cinder-volume[75442]: DEBUG oslo_concurrency.processutils [None req-2a3ff956-3254-4ec2-97a2-f3872926622a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.261s {{(pid=75442) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:34:45 devstack cinder-volume[75442]: DEBUG oslo_concurrency.processutils [None req-2a3ff956-3254-4ec2-97a2-f3872926622a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75442) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:34:45 devstack sudo[84814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 22 15:34:45 devstack sudo[84814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:34:45 devstack sudo[84814]: pam_unix(sudo:session): session closed for user root Sep 22 15:34:45 devstack cinder-volume[75442]: DEBUG oslo_concurrency.processutils [None req-2a3ff956-3254-4ec2-97a2-f3872926622a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.242s {{(pid=75442) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:34:45 devstack cinder-volume[75442]: DEBUG oslo_concurrency.processutils [None req-2a3ff956-3254-4ec2-97a2-f3872926622a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75442) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:34:45 devstack sudo[84817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 22 15:34:45 devstack sudo[84817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:34:45 devstack sudo[84817]: pam_unix(sudo:session): session closed for user root Sep 22 15:34:45 devstack cinder-volume[75442]: DEBUG oslo_concurrency.processutils [None req-2a3ff956-3254-4ec2-97a2-f3872926622a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.253s {{(pid=75442) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:34:45 devstack cinder-volume[75442]: DEBUG cinder.manager [None req-2a3ff956-3254-4ec2-97a2-f3872926622a None None] Notifying Schedulers of capabilities ... {{(pid=75442) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 15:35:00 devstack cinder-volume[75442]: DEBUG dbcounter [-] [75442] Writing DB stats cinder:SELECT=1 {{(pid=75442) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 22 15:35:00 devstack cinder-volume[75442]: DEBUG dbcounter [-] [75442] Writing DB stats cinder:UPDATE=1 {{(pid=75442) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 22 15:35:09 devstack cinder-volume[75263]: INFO oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] Caught SIGTERM, stopping children Sep 22 15:35:09 devstack cinder-volume[75263]: DEBUG oslo_concurrency.lockutils [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] Acquiring lock "singleton_lock" {{(pid=75263) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 22 15:35:09 devstack cinder-volume[75263]: DEBUG oslo_concurrency.lockutils [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] Acquired lock "singleton_lock" {{(pid=75263) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 22 15:35:09 devstack cinder-volume[75263]: DEBUG oslo_concurrency.lockutils [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] Releasing lock "singleton_lock" {{(pid=75263) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 22 15:35:09 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] Stop services. {{(pid=75263) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 22 15:35:09 devstack cinder-volume[75263]: DEBUG oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] Killing children. {{(pid=75263) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 22 15:35:09 devstack cinder-volume[75263]: INFO oslo_service.backend._eventlet.service [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] Waiting on 1 children to exit Sep 22 15:35:14 devstack cinder-volume[75442]: DEBUG oslo_concurrency.lockutils [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] Acquiring lock "singleton_lock" {{(pid=75442) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 22 15:35:14 devstack cinder-volume[75442]: DEBUG oslo_concurrency.lockutils [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] Acquired lock "singleton_lock" {{(pid=75442) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 22 15:35:14 devstack cinder-volume[75442]: DEBUG oslo_concurrency.lockutils [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] Releasing lock "singleton_lock" {{(pid=75442) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 22 15:35:14 devstack cinder-volume[75442]: WARNING amqp [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 22 15:35:14 devstack cinder-volume[75442]: WARNING amqp [None req-fd02f8f4-cd5f-473b-a05c-efb938c1b6b0 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 22 15:35:14 devstack cinder-volume[85419]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 22 15:35:14 devstack cinder-volume[85419]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 22 15:35:14 devstack cinder-volume[85419]: we strongly recommend against using it for new projects. Sep 22 15:35:14 devstack cinder-volume[85419]: If you are already using Eventlet, we recommend migrating to a different Sep 22 15:35:14 devstack cinder-volume[85419]: framework. For more detail see Sep 22 15:35:14 devstack cinder-volume[85419]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 22 15:35:14 devstack cinder-volume[85419]: import eventlet # noqa Sep 22 15:35:16 devstack cinder-volume[85419]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=85419) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 22 15:35:16 devstack cinder-volume[85419]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=85419) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 22 15:35:16 devstack cinder-volume[85419]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=85419) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 22 15:35:17 devstack cinder-volume[85419]: INFO dbcounter [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] Registered counter for database cinder Sep 22 15:35:17 devstack cinder-volume[85419]: DEBUG oslo_db.sqlalchemy.engines [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85419) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 22 15:35:17 devstack cinder-volume[85419]: DEBUG dbcounter [-] [85419] Writer thread running {{(pid=85419) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 22 15:35:17 devstack cinder-volume[85419]: INFO cinder.rpc [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 22 15:35:17 devstack cinder-volume[85419]: INFO cinder.rpc [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 22 15:35:17 devstack cinder-volume[85419]: DEBUG oslo_db.sqlalchemy.engines [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85419) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 22 15:35:17 devstack cinder-volume[85419]: INFO cinder.volume.manager [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] Determined volume DB was empty at startup. Sep 22 15:35:17 devstack cinder-volume[85419]: DEBUG cinder.volume.manager [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=85419) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 22 15:35:17 devstack cinder-volume[85419]: INFO cinder.volume.manager [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 22 15:35:17 devstack cinder-volume[85419]: WARNING stevedore.named [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 22 15:35:17 devstack cinder-volume[85419]: WARNING castellan.key_manager [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 22 15:35:17 devstack cinder-volume[85419]: WARNING cinder.keymgr.conf_key_mgr [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 22 15:35:18 devstack cinder-volume[85419]: INFO cinder.volume.manager [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_db.sqlalchemy.engines [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85419) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 22 15:35:18 devstack cinder-volume[85419]: INFO oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] Starting 1 workers Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] Started child 85636 {{(pid=85419) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] Full set of CONF: {{(pid=85419) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] ******************************************************************************** {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] Configuration options gathered from: {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] ================================================================================ {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] allow_availability_zone_fallback = False {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] allow_compression_on_image_upload = False {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] allowed_direct_url_schemes = [] {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] api_rate_limit = True {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] auth_strategy = keystone {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] backend_availability_zone = None {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:18 devstack cinder-volume[85636]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0) Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] backend_host = None {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] backend_name = None {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] backend_stats_polling_interval = 60 {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] backup_api_class = cinder.backup.api.API {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] backup_name_template = backup-%s {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] backup_use_same_host = False {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] backup_use_temp_snapshot = False {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] chap_password = **** {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] chap_username = {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] cinder_internal_tenant_project_id = eb8a2d6d7e6541fb9d06a0a3594619ee {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] cinder_internal_tenant_user_id = 5e260e248dfc45758401c916d6596d08 {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] cluster = None {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] compression_format = gzip {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] compute_api_class = cinder.compute.nova.API {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] config_dir = [] {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] config_source = [] {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] control_exchange = openstack {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] debug = True {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] default_availability_zone = None {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] default_group_type = None {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] default_volume_type = QuobyteHD {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] disk_geometry = None {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] driver_client_cert = None {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] driver_client_cert_key = None {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] driver_data_namespace = None {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] driver_ssl_cert_path = None {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] driver_ssl_cert_verify = False {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] driver_use_ssl = False {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] enable_new_services = True {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] enable_unsupported_driver = False {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] enabled_backends = ['QuobyteHD'] {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] enforce_multipath_for_image_xfer = False {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] filter_function = None {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] glance_api_insecure = False {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] glance_api_servers = ['http://192.168.122.247/image'] {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] glance_api_ssl_compression = False {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] glance_ca_certificates_file = None {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] glance_catalog_info = image:glance:publicURL {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] glance_certfile = None {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] glance_keyfile = None {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] glance_num_retries = 3 {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] glance_request_timeout = None {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] goodness_function = None {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] graceful_shutdown_timeout = 5 {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] group_api_class = cinder.group.api.API {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] host = devstack {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] image_compress_on_upload = True {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] image_conversion_address_space_limit = 1 {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] image_conversion_cpu_limit = 60 {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] image_conversion_disable = False {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] image_introspection_address_space_limit = 1 {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] image_introspection_cpu_limit = 60 {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] image_upload_use_cinder_backend = False {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] image_upload_use_internal_tenant = False {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] image_volume_cache_enabled = False {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] image_volume_cache_max_count = 0 {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] image_volume_cache_max_size_gb = 0 {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] init_host_max_objects_retrieval = 0 {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] instance_format = [instance: %(uuid)s] {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] iscsi_target_flags = {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] iscsi_write_cache = on {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] iser_helper = tgtadm {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] iser_ip_address = 192.168.122.247 {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] iser_port = 3260 {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] log_color = False {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] log_config_append = None {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] log_dir = None {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] log_file = None {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] log_options = True {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] log_rotate_interval = 1 {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] log_rotate_interval_type = days {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] log_rotation_type = none {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] max_age = 0 {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] max_logfile_count = 30 {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] max_logfile_size_mb = 200 {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] max_over_subscription_ratio = 20.0 {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] message_reap_interval = 86400 {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] message_ttl = 2592000 {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] migration_create_volume_timeout_secs = 300 {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] monkey_patch = False {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] monkey_patch_modules = [] {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] my_ip = 192.168.122.247 {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] no_snapshot_gb_quota = False {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] num_iser_scan_tries = 3 {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] num_shell_tries = 3 {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] num_volume_device_scan_tries = 3 {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] nvmeof_conn_info_version = 1 {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] nvmet_ns_id = 10 {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] nvmet_port_id = 1 {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] osapi_max_limit = 1000 {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] osapi_volume_ext_list = [] {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] osapi_volume_listen = 0.0.0.0 {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] osapi_volume_listen_port = 8776 {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] osapi_volume_use_ssl = False {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] osapi_volume_workers = None {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] per_volume_size_limit = -1 {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] periodic_fuzzy_delay = 60 {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] periodic_interval = 60 {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] project_id_regex = [0-9a-f\-]+ {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] public_endpoint = None {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] publish_errors = False {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] quota_backup_gigabytes = 1000 {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] quota_backups = 10 {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] quota_gigabytes = 1000 {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] quota_groups = 10 {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] quota_snapshots = 10 {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] quota_volumes = 10 {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] rate_limit_burst = 0 {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] rate_limit_except_level = CRITICAL {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] rate_limit_interval = 0 {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] reinit_driver_count = 3 {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] replication_device = **** {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] report_discard_supported = False {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] report_interval = 120 {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] reservation_clean_interval = 86400 {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] reservation_expire = 86400 {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] reserved_image_namespaces = [] {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] reserved_percentage = 0 {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:18 devstack cinder-volume[85636]: INFO cinder.volume.manager [None req-916d6385-ff0c-4c6b-aadb-68ce566e6962 None None] Starting volume driver QuobyteDriver (1.2.1) Sep 22 15:35:18 devstack cinder-volume[85636]: DEBUG cinder.volume.drivers.remotefs [None req-916d6385-ff0c-4c6b-aadb-68ce566e6962 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=85636) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] rpc_response_timeout = 120 {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] run_external_periodic_tasks = True {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] scst_target_driver = iscsi {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] scst_target_iqn_name = None {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] service_down_time = 720 {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] shell_completion = None {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] snapshot_name_template = snapshot-%s {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] split_loggers = False {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] state_path = /opt/stack/data/cinder {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] storage_availability_zone = nova {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] storage_protocol = iSCSI {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] syslog_log_facility = LOG_USER {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] target_helper = lioadm {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] target_ip_address = 192.168.122.247 {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] target_port = 3260 {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] target_protocol = iscsi {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] target_secondary_ip_addresses = [] {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] trace_flags = None {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] transfer_api_class = cinder.transfer.api.API {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] transport_url = **** {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] until_refresh = 0 {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] use_chap_auth = False {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] use_default_quota_class = True {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] use_journal = False {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] use_json = False {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] use_multipath_for_image_xfer = False {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] use_stderr = False {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] use_syslog = False {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] verify_glance_signatures = enabled {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] volume_api_class = cinder.volume.api.API {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] volume_backend_name = None {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] volume_clear = zero {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] volume_clear_ionice = None {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] volume_clear_size = 0 {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] volume_copy_bps_limit = 0 {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] volume_dd_blocksize = 1M {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] volume_name_template = volume-%s {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] volume_service_inithost_offload = False {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] volume_usage_audit_period = month {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] zoning_mode = None {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] oslo_concurrency.disable_process_locking = False {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] keystone_authtoken.auth_section = None {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] keystone_authtoken.auth_type = password {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] keystone_authtoken.auth_version = None {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] keystone_authtoken.cache = None {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] keystone_authtoken.certfile = None {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] keystone_authtoken.delay_auth_decision = False {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] keystone_authtoken.http_connect_timeout = None {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] keystone_authtoken.include_service_catalog = True {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] keystone_authtoken.insecure = False {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] keystone_authtoken.interface = public {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] keystone_authtoken.keyfile = None {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] keystone_authtoken.memcache_password = **** {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] keystone_authtoken.memcache_username = None {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] keystone_authtoken.region_name = None {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] keystone_authtoken.service_token_roles_required = True {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] keystone_authtoken.service_type = None {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] keystone_authtoken.token_cache_time = 300 {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.247/identity {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] cache.backend = dogpile.cache.null {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] cache.backend_argument = **** {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] cache.backend_expiration_time = None {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] cache.config_prefix = cache.oslo {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] cache.debug_cache_backend = False {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] cache.enable_retry_client = False {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] cache.enable_socket_keepalive = False {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] cache.enabled = False {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] cache.expiration_time = 600 {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] cache.hashclient_retry_attempts = 2 {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] cache.memcache_dead_retry = 300 {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] cache.memcache_pool_maxsize = 10 {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] cache.memcache_sasl_enabled = False {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] cache.password = **** {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] cache.proxies = [] {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] cache.redis_db = 0 {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] cache.redis_sentinel_service_name = mymaster {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] cache.redis_server = localhost:6379 {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] cache.retry_attempts = 2 {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] cache.retry_delay = 0.0 {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] cache.socket_keepalive_count = 1 {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] cache.socket_keepalive_idle = 1 {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] cache.socket_keepalive_interval = 1 {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] cache.socket_timeout = 1.0 {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] cache.tls_allowed_ciphers = None {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] cache.tls_cafile = None {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] cache.tls_certfile = None {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] cache.tls_enabled = False {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] cache.tls_keyfile = None {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] cache.username = None {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] coordination.backend_url = **** {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] database.asyncio_connection = **** {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] database.asyncio_slave_connection = **** {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] database.backend = sqlalchemy {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] database.connection = **** {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] database.connection_debug = 0 {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] database.connection_parameters = {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] database.connection_recycle_time = 3600 {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] database.connection_trace = False {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] database.db_inc_retry_interval = True {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] database.db_max_retries = 20 {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] database.db_max_retry_interval = 10 {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] database.db_retry_interval = 1 {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] database.max_overflow = 50 {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] database.max_pool_size = 5 {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] database.max_retries = 10 {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] database.mysql_wsrep_sync_wait = None {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] database.pool_timeout = None {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] database.retry_interval = 10 {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] database.slave_connection = **** {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] database.sqlite_synchronous = True {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] database.synchronous_reader = True {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] database.use_db_reconnect = False {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] oslo_messaging_tracing.insecure = False {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] profiler.connection_string = messaging:// {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] profiler.enabled = False {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] profiler.es_doc_type = notification {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] profiler.es_scroll_size = 10000 {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] profiler.es_scroll_time = 2m {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] profiler.filter_error_trace = False {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] profiler.hmac_keys = **** {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] profiler.sentinel_service_name = mymaster {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] profiler.socket_timeout = 0.1 {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] profiler.trace_requests = False {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] profiler.trace_sqlalchemy = False {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] profiler_jaeger.process_tags = {} {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] profiler_jaeger.service_name_prefix = None {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] profiler_otlp.service_name_prefix = None {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] oslo_policy.enforce_new_defaults = True {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] oslo_policy.policy_default_rule = default {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] oslo_policy.policy_file = policy.yaml {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85636]: DEBUG cinder.volume.drivers.quobyte [None req-916d6385-ff0c-4c6b-aadb-68ce566e6962 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=85636) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 22 15:35:18 devstack cinder-volume[85636]: WARNING cinder.volume.drivers.quobyte [None req-916d6385-ff0c-4c6b-aadb-68ce566e6962 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 22 15:35:18 devstack cinder-volume[85636]: WARNING cinder.volume.drivers.quobyte [None req-916d6385-ff0c-4c6b-aadb-68ce566e6962 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] oslo_policy.remote_timeout = 60.0 {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] privsep_osbrick.group = None {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] privsep_osbrick.helper_command = None {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] privsep_osbrick.user = None {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] cinder_sys_admin.group = None {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] cinder_sys_admin.helper_command = None {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] cinder_sys_admin.user = None {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] service_user.auth_section = None {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] service_user.auth_type = password {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] service_user.cafile = None {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] service_user.certfile = None {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] service_user.collect_timing = False {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] service_user.insecure = False {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] service_user.keyfile = None {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] service_user.send_service_user_token = True {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] service_user.split_loggers = False {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85636]: DEBUG oslo_concurrency.processutils [None req-916d6385-ff0c-4c6b-aadb-68ce566e6962 None None] Running cmd (subprocess): mount.quobyte {{(pid=85636) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] service_user.timeout = None {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] service_user.tls_ciphers = None {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] service_user.tls_min_version = None {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] glance.auth_section = None {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] glance.auth_type = password {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] glance.certfile = None {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] glance.collect_timing = False {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] glance.insecure = False {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] glance.keyfile = None {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] glance.region_name = None {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] glance.split_loggers = False {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] glance.timeout = None {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] glance.tls_ciphers = None {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] glance.tls_min_version = None {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] backend_defaults.backend_availability_zone = None {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] backend_defaults.chap_password = **** {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] backend_defaults.chap_username = {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] backend_defaults.disk_geometry = None {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] backend_defaults.driver_client_cert = None {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] backend_defaults.driver_client_cert_key = None {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] backend_defaults.driver_data_namespace = None {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] backend_defaults.driver_use_ssl = False {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] backend_defaults.enable_unsupported_driver = False {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] backend_defaults.extra_capabilities = {} {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] backend_defaults.filter_function = None {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] backend_defaults.goodness_function = None {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] backend_defaults.iscsi_target_flags = {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] backend_defaults.iscsi_write_cache = on {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] backend_defaults.iser_helper = tgtadm {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] backend_defaults.iser_ip_address = 192.168.122.247 {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] backend_defaults.iser_port = 3260 {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] backend_defaults.nas_host = {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] backend_defaults.nas_login = admin {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] backend_defaults.nas_mount_options = None {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] backend_defaults.nas_password = **** {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] backend_defaults.nas_private_key = {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] backend_defaults.nas_share_path = {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] backend_defaults.nas_ssh_port = 22 {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] backend_defaults.num_shell_tries = 3 {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] backend_defaults.nvmet_port_id = 1 {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] backend_defaults.quobyte_client_cfg = None {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] backend_defaults.quobyte_volume_url = None {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] backend_defaults.replication_device = **** {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] backend_defaults.report_discard_supported = False {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] backend_defaults.reserved_percentage = 0 {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] backend_defaults.scst_target_driver = iscsi {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] backend_defaults.scst_target_iqn_name = None {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] backend_defaults.storage_protocol = iSCSI {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] backend_defaults.target_helper = tgtadm {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] backend_defaults.target_ip_address = 192.168.122.247 {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] backend_defaults.target_port = 3260 {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] backend_defaults.target_protocol = iscsi {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] backend_defaults.trace_flags = None {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] backend_defaults.unique_fqdn_network = True {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] backend_defaults.use_chap_auth = False {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] backend_defaults.volume_backend_name = None {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] backend_defaults.volume_clear = zero {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] backend_defaults.volume_clear_ionice = None {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] backend_defaults.volume_clear_size = 0 {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] oslo_reports.file_event_handler = None {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] oslo_reports.log_dir = None {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] QuobyteHD.backend_availability_zone = None {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] QuobyteHD.backend_host = None {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] QuobyteHD.chap_password = **** {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] QuobyteHD.chap_username = None {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] QuobyteHD.chiscsi_conf = None {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] QuobyteHD.disk_geometry = None {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] QuobyteHD.driver_client_cert = None {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] QuobyteHD.driver_client_cert_key = None {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] QuobyteHD.driver_data_namespace = None {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] QuobyteHD.driver_use_ssl = None {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] QuobyteHD.extra_capabilities = None {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] QuobyteHD.filter_function = None {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] QuobyteHD.goodness_function = None {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] QuobyteHD.iscsi_target_flags = None {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] QuobyteHD.iscsi_write_cache = None {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] QuobyteHD.iser_helper = None {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] QuobyteHD.iser_ip_address = None {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] QuobyteHD.iser_port = None {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] QuobyteHD.iser_target_prefix = None {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack quobyte-client[85639]: Reading configuration file: /etc/quobyte/client.cfg Sep 22 15:35:18 devstack quobyte-client[85639]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] QuobyteHD.nas_host = None {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85636]: DEBUG oslo_concurrency.processutils [None req-916d6385-ff0c-4c6b-aadb-68ce566e6962 None None] CMD "mount.quobyte" returned: 1 in 0.116s {{(pid=85636) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] QuobyteHD.nas_login = None {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] QuobyteHD.nas_mount_options = None {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85636]: DEBUG oslo_concurrency.lockutils [None req-916d6385-ff0c-4c6b-aadb-68ce566e6962 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85636) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] QuobyteHD.nas_password = **** {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85636]: DEBUG oslo_concurrency.lockutils [None req-916d6385-ff0c-4c6b-aadb-68ce566e6962 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85636) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] QuobyteHD.nas_private_key = None {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85636]: DEBUG cinder.volume.drivers.quobyte [None req-916d6385-ff0c-4c6b-aadb-68ce566e6962 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=85636) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] QuobyteHD.nas_share_path = None {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] QuobyteHD.nas_ssh_port = None {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] QuobyteHD.num_shell_tries = None {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] QuobyteHD.nvmet_ns_id = None {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] QuobyteHD.nvmet_port_id = None {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85636]: INFO cinder.volume.drivers.quobyte [None req-916d6385-ff0c-4c6b-aadb-68ce566e6962 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 ... Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85636]: DEBUG oslo_concurrency.processutils [None req-916d6385-ff0c-4c6b-aadb-68ce566e6962 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc -c /etc/quobyte/client-cinder.cfg {{(pid=85636) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] QuobyteHD.replication_device = **** {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] QuobyteHD.report_discard_supported = None {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] QuobyteHD.reserved_percentage = None {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] QuobyteHD.scst_target_driver = None {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] QuobyteHD.storage_protocol = None {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] QuobyteHD.target_helper = None {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] QuobyteHD.target_ip_address = None {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] QuobyteHD.target_port = None {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] QuobyteHD.target_prefix = None {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] QuobyteHD.target_protocol = None {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] QuobyteHD.trace_flags = None {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] QuobyteHD.unique_fqdn_network = None {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] QuobyteHD.use_chap_auth = None {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] QuobyteHD.volume_clear = None {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] QuobyteHD.volume_clear_ionice = None {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] QuobyteHD.volume_clear_size = None {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] QuobyteHD.volumes_dir = None {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] oslo_messaging_rabbit.ssl = False {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] oslo_messaging_rabbit.ssl_version = {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] oslo_messaging_notifications.driver = [] {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] oslo_messaging_notifications.retry = -1 {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] oslo_messaging_notifications.transport_url = **** {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] key_manager.fixed_key = **** {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] barbican.barbican_api_version = None {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] barbican.barbican_endpoint = None {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] barbican.barbican_endpoint_type = public {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] barbican.barbican_region_name = None {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] barbican.cafile = None {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] barbican.certfile = None {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] barbican.collect_timing = False {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] barbican.insecure = False {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] barbican.keyfile = None {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] barbican.number_of_retries = 60 {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] barbican.retry_delay = 1 {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] barbican.send_service_user_token = False {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] barbican.split_loggers = False {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] barbican.timeout = None {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] barbican.tls_ciphers = None {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] barbican.tls_min_version = None {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] barbican.verify_ssl = True {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] barbican.verify_ssl_path = None {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] barbican_service_user.auth_section = None {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] barbican_service_user.auth_type = None {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] barbican_service_user.cafile = None {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] barbican_service_user.certfile = None {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] barbican_service_user.collect_timing = False {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] barbican_service_user.insecure = False {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] barbican_service_user.keyfile = None {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] barbican_service_user.split_loggers = False {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] barbican_service_user.timeout = None {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] barbican_service_user.tls_ciphers = None {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] barbican_service_user.tls_min_version = None {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] vault.approle_role_id = **** {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] vault.approle_secret_id = **** {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] vault.auth_method = approle {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] vault.auth_path = None {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] vault.kv_mountpoint = secret {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] vault.kv_path = None {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] vault.kv_version = 2 {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] vault.namespace = None {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] vault.root_token_id = **** {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] vault.ssl_ca_crt_file = None {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] vault.timeout = 60.0 {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] vault.token_file = None {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] vault.token_role = None {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] vault.use_ssl = False {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:18 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] ******************************************************************************** {{(pid=85419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 22 15:35:18 devstack sudo[85642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc -c /etc/quobyte/client-cinder.cfg Sep 22 15:35:18 devstack sudo[85642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:35:19 devstack sudo[85642]: pam_unix(sudo:session): session closed for user root Sep 22 15:35:19 devstack cinder-volume[85636]: DEBUG oslo_concurrency.processutils [None req-916d6385-ff0c-4c6b-aadb-68ce566e6962 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.489s {{(pid=85636) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:35:19 devstack cinder-volume[85636]: INFO cinder.volume.drivers.quobyte [None req-916d6385-ff0c-4c6b-aadb-68ce566e6962 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 succeeded Sep 22 15:35:19 devstack cinder-volume[85636]: DEBUG cinder.volume.drivers.quobyte [None req-916d6385-ff0c-4c6b-aadb-68ce566e6962 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=85636) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:35:19 devstack cinder-volume[85636]: DEBUG oslo_concurrency.lockutils [None req-916d6385-ff0c-4c6b-aadb-68ce566e6962 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.504s {{(pid=85636) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:35:19 devstack cinder-volume[85636]: DEBUG oslo_concurrency.processutils [None req-916d6385-ff0c-4c6b-aadb-68ce566e6962 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc {{(pid=85636) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:35:19 devstack sudo[85741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc Sep 22 15:35:19 devstack sudo[85741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:35:19 devstack sudo[85741]: pam_unix(sudo:session): session closed for user root Sep 22 15:35:19 devstack cinder-volume[85636]: DEBUG oslo_concurrency.processutils [None req-916d6385-ff0c-4c6b-aadb-68ce566e6962 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc" returned: 0 in 0.238s {{(pid=85636) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:35:19 devstack cinder-volume[85636]: INFO cinder.volume.driver [None req-916d6385-ff0c-4c6b-aadb-68ce566e6962 None None] Driver hasn't implemented _init_vendor_properties() Sep 22 15:35:19 devstack cinder-volume[85636]: DEBUG cinder.volume.driver [None req-916d6385-ff0c-4c6b-aadb-68ce566e6962 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.5676803588867, 'free_capacity_gb': 1775.5676803588867, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=85636) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 22 15:35:19 devstack cinder-volume[85636]: DEBUG oslo_db.sqlalchemy.engines [None req-916d6385-ff0c-4c6b-aadb-68ce566e6962 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85636) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 22 15:35:19 devstack cinder-volume[85636]: DEBUG dbcounter [-] [85636] Writer thread running {{(pid=85636) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 22 15:35:19 devstack cinder-volume[85636]: DEBUG cinder.db.api [None req-916d6385-ff0c-4c6b-aadb-68ce566e6962 None None] Building query based on filter {{(pid=85636) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 22 15:35:19 devstack cinder-volume[85636]: DEBUG cinder.image.image_utils [None req-916d6385-ff0c-4c6b-aadb-68ce566e6962 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=85636) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Sep 22 15:35:19 devstack cinder-volume[85636]: INFO cinder.keymgr.migration [None req-8f5b73a9-c286-45f9-a0da-13c72f682116 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 22 15:35:19 devstack cinder-volume[85636]: DEBUG oslo_concurrency.lockutils [None req-916d6385-ff0c-4c6b-aadb-68ce566e6962 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85636) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:35:19 devstack cinder-volume[85636]: DEBUG oslo_concurrency.lockutils [None req-916d6385-ff0c-4c6b-aadb-68ce566e6962 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85636) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:35:19 devstack cinder-volume[85636]: DEBUG cinder.volume.drivers.quobyte [None req-916d6385-ff0c-4c6b-aadb-68ce566e6962 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=85636) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:35:19 devstack cinder-volume[85636]: DEBUG cinder.volume.drivers.quobyte [None req-916d6385-ff0c-4c6b-aadb-68ce566e6962 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=85636) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:35:19 devstack cinder-volume[85636]: DEBUG oslo_concurrency.lockutils [None req-916d6385-ff0c-4c6b-aadb-68ce566e6962 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85636) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:35:19 devstack cinder-volume[85636]: DEBUG oslo_concurrency.processutils [None req-916d6385-ff0c-4c6b-aadb-68ce566e6962 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc {{(pid=85636) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:35:19 devstack sudo[85745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc Sep 22 15:35:19 devstack sudo[85745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:35:19 devstack sudo[85745]: pam_unix(sudo:session): session closed for user root Sep 22 15:35:19 devstack cinder-volume[85636]: DEBUG oslo_concurrency.processutils [None req-916d6385-ff0c-4c6b-aadb-68ce566e6962 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc" returned: 0 in 0.271s {{(pid=85636) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:35:19 devstack cinder-volume[85636]: DEBUG cinder.manager [None req-916d6385-ff0c-4c6b-aadb-68ce566e6962 None None] Notifying Schedulers of capabilities ... {{(pid=85636) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 15:35:19 devstack cinder-volume[85636]: INFO cinder.volume.manager [None req-916d6385-ff0c-4c6b-aadb-68ce566e6962 None None] Driver initialization completed successfully. Sep 22 15:35:19 devstack cinder-volume[85636]: INFO cinder.manager [None req-916d6385-ff0c-4c6b-aadb-68ce566e6962 None None] Initiating service 3 cleanup Sep 22 15:35:19 devstack cinder-volume[85636]: INFO cinder.manager [None req-916d6385-ff0c-4c6b-aadb-68ce566e6962 None None] Service 3 cleanup completed. Sep 22 15:35:19 devstack cinder-volume[85636]: DEBUG cinder.service [None req-916d6385-ff0c-4c6b-aadb-68ce566e6962 None None] Creating RPC server for service cinder-volume {{(pid=85636) start /opt/stack/cinder/cinder/service.py:231}} Sep 22 15:35:19 devstack cinder-volume[85636]: DEBUG cinder.service [None req-916d6385-ff0c-4c6b-aadb-68ce566e6962 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=85636) start /opt/stack/cinder/cinder/service.py:237}} Sep 22 15:35:19 devstack cinder-volume[85636]: INFO cinder.volume.manager [None req-916d6385-ff0c-4c6b-aadb-68ce566e6962 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 22 15:35:20 devstack cinder-volume[85636]: DEBUG oslo_concurrency.lockutils [None req-916d6385-ff0c-4c6b-aadb-68ce566e6962 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85636) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:35:20 devstack cinder-volume[85636]: DEBUG oslo_concurrency.lockutils [None req-916d6385-ff0c-4c6b-aadb-68ce566e6962 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=85636) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:35:20 devstack cinder-volume[85636]: DEBUG cinder.volume.drivers.quobyte [None req-916d6385-ff0c-4c6b-aadb-68ce566e6962 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=85636) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:35:20 devstack cinder-volume[85636]: DEBUG cinder.volume.drivers.quobyte [None req-916d6385-ff0c-4c6b-aadb-68ce566e6962 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=85636) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:35:20 devstack cinder-volume[85636]: DEBUG oslo_concurrency.lockutils [None req-916d6385-ff0c-4c6b-aadb-68ce566e6962 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=85636) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:35:20 devstack cinder-volume[85636]: DEBUG oslo_concurrency.processutils [None req-916d6385-ff0c-4c6b-aadb-68ce566e6962 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc {{(pid=85636) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:35:20 devstack sudo[85773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc Sep 22 15:35:20 devstack sudo[85773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:35:20 devstack sudo[85773]: pam_unix(sudo:session): session closed for user root Sep 22 15:35:20 devstack cinder-volume[85636]: DEBUG oslo_concurrency.processutils [None req-916d6385-ff0c-4c6b-aadb-68ce566e6962 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc" returned: 0 in 0.270s {{(pid=85636) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:35:20 devstack cinder-volume[85636]: INFO cinder.volume.manager [None req-916d6385-ff0c-4c6b-aadb-68ce566e6962 None None] Driver post RPC initialization completed successfully. Sep 22 15:35:21 devstack cinder-volume[85636]: DEBUG oslo_service.periodic_task [None req-0ab0d3ac-d7d1-4e0e-99df-50b2878403d5 None None] Running periodic task VolumeManager._thread_info {{(pid=85636) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 22 15:35:21 devstack cinder-volume[85636]: DEBUG cinder.volume.manager [None req-0ab0d3ac-d7d1-4e0e-99df-50b2878403d5 None None] thread count: 6 {{(pid=85636) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 22 15:35:21 devstack cinder-volume[85636]: DEBUG cinder.volume.manager [None req-0ab0d3ac-d7d1-4e0e-99df-50b2878403d5 None None] thread info: [<_MainThread(MainThread, started 134430990729344)>, , , , , ] {{(pid=85636) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 22 15:35:23 devstack cinder-volume[85419]: INFO oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] Caught SIGTERM, stopping children Sep 22 15:35:23 devstack cinder-volume[85419]: DEBUG oslo_concurrency.lockutils [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] Acquiring lock "singleton_lock" {{(pid=85419) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 22 15:35:23 devstack cinder-volume[85419]: DEBUG oslo_concurrency.lockutils [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] Acquired lock "singleton_lock" {{(pid=85419) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 22 15:35:23 devstack cinder-volume[85419]: DEBUG oslo_concurrency.lockutils [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] Releasing lock "singleton_lock" {{(pid=85419) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 22 15:35:23 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] Stop services. {{(pid=85419) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 22 15:35:23 devstack cinder-volume[85419]: DEBUG oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] Killing children. {{(pid=85419) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 22 15:35:23 devstack cinder-volume[85419]: INFO oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] Waiting on 1 children to exit Sep 22 15:35:24 devstack cinder-volume[85636]: DEBUG oslo_concurrency.lockutils [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] Acquiring lock "singleton_lock" {{(pid=85636) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 22 15:35:24 devstack cinder-volume[85636]: DEBUG oslo_concurrency.lockutils [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] Acquired lock "singleton_lock" {{(pid=85636) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 22 15:35:24 devstack cinder-volume[85636]: DEBUG oslo_concurrency.lockutils [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] Releasing lock "singleton_lock" {{(pid=85636) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 22 15:35:24 devstack cinder-volume[85636]: WARNING amqp [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 22 15:35:24 devstack cinder-volume[85636]: WARNING amqp [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 22 15:35:24 devstack cinder-volume[85419]: INFO oslo_service.backend._eventlet.service [None req-d95b1dfa-b72f-4013-9e76-c09117191015 None None] Child 85636 exited with status 0 Sep 22 15:35:24 devstack cinder-volume[85972]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 22 15:35:24 devstack cinder-volume[85972]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 22 15:35:24 devstack cinder-volume[85972]: we strongly recommend against using it for new projects. Sep 22 15:35:24 devstack cinder-volume[85972]: If you are already using Eventlet, we recommend migrating to a different Sep 22 15:35:24 devstack cinder-volume[85972]: framework. For more detail see Sep 22 15:35:24 devstack cinder-volume[85972]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 22 15:35:24 devstack cinder-volume[85972]: import eventlet # noqa Sep 22 15:35:27 devstack cinder-volume[85972]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=85972) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 22 15:35:27 devstack cinder-volume[85972]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=85972) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 22 15:35:27 devstack cinder-volume[85972]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=85972) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 22 15:35:28 devstack cinder-volume[85972]: INFO dbcounter [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] Registered counter for database cinder Sep 22 15:35:28 devstack cinder-volume[85972]: DEBUG oslo_db.sqlalchemy.engines [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85972) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG dbcounter [-] [85972] Writer thread running {{(pid=85972) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 22 15:35:29 devstack cinder-volume[85972]: INFO cinder.rpc [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 22 15:35:29 devstack cinder-volume[85972]: INFO cinder.rpc [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_db.sqlalchemy.engines [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85972) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 22 15:35:29 devstack cinder-volume[85972]: INFO cinder.volume.manager [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] Determined volume DB was empty at startup. Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG cinder.volume.manager [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] Cinder Volume DB check: vol_db_empty=True {{(pid=85972) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 22 15:35:29 devstack cinder-volume[85972]: WARNING stevedore.named [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 22 15:35:29 devstack cinder-volume[85972]: WARNING castellan.key_manager [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 22 15:35:29 devstack cinder-volume[85972]: WARNING cinder.keymgr.conf_key_mgr [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 22 15:35:29 devstack cinder-volume[85972]: INFO cinder.volume.manager [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_db.sqlalchemy.engines [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85972) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 22 15:35:29 devstack cinder-volume[85972]: INFO oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] Starting 1 workers Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] Started child 86212 {{(pid=85972) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] Full set of CONF: {{(pid=85972) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] ******************************************************************************** {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] Configuration options gathered from: {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] ================================================================================ {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] allow_availability_zone_fallback = False {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] allow_compression_on_image_upload = False {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] allowed_direct_url_schemes = [] {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] api_rate_limit = True {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] auth_strategy = keystone {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] backend_availability_zone = None {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] backend_host = None {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:29 devstack cinder-volume[86212]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0) Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] backend_name = None {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] backend_stats_polling_interval = 60 {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] backup_api_class = cinder.backup.api.API {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] backup_name_template = backup-%s {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] backup_use_same_host = False {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] backup_use_temp_snapshot = False {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] chap_password = **** {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] chap_username = {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] cinder_internal_tenant_project_id = eb8a2d6d7e6541fb9d06a0a3594619ee {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] cinder_internal_tenant_user_id = 5e260e248dfc45758401c916d6596d08 {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] cluster = None {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] compression_format = gzip {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] compute_api_class = cinder.compute.nova.API {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] config_dir = [] {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] config_source = [] {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] control_exchange = openstack {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] debug = True {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] default_availability_zone = None {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] default_group_type = None {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] default_volume_type = QuobyteHD {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] disk_geometry = None {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] driver_client_cert = None {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] driver_client_cert_key = None {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] driver_data_namespace = None {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] driver_ssl_cert_path = None {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] driver_ssl_cert_verify = False {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] driver_use_ssl = False {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] enable_new_services = True {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] enable_unsupported_driver = False {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] enabled_backends = ['QuobyteHD'] {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] enforce_multipath_for_image_xfer = False {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] filter_function = None {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] glance_api_insecure = False {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] glance_api_servers = ['http://192.168.122.247/image'] {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] glance_api_ssl_compression = False {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] glance_ca_certificates_file = None {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] glance_catalog_info = image:glance:publicURL {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] glance_certfile = None {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] glance_keyfile = None {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] glance_num_retries = 3 {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] glance_request_timeout = None {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] goodness_function = None {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] graceful_shutdown_timeout = 5 {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] group_api_class = cinder.group.api.API {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] host = devstack {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] image_compress_on_upload = True {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] image_conversion_address_space_limit = 1 {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] image_conversion_cpu_limit = 60 {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] image_conversion_disable = False {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] image_introspection_address_space_limit = 1 {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] image_introspection_cpu_limit = 60 {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] image_upload_use_cinder_backend = False {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] image_upload_use_internal_tenant = False {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] image_volume_cache_enabled = False {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] image_volume_cache_max_count = 0 {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] image_volume_cache_max_size_gb = 0 {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] init_host_max_objects_retrieval = 0 {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] instance_format = [instance: %(uuid)s] {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] iscsi_target_flags = {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] iscsi_write_cache = on {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] iser_helper = tgtadm {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] iser_ip_address = 192.168.122.247 {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] iser_port = 3260 {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] log_color = False {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] log_config_append = None {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] log_dir = None {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] log_file = None {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] log_options = True {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] log_rotate_interval = 1 {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] log_rotate_interval_type = days {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] log_rotation_type = none {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] max_age = 0 {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] max_logfile_count = 30 {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] max_logfile_size_mb = 200 {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] max_over_subscription_ratio = 20.0 {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] message_reap_interval = 86400 {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] message_ttl = 2592000 {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] migration_create_volume_timeout_secs = 300 {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] monkey_patch = False {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] monkey_patch_modules = [] {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] my_ip = 192.168.122.247 {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] no_snapshot_gb_quota = False {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] num_iser_scan_tries = 3 {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] num_shell_tries = 3 {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] num_volume_device_scan_tries = 3 {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] nvmeof_conn_info_version = 1 {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] nvmet_ns_id = 10 {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] nvmet_port_id = 1 {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] osapi_max_limit = 1000 {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] osapi_volume_ext_list = [] {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] osapi_volume_listen = 0.0.0.0 {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] osapi_volume_listen_port = 8776 {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] osapi_volume_use_ssl = False {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] osapi_volume_workers = None {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] per_volume_size_limit = -1 {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] periodic_fuzzy_delay = 60 {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] periodic_interval = 60 {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] project_id_regex = [0-9a-f\-]+ {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] public_endpoint = None {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] publish_errors = False {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] quota_backup_gigabytes = 1000 {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] quota_backups = 10 {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] quota_gigabytes = 1000 {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] quota_groups = 10 {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] quota_snapshots = 10 {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] quota_volumes = 10 {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] rate_limit_burst = 0 {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] rate_limit_except_level = CRITICAL {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] rate_limit_interval = 0 {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] reinit_driver_count = 3 {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] replication_device = **** {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] report_discard_supported = False {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] report_interval = 120 {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] reservation_clean_interval = 86400 {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] reservation_expire = 86400 {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] reserved_image_namespaces = [] {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] reserved_percentage = 0 {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] rpc_response_timeout = 120 {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] run_external_periodic_tasks = True {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] scst_target_driver = iscsi {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] scst_target_iqn_name = None {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] service_down_time = 720 {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] shell_completion = None {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] snapshot_name_template = snapshot-%s {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] split_loggers = False {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] state_path = /opt/stack/data/cinder {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] storage_availability_zone = nova {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] storage_protocol = iSCSI {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] syslog_log_facility = LOG_USER {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] target_helper = lioadm {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] target_ip_address = 192.168.122.247 {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] target_port = 3260 {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] target_protocol = iscsi {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] target_secondary_ip_addresses = [] {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] trace_flags = None {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] transfer_api_class = cinder.transfer.api.API {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] transport_url = **** {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] until_refresh = 0 {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] use_chap_auth = False {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] use_default_quota_class = True {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] use_journal = False {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] use_json = False {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] use_multipath_for_image_xfer = False {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] use_stderr = False {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] use_syslog = False {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] verify_glance_signatures = enabled {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] volume_api_class = cinder.volume.api.API {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] volume_backend_name = None {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] volume_clear = zero {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] volume_clear_ionice = None {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] volume_clear_size = 0 {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] volume_copy_bps_limit = 0 {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] volume_dd_blocksize = 1M {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] volume_name_template = volume-%s {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] volume_service_inithost_offload = False {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] volume_usage_audit_period = month {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] zoning_mode = None {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] oslo_concurrency.disable_process_locking = False {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-6c057a2f-24c8-4faf-b5be-ed76276c0abe None None] Starting volume driver QuobyteDriver (1.2.1) Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] os_brick.lightos_discovery_client_address = localhost {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-6c057a2f-24c8-4faf-b5be-ed76276c0abe None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86212) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] os_brick.wait_mpath_device_interval = 1 {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] keystone_authtoken.auth_section = None {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] keystone_authtoken.auth_type = password {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] keystone_authtoken.auth_version = None {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] keystone_authtoken.cache = None {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] keystone_authtoken.certfile = None {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] keystone_authtoken.delay_auth_decision = False {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] keystone_authtoken.http_connect_timeout = None {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] keystone_authtoken.include_service_catalog = True {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] keystone_authtoken.insecure = False {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] keystone_authtoken.interface = public {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] keystone_authtoken.keyfile = None {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] keystone_authtoken.memcache_password = **** {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] keystone_authtoken.memcache_secret_key = **** {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] keystone_authtoken.memcache_security_strategy = None {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] keystone_authtoken.memcache_username = None {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] keystone_authtoken.region_name = None {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] keystone_authtoken.service_token_roles_required = True {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] keystone_authtoken.service_type = None {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] keystone_authtoken.token_cache_time = 300 {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.247/identity {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] cache.backend = dogpile.cache.null {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] cache.backend_argument = **** {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] cache.backend_expiration_time = None {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] cache.config_prefix = cache.oslo {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] cache.debug_cache_backend = False {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] cache.enable_retry_client = False {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] cache.enable_socket_keepalive = False {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] cache.enabled = False {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] cache.expiration_time = 600 {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] cache.hashclient_dead_timeout = 60.0 {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] cache.hashclient_retry_attempts = 2 {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] cache.hashclient_retry_timeout = 1.0 {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] cache.memcache_dead_retry = 300 {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] cache.memcache_pool_maxsize = 10 {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] cache.memcache_pool_unused_timeout = 60 {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] cache.memcache_sasl_enabled = False {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] cache.memcache_servers = ['localhost:11211'] {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] cache.password = **** {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] cache.proxies = [] {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] cache.redis_db = 0 {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] cache.redis_sentinel_service_name = mymaster {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] cache.redis_server = localhost:6379 {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] cache.retry_attempts = 2 {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] cache.retry_delay = 0.0 {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] cache.socket_keepalive_count = 1 {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] cache.socket_keepalive_idle = 1 {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] cache.socket_keepalive_interval = 1 {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] cache.socket_timeout = 1.0 {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] cache.tls_allowed_ciphers = None {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] cache.tls_cafile = None {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] cache.tls_certfile = None {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] cache.tls_enabled = False {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] cache.tls_keyfile = None {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] cache.username = None {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] coordination.backend_url = **** {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] database.asyncio_connection = **** {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] database.asyncio_slave_connection = **** {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] database.backend = sqlalchemy {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] database.connection = **** {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] database.connection_debug = 0 {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] database.connection_parameters = {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] database.connection_recycle_time = 3600 {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] database.connection_trace = False {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] database.db_inc_retry_interval = True {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] database.db_max_retries = 20 {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] database.db_max_retry_interval = 10 {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] database.db_retry_interval = 1 {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] database.max_overflow = 50 {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] database.max_pool_size = 5 {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] database.max_retries = 10 {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] database.mysql_sql_mode = TRADITIONAL {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] database.mysql_wsrep_sync_wait = None {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] database.pool_timeout = None {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] database.retry_interval = 10 {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] database.slave_connection = **** {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] database.sqlite_synchronous = True {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] database.synchronous_reader = True {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] database.use_db_reconnect = False {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] oslo_messaging_metrics.metrics_process_name = {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] oslo_messaging_tracing.insecure = False {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] profiler.connection_string = messaging:// {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] profiler.enabled = False {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] profiler.es_doc_type = notification {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] profiler.es_scroll_size = 10000 {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] profiler.es_scroll_time = 2m {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] profiler.filter_error_trace = False {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] profiler.hmac_keys = **** {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] profiler.sentinel_service_name = mymaster {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] profiler.socket_timeout = 0.1 {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] profiler.trace_requests = False {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] profiler.trace_sqlalchemy = False {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] profiler_jaeger.process_tags = {} {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] profiler_jaeger.service_name_prefix = None {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] profiler_otlp.service_name_prefix = None {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] oslo_policy.enforce_new_defaults = True {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] oslo_policy.policy_default_rule = default {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] oslo_policy.policy_file = policy.yaml {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] oslo_policy.remote_timeout = 60.0 {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] privsep_osbrick.capabilities = [21, 2] {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] privsep_osbrick.group = None {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] privsep_osbrick.helper_command = None {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] privsep_osbrick.log_daemon_traceback = False {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] privsep_osbrick.thread_pool_size = 4 {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] privsep_osbrick.user = None {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] cinder_sys_admin.group = None {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] cinder_sys_admin.helper_command = None {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] cinder_sys_admin.user = None {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] service_user.auth_section = None {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] service_user.auth_type = password {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] service_user.cafile = None {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] service_user.certfile = None {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] service_user.collect_timing = False {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] service_user.insecure = False {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] service_user.keyfile = None {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] service_user.send_service_user_token = True {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] service_user.split_loggers = False {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] service_user.timeout = None {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] service_user.tls_ciphers = None {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] service_user.tls_min_version = None {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] glance.auth_section = None {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] glance.auth_type = password {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] glance.certfile = None {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] glance.collect_timing = False {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] glance.insecure = False {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] glance.keyfile = None {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] glance.region_name = None {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] glance.split_loggers = False {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] glance.timeout = None {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] glance.tls_ciphers = None {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] glance.tls_min_version = None {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] backend_defaults.backend_availability_zone = None {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] backend_defaults.chap_password = **** {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] backend_defaults.chap_username = {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] backend_defaults.disk_geometry = None {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] backend_defaults.driver_client_cert = None {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] backend_defaults.driver_client_cert_key = None {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] backend_defaults.driver_data_namespace = None {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] backend_defaults.driver_ssl_cert_path = None {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] backend_defaults.driver_use_ssl = False {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] backend_defaults.enable_unsupported_driver = False {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] backend_defaults.extra_capabilities = {} {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] backend_defaults.filter_function = None {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] backend_defaults.goodness_function = None {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] backend_defaults.image_volume_cache_enabled = False {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] backend_defaults.iscsi_target_flags = {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] backend_defaults.iscsi_write_cache = on {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] backend_defaults.iser_helper = tgtadm {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] backend_defaults.iser_ip_address = 192.168.122.247 {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] backend_defaults.iser_port = 3260 {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] backend_defaults.nas_host = {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] backend_defaults.nas_login = admin {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] backend_defaults.nas_mount_options = None {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] backend_defaults.nas_password = **** {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] backend_defaults.nas_private_key = {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] backend_defaults.nas_secure_file_operations = auto {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] backend_defaults.nas_share_path = {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] backend_defaults.nas_ssh_port = 22 {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] backend_defaults.nas_volume_prov_type = thin {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] backend_defaults.num_shell_tries = 3 {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] backend_defaults.nvmet_ns_id = 10 {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] backend_defaults.nvmet_port_id = 1 {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] backend_defaults.quobyte_client_cfg = None {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] backend_defaults.quobyte_volume_url = None {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] backend_defaults.replication_device = **** {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] backend_defaults.report_discard_supported = False {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] backend_defaults.reserved_percentage = 0 {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] backend_defaults.scst_target_driver = iscsi {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] backend_defaults.scst_target_iqn_name = None {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] backend_defaults.storage_protocol = iSCSI {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] backend_defaults.target_helper = tgtadm {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] backend_defaults.target_ip_address = 192.168.122.247 {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] backend_defaults.target_port = 3260 {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] backend_defaults.target_protocol = iscsi {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] backend_defaults.trace_flags = None {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] backend_defaults.unique_fqdn_network = True {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] backend_defaults.use_chap_auth = False {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] backend_defaults.volume_backend_name = None {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] backend_defaults.volume_clear = zero {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] backend_defaults.volume_clear_ionice = None {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] backend_defaults.volume_clear_size = 0 {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] oslo_reports.file_event_handler = None {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] oslo_reports.file_event_handler_interval = 1 {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] oslo_reports.log_dir = None {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] QuobyteHD.backend_availability_zone = None {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] QuobyteHD.backend_host = None {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] QuobyteHD.chap_password = **** {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] QuobyteHD.chap_username = None {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] QuobyteHD.chiscsi_conf = None {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] QuobyteHD.disk_geometry = None {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] QuobyteHD.driver_client_cert = None {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] QuobyteHD.driver_client_cert_key = None {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] QuobyteHD.driver_data_namespace = None {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] QuobyteHD.driver_use_ssl = None {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] QuobyteHD.enable_unsupported_driver = None {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] QuobyteHD.extra_capabilities = None {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] QuobyteHD.filter_function = None {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] QuobyteHD.goodness_function = None {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] QuobyteHD.iscsi_target_flags = None {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] QuobyteHD.iscsi_write_cache = None {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] QuobyteHD.iser_helper = None {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] QuobyteHD.iser_ip_address = None {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] QuobyteHD.iser_port = None {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] QuobyteHD.iser_target_prefix = None {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] QuobyteHD.nas_host = None {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-6c057a2f-24c8-4faf-b5be-ed76276c0abe None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86212) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 22 15:35:29 devstack cinder-volume[86212]: WARNING cinder.volume.drivers.quobyte [None req-6c057a2f-24c8-4faf-b5be-ed76276c0abe None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 22 15:35:29 devstack cinder-volume[86212]: WARNING cinder.volume.drivers.quobyte [None req-6c057a2f-24c8-4faf-b5be-ed76276c0abe None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] QuobyteHD.nas_login = None {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] QuobyteHD.nas_mount_options = None {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] QuobyteHD.nas_password = **** {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] QuobyteHD.nas_private_key = None {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] QuobyteHD.nas_secure_file_operations = false {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] QuobyteHD.nas_share_path = None {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] QuobyteHD.nas_ssh_port = None {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] QuobyteHD.nas_volume_prov_type = None {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] QuobyteHD.num_iser_scan_tries = None {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] QuobyteHD.num_shell_tries = None {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] QuobyteHD.nvmet_ns_id = None {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] QuobyteHD.nvmet_port_id = None {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-6c057a2f-24c8-4faf-b5be-ed76276c0abe None None] Running cmd (subprocess): mount.quobyte {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] QuobyteHD.replication_device = **** {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] QuobyteHD.report_discard_supported = None {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] QuobyteHD.reserved_percentage = None {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] QuobyteHD.scst_target_driver = None {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] QuobyteHD.scst_target_iqn_name = None {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] QuobyteHD.storage_protocol = None {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] QuobyteHD.target_helper = None {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] QuobyteHD.target_ip_address = None {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] QuobyteHD.target_port = None {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] QuobyteHD.target_prefix = None {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] QuobyteHD.target_protocol = None {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] QuobyteHD.trace_flags = None {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] QuobyteHD.unique_fqdn_network = None {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] QuobyteHD.use_chap_auth = None {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] QuobyteHD.volume_clear = None {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] QuobyteHD.volume_clear_ionice = None {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] QuobyteHD.volume_clear_size = None {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] QuobyteHD.volume_dd_blocksize = None {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] QuobyteHD.volumes_dir = None {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] oslo_messaging_rabbit.hostname = devstack {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] oslo_messaging_rabbit.ssl = False {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] oslo_messaging_rabbit.ssl_version = {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] oslo_messaging_notifications.driver = [] {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] oslo_messaging_notifications.retry = -1 {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] oslo_messaging_notifications.transport_url = **** {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] key_manager.fixed_key = **** {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] barbican.barbican_api_version = None {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] barbican.barbican_endpoint = None {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] barbican.barbican_endpoint_type = public {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] barbican.barbican_region_name = None {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] barbican.cafile = None {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] barbican.certfile = None {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] barbican.collect_timing = False {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] barbican.insecure = False {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] barbican.keyfile = None {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] barbican.number_of_retries = 60 {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] barbican.retry_delay = 1 {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] barbican.send_service_user_token = False {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] barbican.split_loggers = False {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] barbican.timeout = None {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] barbican.tls_ciphers = None {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] barbican.tls_min_version = None {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] barbican.verify_ssl = True {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] barbican.verify_ssl_path = None {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] barbican_service_user.auth_section = None {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] barbican_service_user.auth_type = None {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] barbican_service_user.cafile = None {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] barbican_service_user.certfile = None {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] barbican_service_user.collect_timing = False {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] barbican_service_user.insecure = False {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] barbican_service_user.keyfile = None {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] barbican_service_user.split_loggers = False {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] barbican_service_user.timeout = None {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] barbican_service_user.tls_ciphers = None {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] barbican_service_user.tls_min_version = None {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] vault.approle_role_id = **** {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] vault.approle_secret_id = **** {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] vault.auth_method = approle {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] vault.auth_path = None {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] vault.kv_mountpoint = secret {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] vault.kv_path = None {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] vault.kv_version = 2 {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] vault.namespace = None {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] vault.root_token_id = **** {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] vault.ssl_ca_crt_file = None {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] vault.timeout = 60.0 {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] vault.token_file = None {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] vault.token_role = None {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] vault.use_ssl = False {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 15:35:29 devstack cinder-volume[85972]: DEBUG oslo_service.backend._eventlet.service [None req-a7e118c0-272c-4ae8-a132-921f71c5228b None None] ******************************************************************************** {{(pid=85972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 22 15:35:29 devstack quobyte-client[86235]: Reading configuration file: /etc/quobyte/client.cfg Sep 22 15:35:29 devstack quobyte-client[86235]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Sep 22 15:35:29 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-6c057a2f-24c8-4faf-b5be-ed76276c0abe None None] CMD "mount.quobyte" returned: 1 in 0.088s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:35:29 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-6c057a2f-24c8-4faf-b5be-ed76276c0abe None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:35:29 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-6c057a2f-24c8-4faf-b5be-ed76276c0abe None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:35:29 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-6c057a2f-24c8-4faf-b5be-ed76276c0abe None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:35:29 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-6c057a2f-24c8-4faf-b5be-ed76276c0abe None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:35:29 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-6c057a2f-24c8-4faf-b5be-ed76276c0abe None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:35:29 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-6c057a2f-24c8-4faf-b5be-ed76276c0abe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:35:29 devstack sudo[86236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc Sep 22 15:35:29 devstack sudo[86236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:35:30 devstack sudo[86236]: pam_unix(sudo:session): session closed for user root Sep 22 15:35:30 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-6c057a2f-24c8-4faf-b5be-ed76276c0abe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc" returned: 0 in 0.279s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:35:30 devstack cinder-volume[86212]: INFO cinder.volume.driver [None req-6c057a2f-24c8-4faf-b5be-ed76276c0abe None None] Driver hasn't implemented _init_vendor_properties() Sep 22 15:35:30 devstack cinder-volume[86212]: DEBUG cinder.volume.driver [None req-6c057a2f-24c8-4faf-b5be-ed76276c0abe None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.568157196045, 'free_capacity_gb': 1775.568157196045, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86212) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 22 15:35:30 devstack cinder-volume[86212]: DEBUG oslo_db.sqlalchemy.engines [None req-6c057a2f-24c8-4faf-b5be-ed76276c0abe None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86212) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 22 15:35:30 devstack cinder-volume[86212]: DEBUG dbcounter [-] [86212] Writer thread running {{(pid=86212) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 22 15:35:30 devstack cinder-volume[86212]: DEBUG cinder.db.api [None req-6c057a2f-24c8-4faf-b5be-ed76276c0abe None None] Building query based on filter {{(pid=86212) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 22 15:35:30 devstack cinder-volume[86212]: DEBUG cinder.image.image_utils [None req-6c057a2f-24c8-4faf-b5be-ed76276c0abe None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86212) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Sep 22 15:35:30 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-6c057a2f-24c8-4faf-b5be-ed76276c0abe None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:35:30 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-6c057a2f-24c8-4faf-b5be-ed76276c0abe None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:35:30 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-6c057a2f-24c8-4faf-b5be-ed76276c0abe None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:35:30 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-6c057a2f-24c8-4faf-b5be-ed76276c0abe None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:35:30 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-6c057a2f-24c8-4faf-b5be-ed76276c0abe None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:35:30 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-6c057a2f-24c8-4faf-b5be-ed76276c0abe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:35:30 devstack cinder-volume[86212]: INFO cinder.keymgr.migration [None req-c89cbef3-b9cc-4662-af5a-cae692b3ec81 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 22 15:35:30 devstack sudo[86257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc Sep 22 15:35:30 devstack sudo[86257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:35:30 devstack sudo[86257]: pam_unix(sudo:session): session closed for user root Sep 22 15:35:30 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-6c057a2f-24c8-4faf-b5be-ed76276c0abe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc" returned: 0 in 0.282s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:35:30 devstack cinder-volume[86212]: DEBUG cinder.manager [None req-6c057a2f-24c8-4faf-b5be-ed76276c0abe None None] Notifying Schedulers of capabilities ... {{(pid=86212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 15:35:30 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-6c057a2f-24c8-4faf-b5be-ed76276c0abe None None] Driver initialization completed successfully. Sep 22 15:35:30 devstack cinder-volume[86212]: INFO cinder.manager [None req-6c057a2f-24c8-4faf-b5be-ed76276c0abe None None] Initiating service 3 cleanup Sep 22 15:35:30 devstack cinder-volume[86212]: INFO cinder.manager [None req-6c057a2f-24c8-4faf-b5be-ed76276c0abe None None] Service 3 cleanup completed. Sep 22 15:35:30 devstack cinder-volume[86212]: DEBUG cinder.service [None req-6c057a2f-24c8-4faf-b5be-ed76276c0abe None None] Creating RPC server for service cinder-volume {{(pid=86212) start /opt/stack/cinder/cinder/service.py:231}} Sep 22 15:35:30 devstack cinder-volume[86212]: DEBUG cinder.service [None req-6c057a2f-24c8-4faf-b5be-ed76276c0abe None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86212) start /opt/stack/cinder/cinder/service.py:237}} Sep 22 15:35:30 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-6c057a2f-24c8-4faf-b5be-ed76276c0abe None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 22 15:35:30 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-6c057a2f-24c8-4faf-b5be-ed76276c0abe None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:35:30 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-6c057a2f-24c8-4faf-b5be-ed76276c0abe None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:35:30 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-6c057a2f-24c8-4faf-b5be-ed76276c0abe None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:35:31 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-6c057a2f-24c8-4faf-b5be-ed76276c0abe None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:35:31 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-6c057a2f-24c8-4faf-b5be-ed76276c0abe None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:35:31 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-6c057a2f-24c8-4faf-b5be-ed76276c0abe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:35:31 devstack sudo[86268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc Sep 22 15:35:31 devstack sudo[86268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:35:31 devstack sudo[86268]: pam_unix(sudo:session): session closed for user root Sep 22 15:35:31 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-6c057a2f-24c8-4faf-b5be-ed76276c0abe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc" returned: 0 in 0.384s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:35:31 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-6c057a2f-24c8-4faf-b5be-ed76276c0abe None None] Driver post RPC initialization completed successfully. Sep 22 15:35:38 devstack cinder-volume[86212]: DEBUG oslo_service.periodic_task [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] Running periodic task VolumeManager._thread_info {{(pid=86212) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 22 15:35:38 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] thread count: 6 {{(pid=86212) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 22 15:35:38 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] thread info: [<_MainThread(MainThread, started 136163191222400)>, , , , , ] {{(pid=86212) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 22 15:35:39 devstack cinder-volume[85972]: DEBUG dbcounter [-] [85972] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=85972) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 22 15:35:40 devstack cinder-volume[86212]: DEBUG dbcounter [-] [86212] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=86212) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 22 15:35:41 devstack cinder-volume[86212]: DEBUG dbcounter [-] [86212] Writing DB stats cinder:SELECT=4 {{(pid=86212) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 22 15:36:38 devstack cinder-volume[86212]: DEBUG oslo_service.periodic_task [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86212) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 22 15:36:38 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:36:38 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:36:38 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:36:38 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:36:38 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:36:38 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:36:38 devstack sudo[86879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc Sep 22 15:36:38 devstack sudo[86879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:36:38 devstack sudo[86879]: pam_unix(sudo:session): session closed for user root Sep 22 15:36:38 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc" returned: 0 in 0.423s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:36:38 devstack cinder-volume[86212]: DEBUG cinder.manager [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] Notifying Schedulers of capabilities ... {{(pid=86212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 15:36:38 devstack cinder-volume[86212]: DEBUG oslo_service.periodic_task [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] Running periodic task VolumeManager._thread_info {{(pid=86212) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 22 15:36:38 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] thread count: 6 {{(pid=86212) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 22 15:36:38 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] thread info: [<_MainThread(MainThread, started 136163191222400)>, , , , , ] {{(pid=86212) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 22 15:36:53 devstack cinder-volume[86212]: DEBUG cinder.volume.flows.manager.create_volume [None req-aef1272f-a1f7-40db-9b4c-644597f4b88c tempest-DeleteServersTestJSON-1163871358 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 15:36:54 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-aef1272f-a1f7-40db-9b4c-644597f4b88c tempest-DeleteServersTestJSON-1163871358 None] Flow 'volume_create_manager' (bb8f8901-46a2-4dd3-9bb6-0ec636d79ec5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:36:54 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-aef1272f-a1f7-40db-9b4c-644597f4b88c tempest-DeleteServersTestJSON-1163871358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e74953c-11c7-4509-8e8c-3e76958767e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:36:54 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-aef1272f-a1f7-40db-9b4c-644597f4b88c tempest-DeleteServersTestJSON-1163871358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e74953c-11c7-4509-8e8c-3e76958767e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:36:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-427206976',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c4354f3-fcde-4466-ac75-85bf923adc93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d16e69da513849ffa35c359de564de65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:36:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:36:54Z,use_quota=True,user_id='4c2dd1bff3bd4280b8a98d2cff204e88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:36:54 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-aef1272f-a1f7-40db-9b4c-644597f4b88c tempest-DeleteServersTestJSON-1163871358 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fd8db0e-eb4e-4fda-8a73-826b0f9c52fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:36:54 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-aef1272f-a1f7-40db-9b4c-644597f4b88c tempest-DeleteServersTestJSON-1163871358 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fd8db0e-eb4e-4fda-8a73-826b0f9c52fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:36:54 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-aef1272f-a1f7-40db-9b4c-644597f4b88c tempest-DeleteServersTestJSON-1163871358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df1f7568-12f0-4ec5-8dce-58fe6660dd35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:36:54 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-aef1272f-a1f7-40db-9b4c-644597f4b88c tempest-DeleteServersTestJSON-1163871358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df1f7568-12f0-4ec5-8dce-58fe6660dd35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2c4354f3-fcde-4466-ac75-85bf923adc93', 'volume_name': 'volume-2c4354f3-fcde-4466-ac75-85bf923adc93', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:36:54 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-aef1272f-a1f7-40db-9b4c-644597f4b88c tempest-DeleteServersTestJSON-1163871358 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e6c87d5-a292-48bd-9378-9ba51adaffb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:36:54 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-aef1272f-a1f7-40db-9b4c-644597f4b88c tempest-DeleteServersTestJSON-1163871358 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e6c87d5-a292-48bd-9378-9ba51adaffb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:36:54 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-aef1272f-a1f7-40db-9b4c-644597f4b88c tempest-DeleteServersTestJSON-1163871358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3133f129-7928-46f0-ab5e-0ee93a2c85ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:36:54 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-aef1272f-a1f7-40db-9b4c-644597f4b88c tempest-DeleteServersTestJSON-1163871358 None] Volume 2c4354f3-fcde-4466-ac75-85bf923adc93: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2c4354f3-fcde-4466-ac75-85bf923adc93', 'volume_size': 1} Sep 22 15:36:54 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-aef1272f-a1f7-40db-9b4c-644597f4b88c tempest-DeleteServersTestJSON-1163871358 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:36:54 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-aef1272f-a1f7-40db-9b4c-644597f4b88c tempest-DeleteServersTestJSON-1163871358 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:36:54 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-aef1272f-a1f7-40db-9b4c-644597f4b88c tempest-DeleteServersTestJSON-1163871358 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:36:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-427206976',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c4354f3-fcde-4466-ac75-85bf923adc93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d16e69da513849ffa35c359de564de65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:36:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:36:54Z,use_quota=True,user_id='4c2dd1bff3bd4280b8a98d2cff204e88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)}" {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 15:36:54 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-aef1272f-a1f7-40db-9b4c-644597f4b88c tempest-DeleteServersTestJSON-1163871358 None] Creating volume 2c4354f3-fcde-4466-ac75-85bf923adc93 {{(pid=86212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 15:36:54 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-aef1272f-a1f7-40db-9b4c-644597f4b88c tempest-DeleteServersTestJSON-1163871358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:36:54 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-aef1272f-a1f7-40db-9b4c-644597f4b88c tempest-DeleteServersTestJSON-1163871358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:36:54 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-aef1272f-a1f7-40db-9b4c-644597f4b88c tempest-DeleteServersTestJSON-1163871358 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:36:54 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-aef1272f-a1f7-40db-9b4c-644597f4b88c tempest-DeleteServersTestJSON-1163871358 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:36:54 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-aef1272f-a1f7-40db-9b4c-644597f4b88c tempest-DeleteServersTestJSON-1163871358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:36:54 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-aef1272f-a1f7-40db-9b4c-644597f4b88c tempest-DeleteServersTestJSON-1163871358 None] Selected osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 as target Quobyte volume. {{(pid=86212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 15:36:54 devstack cinder-volume[86212]: INFO cinder.volume.drivers.remotefs [None req-aef1272f-a1f7-40db-9b4c-644597f4b88c tempest-DeleteServersTestJSON-1163871358 None] casted to osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 Sep 22 15:36:54 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-aef1272f-a1f7-40db-9b4c-644597f4b88c tempest-DeleteServersTestJSON-1163871358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2c4354f3-fcde-4466-ac75-85bf923adc93 1073741824 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:36:54 devstack sudo[87102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2c4354f3-fcde-4466-ac75-85bf923adc93 1073741824 Sep 22 15:36:54 devstack sudo[87102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:36:55 devstack sudo[87102]: pam_unix(sudo:session): session closed for user root Sep 22 15:36:55 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-aef1272f-a1f7-40db-9b4c-644597f4b88c tempest-DeleteServersTestJSON-1163871358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2c4354f3-fcde-4466-ac75-85bf923adc93 1073741824" returned: 0 in 1.460s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:36:56 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-aef1272f-a1f7-40db-9b4c-644597f4b88c tempest-DeleteServersTestJSON-1163871358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2c4354f3-fcde-4466-ac75-85bf923adc93 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:36:56 devstack sudo[87423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2c4354f3-fcde-4466-ac75-85bf923adc93 Sep 22 15:36:56 devstack sudo[87423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:36:56 devstack cinder-volume[86212]: DEBUG cinder.volume.flows.manager.create_volume [None req-35139093-6122-4434-ae0f-fa91406794fa tempest-VolumesAdminNegativeTest-61932815 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 15:36:56 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-35139093-6122-4434-ae0f-fa91406794fa tempest-VolumesAdminNegativeTest-61932815 None] Flow 'volume_create_manager' (9a30eac9-6c80-467a-bc4f-16b988138b1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:36:56 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-35139093-6122-4434-ae0f-fa91406794fa tempest-VolumesAdminNegativeTest-61932815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (678424dd-dc28-449e-9881-b1607817da1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:36:56 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-35139093-6122-4434-ae0f-fa91406794fa tempest-VolumesAdminNegativeTest-61932815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (678424dd-dc28-449e-9881-b1607817da1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:36:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-252046567',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=706bfec1-ba5b-4eed-852b-e0dc76090188,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='288e5e394af845a0b3b0b267b983b2cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:36:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:36:56Z,use_quota=True,user_id='00ca4140e28c406797b0ebc5097c6993',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:36:56 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-35139093-6122-4434-ae0f-fa91406794fa tempest-VolumesAdminNegativeTest-61932815 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56034986-fb7c-4866-9158-5710926ac825) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:36:56 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-35139093-6122-4434-ae0f-fa91406794fa tempest-VolumesAdminNegativeTest-61932815 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56034986-fb7c-4866-9158-5710926ac825) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:36:56 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-35139093-6122-4434-ae0f-fa91406794fa tempest-VolumesAdminNegativeTest-61932815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (679969d6-9658-4247-8d51-fb88a05f7e40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:36:56 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-35139093-6122-4434-ae0f-fa91406794fa tempest-VolumesAdminNegativeTest-61932815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (679969d6-9658-4247-8d51-fb88a05f7e40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '706bfec1-ba5b-4eed-852b-e0dc76090188', 'volume_name': 'volume-706bfec1-ba5b-4eed-852b-e0dc76090188', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:36:56 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-35139093-6122-4434-ae0f-fa91406794fa tempest-VolumesAdminNegativeTest-61932815 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8704eedc-1811-47de-b9b2-96e6578e03a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:36:56 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-35139093-6122-4434-ae0f-fa91406794fa tempest-VolumesAdminNegativeTest-61932815 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8704eedc-1811-47de-b9b2-96e6578e03a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:36:56 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-35139093-6122-4434-ae0f-fa91406794fa tempest-VolumesAdminNegativeTest-61932815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (606d07f4-cb79-477e-9851-80e6f5b20c24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:36:56 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-35139093-6122-4434-ae0f-fa91406794fa tempest-VolumesAdminNegativeTest-61932815 None] Volume 706bfec1-ba5b-4eed-852b-e0dc76090188: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-706bfec1-ba5b-4eed-852b-e0dc76090188', 'volume_size': 1} Sep 22 15:36:56 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-35139093-6122-4434-ae0f-fa91406794fa tempest-VolumesAdminNegativeTest-61932815 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:36:56 devstack sudo[87423]: pam_unix(sudo:session): session closed for user root Sep 22 15:36:56 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-aef1272f-a1f7-40db-9b4c-644597f4b88c tempest-DeleteServersTestJSON-1163871358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2c4354f3-fcde-4466-ac75-85bf923adc93" returned: 0 in 0.719s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:36:56 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-aef1272f-a1f7-40db-9b4c-644597f4b88c tempest-DeleteServersTestJSON-1163871358 None] <== create_volume: return (2533ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'} {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 15:36:56 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-aef1272f-a1f7-40db-9b4c-644597f4b88c tempest-DeleteServersTestJSON-1163871358 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.537s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:36:56 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-35139093-6122-4434-ae0f-fa91406794fa tempest-VolumesAdminNegativeTest-61932815 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.538s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:36:56 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-35139093-6122-4434-ae0f-fa91406794fa tempest-VolumesAdminNegativeTest-61932815 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:36:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-252046567',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=706bfec1-ba5b-4eed-852b-e0dc76090188,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='288e5e394af845a0b3b0b267b983b2cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:36:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:36:56Z,use_quota=True,user_id='00ca4140e28c406797b0ebc5097c6993',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)}" {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 15:36:56 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-35139093-6122-4434-ae0f-fa91406794fa tempest-VolumesAdminNegativeTest-61932815 None] Creating volume 706bfec1-ba5b-4eed-852b-e0dc76090188 {{(pid=86212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 15:36:56 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-35139093-6122-4434-ae0f-fa91406794fa tempest-VolumesAdminNegativeTest-61932815 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:36:56 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-35139093-6122-4434-ae0f-fa91406794fa tempest-VolumesAdminNegativeTest-61932815 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:36:56 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-35139093-6122-4434-ae0f-fa91406794fa tempest-VolumesAdminNegativeTest-61932815 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:36:56 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-35139093-6122-4434-ae0f-fa91406794fa tempest-VolumesAdminNegativeTest-61932815 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:36:56 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-35139093-6122-4434-ae0f-fa91406794fa tempest-VolumesAdminNegativeTest-61932815 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:36:56 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-35139093-6122-4434-ae0f-fa91406794fa tempest-VolumesAdminNegativeTest-61932815 None] Selected osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 as target Quobyte volume. {{(pid=86212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 15:36:56 devstack cinder-volume[86212]: INFO cinder.volume.drivers.remotefs [None req-35139093-6122-4434-ae0f-fa91406794fa tempest-VolumesAdminNegativeTest-61932815 None] casted to osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 Sep 22 15:36:56 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-35139093-6122-4434-ae0f-fa91406794fa tempest-VolumesAdminNegativeTest-61932815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-706bfec1-ba5b-4eed-852b-e0dc76090188 1073741824 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:36:56 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-aef1272f-a1f7-40db-9b4c-644597f4b88c tempest-DeleteServersTestJSON-1163871358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3133f129-7928-46f0-ab5e-0ee93a2c85ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2c4354f3-fcde-4466-ac75-85bf923adc93', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:36:56 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-aef1272f-a1f7-40db-9b4c-644597f4b88c tempest-DeleteServersTestJSON-1163871358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38c151ca-b764-4581-b6dd-979b98c72b17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:36:56 devstack sudo[87427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-706bfec1-ba5b-4eed-852b-e0dc76090188 1073741824 Sep 22 15:36:56 devstack sudo[87427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:36:56 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-aef1272f-a1f7-40db-9b4c-644597f4b88c tempest-DeleteServersTestJSON-1163871358 None] Volume volume-2c4354f3-fcde-4466-ac75-85bf923adc93 (2c4354f3-fcde-4466-ac75-85bf923adc93): created successfully Sep 22 15:36:56 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-aef1272f-a1f7-40db-9b4c-644597f4b88c tempest-DeleteServersTestJSON-1163871358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38c151ca-b764-4581-b6dd-979b98c72b17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:36:56 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-aef1272f-a1f7-40db-9b4c-644597f4b88c tempest-DeleteServersTestJSON-1163871358 None] Flow 'volume_create_manager' (bb8f8901-46a2-4dd3-9bb6-0ec636d79ec5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:36:56 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-aef1272f-a1f7-40db-9b4c-644597f4b88c tempest-DeleteServersTestJSON-1163871358 None] Created volume successfully. Sep 22 15:36:58 devstack sudo[87427]: pam_unix(sudo:session): session closed for user root Sep 22 15:36:58 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-35139093-6122-4434-ae0f-fa91406794fa tempest-VolumesAdminNegativeTest-61932815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-706bfec1-ba5b-4eed-852b-e0dc76090188 1073741824" returned: 0 in 1.397s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:36:58 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-35139093-6122-4434-ae0f-fa91406794fa tempest-VolumesAdminNegativeTest-61932815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-706bfec1-ba5b-4eed-852b-e0dc76090188 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:36:58 devstack sudo[87436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-706bfec1-ba5b-4eed-852b-e0dc76090188 Sep 22 15:36:58 devstack sudo[87436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:36:58 devstack sudo[87436]: pam_unix(sudo:session): session closed for user root Sep 22 15:36:58 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-35139093-6122-4434-ae0f-fa91406794fa tempest-VolumesAdminNegativeTest-61932815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-706bfec1-ba5b-4eed-852b-e0dc76090188" returned: 0 in 0.513s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:36:58 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-35139093-6122-4434-ae0f-fa91406794fa tempest-VolumesAdminNegativeTest-61932815 None] <== create_volume: return (2069ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'} {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 15:36:58 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-35139093-6122-4434-ae0f-fa91406794fa tempest-VolumesAdminNegativeTest-61932815 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.076s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:36:58 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-35139093-6122-4434-ae0f-fa91406794fa tempest-VolumesAdminNegativeTest-61932815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (606d07f4-cb79-477e-9851-80e6f5b20c24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-706bfec1-ba5b-4eed-852b-e0dc76090188', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:36:58 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-35139093-6122-4434-ae0f-fa91406794fa tempest-VolumesAdminNegativeTest-61932815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (daf0dfd6-38f4-49e7-a857-56bf145ea7ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:36:58 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-35139093-6122-4434-ae0f-fa91406794fa tempest-VolumesAdminNegativeTest-61932815 None] Volume volume-706bfec1-ba5b-4eed-852b-e0dc76090188 (706bfec1-ba5b-4eed-852b-e0dc76090188): created successfully Sep 22 15:36:58 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-35139093-6122-4434-ae0f-fa91406794fa tempest-VolumesAdminNegativeTest-61932815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (daf0dfd6-38f4-49e7-a857-56bf145ea7ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:36:58 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-35139093-6122-4434-ae0f-fa91406794fa tempest-VolumesAdminNegativeTest-61932815 None] Flow 'volume_create_manager' (9a30eac9-6c80-467a-bc4f-16b988138b1d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:36:58 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-35139093-6122-4434-ae0f-fa91406794fa tempest-VolumesAdminNegativeTest-61932815 None] Created volume successfully. Sep 22 15:37:01 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-76771779-a0a3-4213-8362-90558c9fcdc7 tempest-VolumesAdminNegativeTest-61932815 None] Acquiring lock "cinder-706bfec1-ba5b-4eed-852b-e0dc76090188-delete_volume" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:37:01 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-76771779-a0a3-4213-8362-90558c9fcdc7 tempest-VolumesAdminNegativeTest-61932815 None] Lock "cinder-706bfec1-ba5b-4eed-852b-e0dc76090188-delete_volume" acquired by "delete_volume" :: waited 0.108s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:37:02 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-76771779-a0a3-4213-8362-90558c9fcdc7 tempest-VolumesAdminNegativeTest-61932815 None] Acquiring lock "cinder-quobyte-706bfec1-ba5b-4eed-852b-e0dc76090188" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:37:02 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-76771779-a0a3-4213-8362-90558c9fcdc7 tempest-VolumesAdminNegativeTest-61932815 None] Lock "cinder-quobyte-706bfec1-ba5b-4eed-852b-e0dc76090188" acquired by "delete_volume" :: waited 0.059s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:37:02 devstack cinder-volume[86212]: INFO oslo.privsep.daemon [None req-76771779-a0a3-4213-8362-90558c9fcdc7 tempest-VolumesAdminNegativeTest-61932815 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpjifgw6my/privsep.sock'] Sep 22 15:37:02 devstack sudo[87520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpjifgw6my/privsep.sock Sep 22 15:37:02 devstack sudo[87520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:37:04 devstack cinder-volume[86212]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Sep 22 15:37:04 devstack cinder-volume[86212]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 22 15:37:04 devstack cinder-volume[86212]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Sep 22 15:37:04 devstack cinder-volume[86212]: WARNING oslo.privsep.daemon [-] privsep log: Sep 22 15:37:04 devstack cinder-volume[86212]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Sep 22 15:37:04 devstack cinder-volume[86212]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Sep 22 15:37:04 devstack cinder-volume[86212]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 22 15:37:04 devstack cinder-volume[86212]: WARNING oslo.privsep.daemon [-] privsep log: Sep 22 15:37:04 devstack cinder-volume[86212]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Sep 22 15:37:04 devstack sudo[87520]: pam_unix(sudo:session): session closed for user root Sep 22 15:37:04 devstack cinder-volume[86212]: INFO oslo.privsep.daemon [None req-76771779-a0a3-4213-8362-90558c9fcdc7 tempest-VolumesAdminNegativeTest-61932815 None] Spawned new privsep daemon via rootwrap Sep 22 15:37:04 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [None req-76771779-a0a3-4213-8362-90558c9fcdc7 tempest-VolumesAdminNegativeTest-61932815 None] Accepted privsep connection to /tmp/tmpjifgw6my/privsep.sock {{(pid=86212) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Sep 22 15:37:04 devstack cinder-volume[86212]: INFO oslo.privsep.daemon [-] privsep daemon starting Sep 22 15:37:04 devstack cinder-volume[86212]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Sep 22 15:37:04 devstack cinder-volume[86212]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Sep 22 15:37:04 devstack cinder-volume[86212]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 87530 Sep 22 15:37:04 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ce22268-43bf-449f-87ea-739b0a243e26]: (2,) {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:37:04 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1bf5b8d-e064-41d1-a7b2-ae0333952a2b]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:37:04 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-76771779-a0a3-4213-8362-90558c9fcdc7 tempest-VolumesAdminNegativeTest-61932815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-706bfec1-ba5b-4eed-852b-e0dc76090188 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:37:04 devstack sudo[87532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-706bfec1-ba5b-4eed-852b-e0dc76090188 Sep 22 15:37:04 devstack sudo[87532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:37:05 devstack sudo[87532]: pam_unix(sudo:session): session closed for user root Sep 22 15:37:05 devstack cinder-volume[86212]: WARNING py.warnings [req-fe88312b-1907-4b37-aff1-cbf2a2d984ee req-06915b73-f606-4620-bc84-4171bc580216 tempest-DeleteServersTestJSON-1163871358 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes_1", "volume_attachment" and FROM element "volumes". Apply join condition(s) between each element to resolve. Sep 22 15:37:05 devstack cinder-volume[86212]: .first() Sep 22 15:37:05 devstack cinder-volume[86212]: Sep 22 15:37:05 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-76771779-a0a3-4213-8362-90558c9fcdc7 tempest-VolumesAdminNegativeTest-61932815 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-706bfec1-ba5b-4eed-852b-e0dc76090188" returned: 0 in 1.229s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:37:05 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-76771779-a0a3-4213-8362-90558c9fcdc7 tempest-VolumesAdminNegativeTest-61932815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-706bfec1-ba5b-4eed-852b-e0dc76090188 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:37:05 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [req-fe88312b-1907-4b37-aff1-cbf2a2d984ee req-06915b73-f606-4620-bc84-4171bc580216 tempest-DeleteServersTestJSON-1163871358 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:37:05 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [req-fe88312b-1907-4b37-aff1-cbf2a2d984ee req-06915b73-f606-4620-bc84-4171bc580216 tempest-DeleteServersTestJSON-1163871358 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:37:06 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [req-fe88312b-1907-4b37-aff1-cbf2a2d984ee req-06915b73-f606-4620-bc84-4171bc580216 tempest-DeleteServersTestJSON-1163871358 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:37:06 devstack sudo[87549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-706bfec1-ba5b-4eed-852b-e0dc76090188 Sep 22 15:37:06 devstack sudo[87549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:37:06 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [req-fe88312b-1907-4b37-aff1-cbf2a2d984ee req-06915b73-f606-4620-bc84-4171bc580216 tempest-DeleteServersTestJSON-1163871358 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31', 'name': 'volume-2c4354f3-fcde-4466-ac75-85bf923adc93', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '86eadcae-712f-4ea2-a87a-3b28ccf1748b', 'enforce_multipath': True} {{(pid=86212) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 22 15:37:06 devstack cinder-volume[86212]: INFO cinder.volume.manager [req-fe88312b-1907-4b37-aff1-cbf2a2d984ee req-06915b73-f606-4620-bc84-4171bc580216 tempest-DeleteServersTestJSON-1163871358 None] attachment_update completed successfully. Sep 22 15:37:06 devstack sudo[87549]: pam_unix(sudo:session): session closed for user root Sep 22 15:37:06 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-76771779-a0a3-4213-8362-90558c9fcdc7 tempest-VolumesAdminNegativeTest-61932815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-706bfec1-ba5b-4eed-852b-e0dc76090188" returned: 0 in 0.693s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:37:06 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-76771779-a0a3-4213-8362-90558c9fcdc7 tempest-VolumesAdminNegativeTest-61932815 None] Lock "cinder-quobyte-706bfec1-ba5b-4eed-852b-e0dc76090188" released by "delete_volume" :: held 4.536s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:37:06 devstack cinder-volume[86212]: WARNING cinder.quota [None req-76771779-a0a3-4213-8362-90558c9fcdc7 tempest-VolumesAdminNegativeTest-61932815 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 22 15:37:06 devstack cinder-volume[86212]: WARNING cinder.quota [None req-76771779-a0a3-4213-8362-90558c9fcdc7 tempest-VolumesAdminNegativeTest-61932815 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 22 15:37:06 devstack cinder-volume[86212]: DEBUG cinder.quota [None req-76771779-a0a3-4213-8362-90558c9fcdc7 tempest-VolumesAdminNegativeTest-61932815 None] Created reservations ['a46eb7b8-32f8-4b28-8b9d-c9e7dd21b6e2', '85648c7b-44da-43e1-88b5-c4da7e1770a2', 'b6743305-0d47-4f19-810f-4e8c2b6d3adb', 'cb5d9ee7-c6fd-41f4-973b-235b2eacb57f'] {{(pid=86212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 15:37:07 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-76771779-a0a3-4213-8362-90558c9fcdc7 tempest-VolumesAdminNegativeTest-61932815 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:37:07 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-76771779-a0a3-4213-8362-90558c9fcdc7 tempest-VolumesAdminNegativeTest-61932815 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:37:07 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-76771779-a0a3-4213-8362-90558c9fcdc7 tempest-VolumesAdminNegativeTest-61932815 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:37:07 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-76771779-a0a3-4213-8362-90558c9fcdc7 tempest-VolumesAdminNegativeTest-61932815 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:37:07 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-76771779-a0a3-4213-8362-90558c9fcdc7 tempest-VolumesAdminNegativeTest-61932815 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.055s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:37:07 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-76771779-a0a3-4213-8362-90558c9fcdc7 tempest-VolumesAdminNegativeTest-61932815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:37:07 devstack sudo[87655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc Sep 22 15:37:07 devstack sudo[87655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:37:08 devstack sudo[87655]: pam_unix(sudo:session): session closed for user root Sep 22 15:37:08 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-76771779-a0a3-4213-8362-90558c9fcdc7 tempest-VolumesAdminNegativeTest-61932815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc" returned: 0 in 1.056s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:37:08 devstack cinder-volume[86212]: DEBUG cinder.manager [None req-76771779-a0a3-4213-8362-90558c9fcdc7 tempest-VolumesAdminNegativeTest-61932815 None] Notifying Schedulers of capabilities ... {{(pid=86212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 15:37:08 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-76771779-a0a3-4213-8362-90558c9fcdc7 tempest-VolumesAdminNegativeTest-61932815 None] Deleted volume successfully. Sep 22 15:37:08 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-76771779-a0a3-4213-8362-90558c9fcdc7 tempest-VolumesAdminNegativeTest-61932815 None] Lock "cinder-706bfec1-ba5b-4eed-852b-e0dc76090188-delete_volume" released by "delete_volume" :: held 6.693s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:37:14 devstack cinder-volume[86212]: INFO cinder.volume.manager [req-2136b54b-3bcd-4643-8c30-90ce3c0112a6 req-c4ba7477-e47a-448d-ba3e-ed7d6fc3c862 tempest-DeleteServersTestJSON-1163871358 None] Terminate volume connection completed successfully. Sep 22 15:37:14 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [req-2136b54b-3bcd-4643-8c30-90ce3c0112a6 req-c4ba7477-e47a-448d-ba3e-ed7d6fc3c862 tempest-DeleteServersTestJSON-1163871358 None] Deleting attachment 86eadcae-712f-4ea2-a87a-3b28ccf1748b. {{(pid=86212) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 22 15:37:15 devstack cinder-volume[86212]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc342f1f-9bb4-4e6f-82e6-102c2491bbc6 tempest-ServersNegativeTestJSON-1813647821 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 15:37:15 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-dc342f1f-9bb4-4e6f-82e6-102c2491bbc6 tempest-ServersNegativeTestJSON-1813647821 None] Flow 'volume_create_manager' (a2ddeffe-316c-47f9-8f95-718d1acb0518) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:37:15 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-dc342f1f-9bb4-4e6f-82e6-102c2491bbc6 tempest-ServersNegativeTestJSON-1813647821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abf0325b-3377-4c2d-93df-cf9b8904dea3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:37:15 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-dc342f1f-9bb4-4e6f-82e6-102c2491bbc6 tempest-ServersNegativeTestJSON-1813647821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abf0325b-3377-4c2d-93df-cf9b8904dea3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:37:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-154347787',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23dd9adc-8eca-4ce7-8b51-2699e20bf14a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b84fa5a10e284c559d37b3f02b6c60ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:37:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:37:15Z,use_quota=True,user_id='51c1de403544493b9dd17f0e7f0c06f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:37:15 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-dc342f1f-9bb4-4e6f-82e6-102c2491bbc6 tempest-ServersNegativeTestJSON-1813647821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d5c28e9-e199-4bc5-be34-ec0bf35c2dd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:37:15 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-dc342f1f-9bb4-4e6f-82e6-102c2491bbc6 tempest-ServersNegativeTestJSON-1813647821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d5c28e9-e199-4bc5-be34-ec0bf35c2dd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:37:15 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-dc342f1f-9bb4-4e6f-82e6-102c2491bbc6 tempest-ServersNegativeTestJSON-1813647821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1db7c7d-6452-41ea-81a2-d99e3ab15b0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:37:15 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-dc342f1f-9bb4-4e6f-82e6-102c2491bbc6 tempest-ServersNegativeTestJSON-1813647821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1db7c7d-6452-41ea-81a2-d99e3ab15b0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '23dd9adc-8eca-4ce7-8b51-2699e20bf14a', 'volume_name': 'volume-23dd9adc-8eca-4ce7-8b51-2699e20bf14a', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:37:15 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-dc342f1f-9bb4-4e6f-82e6-102c2491bbc6 tempest-ServersNegativeTestJSON-1813647821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (409ffbe1-cfb9-4c4b-bb72-a51bef0530a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:37:15 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-dc342f1f-9bb4-4e6f-82e6-102c2491bbc6 tempest-ServersNegativeTestJSON-1813647821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (409ffbe1-cfb9-4c4b-bb72-a51bef0530a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:37:15 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-dc342f1f-9bb4-4e6f-82e6-102c2491bbc6 tempest-ServersNegativeTestJSON-1813647821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e308fd45-7b63-4646-a3b7-267168ee2b06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:37:15 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-dc342f1f-9bb4-4e6f-82e6-102c2491bbc6 tempest-ServersNegativeTestJSON-1813647821 None] Volume 23dd9adc-8eca-4ce7-8b51-2699e20bf14a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-23dd9adc-8eca-4ce7-8b51-2699e20bf14a', 'volume_size': 1} Sep 22 15:37:15 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-dc342f1f-9bb4-4e6f-82e6-102c2491bbc6 tempest-ServersNegativeTestJSON-1813647821 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:37:15 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-dc342f1f-9bb4-4e6f-82e6-102c2491bbc6 tempest-ServersNegativeTestJSON-1813647821 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:37:15 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-dc342f1f-9bb4-4e6f-82e6-102c2491bbc6 tempest-ServersNegativeTestJSON-1813647821 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:37:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-154347787',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23dd9adc-8eca-4ce7-8b51-2699e20bf14a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b84fa5a10e284c559d37b3f02b6c60ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:37:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:37:15Z,use_quota=True,user_id='51c1de403544493b9dd17f0e7f0c06f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)}" {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 15:37:15 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-dc342f1f-9bb4-4e6f-82e6-102c2491bbc6 tempest-ServersNegativeTestJSON-1813647821 None] Creating volume 23dd9adc-8eca-4ce7-8b51-2699e20bf14a {{(pid=86212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 15:37:15 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-dc342f1f-9bb4-4e6f-82e6-102c2491bbc6 tempest-ServersNegativeTestJSON-1813647821 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:37:15 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-dc342f1f-9bb4-4e6f-82e6-102c2491bbc6 tempest-ServersNegativeTestJSON-1813647821 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:37:15 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-dc342f1f-9bb4-4e6f-82e6-102c2491bbc6 tempest-ServersNegativeTestJSON-1813647821 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:37:15 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-dc342f1f-9bb4-4e6f-82e6-102c2491bbc6 tempest-ServersNegativeTestJSON-1813647821 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:37:15 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-dc342f1f-9bb4-4e6f-82e6-102c2491bbc6 tempest-ServersNegativeTestJSON-1813647821 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:37:15 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-dc342f1f-9bb4-4e6f-82e6-102c2491bbc6 tempest-ServersNegativeTestJSON-1813647821 None] Selected osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 as target Quobyte volume. {{(pid=86212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 15:37:15 devstack cinder-volume[86212]: INFO cinder.volume.drivers.remotefs [None req-dc342f1f-9bb4-4e6f-82e6-102c2491bbc6 tempest-ServersNegativeTestJSON-1813647821 None] casted to osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 Sep 22 15:37:15 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-dc342f1f-9bb4-4e6f-82e6-102c2491bbc6 tempest-ServersNegativeTestJSON-1813647821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-23dd9adc-8eca-4ce7-8b51-2699e20bf14a 1073741824 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:37:15 devstack sudo[88111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-23dd9adc-8eca-4ce7-8b51-2699e20bf14a 1073741824 Sep 22 15:37:15 devstack sudo[88111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:37:16 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-6b575b10-42f8-4944-91fe-58b36bdd1a2c tempest-DeleteServersTestJSON-1163871358 None] Acquiring lock "cinder-2c4354f3-fcde-4466-ac75-85bf923adc93-delete_volume" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:37:16 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-6b575b10-42f8-4944-91fe-58b36bdd1a2c tempest-DeleteServersTestJSON-1163871358 None] Lock "cinder-2c4354f3-fcde-4466-ac75-85bf923adc93-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:37:16 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-6b575b10-42f8-4944-91fe-58b36bdd1a2c tempest-DeleteServersTestJSON-1163871358 None] Acquiring lock "cinder-quobyte-2c4354f3-fcde-4466-ac75-85bf923adc93" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:37:16 devstack sudo[88111]: pam_unix(sudo:session): session closed for user root Sep 22 15:37:16 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-dc342f1f-9bb4-4e6f-82e6-102c2491bbc6 tempest-ServersNegativeTestJSON-1813647821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-23dd9adc-8eca-4ce7-8b51-2699e20bf14a 1073741824" returned: 0 in 0.641s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:37:16 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-6b575b10-42f8-4944-91fe-58b36bdd1a2c tempest-DeleteServersTestJSON-1163871358 None] Lock "cinder-quobyte-2c4354f3-fcde-4466-ac75-85bf923adc93" acquired by "delete_volume" :: waited 0.022s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:37:16 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[28f0b000-8d4e-4364-bd7a-5098e2cf26e4]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:37:16 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-6b575b10-42f8-4944-91fe-58b36bdd1a2c tempest-DeleteServersTestJSON-1163871358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2c4354f3-fcde-4466-ac75-85bf923adc93 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:37:16 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-dc342f1f-9bb4-4e6f-82e6-102c2491bbc6 tempest-ServersNegativeTestJSON-1813647821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-23dd9adc-8eca-4ce7-8b51-2699e20bf14a {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:37:16 devstack sudo[88118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-23dd9adc-8eca-4ce7-8b51-2699e20bf14a Sep 22 15:37:16 devstack sudo[88118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:37:16 devstack sudo[88117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2c4354f3-fcde-4466-ac75-85bf923adc93 Sep 22 15:37:16 devstack sudo[88117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:37:16 devstack sudo[88118]: pam_unix(sudo:session): session closed for user root Sep 22 15:37:16 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-dc342f1f-9bb4-4e6f-82e6-102c2491bbc6 tempest-ServersNegativeTestJSON-1813647821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-23dd9adc-8eca-4ce7-8b51-2699e20bf14a" returned: 0 in 0.286s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:37:16 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-dc342f1f-9bb4-4e6f-82e6-102c2491bbc6 tempest-ServersNegativeTestJSON-1813647821 None] <== create_volume: return (1032ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'} {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 15:37:16 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-dc342f1f-9bb4-4e6f-82e6-102c2491bbc6 tempest-ServersNegativeTestJSON-1813647821 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.036s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:37:16 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-dc342f1f-9bb4-4e6f-82e6-102c2491bbc6 tempest-ServersNegativeTestJSON-1813647821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e308fd45-7b63-4646-a3b7-267168ee2b06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23dd9adc-8eca-4ce7-8b51-2699e20bf14a', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:37:16 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-dc342f1f-9bb4-4e6f-82e6-102c2491bbc6 tempest-ServersNegativeTestJSON-1813647821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac271f49-7bfb-43f7-b614-121cae2b8e34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:37:16 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-dc342f1f-9bb4-4e6f-82e6-102c2491bbc6 tempest-ServersNegativeTestJSON-1813647821 None] Volume volume-23dd9adc-8eca-4ce7-8b51-2699e20bf14a (23dd9adc-8eca-4ce7-8b51-2699e20bf14a): created successfully Sep 22 15:37:16 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-dc342f1f-9bb4-4e6f-82e6-102c2491bbc6 tempest-ServersNegativeTestJSON-1813647821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac271f49-7bfb-43f7-b614-121cae2b8e34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:37:16 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-dc342f1f-9bb4-4e6f-82e6-102c2491bbc6 tempest-ServersNegativeTestJSON-1813647821 None] Flow 'volume_create_manager' (a2ddeffe-316c-47f9-8f95-718d1acb0518) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:37:16 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-dc342f1f-9bb4-4e6f-82e6-102c2491bbc6 tempest-ServersNegativeTestJSON-1813647821 None] Created volume successfully. Sep 22 15:37:16 devstack sudo[88117]: pam_unix(sudo:session): session closed for user root Sep 22 15:37:16 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-6b575b10-42f8-4944-91fe-58b36bdd1a2c tempest-DeleteServersTestJSON-1163871358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2c4354f3-fcde-4466-ac75-85bf923adc93" returned: 0 in 0.550s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:37:16 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-6b575b10-42f8-4944-91fe-58b36bdd1a2c tempest-DeleteServersTestJSON-1163871358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2c4354f3-fcde-4466-ac75-85bf923adc93 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:37:16 devstack sudo[88126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2c4354f3-fcde-4466-ac75-85bf923adc93 Sep 22 15:37:16 devstack sudo[88126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:37:17 devstack sudo[88126]: pam_unix(sudo:session): session closed for user root Sep 22 15:37:17 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-6b575b10-42f8-4944-91fe-58b36bdd1a2c tempest-DeleteServersTestJSON-1163871358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2c4354f3-fcde-4466-ac75-85bf923adc93" returned: 0 in 0.244s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:37:17 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-6b575b10-42f8-4944-91fe-58b36bdd1a2c tempest-DeleteServersTestJSON-1163871358 None] Lock "cinder-quobyte-2c4354f3-fcde-4466-ac75-85bf923adc93" released by "delete_volume" :: held 0.862s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:37:17 devstack cinder-volume[86212]: DEBUG cinder.quota [None req-6b575b10-42f8-4944-91fe-58b36bdd1a2c tempest-DeleteServersTestJSON-1163871358 None] Created reservations ['038c169b-9e8b-472a-92bc-e662e15a0011', '6fba7c02-70fe-486e-9b27-3c244ea3e8ac', 'e0ee9f09-f213-479f-a98f-9bdaf0e74ff4', 'c514c7b5-bc2b-4dd1-807e-de6f63cd2210'] {{(pid=86212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 15:37:17 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-6b575b10-42f8-4944-91fe-58b36bdd1a2c tempest-DeleteServersTestJSON-1163871358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:37:17 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-6b575b10-42f8-4944-91fe-58b36bdd1a2c tempest-DeleteServersTestJSON-1163871358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:37:17 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-6b575b10-42f8-4944-91fe-58b36bdd1a2c tempest-DeleteServersTestJSON-1163871358 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:37:17 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-6b575b10-42f8-4944-91fe-58b36bdd1a2c tempest-DeleteServersTestJSON-1163871358 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:37:17 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-6b575b10-42f8-4944-91fe-58b36bdd1a2c tempest-DeleteServersTestJSON-1163871358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:37:17 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-6b575b10-42f8-4944-91fe-58b36bdd1a2c tempest-DeleteServersTestJSON-1163871358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:37:17 devstack sudo[88129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc Sep 22 15:37:17 devstack sudo[88129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:37:17 devstack sudo[88129]: pam_unix(sudo:session): session closed for user root Sep 22 15:37:17 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-6b575b10-42f8-4944-91fe-58b36bdd1a2c tempest-DeleteServersTestJSON-1163871358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc" returned: 0 in 0.351s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:37:17 devstack cinder-volume[86212]: DEBUG cinder.manager [None req-6b575b10-42f8-4944-91fe-58b36bdd1a2c tempest-DeleteServersTestJSON-1163871358 None] Notifying Schedulers of capabilities ... {{(pid=86212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 15:37:17 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-6b575b10-42f8-4944-91fe-58b36bdd1a2c tempest-DeleteServersTestJSON-1163871358 None] Deleted volume successfully. Sep 22 15:37:17 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-6b575b10-42f8-4944-91fe-58b36bdd1a2c tempest-DeleteServersTestJSON-1163871358 None] Lock "cinder-2c4354f3-fcde-4466-ac75-85bf923adc93-delete_volume" released by "delete_volume" :: held 1.538s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:37:22 devstack cinder-volume[86212]: DEBUG cinder.volume.flows.manager.create_volume [None req-b16718b1-e934-4ffd-980a-deb77da859f1 tempest-ServersNegativeTestJSON-1813647821 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 15:37:22 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-b16718b1-e934-4ffd-980a-deb77da859f1 tempest-ServersNegativeTestJSON-1813647821 None] Flow 'volume_create_manager' (e9b99411-5d77-4347-84de-9c000ea45ae6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:37:23 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-b16718b1-e934-4ffd-980a-deb77da859f1 tempest-ServersNegativeTestJSON-1813647821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5713432d-cdfd-4591-b63c-1305928e977a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:37:23 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-b16718b1-e934-4ffd-980a-deb77da859f1 tempest-ServersNegativeTestJSON-1813647821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5713432d-cdfd-4591-b63c-1305928e977a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:37:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-2040837239',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e63af8b2-0a0d-4cbc-b74d-0ae9619eb069,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b84fa5a10e284c559d37b3f02b6c60ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:37:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:37:23Z,use_quota=True,user_id='51c1de403544493b9dd17f0e7f0c06f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:37:23 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-b16718b1-e934-4ffd-980a-deb77da859f1 tempest-ServersNegativeTestJSON-1813647821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe64c066-b957-43ae-aaf8-8973a08f54ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:37:23 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-b16718b1-e934-4ffd-980a-deb77da859f1 tempest-ServersNegativeTestJSON-1813647821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe64c066-b957-43ae-aaf8-8973a08f54ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:37:23 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-b16718b1-e934-4ffd-980a-deb77da859f1 tempest-ServersNegativeTestJSON-1813647821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58b11747-805c-4346-81db-8fd869fd9f69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:37:23 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-b16718b1-e934-4ffd-980a-deb77da859f1 tempest-ServersNegativeTestJSON-1813647821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58b11747-805c-4346-81db-8fd869fd9f69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e63af8b2-0a0d-4cbc-b74d-0ae9619eb069', 'volume_name': 'volume-e63af8b2-0a0d-4cbc-b74d-0ae9619eb069', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:37:23 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-b16718b1-e934-4ffd-980a-deb77da859f1 tempest-ServersNegativeTestJSON-1813647821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (236ee932-1611-48f8-9ddd-dc2fdcb932a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:37:23 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-b16718b1-e934-4ffd-980a-deb77da859f1 tempest-ServersNegativeTestJSON-1813647821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (236ee932-1611-48f8-9ddd-dc2fdcb932a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:37:23 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-b16718b1-e934-4ffd-980a-deb77da859f1 tempest-ServersNegativeTestJSON-1813647821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27db1c96-1073-47b5-9ce6-89c173c29e94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:37:23 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-b16718b1-e934-4ffd-980a-deb77da859f1 tempest-ServersNegativeTestJSON-1813647821 None] Volume e63af8b2-0a0d-4cbc-b74d-0ae9619eb069: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e63af8b2-0a0d-4cbc-b74d-0ae9619eb069', 'volume_size': 1} Sep 22 15:37:23 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-b16718b1-e934-4ffd-980a-deb77da859f1 tempest-ServersNegativeTestJSON-1813647821 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:37:23 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-b16718b1-e934-4ffd-980a-deb77da859f1 tempest-ServersNegativeTestJSON-1813647821 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:37:23 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-b16718b1-e934-4ffd-980a-deb77da859f1 tempest-ServersNegativeTestJSON-1813647821 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:37:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-2040837239',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e63af8b2-0a0d-4cbc-b74d-0ae9619eb069,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b84fa5a10e284c559d37b3f02b6c60ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:37:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:37:23Z,use_quota=True,user_id='51c1de403544493b9dd17f0e7f0c06f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)}" {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 15:37:23 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-b16718b1-e934-4ffd-980a-deb77da859f1 tempest-ServersNegativeTestJSON-1813647821 None] Creating volume e63af8b2-0a0d-4cbc-b74d-0ae9619eb069 {{(pid=86212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 15:37:23 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-b16718b1-e934-4ffd-980a-deb77da859f1 tempest-ServersNegativeTestJSON-1813647821 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:37:23 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-b16718b1-e934-4ffd-980a-deb77da859f1 tempest-ServersNegativeTestJSON-1813647821 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:37:23 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-b16718b1-e934-4ffd-980a-deb77da859f1 tempest-ServersNegativeTestJSON-1813647821 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:37:23 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-b16718b1-e934-4ffd-980a-deb77da859f1 tempest-ServersNegativeTestJSON-1813647821 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:37:23 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-b16718b1-e934-4ffd-980a-deb77da859f1 tempest-ServersNegativeTestJSON-1813647821 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:37:23 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-b16718b1-e934-4ffd-980a-deb77da859f1 tempest-ServersNegativeTestJSON-1813647821 None] Selected osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 as target Quobyte volume. {{(pid=86212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 15:37:23 devstack cinder-volume[86212]: INFO cinder.volume.drivers.remotefs [None req-b16718b1-e934-4ffd-980a-deb77da859f1 tempest-ServersNegativeTestJSON-1813647821 None] casted to osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 Sep 22 15:37:23 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-b16718b1-e934-4ffd-980a-deb77da859f1 tempest-ServersNegativeTestJSON-1813647821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-e63af8b2-0a0d-4cbc-b74d-0ae9619eb069 1073741824 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:37:23 devstack sudo[88138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-e63af8b2-0a0d-4cbc-b74d-0ae9619eb069 1073741824 Sep 22 15:37:23 devstack sudo[88138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:37:23 devstack sudo[88138]: pam_unix(sudo:session): session closed for user root Sep 22 15:37:23 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-b16718b1-e934-4ffd-980a-deb77da859f1 tempest-ServersNegativeTestJSON-1813647821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-e63af8b2-0a0d-4cbc-b74d-0ae9619eb069 1073741824" returned: 0 in 0.568s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:37:23 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-b16718b1-e934-4ffd-980a-deb77da859f1 tempest-ServersNegativeTestJSON-1813647821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-e63af8b2-0a0d-4cbc-b74d-0ae9619eb069 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:37:23 devstack sudo[88144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-e63af8b2-0a0d-4cbc-b74d-0ae9619eb069 Sep 22 15:37:23 devstack sudo[88144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:37:24 devstack sudo[88144]: pam_unix(sudo:session): session closed for user root Sep 22 15:37:24 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-b16718b1-e934-4ffd-980a-deb77da859f1 tempest-ServersNegativeTestJSON-1813647821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-e63af8b2-0a0d-4cbc-b74d-0ae9619eb069" returned: 0 in 0.341s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:37:24 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-b16718b1-e934-4ffd-980a-deb77da859f1 tempest-ServersNegativeTestJSON-1813647821 None] <== create_volume: return (973ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'} {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 15:37:24 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-b16718b1-e934-4ffd-980a-deb77da859f1 tempest-ServersNegativeTestJSON-1813647821 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.976s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:37:24 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-b16718b1-e934-4ffd-980a-deb77da859f1 tempest-ServersNegativeTestJSON-1813647821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27db1c96-1073-47b5-9ce6-89c173c29e94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e63af8b2-0a0d-4cbc-b74d-0ae9619eb069', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:37:24 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-b16718b1-e934-4ffd-980a-deb77da859f1 tempest-ServersNegativeTestJSON-1813647821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df4bf461-2cb0-4f31-8072-b3fbdcf21959) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:37:24 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-b16718b1-e934-4ffd-980a-deb77da859f1 tempest-ServersNegativeTestJSON-1813647821 None] Volume volume-e63af8b2-0a0d-4cbc-b74d-0ae9619eb069 (e63af8b2-0a0d-4cbc-b74d-0ae9619eb069): created successfully Sep 22 15:37:24 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-b16718b1-e934-4ffd-980a-deb77da859f1 tempest-ServersNegativeTestJSON-1813647821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df4bf461-2cb0-4f31-8072-b3fbdcf21959) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:37:24 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-b16718b1-e934-4ffd-980a-deb77da859f1 tempest-ServersNegativeTestJSON-1813647821 None] Flow 'volume_create_manager' (e9b99411-5d77-4347-84de-9c000ea45ae6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:37:24 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-b16718b1-e934-4ffd-980a-deb77da859f1 tempest-ServersNegativeTestJSON-1813647821 None] Created volume successfully. Sep 22 15:37:25 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-9a202109-0fa3-4d5a-b4d0-49b26213fb01 tempest-ServersNegativeTestJSON-1813647821 None] Acquiring lock "cinder-e63af8b2-0a0d-4cbc-b74d-0ae9619eb069-delete_volume" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:37:25 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-9a202109-0fa3-4d5a-b4d0-49b26213fb01 tempest-ServersNegativeTestJSON-1813647821 None] Lock "cinder-e63af8b2-0a0d-4cbc-b74d-0ae9619eb069-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:37:25 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-9a202109-0fa3-4d5a-b4d0-49b26213fb01 tempest-ServersNegativeTestJSON-1813647821 None] Acquiring lock "cinder-quobyte-e63af8b2-0a0d-4cbc-b74d-0ae9619eb069" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:37:25 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-9a202109-0fa3-4d5a-b4d0-49b26213fb01 tempest-ServersNegativeTestJSON-1813647821 None] Lock "cinder-quobyte-e63af8b2-0a0d-4cbc-b74d-0ae9619eb069" acquired by "delete_volume" :: waited 0.031s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:37:25 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[79d9b22c-651c-418b-8e6a-1af658fe8463]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:37:25 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-9a202109-0fa3-4d5a-b4d0-49b26213fb01 tempest-ServersNegativeTestJSON-1813647821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-e63af8b2-0a0d-4cbc-b74d-0ae9619eb069 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:37:26 devstack sudo[88186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-e63af8b2-0a0d-4cbc-b74d-0ae9619eb069 Sep 22 15:37:26 devstack sudo[88186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:37:26 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-5d98c2bd-cb14-44af-b55c-9bd4811fb281 tempest-GroupsTest-999422492 None] Group tempest-Group1-277003004: creating Sep 22 15:37:26 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-5d98c2bd-cb14-44af-b55c-9bd4811fb281 tempest-GroupsTest-999422492 None] Group tempest-Group1-277003004: created successfully Sep 22 15:37:26 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-5d98c2bd-cb14-44af-b55c-9bd4811fb281 tempest-GroupsTest-999422492 None] Create group completed successfully. Sep 22 15:37:26 devstack sudo[88186]: pam_unix(sudo:session): session closed for user root Sep 22 15:37:26 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-9a202109-0fa3-4d5a-b4d0-49b26213fb01 tempest-ServersNegativeTestJSON-1813647821 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-e63af8b2-0a0d-4cbc-b74d-0ae9619eb069" returned: 0 in 0.719s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:37:26 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-9a202109-0fa3-4d5a-b4d0-49b26213fb01 tempest-ServersNegativeTestJSON-1813647821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-e63af8b2-0a0d-4cbc-b74d-0ae9619eb069 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:37:26 devstack sudo[88194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-e63af8b2-0a0d-4cbc-b74d-0ae9619eb069 Sep 22 15:37:26 devstack sudo[88194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:37:26 devstack sudo[88194]: pam_unix(sudo:session): session closed for user root Sep 22 15:37:26 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-9a202109-0fa3-4d5a-b4d0-49b26213fb01 tempest-ServersNegativeTestJSON-1813647821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-e63af8b2-0a0d-4cbc-b74d-0ae9619eb069" returned: 0 in 0.302s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:37:26 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-9a202109-0fa3-4d5a-b4d0-49b26213fb01 tempest-ServersNegativeTestJSON-1813647821 None] Lock "cinder-quobyte-e63af8b2-0a0d-4cbc-b74d-0ae9619eb069" released by "delete_volume" :: held 1.079s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:37:27 devstack cinder-volume[86212]: DEBUG cinder.quota [None req-9a202109-0fa3-4d5a-b4d0-49b26213fb01 tempest-ServersNegativeTestJSON-1813647821 None] Created reservations ['d37e75ea-19d2-4f13-b21d-6d1d8ce26a65', '1f15fca8-da02-4697-8abb-058ae9f77e2e', '8de81e25-a468-4f62-9535-5e06d3d689d2', '6ca76f89-72fd-445f-9145-7d14e40e4c2d'] {{(pid=86212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 15:37:27 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-9a202109-0fa3-4d5a-b4d0-49b26213fb01 tempest-ServersNegativeTestJSON-1813647821 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:37:27 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-9a202109-0fa3-4d5a-b4d0-49b26213fb01 tempest-ServersNegativeTestJSON-1813647821 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:37:27 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-9a202109-0fa3-4d5a-b4d0-49b26213fb01 tempest-ServersNegativeTestJSON-1813647821 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:37:27 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-9a202109-0fa3-4d5a-b4d0-49b26213fb01 tempest-ServersNegativeTestJSON-1813647821 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:37:27 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-9a202109-0fa3-4d5a-b4d0-49b26213fb01 tempest-ServersNegativeTestJSON-1813647821 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:37:27 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-9a202109-0fa3-4d5a-b4d0-49b26213fb01 tempest-ServersNegativeTestJSON-1813647821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:37:27 devstack sudo[88198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc Sep 22 15:37:27 devstack sudo[88198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:37:27 devstack sudo[88198]: pam_unix(sudo:session): session closed for user root Sep 22 15:37:27 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-9a202109-0fa3-4d5a-b4d0-49b26213fb01 tempest-ServersNegativeTestJSON-1813647821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc" returned: 0 in 0.278s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:37:27 devstack cinder-volume[86212]: DEBUG cinder.manager [None req-9a202109-0fa3-4d5a-b4d0-49b26213fb01 tempest-ServersNegativeTestJSON-1813647821 None] Notifying Schedulers of capabilities ... {{(pid=86212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 15:37:27 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-9a202109-0fa3-4d5a-b4d0-49b26213fb01 tempest-ServersNegativeTestJSON-1813647821 None] Deleted volume successfully. Sep 22 15:37:27 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-9a202109-0fa3-4d5a-b4d0-49b26213fb01 tempest-ServersNegativeTestJSON-1813647821 None] Lock "cinder-e63af8b2-0a0d-4cbc-b74d-0ae9619eb069-delete_volume" released by "delete_volume" :: held 1.614s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:37:27 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-9057bda1-a5bf-4f58-986a-87fb4c2db82e tempest-GroupsTest-999422492 None] Group tempest-Group2-1520584491: creating Sep 22 15:37:27 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-9057bda1-a5bf-4f58-986a-87fb4c2db82e tempest-GroupsTest-999422492 None] Group tempest-Group2-1520584491: created successfully Sep 22 15:37:27 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-9057bda1-a5bf-4f58-986a-87fb4c2db82e tempest-GroupsTest-999422492 None] Create group completed successfully. Sep 22 15:37:28 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-e5d75e68-b0be-4878-9dda-8599fb0533eb tempest-ServersNegativeTestJSON-1813647821 None] Acquiring lock "cinder-23dd9adc-8eca-4ce7-8b51-2699e20bf14a-delete_volume" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:37:28 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-e5d75e68-b0be-4878-9dda-8599fb0533eb tempest-ServersNegativeTestJSON-1813647821 None] Lock "cinder-23dd9adc-8eca-4ce7-8b51-2699e20bf14a-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:37:28 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-e5d75e68-b0be-4878-9dda-8599fb0533eb tempest-ServersNegativeTestJSON-1813647821 None] Acquiring lock "cinder-quobyte-23dd9adc-8eca-4ce7-8b51-2699e20bf14a" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:37:28 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-e5d75e68-b0be-4878-9dda-8599fb0533eb tempest-ServersNegativeTestJSON-1813647821 None] Lock "cinder-quobyte-23dd9adc-8eca-4ce7-8b51-2699e20bf14a" acquired by "delete_volume" :: waited 0.024s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:37:28 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[837ac4c8-ffb5-438d-b208-15b97c03894f]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:37:28 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-e5d75e68-b0be-4878-9dda-8599fb0533eb tempest-ServersNegativeTestJSON-1813647821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-23dd9adc-8eca-4ce7-8b51-2699e20bf14a {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:37:28 devstack sudo[88203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-23dd9adc-8eca-4ce7-8b51-2699e20bf14a Sep 22 15:37:28 devstack sudo[88203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:37:28 devstack sudo[88203]: pam_unix(sudo:session): session closed for user root Sep 22 15:37:28 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-e5d75e68-b0be-4878-9dda-8599fb0533eb tempest-ServersNegativeTestJSON-1813647821 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-23dd9adc-8eca-4ce7-8b51-2699e20bf14a" returned: 0 in 0.430s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:37:28 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-e5d75e68-b0be-4878-9dda-8599fb0533eb tempest-ServersNegativeTestJSON-1813647821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-23dd9adc-8eca-4ce7-8b51-2699e20bf14a {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:37:28 devstack sudo[88218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-23dd9adc-8eca-4ce7-8b51-2699e20bf14a Sep 22 15:37:28 devstack sudo[88218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:37:29 devstack sudo[88218]: pam_unix(sudo:session): session closed for user root Sep 22 15:37:29 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-e5d75e68-b0be-4878-9dda-8599fb0533eb tempest-ServersNegativeTestJSON-1813647821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-23dd9adc-8eca-4ce7-8b51-2699e20bf14a" returned: 0 in 0.448s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:37:29 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-e5d75e68-b0be-4878-9dda-8599fb0533eb tempest-ServersNegativeTestJSON-1813647821 None] Lock "cinder-quobyte-23dd9adc-8eca-4ce7-8b51-2699e20bf14a" released by "delete_volume" :: held 0.959s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:37:29 devstack cinder-volume[86212]: DEBUG cinder.quota [None req-e5d75e68-b0be-4878-9dda-8599fb0533eb tempest-ServersNegativeTestJSON-1813647821 None] Created reservations ['ae9e0d45-d554-44f9-a15c-0ddf43e654b1', '0bf9c1f3-976c-4092-bfc4-2c5b638e5b9d', '2342e0e8-3bf7-4a5d-94a7-3dc54941e514', 'ab704347-60ce-44d9-bf83-43995413cf15'] {{(pid=86212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 15:37:29 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-e5d75e68-b0be-4878-9dda-8599fb0533eb tempest-ServersNegativeTestJSON-1813647821 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:37:29 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-e5d75e68-b0be-4878-9dda-8599fb0533eb tempest-ServersNegativeTestJSON-1813647821 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:37:29 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-e5d75e68-b0be-4878-9dda-8599fb0533eb tempest-ServersNegativeTestJSON-1813647821 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:37:29 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-e5d75e68-b0be-4878-9dda-8599fb0533eb tempest-ServersNegativeTestJSON-1813647821 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:37:29 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-e5d75e68-b0be-4878-9dda-8599fb0533eb tempest-ServersNegativeTestJSON-1813647821 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:37:29 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-e5d75e68-b0be-4878-9dda-8599fb0533eb tempest-ServersNegativeTestJSON-1813647821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:37:29 devstack sudo[88221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc Sep 22 15:37:29 devstack sudo[88221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:37:29 devstack cinder-volume[86212]: DEBUG cinder.volume.flows.manager.create_volume [None req-896e4823-07d5-49bf-a38b-02f4e9f1e246 tempest-GroupsTest-999422492 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 15:37:29 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-896e4823-07d5-49bf-a38b-02f4e9f1e246 tempest-GroupsTest-999422492 None] Flow 'volume_create_manager' (235a1800-c23f-40dd-95ff-aea275875406) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:37:29 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-896e4823-07d5-49bf-a38b-02f4e9f1e246 tempest-GroupsTest-999422492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (315e107f-46f3-471c-a9c2-e689a01d7e2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:37:29 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-896e4823-07d5-49bf-a38b-02f4e9f1e246 tempest-GroupsTest-999422492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (315e107f-46f3-471c-a9c2-e689a01d7e2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:37:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-977255522',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e6c0e695-851d-438a-a2f6-5ea965bd1b36,host='devstack@QuobyteHD#QuobyteHD',id=bf78434d-a1b7-4ae2-bea7-7957726a3b73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97c889f74d5644fba1c3aed9d51f1218',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:37:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:37:29Z,use_quota=True,user_id='ebc5896c543542baa45f0723c67d7003',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfbac6af-47d3-49ca-92f5-334f57d204f3),volume_type_id=cfbac6af-47d3-49ca-92f5-334f57d204f3)' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:37:29 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-896e4823-07d5-49bf-a38b-02f4e9f1e246 tempest-GroupsTest-999422492 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5ab1bb4-9839-475e-800c-5c42720b6f1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:37:29 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-896e4823-07d5-49bf-a38b-02f4e9f1e246 tempest-GroupsTest-999422492 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5ab1bb4-9839-475e-800c-5c42720b6f1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:37:29 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-896e4823-07d5-49bf-a38b-02f4e9f1e246 tempest-GroupsTest-999422492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ef03538-0b59-4145-bcca-83bd367189a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:37:29 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-896e4823-07d5-49bf-a38b-02f4e9f1e246 tempest-GroupsTest-999422492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ef03538-0b59-4145-bcca-83bd367189a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bf78434d-a1b7-4ae2-bea7-7957726a3b73', 'volume_name': 'volume-bf78434d-a1b7-4ae2-bea7-7957726a3b73', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:37:29 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-896e4823-07d5-49bf-a38b-02f4e9f1e246 tempest-GroupsTest-999422492 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (355aa0cb-224a-46bf-b601-507f709ba7ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:37:29 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-896e4823-07d5-49bf-a38b-02f4e9f1e246 tempest-GroupsTest-999422492 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (355aa0cb-224a-46bf-b601-507f709ba7ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:37:29 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-896e4823-07d5-49bf-a38b-02f4e9f1e246 tempest-GroupsTest-999422492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05298704-294e-4862-a902-4cae941f8bf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:37:29 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-896e4823-07d5-49bf-a38b-02f4e9f1e246 tempest-GroupsTest-999422492 None] Volume bf78434d-a1b7-4ae2-bea7-7957726a3b73: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bf78434d-a1b7-4ae2-bea7-7957726a3b73', 'volume_size': 1} Sep 22 15:37:29 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-896e4823-07d5-49bf-a38b-02f4e9f1e246 tempest-GroupsTest-999422492 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:37:29 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-896e4823-07d5-49bf-a38b-02f4e9f1e246 tempest-GroupsTest-999422492 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:37:29 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-896e4823-07d5-49bf-a38b-02f4e9f1e246 tempest-GroupsTest-999422492 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=e6c0e695-851d-438a-a2f6-5ea965bd1b36,created_at=2026-09-22T13:37:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-977255522',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e6c0e695-851d-438a-a2f6-5ea965bd1b36,host='devstack@QuobyteHD#QuobyteHD',id=bf78434d-a1b7-4ae2-bea7-7957726a3b73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97c889f74d5644fba1c3aed9d51f1218',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:37:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:37:29Z,use_quota=True,user_id='ebc5896c543542baa45f0723c67d7003',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfbac6af-47d3-49ca-92f5-334f57d204f3),volume_type_id=cfbac6af-47d3-49ca-92f5-334f57d204f3)}" {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 15:37:29 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-896e4823-07d5-49bf-a38b-02f4e9f1e246 tempest-GroupsTest-999422492 None] Creating volume bf78434d-a1b7-4ae2-bea7-7957726a3b73 {{(pid=86212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 15:37:29 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-896e4823-07d5-49bf-a38b-02f4e9f1e246 tempest-GroupsTest-999422492 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:37:29 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-896e4823-07d5-49bf-a38b-02f4e9f1e246 tempest-GroupsTest-999422492 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:37:29 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-896e4823-07d5-49bf-a38b-02f4e9f1e246 tempest-GroupsTest-999422492 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:37:29 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-896e4823-07d5-49bf-a38b-02f4e9f1e246 tempest-GroupsTest-999422492 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:37:29 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-896e4823-07d5-49bf-a38b-02f4e9f1e246 tempest-GroupsTest-999422492 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:37:29 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-896e4823-07d5-49bf-a38b-02f4e9f1e246 tempest-GroupsTest-999422492 None] Selected osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 as target Quobyte volume. {{(pid=86212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 15:37:29 devstack cinder-volume[86212]: INFO cinder.volume.drivers.remotefs [None req-896e4823-07d5-49bf-a38b-02f4e9f1e246 tempest-GroupsTest-999422492 None] casted to osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 Sep 22 15:37:29 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-896e4823-07d5-49bf-a38b-02f4e9f1e246 tempest-GroupsTest-999422492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-bf78434d-a1b7-4ae2-bea7-7957726a3b73 1073741824 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:37:29 devstack sudo[88224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-bf78434d-a1b7-4ae2-bea7-7957726a3b73 1073741824 Sep 22 15:37:29 devstack sudo[88224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:37:29 devstack sudo[88221]: pam_unix(sudo:session): session closed for user root Sep 22 15:37:29 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-e5d75e68-b0be-4878-9dda-8599fb0533eb tempest-ServersNegativeTestJSON-1813647821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc" returned: 0 in 0.386s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:37:29 devstack cinder-volume[86212]: DEBUG cinder.manager [None req-e5d75e68-b0be-4878-9dda-8599fb0533eb tempest-ServersNegativeTestJSON-1813647821 None] Notifying Schedulers of capabilities ... {{(pid=86212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 15:37:29 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-e5d75e68-b0be-4878-9dda-8599fb0533eb tempest-ServersNegativeTestJSON-1813647821 None] Deleted volume successfully. Sep 22 15:37:29 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-e5d75e68-b0be-4878-9dda-8599fb0533eb tempest-ServersNegativeTestJSON-1813647821 None] Lock "cinder-23dd9adc-8eca-4ce7-8b51-2699e20bf14a-delete_volume" released by "delete_volume" :: held 1.679s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:37:30 devstack sudo[88224]: pam_unix(sudo:session): session closed for user root Sep 22 15:37:30 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-896e4823-07d5-49bf-a38b-02f4e9f1e246 tempest-GroupsTest-999422492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-bf78434d-a1b7-4ae2-bea7-7957726a3b73 1073741824" returned: 0 in 0.589s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:37:30 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-896e4823-07d5-49bf-a38b-02f4e9f1e246 tempest-GroupsTest-999422492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-bf78434d-a1b7-4ae2-bea7-7957726a3b73 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:37:30 devstack sudo[88230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-bf78434d-a1b7-4ae2-bea7-7957726a3b73 Sep 22 15:37:30 devstack sudo[88230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:37:30 devstack sudo[88230]: pam_unix(sudo:session): session closed for user root Sep 22 15:37:30 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-896e4823-07d5-49bf-a38b-02f4e9f1e246 tempest-GroupsTest-999422492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-bf78434d-a1b7-4ae2-bea7-7957726a3b73" returned: 0 in 0.314s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:37:30 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-896e4823-07d5-49bf-a38b-02f4e9f1e246 tempest-GroupsTest-999422492 None] <== create_volume: return (962ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'} {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 15:37:30 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-896e4823-07d5-49bf-a38b-02f4e9f1e246 tempest-GroupsTest-999422492 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.973s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:37:30 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-896e4823-07d5-49bf-a38b-02f4e9f1e246 tempest-GroupsTest-999422492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05298704-294e-4862-a902-4cae941f8bf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf78434d-a1b7-4ae2-bea7-7957726a3b73', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:37:30 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-896e4823-07d5-49bf-a38b-02f4e9f1e246 tempest-GroupsTest-999422492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b18756a-8195-45bf-8d19-b6c4e71be0d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:37:30 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-896e4823-07d5-49bf-a38b-02f4e9f1e246 tempest-GroupsTest-999422492 None] Volume volume-bf78434d-a1b7-4ae2-bea7-7957726a3b73 (bf78434d-a1b7-4ae2-bea7-7957726a3b73): created successfully Sep 22 15:37:30 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-896e4823-07d5-49bf-a38b-02f4e9f1e246 tempest-GroupsTest-999422492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b18756a-8195-45bf-8d19-b6c4e71be0d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:37:30 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-896e4823-07d5-49bf-a38b-02f4e9f1e246 tempest-GroupsTest-999422492 None] Flow 'volume_create_manager' (235a1800-c23f-40dd-95ff-aea275875406) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:37:30 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-896e4823-07d5-49bf-a38b-02f4e9f1e246 tempest-GroupsTest-999422492 None] Created volume successfully. Sep 22 15:37:33 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-434a97af-0f7d-4881-b658-2ab1e8a03009 tempest-GroupsTest-999422492 None] Acquiring lock "cinder-quobyte-bf78434d-a1b7-4ae2-bea7-7957726a3b73" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:37:33 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-434a97af-0f7d-4881-b658-2ab1e8a03009 tempest-GroupsTest-999422492 None] Lock "cinder-quobyte-bf78434d-a1b7-4ae2-bea7-7957726a3b73" acquired by "delete_volume" :: waited 0.045s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:37:33 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[f09c5784-257a-4c3a-bcae-20bd95890f37]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:37:33 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-434a97af-0f7d-4881-b658-2ab1e8a03009 tempest-GroupsTest-999422492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-bf78434d-a1b7-4ae2-bea7-7957726a3b73 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:37:33 devstack sudo[88259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-bf78434d-a1b7-4ae2-bea7-7957726a3b73 Sep 22 15:37:33 devstack sudo[88259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:37:33 devstack sudo[88259]: pam_unix(sudo:session): session closed for user root Sep 22 15:37:33 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-434a97af-0f7d-4881-b658-2ab1e8a03009 tempest-GroupsTest-999422492 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-bf78434d-a1b7-4ae2-bea7-7957726a3b73" returned: 0 in 0.435s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:37:33 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-434a97af-0f7d-4881-b658-2ab1e8a03009 tempest-GroupsTest-999422492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-bf78434d-a1b7-4ae2-bea7-7957726a3b73 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:37:34 devstack sudo[88265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-bf78434d-a1b7-4ae2-bea7-7957726a3b73 Sep 22 15:37:34 devstack sudo[88265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:37:34 devstack sudo[88265]: pam_unix(sudo:session): session closed for user root Sep 22 15:37:34 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-434a97af-0f7d-4881-b658-2ab1e8a03009 tempest-GroupsTest-999422492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-bf78434d-a1b7-4ae2-bea7-7957726a3b73" returned: 0 in 0.343s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:37:34 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-434a97af-0f7d-4881-b658-2ab1e8a03009 tempest-GroupsTest-999422492 None] Lock "cinder-quobyte-bf78434d-a1b7-4ae2-bea7-7957726a3b73" released by "delete_volume" :: held 0.854s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:37:34 devstack cinder-volume[86212]: DEBUG cinder.quota [None req-434a97af-0f7d-4881-b658-2ab1e8a03009 tempest-GroupsTest-999422492 None] Created reservations ['073d3f88-4073-4e8c-a556-a200e24996a0'] {{(pid=86212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 15:37:34 devstack cinder-volume[86212]: WARNING cinder.quota [None req-434a97af-0f7d-4881-b658-2ab1e8a03009 tempest-GroupsTest-999422492 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-820553704 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-820553704, it is now deprecated. Please use the default quota class for default quota. Sep 22 15:37:34 devstack cinder-volume[86212]: WARNING cinder.quota [None req-434a97af-0f7d-4881-b658-2ab1e8a03009 tempest-GroupsTest-999422492 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-820553704 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-820553704, it is now deprecated. Please use the default quota class for default quota. Sep 22 15:37:34 devstack cinder-volume[86212]: DEBUG cinder.quota [None req-434a97af-0f7d-4881-b658-2ab1e8a03009 tempest-GroupsTest-999422492 None] Created reservations ['aa78f090-76d1-4712-aed6-f08a987834a0', '3718a164-3d45-4da4-a9ae-527864613663', '0489754d-eaa3-4ac3-b922-18bc7acb6536', 'ebcad555-7ba6-49ff-ac36-a4e66ac8d6a2'] {{(pid=86212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 15:37:34 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-434a97af-0f7d-4881-b658-2ab1e8a03009 tempest-GroupsTest-999422492 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:37:34 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-434a97af-0f7d-4881-b658-2ab1e8a03009 tempest-GroupsTest-999422492 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:37:34 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-434a97af-0f7d-4881-b658-2ab1e8a03009 tempest-GroupsTest-999422492 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:37:34 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-434a97af-0f7d-4881-b658-2ab1e8a03009 tempest-GroupsTest-999422492 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:37:34 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-434a97af-0f7d-4881-b658-2ab1e8a03009 tempest-GroupsTest-999422492 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:37:34 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-434a97af-0f7d-4881-b658-2ab1e8a03009 tempest-GroupsTest-999422492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:37:34 devstack sudo[88268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc Sep 22 15:37:34 devstack sudo[88268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:37:34 devstack cinder-volume[86212]: DEBUG cinder.quota [None req-26fed3b4-c44d-4c30-a9c4-69b835dc881c tempest-GroupsTest-999422492 None] Created reservations ['5cb1215f-2200-470f-8288-685e5df13032'] {{(pid=86212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 15:37:34 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-26fed3b4-c44d-4c30-a9c4-69b835dc881c tempest-GroupsTest-999422492 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:37:34 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-26fed3b4-c44d-4c30-a9c4-69b835dc881c tempest-GroupsTest-999422492 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:37:34 devstack sudo[88268]: pam_unix(sudo:session): session closed for user root Sep 22 15:37:34 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-26fed3b4-c44d-4c30-a9c4-69b835dc881c tempest-GroupsTest-999422492 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:37:35 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-26fed3b4-c44d-4c30-a9c4-69b835dc881c tempest-GroupsTest-999422492 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:37:35 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-26fed3b4-c44d-4c30-a9c4-69b835dc881c tempest-GroupsTest-999422492 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:37:35 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-26fed3b4-c44d-4c30-a9c4-69b835dc881c tempest-GroupsTest-999422492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:37:35 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-434a97af-0f7d-4881-b658-2ab1e8a03009 tempest-GroupsTest-999422492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc" returned: 0 in 0.313s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:37:35 devstack cinder-volume[86212]: DEBUG cinder.manager [None req-434a97af-0f7d-4881-b658-2ab1e8a03009 tempest-GroupsTest-999422492 None] Notifying Schedulers of capabilities ... {{(pid=86212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 15:37:35 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-434a97af-0f7d-4881-b658-2ab1e8a03009 tempest-GroupsTest-999422492 None] Delete group completed successfully. Sep 22 15:37:35 devstack sudo[88271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc Sep 22 15:37:35 devstack sudo[88271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:37:35 devstack sudo[88271]: pam_unix(sudo:session): session closed for user root Sep 22 15:37:35 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-26fed3b4-c44d-4c30-a9c4-69b835dc881c tempest-GroupsTest-999422492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc" returned: 0 in 0.275s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:37:35 devstack cinder-volume[86212]: DEBUG cinder.manager [None req-26fed3b4-c44d-4c30-a9c4-69b835dc881c tempest-GroupsTest-999422492 None] Notifying Schedulers of capabilities ... {{(pid=86212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 15:37:35 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-26fed3b4-c44d-4c30-a9c4-69b835dc881c tempest-GroupsTest-999422492 None] Delete group completed successfully. Sep 22 15:37:36 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-13545833-c91d-4e2b-be08-57425ea1bad8 tempest-GroupsTest-999422492 None] Group tempest-GroupsTest-Group-2083686795: creating Sep 22 15:37:36 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-13545833-c91d-4e2b-be08-57425ea1bad8 tempest-GroupsTest-999422492 None] Group tempest-GroupsTest-Group-2083686795: created successfully Sep 22 15:37:36 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-13545833-c91d-4e2b-be08-57425ea1bad8 tempest-GroupsTest-999422492 None] Create group completed successfully. Sep 22 15:37:38 devstack cinder-volume[86212]: DEBUG oslo_service.periodic_task [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86212) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 22 15:37:38 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:37:38 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:37:38 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:37:38 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:37:38 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:37:38 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:37:38 devstack sudo[88276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc Sep 22 15:37:38 devstack sudo[88276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:37:38 devstack cinder-volume[86212]: DEBUG cinder.volume.flows.manager.create_volume [None req-2fa51893-3aaa-43d7-949c-0388a0a77b8a tempest-GroupsTest-999422492 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 15:37:38 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-2fa51893-3aaa-43d7-949c-0388a0a77b8a tempest-GroupsTest-999422492 None] Flow 'volume_create_manager' (8acf5bc6-253d-4549-9c79-97a18c7575d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:37:38 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-2fa51893-3aaa-43d7-949c-0388a0a77b8a tempest-GroupsTest-999422492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53d22ffa-6a3e-4113-bcd7-2c598ed26b3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:37:38 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-2fa51893-3aaa-43d7-949c-0388a0a77b8a tempest-GroupsTest-999422492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53d22ffa-6a3e-4113-bcd7-2c598ed26b3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:37:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-600309053',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2e3784b1-6718-4862-b05d-51cf71a30043,host='devstack@QuobyteHD#QuobyteHD',id=a9732a39-4171-4895-bd92-9821231af4d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97c889f74d5644fba1c3aed9d51f1218',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:37:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:37:38Z,use_quota=True,user_id='ebc5896c543542baa45f0723c67d7003',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0bfb6622-93ab-44b8-80af-b4e565a834f6),volume_type_id=0bfb6622-93ab-44b8-80af-b4e565a834f6)' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:37:38 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-2fa51893-3aaa-43d7-949c-0388a0a77b8a tempest-GroupsTest-999422492 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (384cf0d6-c02e-43c1-90c6-158f0139fd09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:37:38 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-2fa51893-3aaa-43d7-949c-0388a0a77b8a tempest-GroupsTest-999422492 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (384cf0d6-c02e-43c1-90c6-158f0139fd09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:37:38 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-2fa51893-3aaa-43d7-949c-0388a0a77b8a tempest-GroupsTest-999422492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72819481-98fe-4718-a482-e77e7e663d1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:37:38 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-2fa51893-3aaa-43d7-949c-0388a0a77b8a tempest-GroupsTest-999422492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72819481-98fe-4718-a482-e77e7e663d1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a9732a39-4171-4895-bd92-9821231af4d6', 'volume_name': 'volume-a9732a39-4171-4895-bd92-9821231af4d6', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:37:38 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-2fa51893-3aaa-43d7-949c-0388a0a77b8a tempest-GroupsTest-999422492 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a23b130a-d46e-435c-8b9a-a263868edf4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:37:38 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-2fa51893-3aaa-43d7-949c-0388a0a77b8a tempest-GroupsTest-999422492 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a23b130a-d46e-435c-8b9a-a263868edf4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:37:38 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-2fa51893-3aaa-43d7-949c-0388a0a77b8a tempest-GroupsTest-999422492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fa958f6-818b-4cdf-9e83-e275d08c465c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:37:38 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-2fa51893-3aaa-43d7-949c-0388a0a77b8a tempest-GroupsTest-999422492 None] Volume a9732a39-4171-4895-bd92-9821231af4d6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a9732a39-4171-4895-bd92-9821231af4d6', 'volume_size': 1} Sep 22 15:37:38 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-2fa51893-3aaa-43d7-949c-0388a0a77b8a tempest-GroupsTest-999422492 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:37:38 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-2fa51893-3aaa-43d7-949c-0388a0a77b8a tempest-GroupsTest-999422492 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:37:38 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-2fa51893-3aaa-43d7-949c-0388a0a77b8a tempest-GroupsTest-999422492 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=2e3784b1-6718-4862-b05d-51cf71a30043,created_at=2026-09-22T13:37:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-600309053',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2e3784b1-6718-4862-b05d-51cf71a30043,host='devstack@QuobyteHD#QuobyteHD',id=a9732a39-4171-4895-bd92-9821231af4d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97c889f74d5644fba1c3aed9d51f1218',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:37:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:37:38Z,use_quota=True,user_id='ebc5896c543542baa45f0723c67d7003',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0bfb6622-93ab-44b8-80af-b4e565a834f6),volume_type_id=0bfb6622-93ab-44b8-80af-b4e565a834f6)}" {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 15:37:38 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-2fa51893-3aaa-43d7-949c-0388a0a77b8a tempest-GroupsTest-999422492 None] Creating volume a9732a39-4171-4895-bd92-9821231af4d6 {{(pid=86212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 15:37:38 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-2fa51893-3aaa-43d7-949c-0388a0a77b8a tempest-GroupsTest-999422492 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:37:38 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-2fa51893-3aaa-43d7-949c-0388a0a77b8a tempest-GroupsTest-999422492 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:37:38 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-2fa51893-3aaa-43d7-949c-0388a0a77b8a tempest-GroupsTest-999422492 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:37:38 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-2fa51893-3aaa-43d7-949c-0388a0a77b8a tempest-GroupsTest-999422492 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:37:38 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-2fa51893-3aaa-43d7-949c-0388a0a77b8a tempest-GroupsTest-999422492 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:37:38 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-2fa51893-3aaa-43d7-949c-0388a0a77b8a tempest-GroupsTest-999422492 None] Selected osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 as target Quobyte volume. {{(pid=86212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 15:37:38 devstack cinder-volume[86212]: INFO cinder.volume.drivers.remotefs [None req-2fa51893-3aaa-43d7-949c-0388a0a77b8a tempest-GroupsTest-999422492 None] casted to osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 Sep 22 15:37:38 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-2fa51893-3aaa-43d7-949c-0388a0a77b8a tempest-GroupsTest-999422492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a9732a39-4171-4895-bd92-9821231af4d6 1073741824 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:37:38 devstack sudo[88279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a9732a39-4171-4895-bd92-9821231af4d6 1073741824 Sep 22 15:37:38 devstack sudo[88279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:37:38 devstack sudo[88276]: pam_unix(sudo:session): session closed for user root Sep 22 15:37:38 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc" returned: 0 in 0.377s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:37:38 devstack cinder-volume[86212]: DEBUG cinder.manager [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] Notifying Schedulers of capabilities ... {{(pid=86212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 15:37:39 devstack sudo[88279]: pam_unix(sudo:session): session closed for user root Sep 22 15:37:39 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-2fa51893-3aaa-43d7-949c-0388a0a77b8a tempest-GroupsTest-999422492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a9732a39-4171-4895-bd92-9821231af4d6 1073741824" returned: 0 in 0.619s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:37:39 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-2fa51893-3aaa-43d7-949c-0388a0a77b8a tempest-GroupsTest-999422492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a9732a39-4171-4895-bd92-9821231af4d6 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:37:39 devstack sudo[88285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a9732a39-4171-4895-bd92-9821231af4d6 Sep 22 15:37:39 devstack sudo[88285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:37:39 devstack sudo[88285]: pam_unix(sudo:session): session closed for user root Sep 22 15:37:39 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-2fa51893-3aaa-43d7-949c-0388a0a77b8a tempest-GroupsTest-999422492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a9732a39-4171-4895-bd92-9821231af4d6" returned: 0 in 0.350s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:37:39 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-2fa51893-3aaa-43d7-949c-0388a0a77b8a tempest-GroupsTest-999422492 None] <== create_volume: return (1019ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'} {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 15:37:39 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-2fa51893-3aaa-43d7-949c-0388a0a77b8a tempest-GroupsTest-999422492 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.023s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:37:39 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-2fa51893-3aaa-43d7-949c-0388a0a77b8a tempest-GroupsTest-999422492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fa958f6-818b-4cdf-9e83-e275d08c465c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a9732a39-4171-4895-bd92-9821231af4d6', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:37:39 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-2fa51893-3aaa-43d7-949c-0388a0a77b8a tempest-GroupsTest-999422492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a3bb7da-f347-45e7-9226-ecdd89d11c99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:37:39 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-2fa51893-3aaa-43d7-949c-0388a0a77b8a tempest-GroupsTest-999422492 None] Volume volume-a9732a39-4171-4895-bd92-9821231af4d6 (a9732a39-4171-4895-bd92-9821231af4d6): created successfully Sep 22 15:37:39 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-2fa51893-3aaa-43d7-949c-0388a0a77b8a tempest-GroupsTest-999422492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a3bb7da-f347-45e7-9226-ecdd89d11c99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:37:39 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-2fa51893-3aaa-43d7-949c-0388a0a77b8a tempest-GroupsTest-999422492 None] Flow 'volume_create_manager' (8acf5bc6-253d-4549-9c79-97a18c7575d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:37:39 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-2fa51893-3aaa-43d7-949c-0388a0a77b8a tempest-GroupsTest-999422492 None] Created volume successfully. Sep 22 15:37:41 devstack cinder-volume[86212]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6de651d-c0b0-4e3d-a05a-bba5e3f471da tempest-GroupsTest-999422492 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 15:37:41 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-e6de651d-c0b0-4e3d-a05a-bba5e3f471da tempest-GroupsTest-999422492 None] Flow 'volume_create_manager' (f2588431-d48e-4708-8e78-5011ae9c44aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:37:41 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-e6de651d-c0b0-4e3d-a05a-bba5e3f471da tempest-GroupsTest-999422492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (546a2396-543a-447f-858b-9e0087852870) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:37:41 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-e6de651d-c0b0-4e3d-a05a-bba5e3f471da tempest-GroupsTest-999422492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (546a2396-543a-447f-858b-9e0087852870) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:37:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-615268260',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2e3784b1-6718-4862-b05d-51cf71a30043,host='devstack@QuobyteHD#QuobyteHD',id=5453844b-4d98-4f98-bef1-520389a5be39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97c889f74d5644fba1c3aed9d51f1218',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:37:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:37:42Z,use_quota=True,user_id='ebc5896c543542baa45f0723c67d7003',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0bfb6622-93ab-44b8-80af-b4e565a834f6),volume_type_id=0bfb6622-93ab-44b8-80af-b4e565a834f6)' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:37:41 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-e6de651d-c0b0-4e3d-a05a-bba5e3f471da tempest-GroupsTest-999422492 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c0aa205-994d-4278-9739-364f4b9ea835) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:37:41 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-e6de651d-c0b0-4e3d-a05a-bba5e3f471da tempest-GroupsTest-999422492 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c0aa205-994d-4278-9739-364f4b9ea835) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:37:41 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-e6de651d-c0b0-4e3d-a05a-bba5e3f471da tempest-GroupsTest-999422492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f78d6a5e-9171-4b9e-9bf0-009060928836) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:37:41 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-e6de651d-c0b0-4e3d-a05a-bba5e3f471da tempest-GroupsTest-999422492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f78d6a5e-9171-4b9e-9bf0-009060928836) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5453844b-4d98-4f98-bef1-520389a5be39', 'volume_name': 'volume-5453844b-4d98-4f98-bef1-520389a5be39', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:37:41 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-e6de651d-c0b0-4e3d-a05a-bba5e3f471da tempest-GroupsTest-999422492 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f39feadf-b5d8-42d6-9a38-235e3425e48b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:37:41 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-e6de651d-c0b0-4e3d-a05a-bba5e3f471da tempest-GroupsTest-999422492 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f39feadf-b5d8-42d6-9a38-235e3425e48b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:37:41 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-e6de651d-c0b0-4e3d-a05a-bba5e3f471da tempest-GroupsTest-999422492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a54c8ff-b6be-4e89-9bb9-581740ea2431) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:37:41 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-e6de651d-c0b0-4e3d-a05a-bba5e3f471da tempest-GroupsTest-999422492 None] Volume 5453844b-4d98-4f98-bef1-520389a5be39: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5453844b-4d98-4f98-bef1-520389a5be39', 'volume_size': 1} Sep 22 15:37:41 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-e6de651d-c0b0-4e3d-a05a-bba5e3f471da tempest-GroupsTest-999422492 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:37:41 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-e6de651d-c0b0-4e3d-a05a-bba5e3f471da tempest-GroupsTest-999422492 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:37:41 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-e6de651d-c0b0-4e3d-a05a-bba5e3f471da tempest-GroupsTest-999422492 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=2e3784b1-6718-4862-b05d-51cf71a30043,created_at=2026-09-22T13:37:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-615268260',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2e3784b1-6718-4862-b05d-51cf71a30043,host='devstack@QuobyteHD#QuobyteHD',id=5453844b-4d98-4f98-bef1-520389a5be39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97c889f74d5644fba1c3aed9d51f1218',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:37:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:37:42Z,use_quota=True,user_id='ebc5896c543542baa45f0723c67d7003',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0bfb6622-93ab-44b8-80af-b4e565a834f6),volume_type_id=0bfb6622-93ab-44b8-80af-b4e565a834f6)}" {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 15:37:41 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-e6de651d-c0b0-4e3d-a05a-bba5e3f471da tempest-GroupsTest-999422492 None] Creating volume 5453844b-4d98-4f98-bef1-520389a5be39 {{(pid=86212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 15:37:41 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-e6de651d-c0b0-4e3d-a05a-bba5e3f471da tempest-GroupsTest-999422492 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:37:41 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-e6de651d-c0b0-4e3d-a05a-bba5e3f471da tempest-GroupsTest-999422492 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:37:41 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-e6de651d-c0b0-4e3d-a05a-bba5e3f471da tempest-GroupsTest-999422492 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:37:41 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-e6de651d-c0b0-4e3d-a05a-bba5e3f471da tempest-GroupsTest-999422492 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:37:41 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-e6de651d-c0b0-4e3d-a05a-bba5e3f471da tempest-GroupsTest-999422492 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:37:41 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-e6de651d-c0b0-4e3d-a05a-bba5e3f471da tempest-GroupsTest-999422492 None] Selected osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 as target Quobyte volume. {{(pid=86212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 15:37:41 devstack cinder-volume[86212]: INFO cinder.volume.drivers.remotefs [None req-e6de651d-c0b0-4e3d-a05a-bba5e3f471da tempest-GroupsTest-999422492 None] casted to osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 Sep 22 15:37:41 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-e6de651d-c0b0-4e3d-a05a-bba5e3f471da tempest-GroupsTest-999422492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-5453844b-4d98-4f98-bef1-520389a5be39 1073741824 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:37:42 devstack sudo[88290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-5453844b-4d98-4f98-bef1-520389a5be39 1073741824 Sep 22 15:37:42 devstack sudo[88290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:37:42 devstack sudo[88290]: pam_unix(sudo:session): session closed for user root Sep 22 15:37:42 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-e6de651d-c0b0-4e3d-a05a-bba5e3f471da tempest-GroupsTest-999422492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-5453844b-4d98-4f98-bef1-520389a5be39 1073741824" returned: 0 in 0.512s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:37:42 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-e6de651d-c0b0-4e3d-a05a-bba5e3f471da tempest-GroupsTest-999422492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-5453844b-4d98-4f98-bef1-520389a5be39 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:37:42 devstack sudo[88296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-5453844b-4d98-4f98-bef1-520389a5be39 Sep 22 15:37:42 devstack sudo[88296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:37:42 devstack sudo[88296]: pam_unix(sudo:session): session closed for user root Sep 22 15:37:42 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-e6de651d-c0b0-4e3d-a05a-bba5e3f471da tempest-GroupsTest-999422492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-5453844b-4d98-4f98-bef1-520389a5be39" returned: 0 in 0.307s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:37:42 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-e6de651d-c0b0-4e3d-a05a-bba5e3f471da tempest-GroupsTest-999422492 None] <== create_volume: return (867ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'} {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 15:37:42 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-e6de651d-c0b0-4e3d-a05a-bba5e3f471da tempest-GroupsTest-999422492 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.870s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:37:42 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-e6de651d-c0b0-4e3d-a05a-bba5e3f471da tempest-GroupsTest-999422492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a54c8ff-b6be-4e89-9bb9-581740ea2431) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5453844b-4d98-4f98-bef1-520389a5be39', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:37:42 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-e6de651d-c0b0-4e3d-a05a-bba5e3f471da tempest-GroupsTest-999422492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98107b09-809a-413a-be85-ac85b492fa7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:37:42 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-e6de651d-c0b0-4e3d-a05a-bba5e3f471da tempest-GroupsTest-999422492 None] Volume volume-5453844b-4d98-4f98-bef1-520389a5be39 (5453844b-4d98-4f98-bef1-520389a5be39): created successfully Sep 22 15:37:42 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-e6de651d-c0b0-4e3d-a05a-bba5e3f471da tempest-GroupsTest-999422492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98107b09-809a-413a-be85-ac85b492fa7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:37:42 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-e6de651d-c0b0-4e3d-a05a-bba5e3f471da tempest-GroupsTest-999422492 None] Flow 'volume_create_manager' (f2588431-d48e-4708-8e78-5011ae9c44aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:37:42 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-e6de651d-c0b0-4e3d-a05a-bba5e3f471da tempest-GroupsTest-999422492 None] Created volume successfully. Sep 22 15:37:43 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-3c191c98-71b2-4775-a17e-0395b1c48261 tempest-GroupsTest-999422492 None] Update group completed successfully. Sep 22 15:37:44 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-213db4f3-75de-42fb-a489-b731ce275831 tempest-GroupsTest-999422492 None] Update group completed successfully. Sep 22 15:37:46 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-aa6aaf64-ae56-47e3-9604-3a13e797e0f8 tempest-GroupsTest-999422492 None] Acquiring lock "cinder-quobyte-5453844b-4d98-4f98-bef1-520389a5be39" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:37:46 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-aa6aaf64-ae56-47e3-9604-3a13e797e0f8 tempest-GroupsTest-999422492 None] Lock "cinder-quobyte-5453844b-4d98-4f98-bef1-520389a5be39" acquired by "delete_volume" :: waited 0.021s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:37:46 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c4ffd62-0d8d-475a-be14-969a1870d2ca]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:37:46 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-aa6aaf64-ae56-47e3-9604-3a13e797e0f8 tempest-GroupsTest-999422492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-5453844b-4d98-4f98-bef1-520389a5be39 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:37:46 devstack sudo[88300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-5453844b-4d98-4f98-bef1-520389a5be39 Sep 22 15:37:46 devstack sudo[88300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:37:47 devstack sudo[88300]: pam_unix(sudo:session): session closed for user root Sep 22 15:37:47 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-aa6aaf64-ae56-47e3-9604-3a13e797e0f8 tempest-GroupsTest-999422492 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-5453844b-4d98-4f98-bef1-520389a5be39" returned: 0 in 0.464s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:37:47 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-aa6aaf64-ae56-47e3-9604-3a13e797e0f8 tempest-GroupsTest-999422492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-5453844b-4d98-4f98-bef1-520389a5be39 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:37:47 devstack sudo[88306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-5453844b-4d98-4f98-bef1-520389a5be39 Sep 22 15:37:47 devstack sudo[88306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:37:47 devstack sudo[88306]: pam_unix(sudo:session): session closed for user root Sep 22 15:37:47 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-aa6aaf64-ae56-47e3-9604-3a13e797e0f8 tempest-GroupsTest-999422492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-5453844b-4d98-4f98-bef1-520389a5be39" returned: 0 in 0.310s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:37:47 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-aa6aaf64-ae56-47e3-9604-3a13e797e0f8 tempest-GroupsTest-999422492 None] Lock "cinder-quobyte-5453844b-4d98-4f98-bef1-520389a5be39" released by "delete_volume" :: held 0.851s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:37:47 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-aa6aaf64-ae56-47e3-9604-3a13e797e0f8 tempest-GroupsTest-999422492 None] Acquiring lock "cinder-quobyte-a9732a39-4171-4895-bd92-9821231af4d6" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:37:47 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-aa6aaf64-ae56-47e3-9604-3a13e797e0f8 tempest-GroupsTest-999422492 None] Lock "cinder-quobyte-a9732a39-4171-4895-bd92-9821231af4d6" acquired by "delete_volume" :: waited 0.024s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:37:47 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cd1321c-d88e-4adf-a89f-54116051cd6d]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:37:47 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-aa6aaf64-ae56-47e3-9604-3a13e797e0f8 tempest-GroupsTest-999422492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a9732a39-4171-4895-bd92-9821231af4d6 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:37:47 devstack sudo[88309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a9732a39-4171-4895-bd92-9821231af4d6 Sep 22 15:37:47 devstack sudo[88309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:37:48 devstack sudo[88309]: pam_unix(sudo:session): session closed for user root Sep 22 15:37:48 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-aa6aaf64-ae56-47e3-9604-3a13e797e0f8 tempest-GroupsTest-999422492 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a9732a39-4171-4895-bd92-9821231af4d6" returned: 0 in 0.503s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:37:48 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-aa6aaf64-ae56-47e3-9604-3a13e797e0f8 tempest-GroupsTest-999422492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a9732a39-4171-4895-bd92-9821231af4d6 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:37:48 devstack sudo[88314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a9732a39-4171-4895-bd92-9821231af4d6 Sep 22 15:37:48 devstack sudo[88314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:37:48 devstack sudo[88314]: pam_unix(sudo:session): session closed for user root Sep 22 15:37:48 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-aa6aaf64-ae56-47e3-9604-3a13e797e0f8 tempest-GroupsTest-999422492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a9732a39-4171-4895-bd92-9821231af4d6" returned: 0 in 0.282s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:37:48 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-aa6aaf64-ae56-47e3-9604-3a13e797e0f8 tempest-GroupsTest-999422492 None] Lock "cinder-quobyte-a9732a39-4171-4895-bd92-9821231af4d6" released by "delete_volume" :: held 0.906s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:37:48 devstack cinder-volume[86212]: DEBUG cinder.quota [None req-aa6aaf64-ae56-47e3-9604-3a13e797e0f8 tempest-GroupsTest-999422492 None] Created reservations ['c0a7711e-4e4f-47cc-8eee-f0141d597cc3'] {{(pid=86212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 15:37:48 devstack cinder-volume[86212]: WARNING cinder.quota [None req-aa6aaf64-ae56-47e3-9604-3a13e797e0f8 tempest-GroupsTest-999422492 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-629793324 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-629793324, it is now deprecated. Please use the default quota class for default quota. Sep 22 15:37:48 devstack cinder-volume[86212]: WARNING cinder.quota [None req-aa6aaf64-ae56-47e3-9604-3a13e797e0f8 tempest-GroupsTest-999422492 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-629793324 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-629793324, it is now deprecated. Please use the default quota class for default quota. Sep 22 15:37:48 devstack cinder-volume[86212]: DEBUG cinder.quota [None req-aa6aaf64-ae56-47e3-9604-3a13e797e0f8 tempest-GroupsTest-999422492 None] Created reservations ['5150ec9d-a1ab-43fe-973b-d64c7dc4f9ba', '648cff36-5313-41fd-be61-e5960dc5b1f7', 'ffcabb9d-6d74-4680-ac8d-f074aebc9361', '78d4d7a2-2941-483a-b32c-92e21c93c5e8'] {{(pid=86212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 15:37:48 devstack cinder-volume[86212]: DEBUG cinder.quota [None req-aa6aaf64-ae56-47e3-9604-3a13e797e0f8 tempest-GroupsTest-999422492 None] Created reservations ['69ffabd4-b8c4-44d7-93de-bc8fab9ad496', '2c713722-4f58-422f-8a86-f287580e7cf1', '8bbc773f-9ed4-42d3-8023-d47ca23ddc49', '7c6d7663-6a71-4abc-b2aa-4809448f24a4'] {{(pid=86212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 15:37:48 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-aa6aaf64-ae56-47e3-9604-3a13e797e0f8 tempest-GroupsTest-999422492 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:37:48 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-aa6aaf64-ae56-47e3-9604-3a13e797e0f8 tempest-GroupsTest-999422492 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:37:48 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-aa6aaf64-ae56-47e3-9604-3a13e797e0f8 tempest-GroupsTest-999422492 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:37:48 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-aa6aaf64-ae56-47e3-9604-3a13e797e0f8 tempest-GroupsTest-999422492 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:37:48 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-aa6aaf64-ae56-47e3-9604-3a13e797e0f8 tempest-GroupsTest-999422492 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:37:48 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-aa6aaf64-ae56-47e3-9604-3a13e797e0f8 tempest-GroupsTest-999422492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:37:48 devstack sudo[88317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc Sep 22 15:37:48 devstack sudo[88317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:37:49 devstack sudo[88317]: pam_unix(sudo:session): session closed for user root Sep 22 15:37:49 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-aa6aaf64-ae56-47e3-9604-3a13e797e0f8 tempest-GroupsTest-999422492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc" returned: 0 in 0.299s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:37:49 devstack cinder-volume[86212]: DEBUG cinder.manager [None req-aa6aaf64-ae56-47e3-9604-3a13e797e0f8 tempest-GroupsTest-999422492 None] Notifying Schedulers of capabilities ... {{(pid=86212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 15:37:49 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-aa6aaf64-ae56-47e3-9604-3a13e797e0f8 tempest-GroupsTest-999422492 None] Delete group completed successfully. Sep 22 15:37:58 devstack cinder-volume[86212]: DEBUG dbcounter [-] [86212] Writing DB stats cinder:UPDATE=91,cinder:SELECT=79,cinder:DELETE=7,cinder:INSERT=16 {{(pid=86212) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 22 15:37:58 devstack cinder-volume[86212]: DEBUG dbcounter [-] [86212] Writing DB stats cinder:SELECT=75,cinder:UPDATE=92,cinder:INSERT=22,cinder:DELETE=4 {{(pid=86212) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 22 15:38:00 devstack cinder-volume[86212]: DEBUG cinder.volume.flows.manager.create_volume [None req-c69e78d0-1269-4d74-a98a-07d8f5ec1534 tempest-TaggedAttachmentsTest-1222342858 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 15:38:00 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-c69e78d0-1269-4d74-a98a-07d8f5ec1534 tempest-TaggedAttachmentsTest-1222342858 None] Flow 'volume_create_manager' (5358ce1e-4319-4c77-b545-7fca226d8518) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:38:00 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-c69e78d0-1269-4d74-a98a-07d8f5ec1534 tempest-TaggedAttachmentsTest-1222342858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbc51f17-a6ef-48b3-87e4-a72560955b73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:38:00 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-c69e78d0-1269-4d74-a98a-07d8f5ec1534 tempest-TaggedAttachmentsTest-1222342858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbc51f17-a6ef-48b3-87e4-a72560955b73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:38:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-2122879844',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=717fe045-fa44-4bcb-834d-a91f696749a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4af561cc9904e2a84a7d2154c4b23f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:38:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:38:00Z,use_quota=True,user_id='a7dd50b48b9d4079b8469ee146049617',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:38:00 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-c69e78d0-1269-4d74-a98a-07d8f5ec1534 tempest-TaggedAttachmentsTest-1222342858 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd7cedbe-b7da-4a89-b0c3-4a2e187e5e7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:38:00 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-c69e78d0-1269-4d74-a98a-07d8f5ec1534 tempest-TaggedAttachmentsTest-1222342858 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd7cedbe-b7da-4a89-b0c3-4a2e187e5e7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:38:00 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-c69e78d0-1269-4d74-a98a-07d8f5ec1534 tempest-TaggedAttachmentsTest-1222342858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fdf8b4c-180e-4442-9f89-c4dbe9e4cae6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:38:00 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-c69e78d0-1269-4d74-a98a-07d8f5ec1534 tempest-TaggedAttachmentsTest-1222342858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fdf8b4c-180e-4442-9f89-c4dbe9e4cae6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '717fe045-fa44-4bcb-834d-a91f696749a6', 'volume_name': 'volume-717fe045-fa44-4bcb-834d-a91f696749a6', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:38:00 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-c69e78d0-1269-4d74-a98a-07d8f5ec1534 tempest-TaggedAttachmentsTest-1222342858 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ade014c-5a90-4455-8b9d-ddb6e0b7d85d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:38:00 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-c69e78d0-1269-4d74-a98a-07d8f5ec1534 tempest-TaggedAttachmentsTest-1222342858 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ade014c-5a90-4455-8b9d-ddb6e0b7d85d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:38:00 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-c69e78d0-1269-4d74-a98a-07d8f5ec1534 tempest-TaggedAttachmentsTest-1222342858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a24ccca1-ff53-45c4-b212-d2f6de5a03f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:38:00 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-c69e78d0-1269-4d74-a98a-07d8f5ec1534 tempest-TaggedAttachmentsTest-1222342858 None] Volume 717fe045-fa44-4bcb-834d-a91f696749a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-717fe045-fa44-4bcb-834d-a91f696749a6', 'volume_size': 1} Sep 22 15:38:00 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-c69e78d0-1269-4d74-a98a-07d8f5ec1534 tempest-TaggedAttachmentsTest-1222342858 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:38:00 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-c69e78d0-1269-4d74-a98a-07d8f5ec1534 tempest-TaggedAttachmentsTest-1222342858 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:38:00 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-c69e78d0-1269-4d74-a98a-07d8f5ec1534 tempest-TaggedAttachmentsTest-1222342858 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:38:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-2122879844',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=717fe045-fa44-4bcb-834d-a91f696749a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4af561cc9904e2a84a7d2154c4b23f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:38:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:38:00Z,use_quota=True,user_id='a7dd50b48b9d4079b8469ee146049617',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)}" {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 15:38:00 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-c69e78d0-1269-4d74-a98a-07d8f5ec1534 tempest-TaggedAttachmentsTest-1222342858 None] Creating volume 717fe045-fa44-4bcb-834d-a91f696749a6 {{(pid=86212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 15:38:00 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-c69e78d0-1269-4d74-a98a-07d8f5ec1534 tempest-TaggedAttachmentsTest-1222342858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:38:00 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-c69e78d0-1269-4d74-a98a-07d8f5ec1534 tempest-TaggedAttachmentsTest-1222342858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:38:00 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-c69e78d0-1269-4d74-a98a-07d8f5ec1534 tempest-TaggedAttachmentsTest-1222342858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:38:00 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-c69e78d0-1269-4d74-a98a-07d8f5ec1534 tempest-TaggedAttachmentsTest-1222342858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:38:00 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-c69e78d0-1269-4d74-a98a-07d8f5ec1534 tempest-TaggedAttachmentsTest-1222342858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:38:00 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-c69e78d0-1269-4d74-a98a-07d8f5ec1534 tempest-TaggedAttachmentsTest-1222342858 None] Selected osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 as target Quobyte volume. {{(pid=86212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 15:38:00 devstack cinder-volume[86212]: INFO cinder.volume.drivers.remotefs [None req-c69e78d0-1269-4d74-a98a-07d8f5ec1534 tempest-TaggedAttachmentsTest-1222342858 None] casted to osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 Sep 22 15:38:00 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-c69e78d0-1269-4d74-a98a-07d8f5ec1534 tempest-TaggedAttachmentsTest-1222342858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-717fe045-fa44-4bcb-834d-a91f696749a6 1073741824 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:38:00 devstack sudo[88331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-717fe045-fa44-4bcb-834d-a91f696749a6 1073741824 Sep 22 15:38:00 devstack sudo[88331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:38:01 devstack sudo[88331]: pam_unix(sudo:session): session closed for user root Sep 22 15:38:01 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-c69e78d0-1269-4d74-a98a-07d8f5ec1534 tempest-TaggedAttachmentsTest-1222342858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-717fe045-fa44-4bcb-834d-a91f696749a6 1073741824" returned: 0 in 0.643s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:38:01 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-c69e78d0-1269-4d74-a98a-07d8f5ec1534 tempest-TaggedAttachmentsTest-1222342858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-717fe045-fa44-4bcb-834d-a91f696749a6 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:38:01 devstack sudo[88337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-717fe045-fa44-4bcb-834d-a91f696749a6 Sep 22 15:38:01 devstack sudo[88337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:38:01 devstack sudo[88337]: pam_unix(sudo:session): session closed for user root Sep 22 15:38:01 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-c69e78d0-1269-4d74-a98a-07d8f5ec1534 tempest-TaggedAttachmentsTest-1222342858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-717fe045-fa44-4bcb-834d-a91f696749a6" returned: 0 in 0.337s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:38:01 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-c69e78d0-1269-4d74-a98a-07d8f5ec1534 tempest-TaggedAttachmentsTest-1222342858 None] <== create_volume: return (1078ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'} {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 15:38:01 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-c69e78d0-1269-4d74-a98a-07d8f5ec1534 tempest-TaggedAttachmentsTest-1222342858 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.081s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:38:01 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-c69e78d0-1269-4d74-a98a-07d8f5ec1534 tempest-TaggedAttachmentsTest-1222342858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a24ccca1-ff53-45c4-b212-d2f6de5a03f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-717fe045-fa44-4bcb-834d-a91f696749a6', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:38:01 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-c69e78d0-1269-4d74-a98a-07d8f5ec1534 tempest-TaggedAttachmentsTest-1222342858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39296efb-8a2c-4131-8785-dad39b4fac0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:38:01 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-c69e78d0-1269-4d74-a98a-07d8f5ec1534 tempest-TaggedAttachmentsTest-1222342858 None] Volume volume-717fe045-fa44-4bcb-834d-a91f696749a6 (717fe045-fa44-4bcb-834d-a91f696749a6): created successfully Sep 22 15:38:01 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-c69e78d0-1269-4d74-a98a-07d8f5ec1534 tempest-TaggedAttachmentsTest-1222342858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39296efb-8a2c-4131-8785-dad39b4fac0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:38:01 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-c69e78d0-1269-4d74-a98a-07d8f5ec1534 tempest-TaggedAttachmentsTest-1222342858 None] Flow 'volume_create_manager' (5358ce1e-4319-4c77-b545-7fca226d8518) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:38:01 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-c69e78d0-1269-4d74-a98a-07d8f5ec1534 tempest-TaggedAttachmentsTest-1222342858 None] Created volume successfully. Sep 22 15:38:11 devstack cinder-volume[86212]: DEBUG dbcounter [-] [86212] Writing DB stats cinder:SELECT=3,cinder:UPDATE=3,cinder:INSERT=1 {{(pid=86212) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 22 15:38:11 devstack cinder-volume[86212]: DEBUG dbcounter [-] [86212] Writing DB stats cinder:SELECT=1,cinder:UPDATE=3,cinder:DELETE=1 {{(pid=86212) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 22 15:38:35 devstack cinder-volume[86212]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f574eb6-08ea-4123-bc93-3ef238be2570 tempest-VolumeSnapshotQuotasNegativeTestJSON-677448301 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 15:38:35 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-5f574eb6-08ea-4123-bc93-3ef238be2570 tempest-VolumeSnapshotQuotasNegativeTestJSON-677448301 None] Flow 'volume_create_manager' (88eb13a6-6697-4ad0-af85-38366ec24b1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:38:35 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-5f574eb6-08ea-4123-bc93-3ef238be2570 tempest-VolumeSnapshotQuotasNegativeTestJSON-677448301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79b1aac3-b0d3-4bee-ba55-e7e3bbf78296) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:38:35 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-5f574eb6-08ea-4123-bc93-3ef238be2570 tempest-VolumeSnapshotQuotasNegativeTestJSON-677448301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79b1aac3-b0d3-4bee-ba55-e7e3bbf78296) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:38:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1833337481',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd38c53f-d7c9-4811-a97c-dd405c7af884,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='195fa22afe7e4c188772883740a248bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:38:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:38:35Z,use_quota=True,user_id='b8724a2cf6d147038de488e2f1b394ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:38:35 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-5f574eb6-08ea-4123-bc93-3ef238be2570 tempest-VolumeSnapshotQuotasNegativeTestJSON-677448301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (355d3a97-d0e9-4a18-b7b1-78822cb54ded) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:38:35 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-5f574eb6-08ea-4123-bc93-3ef238be2570 tempest-VolumeSnapshotQuotasNegativeTestJSON-677448301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (355d3a97-d0e9-4a18-b7b1-78822cb54ded) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:38:35 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-5f574eb6-08ea-4123-bc93-3ef238be2570 tempest-VolumeSnapshotQuotasNegativeTestJSON-677448301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec05dc07-253c-412b-9e3c-008b9ef381f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:38:35 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-5f574eb6-08ea-4123-bc93-3ef238be2570 tempest-VolumeSnapshotQuotasNegativeTestJSON-677448301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec05dc07-253c-412b-9e3c-008b9ef381f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bd38c53f-d7c9-4811-a97c-dd405c7af884', 'volume_name': 'volume-bd38c53f-d7c9-4811-a97c-dd405c7af884', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:38:35 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-5f574eb6-08ea-4123-bc93-3ef238be2570 tempest-VolumeSnapshotQuotasNegativeTestJSON-677448301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2847e0ab-20fc-4988-b52e-ea4fb5eafe7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:38:35 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-5f574eb6-08ea-4123-bc93-3ef238be2570 tempest-VolumeSnapshotQuotasNegativeTestJSON-677448301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2847e0ab-20fc-4988-b52e-ea4fb5eafe7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:38:35 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-5f574eb6-08ea-4123-bc93-3ef238be2570 tempest-VolumeSnapshotQuotasNegativeTestJSON-677448301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b980462-44bc-4130-bdcc-ecff6ec24b48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:38:35 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-5f574eb6-08ea-4123-bc93-3ef238be2570 tempest-VolumeSnapshotQuotasNegativeTestJSON-677448301 None] Volume bd38c53f-d7c9-4811-a97c-dd405c7af884: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bd38c53f-d7c9-4811-a97c-dd405c7af884', 'volume_size': 1} Sep 22 15:38:35 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-5f574eb6-08ea-4123-bc93-3ef238be2570 tempest-VolumeSnapshotQuotasNegativeTestJSON-677448301 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:38:35 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-5f574eb6-08ea-4123-bc93-3ef238be2570 tempest-VolumeSnapshotQuotasNegativeTestJSON-677448301 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:38:35 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-5f574eb6-08ea-4123-bc93-3ef238be2570 tempest-VolumeSnapshotQuotasNegativeTestJSON-677448301 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:38:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1833337481',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd38c53f-d7c9-4811-a97c-dd405c7af884,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='195fa22afe7e4c188772883740a248bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:38:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:38:35Z,use_quota=True,user_id='b8724a2cf6d147038de488e2f1b394ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)}" {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 15:38:35 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-5f574eb6-08ea-4123-bc93-3ef238be2570 tempest-VolumeSnapshotQuotasNegativeTestJSON-677448301 None] Creating volume bd38c53f-d7c9-4811-a97c-dd405c7af884 {{(pid=86212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 15:38:35 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-5f574eb6-08ea-4123-bc93-3ef238be2570 tempest-VolumeSnapshotQuotasNegativeTestJSON-677448301 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:38:35 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-5f574eb6-08ea-4123-bc93-3ef238be2570 tempest-VolumeSnapshotQuotasNegativeTestJSON-677448301 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:38:35 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-5f574eb6-08ea-4123-bc93-3ef238be2570 tempest-VolumeSnapshotQuotasNegativeTestJSON-677448301 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:38:35 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-5f574eb6-08ea-4123-bc93-3ef238be2570 tempest-VolumeSnapshotQuotasNegativeTestJSON-677448301 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:38:35 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-5f574eb6-08ea-4123-bc93-3ef238be2570 tempest-VolumeSnapshotQuotasNegativeTestJSON-677448301 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:38:35 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-5f574eb6-08ea-4123-bc93-3ef238be2570 tempest-VolumeSnapshotQuotasNegativeTestJSON-677448301 None] Selected osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 as target Quobyte volume. {{(pid=86212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 15:38:35 devstack cinder-volume[86212]: INFO cinder.volume.drivers.remotefs [None req-5f574eb6-08ea-4123-bc93-3ef238be2570 tempest-VolumeSnapshotQuotasNegativeTestJSON-677448301 None] casted to osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 Sep 22 15:38:35 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-5f574eb6-08ea-4123-bc93-3ef238be2570 tempest-VolumeSnapshotQuotasNegativeTestJSON-677448301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-bd38c53f-d7c9-4811-a97c-dd405c7af884 1073741824 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:38:35 devstack sudo[88710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-bd38c53f-d7c9-4811-a97c-dd405c7af884 1073741824 Sep 22 15:38:35 devstack sudo[88710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:38:35 devstack sudo[88710]: pam_unix(sudo:session): session closed for user root Sep 22 15:38:35 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-5f574eb6-08ea-4123-bc93-3ef238be2570 tempest-VolumeSnapshotQuotasNegativeTestJSON-677448301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-bd38c53f-d7c9-4811-a97c-dd405c7af884 1073741824" returned: 0 in 0.477s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:38:35 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-5f574eb6-08ea-4123-bc93-3ef238be2570 tempest-VolumeSnapshotQuotasNegativeTestJSON-677448301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-bd38c53f-d7c9-4811-a97c-dd405c7af884 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:38:35 devstack sudo[88716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-bd38c53f-d7c9-4811-a97c-dd405c7af884 Sep 22 15:38:35 devstack sudo[88716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:38:35 devstack sudo[88716]: pam_unix(sudo:session): session closed for user root Sep 22 15:38:35 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-5f574eb6-08ea-4123-bc93-3ef238be2570 tempest-VolumeSnapshotQuotasNegativeTestJSON-677448301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-bd38c53f-d7c9-4811-a97c-dd405c7af884" returned: 0 in 0.273s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:38:35 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-5f574eb6-08ea-4123-bc93-3ef238be2570 tempest-VolumeSnapshotQuotasNegativeTestJSON-677448301 None] <== create_volume: return (800ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'} {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 15:38:35 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-5f574eb6-08ea-4123-bc93-3ef238be2570 tempest-VolumeSnapshotQuotasNegativeTestJSON-677448301 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.806s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:38:35 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-5f574eb6-08ea-4123-bc93-3ef238be2570 tempest-VolumeSnapshotQuotasNegativeTestJSON-677448301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b980462-44bc-4130-bdcc-ecff6ec24b48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd38c53f-d7c9-4811-a97c-dd405c7af884', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:38:35 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-5f574eb6-08ea-4123-bc93-3ef238be2570 tempest-VolumeSnapshotQuotasNegativeTestJSON-677448301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe6be2fe-3705-4615-832c-378ee1a01e46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:38:35 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-5f574eb6-08ea-4123-bc93-3ef238be2570 tempest-VolumeSnapshotQuotasNegativeTestJSON-677448301 None] Volume volume-bd38c53f-d7c9-4811-a97c-dd405c7af884 (bd38c53f-d7c9-4811-a97c-dd405c7af884): created successfully Sep 22 15:38:35 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-5f574eb6-08ea-4123-bc93-3ef238be2570 tempest-VolumeSnapshotQuotasNegativeTestJSON-677448301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe6be2fe-3705-4615-832c-378ee1a01e46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:38:35 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-5f574eb6-08ea-4123-bc93-3ef238be2570 tempest-VolumeSnapshotQuotasNegativeTestJSON-677448301 None] Flow 'volume_create_manager' (88eb13a6-6697-4ad0-af85-38366ec24b1b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:38:36 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-5f574eb6-08ea-4123-bc93-3ef238be2570 tempest-VolumeSnapshotQuotasNegativeTestJSON-677448301 None] Created volume successfully. Sep 22 15:38:37 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-108009a8-50b6-4e13-9889-6ae1d8df8053 tempest-VolumeSnapshotQuotasNegativeTestJSON-677448301 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:38:37 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-108009a8-50b6-4e13-9889-6ae1d8df8053 tempest-VolumeSnapshotQuotasNegativeTestJSON-677448301 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:38:37 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-108009a8-50b6-4e13-9889-6ae1d8df8053 tempest-VolumeSnapshotQuotasNegativeTestJSON-677448301 None] Creating offline snapshot 9151bd30-ca24-454a-b6c2-8d908959950d of volume bd38c53f-d7c9-4811-a97c-dd405c7af884 {{(pid=86212) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 22 15:38:37 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd7338f8-0982-4333-87d7-41b5488ff2fa]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:38:37 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-108009a8-50b6-4e13-9889-6ae1d8df8053 tempest-VolumeSnapshotQuotasNegativeTestJSON-677448301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-bd38c53f-d7c9-4811-a97c-dd405c7af884 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:38:37 devstack sudo[88735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-bd38c53f-d7c9-4811-a97c-dd405c7af884 Sep 22 15:38:37 devstack sudo[88735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:38:37 devstack sudo[88735]: pam_unix(sudo:session): session closed for user root Sep 22 15:38:37 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-108009a8-50b6-4e13-9889-6ae1d8df8053 tempest-VolumeSnapshotQuotasNegativeTestJSON-677448301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-bd38c53f-d7c9-4811-a97c-dd405c7af884" returned: 0 in 0.382s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:38:37 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-108009a8-50b6-4e13-9889-6ae1d8df8053 tempest-VolumeSnapshotQuotasNegativeTestJSON-677448301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-bd38c53f-d7c9-4811-a97c-dd405c7af884,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-bd38c53f-d7c9-4811-a97c-dd405c7af884.9151bd30-ca24-454a-b6c2-8d908959950d 1G {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:38:37 devstack sudo[88741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-bd38c53f-d7c9-4811-a97c-dd405c7af884,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-bd38c53f-d7c9-4811-a97c-dd405c7af884.9151bd30-ca24-454a-b6c2-8d908959950d 1G Sep 22 15:38:37 devstack sudo[88741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:38:38 devstack sudo[88741]: pam_unix(sudo:session): session closed for user root Sep 22 15:38:38 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-108009a8-50b6-4e13-9889-6ae1d8df8053 tempest-VolumeSnapshotQuotasNegativeTestJSON-677448301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-bd38c53f-d7c9-4811-a97c-dd405c7af884,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-bd38c53f-d7c9-4811-a97c-dd405c7af884.9151bd30-ca24-454a-b6c2-8d908959950d 1G" returned: 0 in 0.426s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:38:38 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-108009a8-50b6-4e13-9889-6ae1d8df8053 tempest-VolumeSnapshotQuotasNegativeTestJSON-677448301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd38c53f-d7c9-4811-a97c-dd405c7af884 -F qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-bd38c53f-d7c9-4811-a97c-dd405c7af884.9151bd30-ca24-454a-b6c2-8d908959950d {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:38:38 devstack sudo[88747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd38c53f-d7c9-4811-a97c-dd405c7af884 -F qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-bd38c53f-d7c9-4811-a97c-dd405c7af884.9151bd30-ca24-454a-b6c2-8d908959950d Sep 22 15:38:38 devstack sudo[88747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:38:38 devstack cinder-volume[86212]: DEBUG oslo_service.periodic_task [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86212) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 22 15:38:38 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:38:38 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:38:38 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:38:38 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:38:38 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:38:38 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:38:38 devstack sudo[88764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc Sep 22 15:38:38 devstack sudo[88764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:38:38 devstack sudo[88747]: pam_unix(sudo:session): session closed for user root Sep 22 15:38:38 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-108009a8-50b6-4e13-9889-6ae1d8df8053 tempest-VolumeSnapshotQuotasNegativeTestJSON-677448301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd38c53f-d7c9-4811-a97c-dd405c7af884 -F qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-bd38c53f-d7c9-4811-a97c-dd405c7af884.9151bd30-ca24-454a-b6c2-8d908959950d" returned: 0 in 0.338s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:38:38 devstack cinder-volume[86212]: WARNING cinder.volume.drivers.remotefs [None req-108009a8-50b6-4e13-9889-6ae1d8df8053 tempest-VolumeSnapshotQuotasNegativeTestJSON-677448301 None] /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-bd38c53f-d7c9-4811-a97c-dd405c7af884.9151bd30-ca24-454a-b6c2-8d908959950d is being set with open permissions: ugo+rw Sep 22 15:38:38 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-108009a8-50b6-4e13-9889-6ae1d8df8053 tempest-VolumeSnapshotQuotasNegativeTestJSON-677448301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-bd38c53f-d7c9-4811-a97c-dd405c7af884.9151bd30-ca24-454a-b6c2-8d908959950d {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:38:38 devstack sudo[88767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-bd38c53f-d7c9-4811-a97c-dd405c7af884.9151bd30-ca24-454a-b6c2-8d908959950d Sep 22 15:38:38 devstack sudo[88767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:38:38 devstack sudo[88764]: pam_unix(sudo:session): session closed for user root Sep 22 15:38:38 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc" returned: 0 in 0.288s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:38:38 devstack cinder-volume[86212]: DEBUG cinder.manager [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] Notifying Schedulers of capabilities ... {{(pid=86212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 15:38:38 devstack cinder-volume[86212]: DEBUG oslo_service.periodic_task [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] Running periodic task VolumeManager._thread_info {{(pid=86212) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 22 15:38:38 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] thread count: 8 {{(pid=86212) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 22 15:38:38 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] thread info: [<_MainThread(MainThread, started 136163191222400)>, , , , , , , ] {{(pid=86212) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 22 15:38:38 devstack sudo[88767]: pam_unix(sudo:session): session closed for user root Sep 22 15:38:38 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-108009a8-50b6-4e13-9889-6ae1d8df8053 tempest-VolumeSnapshotQuotasNegativeTestJSON-677448301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-bd38c53f-d7c9-4811-a97c-dd405c7af884.9151bd30-ca24-454a-b6c2-8d908959950d" returned: 0 in 0.268s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:38:38 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-108009a8-50b6-4e13-9889-6ae1d8df8053 tempest-VolumeSnapshotQuotasNegativeTestJSON-677448301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-bd38c53f-d7c9-4811-a97c-dd405c7af884.info {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:38:38 devstack sudo[88771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-bd38c53f-d7c9-4811-a97c-dd405c7af884.info Sep 22 15:38:38 devstack sudo[88771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:38:39 devstack sudo[88771]: pam_unix(sudo:session): session closed for user root Sep 22 15:38:39 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-108009a8-50b6-4e13-9889-6ae1d8df8053 tempest-VolumeSnapshotQuotasNegativeTestJSON-677448301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-bd38c53f-d7c9-4811-a97c-dd405c7af884.info" returned: 0 in 0.261s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:38:39 devstack cinder-volume[86212]: WARNING cinder.volume.drivers.remotefs [None req-108009a8-50b6-4e13-9889-6ae1d8df8053 tempest-VolumeSnapshotQuotasNegativeTestJSON-677448301 None] /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-bd38c53f-d7c9-4811-a97c-dd405c7af884.info is being set with open permissions: ugo+rw Sep 22 15:38:39 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-108009a8-50b6-4e13-9889-6ae1d8df8053 tempest-VolumeSnapshotQuotasNegativeTestJSON-677448301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-bd38c53f-d7c9-4811-a97c-dd405c7af884.info {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:38:39 devstack sudo[88774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-bd38c53f-d7c9-4811-a97c-dd405c7af884.info Sep 22 15:38:39 devstack sudo[88774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:38:39 devstack sudo[88774]: pam_unix(sudo:session): session closed for user root Sep 22 15:38:39 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-108009a8-50b6-4e13-9889-6ae1d8df8053 tempest-VolumeSnapshotQuotasNegativeTestJSON-677448301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-bd38c53f-d7c9-4811-a97c-dd405c7af884.info" returned: 0 in 0.271s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:38:39 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-108009a8-50b6-4e13-9889-6ae1d8df8053 tempest-VolumeSnapshotQuotasNegativeTestJSON-677448301 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.049s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:38:39 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-108009a8-50b6-4e13-9889-6ae1d8df8053 tempest-VolumeSnapshotQuotasNegativeTestJSON-677448301 None] Create snapshot completed successfully Sep 22 15:38:39 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-a128d074-3d05-4d8e-a0ac-7c33abaf8d62 tempest-VolumeSnapshotQuotasNegativeTestJSON-677448301 None] Acquiring lock "cinder-9151bd30-ca24-454a-b6c2-8d908959950d-delete_snapshot" by "delete_snapshot" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:38:40 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-a128d074-3d05-4d8e-a0ac-7c33abaf8d62 tempest-VolumeSnapshotQuotasNegativeTestJSON-677448301 None] Lock "cinder-9151bd30-ca24-454a-b6c2-8d908959950d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:38:40 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-a128d074-3d05-4d8e-a0ac-7c33abaf8d62 tempest-VolumeSnapshotQuotasNegativeTestJSON-677448301 None] Acquiring lock "cinder-quobyte-bd38c53f-d7c9-4811-a97c-dd405c7af884" by "delete_snapshot" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:38:40 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-a128d074-3d05-4d8e-a0ac-7c33abaf8d62 tempest-VolumeSnapshotQuotasNegativeTestJSON-677448301 None] Lock "cinder-quobyte-bd38c53f-d7c9-4811-a97c-dd405c7af884" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:38:40 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-a128d074-3d05-4d8e-a0ac-7c33abaf8d62 tempest-VolumeSnapshotQuotasNegativeTestJSON-677448301 None] Acquiring lock "cinder-quobyte-9151bd30-ca24-454a-b6c2-8d908959950d" by "_delete_snapshot" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:38:40 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-a128d074-3d05-4d8e-a0ac-7c33abaf8d62 tempest-VolumeSnapshotQuotasNegativeTestJSON-677448301 None] Lock "cinder-quobyte-9151bd30-ca24-454a-b6c2-8d908959950d" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:38:40 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-a128d074-3d05-4d8e-a0ac-7c33abaf8d62 tempest-VolumeSnapshotQuotasNegativeTestJSON-677448301 None] Deleting offline snapshot 9151bd30-ca24-454a-b6c2-8d908959950d of volume bd38c53f-d7c9-4811-a97c-dd405c7af884 {{(pid=86212) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 22 15:38:40 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-a128d074-3d05-4d8e-a0ac-7c33abaf8d62 tempest-VolumeSnapshotQuotasNegativeTestJSON-677448301 None] snapshot_file for this snap is: volume-bd38c53f-d7c9-4811-a97c-dd405c7af884.9151bd30-ca24-454a-b6c2-8d908959950d {{(pid=86212) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 22 15:38:40 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1bbe0de-b267-4bcb-a91a-e469066fe768]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:38:40 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-a128d074-3d05-4d8e-a0ac-7c33abaf8d62 tempest-VolumeSnapshotQuotasNegativeTestJSON-677448301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-bd38c53f-d7c9-4811-a97c-dd405c7af884.9151bd30-ca24-454a-b6c2-8d908959950d {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:38:40 devstack sudo[88777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-bd38c53f-d7c9-4811-a97c-dd405c7af884.9151bd30-ca24-454a-b6c2-8d908959950d Sep 22 15:38:40 devstack sudo[88777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:38:40 devstack sudo[88777]: pam_unix(sudo:session): session closed for user root Sep 22 15:38:40 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-a128d074-3d05-4d8e-a0ac-7c33abaf8d62 tempest-VolumeSnapshotQuotasNegativeTestJSON-677448301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-bd38c53f-d7c9-4811-a97c-dd405c7af884.9151bd30-ca24-454a-b6c2-8d908959950d" returned: 0 in 0.360s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:38:40 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-a128d074-3d05-4d8e-a0ac-7c33abaf8d62 tempest-VolumeSnapshotQuotasNegativeTestJSON-677448301 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bd38c53f-d7c9-4811-a97c-dd405c7af884(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86212) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 22 15:38:40 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ba3710e-c540-4e1a-bac9-524e006a6c2c]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:38:40 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-a128d074-3d05-4d8e-a0ac-7c33abaf8d62 tempest-VolumeSnapshotQuotasNegativeTestJSON-677448301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-bd38c53f-d7c9-4811-a97c-dd405c7af884 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:38:40 devstack sudo[88782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-bd38c53f-d7c9-4811-a97c-dd405c7af884 Sep 22 15:38:40 devstack sudo[88782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:38:40 devstack sudo[88782]: pam_unix(sudo:session): session closed for user root Sep 22 15:38:40 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-a128d074-3d05-4d8e-a0ac-7c33abaf8d62 tempest-VolumeSnapshotQuotasNegativeTestJSON-677448301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-bd38c53f-d7c9-4811-a97c-dd405c7af884" returned: 0 in 0.352s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:38:40 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-a128d074-3d05-4d8e-a0ac-7c33abaf8d62 tempest-VolumeSnapshotQuotasNegativeTestJSON-677448301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-bd38c53f-d7c9-4811-a97c-dd405c7af884.9151bd30-ca24-454a-b6c2-8d908959950d {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:38:40 devstack sudo[88787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-bd38c53f-d7c9-4811-a97c-dd405c7af884.9151bd30-ca24-454a-b6c2-8d908959950d Sep 22 15:38:40 devstack sudo[88787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:38:41 devstack sudo[88787]: pam_unix(sudo:session): session closed for user root Sep 22 15:38:41 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-a128d074-3d05-4d8e-a0ac-7c33abaf8d62 tempest-VolumeSnapshotQuotasNegativeTestJSON-677448301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-bd38c53f-d7c9-4811-a97c-dd405c7af884.9151bd30-ca24-454a-b6c2-8d908959950d" returned: 0 in 0.327s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:38:41 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-a128d074-3d05-4d8e-a0ac-7c33abaf8d62 tempest-VolumeSnapshotQuotasNegativeTestJSON-677448301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-bd38c53f-d7c9-4811-a97c-dd405c7af884.9151bd30-ca24-454a-b6c2-8d908959950d {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:38:41 devstack sudo[88793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-bd38c53f-d7c9-4811-a97c-dd405c7af884.9151bd30-ca24-454a-b6c2-8d908959950d Sep 22 15:38:41 devstack sudo[88793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:38:41 devstack sudo[88793]: pam_unix(sudo:session): session closed for user root Sep 22 15:38:41 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-a128d074-3d05-4d8e-a0ac-7c33abaf8d62 tempest-VolumeSnapshotQuotasNegativeTestJSON-677448301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-bd38c53f-d7c9-4811-a97c-dd405c7af884.9151bd30-ca24-454a-b6c2-8d908959950d" returned: 0 in 0.242s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:38:41 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-a128d074-3d05-4d8e-a0ac-7c33abaf8d62 tempest-VolumeSnapshotQuotasNegativeTestJSON-677448301 None] Lock "cinder-quobyte-9151bd30-ca24-454a-b6c2-8d908959950d" released by "_delete_snapshot" :: held 1.396s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:38:41 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-a128d074-3d05-4d8e-a0ac-7c33abaf8d62 tempest-VolumeSnapshotQuotasNegativeTestJSON-677448301 None] Lock "cinder-quobyte-bd38c53f-d7c9-4811-a97c-dd405c7af884" released by "delete_snapshot" :: held 1.429s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:38:41 devstack cinder-volume[86212]: WARNING cinder.quota [None req-a128d074-3d05-4d8e-a0ac-7c33abaf8d62 tempest-VolumeSnapshotQuotasNegativeTestJSON-677448301 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 22 15:38:41 devstack cinder-volume[86212]: DEBUG cinder.quota [None req-a128d074-3d05-4d8e-a0ac-7c33abaf8d62 tempest-VolumeSnapshotQuotasNegativeTestJSON-677448301 None] Created reservations ['2401fcfb-2931-4366-90a1-03ce6d71e112', '3b8bbee3-cb27-47ba-ae86-be0eb105cbe8', '41416b4e-31ba-4305-8008-248ac369250f', 'b381b71c-37a9-46c9-86b8-01b357bd4b20'] {{(pid=86212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 15:38:41 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-a128d074-3d05-4d8e-a0ac-7c33abaf8d62 tempest-VolumeSnapshotQuotasNegativeTestJSON-677448301 None] Delete snapshot completed successfully. Sep 22 15:38:41 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-a128d074-3d05-4d8e-a0ac-7c33abaf8d62 tempest-VolumeSnapshotQuotasNegativeTestJSON-677448301 None] Lock "cinder-9151bd30-ca24-454a-b6c2-8d908959950d-delete_snapshot" released by "delete_snapshot" :: held 1.565s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:38:42 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-fdde99d1-a1cf-432f-bb7c-1a9f194092b5 tempest-VolumeSnapshotQuotasNegativeTestJSON-677448301 None] Acquiring lock "cinder-bd38c53f-d7c9-4811-a97c-dd405c7af884-delete_volume" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:38:42 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-fdde99d1-a1cf-432f-bb7c-1a9f194092b5 tempest-VolumeSnapshotQuotasNegativeTestJSON-677448301 None] Lock "cinder-bd38c53f-d7c9-4811-a97c-dd405c7af884-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:38:42 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-fdde99d1-a1cf-432f-bb7c-1a9f194092b5 tempest-VolumeSnapshotQuotasNegativeTestJSON-677448301 None] Acquiring lock "cinder-quobyte-bd38c53f-d7c9-4811-a97c-dd405c7af884" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:38:42 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-fdde99d1-a1cf-432f-bb7c-1a9f194092b5 tempest-VolumeSnapshotQuotasNegativeTestJSON-677448301 None] Lock "cinder-quobyte-bd38c53f-d7c9-4811-a97c-dd405c7af884" acquired by "delete_volume" :: waited 0.013s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:38:42 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[005bb6b2-4cfd-4389-9333-74b0976f686b]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:38:42 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-fdde99d1-a1cf-432f-bb7c-1a9f194092b5 tempest-VolumeSnapshotQuotasNegativeTestJSON-677448301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-bd38c53f-d7c9-4811-a97c-dd405c7af884 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:38:42 devstack sudo[88796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-bd38c53f-d7c9-4811-a97c-dd405c7af884 Sep 22 15:38:42 devstack sudo[88796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:38:42 devstack sudo[88796]: pam_unix(sudo:session): session closed for user root Sep 22 15:38:42 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-fdde99d1-a1cf-432f-bb7c-1a9f194092b5 tempest-VolumeSnapshotQuotasNegativeTestJSON-677448301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-bd38c53f-d7c9-4811-a97c-dd405c7af884" returned: 0 in 0.355s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:38:42 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-fdde99d1-a1cf-432f-bb7c-1a9f194092b5 tempest-VolumeSnapshotQuotasNegativeTestJSON-677448301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-bd38c53f-d7c9-4811-a97c-dd405c7af884 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:38:42 devstack sudo[88801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-bd38c53f-d7c9-4811-a97c-dd405c7af884 Sep 22 15:38:42 devstack sudo[88801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:38:42 devstack sudo[88801]: pam_unix(sudo:session): session closed for user root Sep 22 15:38:42 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-fdde99d1-a1cf-432f-bb7c-1a9f194092b5 tempest-VolumeSnapshotQuotasNegativeTestJSON-677448301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-bd38c53f-d7c9-4811-a97c-dd405c7af884" returned: 0 in 0.229s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:38:42 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-fdde99d1-a1cf-432f-bb7c-1a9f194092b5 tempest-VolumeSnapshotQuotasNegativeTestJSON-677448301 None] Lock "cinder-quobyte-bd38c53f-d7c9-4811-a97c-dd405c7af884" released by "delete_volume" :: held 0.642s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:38:42 devstack cinder-volume[86212]: DEBUG cinder.quota [None req-fdde99d1-a1cf-432f-bb7c-1a9f194092b5 tempest-VolumeSnapshotQuotasNegativeTestJSON-677448301 None] Created reservations ['0c07f523-19ad-4d73-b78d-999fc618e4f3', 'e49f7915-82f5-4d79-9d9c-4646fdd84b76', '1370d352-7007-4475-bbcc-1d38174c0f9d', '2272db85-9d0c-4f56-98c2-f1b5696642b5'] {{(pid=86212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 15:38:43 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-fdde99d1-a1cf-432f-bb7c-1a9f194092b5 tempest-VolumeSnapshotQuotasNegativeTestJSON-677448301 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:38:43 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-fdde99d1-a1cf-432f-bb7c-1a9f194092b5 tempest-VolumeSnapshotQuotasNegativeTestJSON-677448301 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:38:43 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-fdde99d1-a1cf-432f-bb7c-1a9f194092b5 tempest-VolumeSnapshotQuotasNegativeTestJSON-677448301 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:38:43 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-fdde99d1-a1cf-432f-bb7c-1a9f194092b5 tempest-VolumeSnapshotQuotasNegativeTestJSON-677448301 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:38:43 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-fdde99d1-a1cf-432f-bb7c-1a9f194092b5 tempest-VolumeSnapshotQuotasNegativeTestJSON-677448301 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:38:43 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-fdde99d1-a1cf-432f-bb7c-1a9f194092b5 tempest-VolumeSnapshotQuotasNegativeTestJSON-677448301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:38:43 devstack sudo[88804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc Sep 22 15:38:43 devstack sudo[88804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:38:43 devstack sudo[88804]: pam_unix(sudo:session): session closed for user root Sep 22 15:38:43 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-fdde99d1-a1cf-432f-bb7c-1a9f194092b5 tempest-VolumeSnapshotQuotasNegativeTestJSON-677448301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc" returned: 0 in 0.248s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:38:43 devstack cinder-volume[86212]: DEBUG cinder.manager [None req-fdde99d1-a1cf-432f-bb7c-1a9f194092b5 tempest-VolumeSnapshotQuotasNegativeTestJSON-677448301 None] Notifying Schedulers of capabilities ... {{(pid=86212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 15:38:43 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-fdde99d1-a1cf-432f-bb7c-1a9f194092b5 tempest-VolumeSnapshotQuotasNegativeTestJSON-677448301 None] Deleted volume successfully. Sep 22 15:38:43 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-fdde99d1-a1cf-432f-bb7c-1a9f194092b5 tempest-VolumeSnapshotQuotasNegativeTestJSON-677448301 None] Lock "cinder-bd38c53f-d7c9-4811-a97c-dd405c7af884-delete_volume" released by "delete_volume" :: held 1.085s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:38:44 devstack cinder-volume[86212]: DEBUG cinder.volume.flows.manager.create_volume [None req-73f74c94-6bbb-41bc-a269-61f0c539a417 tempest-ServerActionsTestOtherA-1816233839 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 15:38:44 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-73f74c94-6bbb-41bc-a269-61f0c539a417 tempest-ServerActionsTestOtherA-1816233839 None] Flow 'volume_create_manager' (eab27d55-1b8b-42b8-8178-36313de76b02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:38:44 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-73f74c94-6bbb-41bc-a269-61f0c539a417 tempest-ServerActionsTestOtherA-1816233839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97b4b654-93f8-432c-aa26-98db87b19289) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:38:44 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-73f74c94-6bbb-41bc-a269-61f0c539a417 tempest-ServerActionsTestOtherA-1816233839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97b4b654-93f8-432c-aa26-98db87b19289) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:38:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-790979478',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34a55037-d1d2-4edd-8350-32536e5cd337,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c05506a15e87408ea1d2542c3f5c8e14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:38:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:38:45Z,use_quota=True,user_id='9b8b3ceb4b52490aaf75da231d786280',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:38:44 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-73f74c94-6bbb-41bc-a269-61f0c539a417 tempest-ServerActionsTestOtherA-1816233839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e26b26bf-dc51-4771-b787-5a7d2ffd6d3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:38:44 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-73f74c94-6bbb-41bc-a269-61f0c539a417 tempest-ServerActionsTestOtherA-1816233839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e26b26bf-dc51-4771-b787-5a7d2ffd6d3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:38:44 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-73f74c94-6bbb-41bc-a269-61f0c539a417 tempest-ServerActionsTestOtherA-1816233839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3787011e-c8f0-4fd1-bb41-c0532755e2e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:38:44 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-73f74c94-6bbb-41bc-a269-61f0c539a417 tempest-ServerActionsTestOtherA-1816233839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3787011e-c8f0-4fd1-bb41-c0532755e2e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '34a55037-d1d2-4edd-8350-32536e5cd337', 'volume_name': 'volume-34a55037-d1d2-4edd-8350-32536e5cd337', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:38:44 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-73f74c94-6bbb-41bc-a269-61f0c539a417 tempest-ServerActionsTestOtherA-1816233839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (004ad203-449a-47b7-991f-bb7843e3305c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:38:44 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-73f74c94-6bbb-41bc-a269-61f0c539a417 tempest-ServerActionsTestOtherA-1816233839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (004ad203-449a-47b7-991f-bb7843e3305c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:38:44 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-73f74c94-6bbb-41bc-a269-61f0c539a417 tempest-ServerActionsTestOtherA-1816233839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e95d45e9-0004-4f32-81ba-6e28c694f6c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:38:44 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-73f74c94-6bbb-41bc-a269-61f0c539a417 tempest-ServerActionsTestOtherA-1816233839 None] Volume 34a55037-d1d2-4edd-8350-32536e5cd337: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-34a55037-d1d2-4edd-8350-32536e5cd337', 'volume_size': 1} Sep 22 15:38:44 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-73f74c94-6bbb-41bc-a269-61f0c539a417 tempest-ServerActionsTestOtherA-1816233839 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:38:44 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-73f74c94-6bbb-41bc-a269-61f0c539a417 tempest-ServerActionsTestOtherA-1816233839 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:38:44 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-73f74c94-6bbb-41bc-a269-61f0c539a417 tempest-ServerActionsTestOtherA-1816233839 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:38:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-790979478',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34a55037-d1d2-4edd-8350-32536e5cd337,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c05506a15e87408ea1d2542c3f5c8e14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:38:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:38:45Z,use_quota=True,user_id='9b8b3ceb4b52490aaf75da231d786280',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)}" {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 15:38:44 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-73f74c94-6bbb-41bc-a269-61f0c539a417 tempest-ServerActionsTestOtherA-1816233839 None] Creating volume 34a55037-d1d2-4edd-8350-32536e5cd337 {{(pid=86212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 15:38:44 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-73f74c94-6bbb-41bc-a269-61f0c539a417 tempest-ServerActionsTestOtherA-1816233839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:38:44 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-73f74c94-6bbb-41bc-a269-61f0c539a417 tempest-ServerActionsTestOtherA-1816233839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:38:44 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-73f74c94-6bbb-41bc-a269-61f0c539a417 tempest-ServerActionsTestOtherA-1816233839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:38:44 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-73f74c94-6bbb-41bc-a269-61f0c539a417 tempest-ServerActionsTestOtherA-1816233839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:38:44 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-73f74c94-6bbb-41bc-a269-61f0c539a417 tempest-ServerActionsTestOtherA-1816233839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:38:44 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-73f74c94-6bbb-41bc-a269-61f0c539a417 tempest-ServerActionsTestOtherA-1816233839 None] Selected osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 as target Quobyte volume. {{(pid=86212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 15:38:44 devstack cinder-volume[86212]: INFO cinder.volume.drivers.remotefs [None req-73f74c94-6bbb-41bc-a269-61f0c539a417 tempest-ServerActionsTestOtherA-1816233839 None] casted to osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 Sep 22 15:38:44 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-73f74c94-6bbb-41bc-a269-61f0c539a417 tempest-ServerActionsTestOtherA-1816233839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-34a55037-d1d2-4edd-8350-32536e5cd337 1073741824 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:38:44 devstack sudo[88809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-34a55037-d1d2-4edd-8350-32536e5cd337 1073741824 Sep 22 15:38:44 devstack sudo[88809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:38:45 devstack sudo[88809]: pam_unix(sudo:session): session closed for user root Sep 22 15:38:45 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-73f74c94-6bbb-41bc-a269-61f0c539a417 tempest-ServerActionsTestOtherA-1816233839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-34a55037-d1d2-4edd-8350-32536e5cd337 1073741824" returned: 0 in 0.670s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:38:45 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-73f74c94-6bbb-41bc-a269-61f0c539a417 tempest-ServerActionsTestOtherA-1816233839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-34a55037-d1d2-4edd-8350-32536e5cd337 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:38:45 devstack sudo[88816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-34a55037-d1d2-4edd-8350-32536e5cd337 Sep 22 15:38:45 devstack sudo[88816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:38:45 devstack sudo[88816]: pam_unix(sudo:session): session closed for user root Sep 22 15:38:45 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-73f74c94-6bbb-41bc-a269-61f0c539a417 tempest-ServerActionsTestOtherA-1816233839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-34a55037-d1d2-4edd-8350-32536e5cd337" returned: 0 in 0.257s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:38:45 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-73f74c94-6bbb-41bc-a269-61f0c539a417 tempest-ServerActionsTestOtherA-1816233839 None] <== create_volume: return (999ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'} {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 15:38:45 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-73f74c94-6bbb-41bc-a269-61f0c539a417 tempest-ServerActionsTestOtherA-1816233839 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.002s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:38:45 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-73f74c94-6bbb-41bc-a269-61f0c539a417 tempest-ServerActionsTestOtherA-1816233839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e95d45e9-0004-4f32-81ba-6e28c694f6c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-34a55037-d1d2-4edd-8350-32536e5cd337', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:38:45 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-73f74c94-6bbb-41bc-a269-61f0c539a417 tempest-ServerActionsTestOtherA-1816233839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a98c7cc-edfd-4313-af86-2a5f07326d1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:38:45 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-73f74c94-6bbb-41bc-a269-61f0c539a417 tempest-ServerActionsTestOtherA-1816233839 None] Volume volume-34a55037-d1d2-4edd-8350-32536e5cd337 (34a55037-d1d2-4edd-8350-32536e5cd337): created successfully Sep 22 15:38:45 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-73f74c94-6bbb-41bc-a269-61f0c539a417 tempest-ServerActionsTestOtherA-1816233839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a98c7cc-edfd-4313-af86-2a5f07326d1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:38:45 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-73f74c94-6bbb-41bc-a269-61f0c539a417 tempest-ServerActionsTestOtherA-1816233839 None] Flow 'volume_create_manager' (eab27d55-1b8b-42b8-8178-36313de76b02) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:38:45 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-73f74c94-6bbb-41bc-a269-61f0c539a417 tempest-ServerActionsTestOtherA-1816233839 None] Created volume successfully. Sep 22 15:38:47 devstack cinder-volume[86212]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9c50c01-a5cd-4b55-a5a2-a30b08e1f4cf tempest-AttachVolumeShelveTestJSON-269480047 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 15:38:47 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-b9c50c01-a5cd-4b55-a5a2-a30b08e1f4cf tempest-AttachVolumeShelveTestJSON-269480047 None] Flow 'volume_create_manager' (7464da05-dd4e-4db6-86c6-67d253e48658) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:38:47 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-b9c50c01-a5cd-4b55-a5a2-a30b08e1f4cf tempest-AttachVolumeShelveTestJSON-269480047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (542ea749-d823-4284-99b3-6ae4b62080e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:38:47 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-b9c50c01-a5cd-4b55-a5a2-a30b08e1f4cf tempest-AttachVolumeShelveTestJSON-269480047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (542ea749-d823-4284-99b3-6ae4b62080e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:38:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1250900824',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4dc9ae44-eae2-4a0e-b4b0-4ee60b9c54b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9fedba1386a4f6cb1567b8353296ef5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:38:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:38:47Z,use_quota=True,user_id='197a1a12fdb342689bc772474ee0ad00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:38:47 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-b9c50c01-a5cd-4b55-a5a2-a30b08e1f4cf tempest-AttachVolumeShelveTestJSON-269480047 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8cc5c25a-a0ab-44c7-aec5-a0a0b056714d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:38:47 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-b9c50c01-a5cd-4b55-a5a2-a30b08e1f4cf tempest-AttachVolumeShelveTestJSON-269480047 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8cc5c25a-a0ab-44c7-aec5-a0a0b056714d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:38:47 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-b9c50c01-a5cd-4b55-a5a2-a30b08e1f4cf tempest-AttachVolumeShelveTestJSON-269480047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48e930ec-b92c-4f73-9ec1-97ad92a4e33c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:38:47 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-b9c50c01-a5cd-4b55-a5a2-a30b08e1f4cf tempest-AttachVolumeShelveTestJSON-269480047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48e930ec-b92c-4f73-9ec1-97ad92a4e33c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4dc9ae44-eae2-4a0e-b4b0-4ee60b9c54b2', 'volume_name': 'volume-4dc9ae44-eae2-4a0e-b4b0-4ee60b9c54b2', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:38:47 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-b9c50c01-a5cd-4b55-a5a2-a30b08e1f4cf tempest-AttachVolumeShelveTestJSON-269480047 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (618a5665-4a8e-41cb-b0b2-d199cf94b380) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:38:47 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-b9c50c01-a5cd-4b55-a5a2-a30b08e1f4cf tempest-AttachVolumeShelveTestJSON-269480047 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (618a5665-4a8e-41cb-b0b2-d199cf94b380) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:38:47 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-b9c50c01-a5cd-4b55-a5a2-a30b08e1f4cf tempest-AttachVolumeShelveTestJSON-269480047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fc88930-9e4c-4168-8e58-cb56968a2d7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:38:47 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-b9c50c01-a5cd-4b55-a5a2-a30b08e1f4cf tempest-AttachVolumeShelveTestJSON-269480047 None] Volume 4dc9ae44-eae2-4a0e-b4b0-4ee60b9c54b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4dc9ae44-eae2-4a0e-b4b0-4ee60b9c54b2', 'volume_size': 1} Sep 22 15:38:47 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-b9c50c01-a5cd-4b55-a5a2-a30b08e1f4cf tempest-AttachVolumeShelveTestJSON-269480047 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:38:47 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-b9c50c01-a5cd-4b55-a5a2-a30b08e1f4cf tempest-AttachVolumeShelveTestJSON-269480047 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:38:47 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-b9c50c01-a5cd-4b55-a5a2-a30b08e1f4cf tempest-AttachVolumeShelveTestJSON-269480047 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:38:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1250900824',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4dc9ae44-eae2-4a0e-b4b0-4ee60b9c54b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9fedba1386a4f6cb1567b8353296ef5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:38:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:38:47Z,use_quota=True,user_id='197a1a12fdb342689bc772474ee0ad00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)}" {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 15:38:47 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-b9c50c01-a5cd-4b55-a5a2-a30b08e1f4cf tempest-AttachVolumeShelveTestJSON-269480047 None] Creating volume 4dc9ae44-eae2-4a0e-b4b0-4ee60b9c54b2 {{(pid=86212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 15:38:47 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-b9c50c01-a5cd-4b55-a5a2-a30b08e1f4cf tempest-AttachVolumeShelveTestJSON-269480047 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:38:47 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-b9c50c01-a5cd-4b55-a5a2-a30b08e1f4cf tempest-AttachVolumeShelveTestJSON-269480047 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:38:47 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-b9c50c01-a5cd-4b55-a5a2-a30b08e1f4cf tempest-AttachVolumeShelveTestJSON-269480047 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:38:47 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-b9c50c01-a5cd-4b55-a5a2-a30b08e1f4cf tempest-AttachVolumeShelveTestJSON-269480047 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:38:47 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-b9c50c01-a5cd-4b55-a5a2-a30b08e1f4cf tempest-AttachVolumeShelveTestJSON-269480047 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:38:47 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-b9c50c01-a5cd-4b55-a5a2-a30b08e1f4cf tempest-AttachVolumeShelveTestJSON-269480047 None] Selected osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 as target Quobyte volume. {{(pid=86212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 15:38:47 devstack cinder-volume[86212]: INFO cinder.volume.drivers.remotefs [None req-b9c50c01-a5cd-4b55-a5a2-a30b08e1f4cf tempest-AttachVolumeShelveTestJSON-269480047 None] casted to osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 Sep 22 15:38:47 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-b9c50c01-a5cd-4b55-a5a2-a30b08e1f4cf tempest-AttachVolumeShelveTestJSON-269480047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-4dc9ae44-eae2-4a0e-b4b0-4ee60b9c54b2 1073741824 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:38:47 devstack sudo[88824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-4dc9ae44-eae2-4a0e-b4b0-4ee60b9c54b2 1073741824 Sep 22 15:38:47 devstack sudo[88824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:38:47 devstack sudo[88824]: pam_unix(sudo:session): session closed for user root Sep 22 15:38:47 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-b9c50c01-a5cd-4b55-a5a2-a30b08e1f4cf tempest-AttachVolumeShelveTestJSON-269480047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-4dc9ae44-eae2-4a0e-b4b0-4ee60b9c54b2 1073741824" returned: 0 in 0.693s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:38:48 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-b9c50c01-a5cd-4b55-a5a2-a30b08e1f4cf tempest-AttachVolumeShelveTestJSON-269480047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-4dc9ae44-eae2-4a0e-b4b0-4ee60b9c54b2 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:38:48 devstack sudo[88832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-4dc9ae44-eae2-4a0e-b4b0-4ee60b9c54b2 Sep 22 15:38:48 devstack sudo[88832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:38:48 devstack sudo[88832]: pam_unix(sudo:session): session closed for user root Sep 22 15:38:48 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-b9c50c01-a5cd-4b55-a5a2-a30b08e1f4cf tempest-AttachVolumeShelveTestJSON-269480047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-4dc9ae44-eae2-4a0e-b4b0-4ee60b9c54b2" returned: 0 in 0.321s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:38:48 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-b9c50c01-a5cd-4b55-a5a2-a30b08e1f4cf tempest-AttachVolumeShelveTestJSON-269480047 None] <== create_volume: return (1122ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'} {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 15:38:48 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-b9c50c01-a5cd-4b55-a5a2-a30b08e1f4cf tempest-AttachVolumeShelveTestJSON-269480047 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.128s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:38:48 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-b9c50c01-a5cd-4b55-a5a2-a30b08e1f4cf tempest-AttachVolumeShelveTestJSON-269480047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fc88930-9e4c-4168-8e58-cb56968a2d7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4dc9ae44-eae2-4a0e-b4b0-4ee60b9c54b2', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:38:48 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-b9c50c01-a5cd-4b55-a5a2-a30b08e1f4cf tempest-AttachVolumeShelveTestJSON-269480047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8b14cd0-1da3-4418-86dd-995a36a4fdb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:38:48 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-b9c50c01-a5cd-4b55-a5a2-a30b08e1f4cf tempest-AttachVolumeShelveTestJSON-269480047 None] Volume volume-4dc9ae44-eae2-4a0e-b4b0-4ee60b9c54b2 (4dc9ae44-eae2-4a0e-b4b0-4ee60b9c54b2): created successfully Sep 22 15:38:48 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-b9c50c01-a5cd-4b55-a5a2-a30b08e1f4cf tempest-AttachVolumeShelveTestJSON-269480047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8b14cd0-1da3-4418-86dd-995a36a4fdb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:38:48 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-b9c50c01-a5cd-4b55-a5a2-a30b08e1f4cf tempest-AttachVolumeShelveTestJSON-269480047 None] Flow 'volume_create_manager' (7464da05-dd4e-4db6-86c6-67d253e48658) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:38:48 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-b9c50c01-a5cd-4b55-a5a2-a30b08e1f4cf tempest-AttachVolumeShelveTestJSON-269480047 None] Created volume successfully. Sep 22 15:38:52 devstack cinder-volume[86212]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1561c82-0636-43e6-9276-a1cc7e766d1a tempest-VolumeTypesAccessTest-402847972 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 15:38:52 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-b1561c82-0636-43e6-9276-a1cc7e766d1a tempest-VolumeTypesAccessTest-402847972 None] Flow 'volume_create_manager' (920d9a91-869f-4227-8baf-309da001c940) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:38:52 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-b1561c82-0636-43e6-9276-a1cc7e766d1a tempest-VolumeTypesAccessTest-402847972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e534cf1-5d9b-4fec-877d-4dd49d651471) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:38:52 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-b1561c82-0636-43e6-9276-a1cc7e766d1a tempest-VolumeTypesAccessTest-402847972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e534cf1-5d9b-4fec-877d-4dd49d651471) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:38:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-188382820',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4771f90a-1cd9-4585-b2cc-8feabf906720,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f7a46ae82f44348a320e3f412414197',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:38:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:38:52Z,use_quota=True,user_id='3f9ab1b686434112862db2914d8c5ab7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab721a9d-43bc-4366-acb3-0086671a0a28),volume_type_id=ab721a9d-43bc-4366-acb3-0086671a0a28)' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:38:52 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-b1561c82-0636-43e6-9276-a1cc7e766d1a tempest-VolumeTypesAccessTest-402847972 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17078ddf-620b-4479-9a44-25eaeecb1d09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:38:52 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-b1561c82-0636-43e6-9276-a1cc7e766d1a tempest-VolumeTypesAccessTest-402847972 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17078ddf-620b-4479-9a44-25eaeecb1d09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:38:52 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-b1561c82-0636-43e6-9276-a1cc7e766d1a tempest-VolumeTypesAccessTest-402847972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6d6da8c-8308-4294-b508-a86706a82b9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:38:52 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-b1561c82-0636-43e6-9276-a1cc7e766d1a tempest-VolumeTypesAccessTest-402847972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6d6da8c-8308-4294-b508-a86706a82b9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4771f90a-1cd9-4585-b2cc-8feabf906720', 'volume_name': 'volume-4771f90a-1cd9-4585-b2cc-8feabf906720', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:38:52 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-b1561c82-0636-43e6-9276-a1cc7e766d1a tempest-VolumeTypesAccessTest-402847972 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4a9a734-fb76-4cbd-a911-c191669d5dc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:38:52 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-b1561c82-0636-43e6-9276-a1cc7e766d1a tempest-VolumeTypesAccessTest-402847972 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4a9a734-fb76-4cbd-a911-c191669d5dc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:38:52 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-b1561c82-0636-43e6-9276-a1cc7e766d1a tempest-VolumeTypesAccessTest-402847972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad9c5317-5947-4fda-ae6f-e1ef464a379e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:38:52 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-b1561c82-0636-43e6-9276-a1cc7e766d1a tempest-VolumeTypesAccessTest-402847972 None] Volume 4771f90a-1cd9-4585-b2cc-8feabf906720: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4771f90a-1cd9-4585-b2cc-8feabf906720', 'volume_size': 1} Sep 22 15:38:52 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-b1561c82-0636-43e6-9276-a1cc7e766d1a tempest-VolumeTypesAccessTest-402847972 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:38:52 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-b1561c82-0636-43e6-9276-a1cc7e766d1a tempest-VolumeTypesAccessTest-402847972 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:38:52 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-b1561c82-0636-43e6-9276-a1cc7e766d1a tempest-VolumeTypesAccessTest-402847972 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:38:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-188382820',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4771f90a-1cd9-4585-b2cc-8feabf906720,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f7a46ae82f44348a320e3f412414197',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:38:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:38:52Z,use_quota=True,user_id='3f9ab1b686434112862db2914d8c5ab7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab721a9d-43bc-4366-acb3-0086671a0a28),volume_type_id=ab721a9d-43bc-4366-acb3-0086671a0a28)}" {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 15:38:52 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-b1561c82-0636-43e6-9276-a1cc7e766d1a tempest-VolumeTypesAccessTest-402847972 None] Creating volume 4771f90a-1cd9-4585-b2cc-8feabf906720 {{(pid=86212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 15:38:52 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-b1561c82-0636-43e6-9276-a1cc7e766d1a tempest-VolumeTypesAccessTest-402847972 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:38:52 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-b1561c82-0636-43e6-9276-a1cc7e766d1a tempest-VolumeTypesAccessTest-402847972 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:38:52 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-b1561c82-0636-43e6-9276-a1cc7e766d1a tempest-VolumeTypesAccessTest-402847972 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:38:52 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-b1561c82-0636-43e6-9276-a1cc7e766d1a tempest-VolumeTypesAccessTest-402847972 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:38:52 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-b1561c82-0636-43e6-9276-a1cc7e766d1a tempest-VolumeTypesAccessTest-402847972 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:38:52 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-b1561c82-0636-43e6-9276-a1cc7e766d1a tempest-VolumeTypesAccessTest-402847972 None] Selected osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 as target Quobyte volume. {{(pid=86212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 15:38:52 devstack cinder-volume[86212]: INFO cinder.volume.drivers.remotefs [None req-b1561c82-0636-43e6-9276-a1cc7e766d1a tempest-VolumeTypesAccessTest-402847972 None] casted to osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 Sep 22 15:38:52 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-b1561c82-0636-43e6-9276-a1cc7e766d1a tempest-VolumeTypesAccessTest-402847972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-4771f90a-1cd9-4585-b2cc-8feabf906720 1073741824 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:38:52 devstack sudo[88897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-4771f90a-1cd9-4585-b2cc-8feabf906720 1073741824 Sep 22 15:38:52 devstack sudo[88897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:38:53 devstack sudo[88897]: pam_unix(sudo:session): session closed for user root Sep 22 15:38:53 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-b1561c82-0636-43e6-9276-a1cc7e766d1a tempest-VolumeTypesAccessTest-402847972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-4771f90a-1cd9-4585-b2cc-8feabf906720 1073741824" returned: 0 in 0.748s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:38:53 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-b1561c82-0636-43e6-9276-a1cc7e766d1a tempest-VolumeTypesAccessTest-402847972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-4771f90a-1cd9-4585-b2cc-8feabf906720 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:38:53 devstack sudo[88931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-4771f90a-1cd9-4585-b2cc-8feabf906720 Sep 22 15:38:53 devstack sudo[88931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:38:53 devstack sudo[88931]: pam_unix(sudo:session): session closed for user root Sep 22 15:38:54 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-b1561c82-0636-43e6-9276-a1cc7e766d1a tempest-VolumeTypesAccessTest-402847972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-4771f90a-1cd9-4585-b2cc-8feabf906720" returned: 0 in 0.437s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:38:54 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-b1561c82-0636-43e6-9276-a1cc7e766d1a tempest-VolumeTypesAccessTest-402847972 None] <== create_volume: return (1287ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'} {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 15:38:54 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-b1561c82-0636-43e6-9276-a1cc7e766d1a tempest-VolumeTypesAccessTest-402847972 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.294s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:38:54 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-b1561c82-0636-43e6-9276-a1cc7e766d1a tempest-VolumeTypesAccessTest-402847972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad9c5317-5947-4fda-ae6f-e1ef464a379e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4771f90a-1cd9-4585-b2cc-8feabf906720', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:38:54 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-b1561c82-0636-43e6-9276-a1cc7e766d1a tempest-VolumeTypesAccessTest-402847972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c2ff802-001f-4aeb-a9b8-1dfc7fd5ab5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:38:54 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-b1561c82-0636-43e6-9276-a1cc7e766d1a tempest-VolumeTypesAccessTest-402847972 None] Volume volume-4771f90a-1cd9-4585-b2cc-8feabf906720 (4771f90a-1cd9-4585-b2cc-8feabf906720): created successfully Sep 22 15:38:54 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-b1561c82-0636-43e6-9276-a1cc7e766d1a tempest-VolumeTypesAccessTest-402847972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c2ff802-001f-4aeb-a9b8-1dfc7fd5ab5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:38:54 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-b1561c82-0636-43e6-9276-a1cc7e766d1a tempest-VolumeTypesAccessTest-402847972 None] Flow 'volume_create_manager' (920d9a91-869f-4227-8baf-309da001c940) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:38:54 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-b1561c82-0636-43e6-9276-a1cc7e766d1a tempest-VolumeTypesAccessTest-402847972 None] Created volume successfully. Sep 22 15:38:54 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-7fa48ad5-7f97-4ffc-b9ce-d20b042df1ed tempest-VolumeTypesAccessTest-402847972 None] Acquiring lock "cinder-4771f90a-1cd9-4585-b2cc-8feabf906720-delete_volume" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:38:54 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-7fa48ad5-7f97-4ffc-b9ce-d20b042df1ed tempest-VolumeTypesAccessTest-402847972 None] Lock "cinder-4771f90a-1cd9-4585-b2cc-8feabf906720-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:38:54 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-7fa48ad5-7f97-4ffc-b9ce-d20b042df1ed tempest-VolumeTypesAccessTest-402847972 None] Acquiring lock "cinder-quobyte-4771f90a-1cd9-4585-b2cc-8feabf906720" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:38:54 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-7fa48ad5-7f97-4ffc-b9ce-d20b042df1ed tempest-VolumeTypesAccessTest-402847972 None] Lock "cinder-quobyte-4771f90a-1cd9-4585-b2cc-8feabf906720" acquired by "delete_volume" :: waited 0.023s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:38:54 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdc43ccf-d08f-433d-8b94-66c8bc2064c0]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:38:54 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-7fa48ad5-7f97-4ffc-b9ce-d20b042df1ed tempest-VolumeTypesAccessTest-402847972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-4771f90a-1cd9-4585-b2cc-8feabf906720 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:38:55 devstack sudo[88948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-4771f90a-1cd9-4585-b2cc-8feabf906720 Sep 22 15:38:55 devstack sudo[88948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:38:55 devstack sudo[88948]: pam_unix(sudo:session): session closed for user root Sep 22 15:38:55 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-7fa48ad5-7f97-4ffc-b9ce-d20b042df1ed tempest-VolumeTypesAccessTest-402847972 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-4771f90a-1cd9-4585-b2cc-8feabf906720" returned: 0 in 0.767s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:38:55 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-7fa48ad5-7f97-4ffc-b9ce-d20b042df1ed tempest-VolumeTypesAccessTest-402847972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-4771f90a-1cd9-4585-b2cc-8feabf906720 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:38:55 devstack sudo[88978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-4771f90a-1cd9-4585-b2cc-8feabf906720 Sep 22 15:38:55 devstack sudo[88978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:38:56 devstack sudo[88978]: pam_unix(sudo:session): session closed for user root Sep 22 15:38:56 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-7fa48ad5-7f97-4ffc-b9ce-d20b042df1ed tempest-VolumeTypesAccessTest-402847972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-4771f90a-1cd9-4585-b2cc-8feabf906720" returned: 0 in 0.756s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:38:56 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-7fa48ad5-7f97-4ffc-b9ce-d20b042df1ed tempest-VolumeTypesAccessTest-402847972 None] Lock "cinder-quobyte-4771f90a-1cd9-4585-b2cc-8feabf906720" released by "delete_volume" :: held 1.632s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:38:56 devstack cinder-volume[86212]: WARNING cinder.quota [None req-7fa48ad5-7f97-4ffc-b9ce-d20b042df1ed tempest-VolumeTypesAccessTest-402847972 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-150736640 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-150736640, it is now deprecated. Please use the default quota class for default quota. Sep 22 15:38:56 devstack cinder-volume[86212]: WARNING cinder.quota [None req-7fa48ad5-7f97-4ffc-b9ce-d20b042df1ed tempest-VolumeTypesAccessTest-402847972 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-150736640 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-150736640, it is now deprecated. Please use the default quota class for default quota. Sep 22 15:38:56 devstack cinder-volume[86212]: DEBUG cinder.quota [None req-7fa48ad5-7f97-4ffc-b9ce-d20b042df1ed tempest-VolumeTypesAccessTest-402847972 None] Created reservations ['159f4156-c676-489c-940b-33b22d0f9148', '6066f2cd-1be3-4b3c-bae5-0cab5eafdc79', 'e10dd609-aabd-46fe-814b-0b81e439bb75', 'f87d22cd-2034-4c9f-9da2-1568da7e7c18'] {{(pid=86212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 15:38:56 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-7fa48ad5-7f97-4ffc-b9ce-d20b042df1ed tempest-VolumeTypesAccessTest-402847972 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:38:56 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-7fa48ad5-7f97-4ffc-b9ce-d20b042df1ed tempest-VolumeTypesAccessTest-402847972 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:38:56 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-7fa48ad5-7f97-4ffc-b9ce-d20b042df1ed tempest-VolumeTypesAccessTest-402847972 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:38:56 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-7fa48ad5-7f97-4ffc-b9ce-d20b042df1ed tempest-VolumeTypesAccessTest-402847972 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:38:56 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-7fa48ad5-7f97-4ffc-b9ce-d20b042df1ed tempest-VolumeTypesAccessTest-402847972 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:38:56 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-7fa48ad5-7f97-4ffc-b9ce-d20b042df1ed tempest-VolumeTypesAccessTest-402847972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:38:56 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [req-f74ce5df-3e52-4d18-8fc4-13047c74bbaf req-b8b19ef7-5521-4737-bc5a-60242b7b71cd tempest-TaggedAttachmentsTest-1222342858 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:38:56 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [req-f74ce5df-3e52-4d18-8fc4-13047c74bbaf req-b8b19ef7-5521-4737-bc5a-60242b7b71cd tempest-TaggedAttachmentsTest-1222342858 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.010s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:38:56 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [req-f74ce5df-3e52-4d18-8fc4-13047c74bbaf req-b8b19ef7-5521-4737-bc5a-60242b7b71cd tempest-TaggedAttachmentsTest-1222342858 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:38:56 devstack sudo[89006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc Sep 22 15:38:56 devstack sudo[89006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:38:56 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [req-f74ce5df-3e52-4d18-8fc4-13047c74bbaf req-b8b19ef7-5521-4737-bc5a-60242b7b71cd tempest-TaggedAttachmentsTest-1222342858 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31', 'name': 'volume-717fe045-fa44-4bcb-834d-a91f696749a6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '87f6a120-76c6-47e2-a565-bb04871f01c9', 'enforce_multipath': True} {{(pid=86212) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 22 15:38:56 devstack cinder-volume[86212]: INFO cinder.volume.manager [req-f74ce5df-3e52-4d18-8fc4-13047c74bbaf req-b8b19ef7-5521-4737-bc5a-60242b7b71cd tempest-TaggedAttachmentsTest-1222342858 None] attachment_update completed successfully. Sep 22 15:38:57 devstack sudo[89006]: pam_unix(sudo:session): session closed for user root Sep 22 15:38:57 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-7fa48ad5-7f97-4ffc-b9ce-d20b042df1ed tempest-VolumeTypesAccessTest-402847972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc" returned: 0 in 0.636s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:38:57 devstack cinder-volume[86212]: DEBUG cinder.manager [None req-7fa48ad5-7f97-4ffc-b9ce-d20b042df1ed tempest-VolumeTypesAccessTest-402847972 None] Notifying Schedulers of capabilities ... {{(pid=86212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 15:38:57 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-7fa48ad5-7f97-4ffc-b9ce-d20b042df1ed tempest-VolumeTypesAccessTest-402847972 None] Deleted volume successfully. Sep 22 15:38:57 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-7fa48ad5-7f97-4ffc-b9ce-d20b042df1ed tempest-VolumeTypesAccessTest-402847972 None] Lock "cinder-4771f90a-1cd9-4585-b2cc-8feabf906720-delete_volume" released by "delete_volume" :: held 2.727s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:39:02 devstack cinder-volume[86212]: INFO cinder.volume.manager [req-8b1b6b84-781a-49b1-9ec7-373655df3587 req-804b4cd3-3efd-44a7-b993-014525a5be99 tempest-TaggedAttachmentsTest-1222342858 None] Terminate volume connection completed successfully. Sep 22 15:39:02 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [req-8b1b6b84-781a-49b1-9ec7-373655df3587 req-804b4cd3-3efd-44a7-b993-014525a5be99 tempest-TaggedAttachmentsTest-1222342858 None] Deleting attachment 87f6a120-76c6-47e2-a565-bb04871f01c9. {{(pid=86212) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 22 15:39:09 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [req-a4731713-06e2-41ad-bc18-99fb8684a986 req-3a0bd26d-c2e2-42ff-835b-18e3a43356b0 tempest-AttachVolumeShelveTestJSON-269480047 None] No connector for attachment 0be2aff6-75f6-4a5e-b32d-ef9b88ff9754; skipping storage backend terminate_connection call. {{(pid=86212) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Sep 22 15:39:09 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [req-a4731713-06e2-41ad-bc18-99fb8684a986 req-3a0bd26d-c2e2-42ff-835b-18e3a43356b0 tempest-AttachVolumeShelveTestJSON-269480047 None] Deleting attachment 0be2aff6-75f6-4a5e-b32d-ef9b88ff9754. {{(pid=86212) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 22 15:39:17 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-1e0a9951-68d9-491e-8eda-f3dc7cfcedfe tempest-TaggedAttachmentsTest-1222342858 None] Acquiring lock "cinder-717fe045-fa44-4bcb-834d-a91f696749a6-delete_volume" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:39:17 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-1e0a9951-68d9-491e-8eda-f3dc7cfcedfe tempest-TaggedAttachmentsTest-1222342858 None] Lock "cinder-717fe045-fa44-4bcb-834d-a91f696749a6-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:39:17 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-1e0a9951-68d9-491e-8eda-f3dc7cfcedfe tempest-TaggedAttachmentsTest-1222342858 None] Acquiring lock "cinder-quobyte-717fe045-fa44-4bcb-834d-a91f696749a6" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:39:17 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-1e0a9951-68d9-491e-8eda-f3dc7cfcedfe tempest-TaggedAttachmentsTest-1222342858 None] Lock "cinder-quobyte-717fe045-fa44-4bcb-834d-a91f696749a6" acquired by "delete_volume" :: waited 0.017s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:39:17 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8a4b5b3-22bc-42e2-8bfc-7acc27099b8d]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:39:17 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-1e0a9951-68d9-491e-8eda-f3dc7cfcedfe tempest-TaggedAttachmentsTest-1222342858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-717fe045-fa44-4bcb-834d-a91f696749a6 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:39:17 devstack sudo[89568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-717fe045-fa44-4bcb-834d-a91f696749a6 Sep 22 15:39:17 devstack sudo[89568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:39:17 devstack sudo[89568]: pam_unix(sudo:session): session closed for user root Sep 22 15:39:17 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-1e0a9951-68d9-491e-8eda-f3dc7cfcedfe tempest-TaggedAttachmentsTest-1222342858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-717fe045-fa44-4bcb-834d-a91f696749a6" returned: 0 in 0.405s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:39:17 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-1e0a9951-68d9-491e-8eda-f3dc7cfcedfe tempest-TaggedAttachmentsTest-1222342858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-717fe045-fa44-4bcb-834d-a91f696749a6 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:39:17 devstack sudo[89574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-717fe045-fa44-4bcb-834d-a91f696749a6 Sep 22 15:39:17 devstack sudo[89574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:39:17 devstack sudo[89574]: pam_unix(sudo:session): session closed for user root Sep 22 15:39:17 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-1e0a9951-68d9-491e-8eda-f3dc7cfcedfe tempest-TaggedAttachmentsTest-1222342858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-717fe045-fa44-4bcb-834d-a91f696749a6" returned: 0 in 0.349s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:39:18 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-1e0a9951-68d9-491e-8eda-f3dc7cfcedfe tempest-TaggedAttachmentsTest-1222342858 None] Lock "cinder-quobyte-717fe045-fa44-4bcb-834d-a91f696749a6" released by "delete_volume" :: held 0.825s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:39:18 devstack cinder-volume[86212]: DEBUG cinder.quota [None req-1e0a9951-68d9-491e-8eda-f3dc7cfcedfe tempest-TaggedAttachmentsTest-1222342858 None] Created reservations ['2155c38a-078e-4b73-b671-273289b594b3', 'cdac87aa-3433-4722-9fab-c07d139fc1cf', 'a6c129f0-316e-4230-bc6f-8b2b66ed0b7b', '2477b839-52b7-47a7-ab1b-3ff46cda506e'] {{(pid=86212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 15:39:18 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-1e0a9951-68d9-491e-8eda-f3dc7cfcedfe tempest-TaggedAttachmentsTest-1222342858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:39:18 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-1e0a9951-68d9-491e-8eda-f3dc7cfcedfe tempest-TaggedAttachmentsTest-1222342858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:39:18 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-1e0a9951-68d9-491e-8eda-f3dc7cfcedfe tempest-TaggedAttachmentsTest-1222342858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:39:18 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-1e0a9951-68d9-491e-8eda-f3dc7cfcedfe tempest-TaggedAttachmentsTest-1222342858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:39:18 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-1e0a9951-68d9-491e-8eda-f3dc7cfcedfe tempest-TaggedAttachmentsTest-1222342858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:39:18 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-1e0a9951-68d9-491e-8eda-f3dc7cfcedfe tempest-TaggedAttachmentsTest-1222342858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:39:18 devstack sudo[89590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc Sep 22 15:39:18 devstack sudo[89590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:39:18 devstack sudo[89590]: pam_unix(sudo:session): session closed for user root Sep 22 15:39:18 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-1e0a9951-68d9-491e-8eda-f3dc7cfcedfe tempest-TaggedAttachmentsTest-1222342858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc" returned: 0 in 0.472s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:39:18 devstack cinder-volume[86212]: DEBUG cinder.manager [None req-1e0a9951-68d9-491e-8eda-f3dc7cfcedfe tempest-TaggedAttachmentsTest-1222342858 None] Notifying Schedulers of capabilities ... {{(pid=86212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 15:39:18 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-1e0a9951-68d9-491e-8eda-f3dc7cfcedfe tempest-TaggedAttachmentsTest-1222342858 None] Deleted volume successfully. Sep 22 15:39:18 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-1e0a9951-68d9-491e-8eda-f3dc7cfcedfe tempest-TaggedAttachmentsTest-1222342858 None] Lock "cinder-717fe045-fa44-4bcb-834d-a91f696749a6-delete_volume" released by "delete_volume" :: held 1.633s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:39:25 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [req-5d6248cf-3b25-4610-be93-e33a130a5866 req-bcad94aa-981e-4fa7-b459-e5b337db66c1 tempest-ServerActionsTestOtherA-1816233839 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:39:25 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [req-5d6248cf-3b25-4610-be93-e33a130a5866 req-bcad94aa-981e-4fa7-b459-e5b337db66c1 tempest-ServerActionsTestOtherA-1816233839 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:39:26 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [req-5d6248cf-3b25-4610-be93-e33a130a5866 req-bcad94aa-981e-4fa7-b459-e5b337db66c1 tempest-ServerActionsTestOtherA-1816233839 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:39:26 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [req-5d6248cf-3b25-4610-be93-e33a130a5866 req-bcad94aa-981e-4fa7-b459-e5b337db66c1 tempest-ServerActionsTestOtherA-1816233839 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31', 'name': 'volume-34a55037-d1d2-4edd-8350-32536e5cd337', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c8584426-d526-4ea7-b90c-19436fea797e', 'enforce_multipath': True} {{(pid=86212) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 22 15:39:26 devstack cinder-volume[86212]: INFO cinder.volume.manager [req-5d6248cf-3b25-4610-be93-e33a130a5866 req-bcad94aa-981e-4fa7-b459-e5b337db66c1 tempest-ServerActionsTestOtherA-1816233839 None] attachment_update completed successfully. Sep 22 15:39:33 devstack cinder-volume[86212]: DEBUG dbcounter [-] [86212] Writing DB stats cinder:SELECT=49,cinder:UPDATE=42,cinder:DELETE=6,cinder:INSERT=6 {{(pid=86212) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 22 15:39:33 devstack cinder-volume[86212]: DEBUG dbcounter [-] [86212] Writing DB stats cinder:UPDATE=51,cinder:SELECT=48,cinder:INSERT=15,cinder:DELETE=2 {{(pid=86212) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 22 15:39:33 devstack cinder-volume[86212]: INFO cinder.volume.manager [req-eed5e693-e27d-4e29-a536-e1afd201e5ac req-3d15f622-cfef-4f70-a58a-ba393ef9d5af tempest-ServerActionsTestOtherA-1816233839 None] Terminate volume connection completed successfully. Sep 22 15:39:33 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [req-eed5e693-e27d-4e29-a536-e1afd201e5ac req-3d15f622-cfef-4f70-a58a-ba393ef9d5af tempest-ServerActionsTestOtherA-1816233839 None] Deleting attachment c8584426-d526-4ea7-b90c-19436fea797e. {{(pid=86212) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 22 15:39:34 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [req-eed5e693-e27d-4e29-a536-e1afd201e5ac req-994dfcbe-3404-4997-b53c-e92f07e1ea7b tempest-ServerActionsTestOtherA-1816233839 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:39:34 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [req-eed5e693-e27d-4e29-a536-e1afd201e5ac req-994dfcbe-3404-4997-b53c-e92f07e1ea7b tempest-ServerActionsTestOtherA-1816233839 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:39:34 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [req-eed5e693-e27d-4e29-a536-e1afd201e5ac req-994dfcbe-3404-4997-b53c-e92f07e1ea7b tempest-ServerActionsTestOtherA-1816233839 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:39:34 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [req-eed5e693-e27d-4e29-a536-e1afd201e5ac req-994dfcbe-3404-4997-b53c-e92f07e1ea7b tempest-ServerActionsTestOtherA-1816233839 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31', 'name': 'volume-34a55037-d1d2-4edd-8350-32536e5cd337', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7c5ad421-6afb-4345-8c99-3da1a76c53ba', 'enforce_multipath': True} {{(pid=86212) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 22 15:39:34 devstack cinder-volume[86212]: INFO cinder.volume.manager [req-eed5e693-e27d-4e29-a536-e1afd201e5ac req-994dfcbe-3404-4997-b53c-e92f07e1ea7b tempest-ServerActionsTestOtherA-1816233839 None] attachment_update completed successfully. Sep 22 15:39:38 devstack cinder-volume[86212]: DEBUG oslo_service.periodic_task [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86212) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 22 15:39:38 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:39:38 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:39:38 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:39:38 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:39:38 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:39:38 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:39:38 devstack sudo[90716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc Sep 22 15:39:38 devstack sudo[90716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:39:39 devstack sudo[90716]: pam_unix(sudo:session): session closed for user root Sep 22 15:39:39 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc" returned: 0 in 0.584s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:39:39 devstack cinder-volume[86212]: DEBUG cinder.manager [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] Notifying Schedulers of capabilities ... {{(pid=86212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 15:39:39 devstack cinder-volume[86212]: DEBUG oslo_service.periodic_task [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] Running periodic task VolumeManager._thread_info {{(pid=86212) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 22 15:39:39 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] thread count: 8 {{(pid=86212) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 22 15:39:39 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] thread info: [<_MainThread(MainThread, started 136163191222400)>, , , , , , , ] {{(pid=86212) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 22 15:39:44 devstack cinder-volume[86212]: DEBUG dbcounter [-] [86212] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=86212) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 22 15:39:44 devstack cinder-volume[86212]: DEBUG dbcounter [-] [86212] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=86212) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 22 15:39:59 devstack cinder-volume[86212]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5eb8645-36ea-4aef-9f28-370f4061d1ee tempest-VolumesActionsTest-370018746 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 15:39:59 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-c5eb8645-36ea-4aef-9f28-370f4061d1ee tempest-VolumesActionsTest-370018746 None] Flow 'volume_create_manager' (d30a927b-1214-4ac3-af8f-62aebd727c00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:39:59 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-c5eb8645-36ea-4aef-9f28-370f4061d1ee tempest-VolumesActionsTest-370018746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d2e5559-1296-444c-8ac3-cb71bac3635b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:39:59 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-c5eb8645-36ea-4aef-9f28-370f4061d1ee tempest-VolumesActionsTest-370018746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d2e5559-1296-444c-8ac3-cb71bac3635b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:39:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-634699199',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97ff9d7d-e8bd-41c7-9f76-a5f60ee07c2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a6e6db79b124a28acc4a325500a8405',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:39:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:39:59Z,use_quota=True,user_id='87f0730725c0472389f7c7fab9d258a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:39:59 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-c5eb8645-36ea-4aef-9f28-370f4061d1ee tempest-VolumesActionsTest-370018746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffa16dfe-d087-42f9-86aa-6c25100f000f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:39:59 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-c5eb8645-36ea-4aef-9f28-370f4061d1ee tempest-VolumesActionsTest-370018746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffa16dfe-d087-42f9-86aa-6c25100f000f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:39:59 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-c5eb8645-36ea-4aef-9f28-370f4061d1ee tempest-VolumesActionsTest-370018746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (870234c2-b86f-4ed7-86dc-78f1b09f825d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:39:59 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-c5eb8645-36ea-4aef-9f28-370f4061d1ee tempest-VolumesActionsTest-370018746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (870234c2-b86f-4ed7-86dc-78f1b09f825d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '97ff9d7d-e8bd-41c7-9f76-a5f60ee07c2d', 'volume_name': 'volume-97ff9d7d-e8bd-41c7-9f76-a5f60ee07c2d', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:39:59 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-c5eb8645-36ea-4aef-9f28-370f4061d1ee tempest-VolumesActionsTest-370018746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14720d35-e6b1-4928-8b21-879a9b855c5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:39:59 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-c5eb8645-36ea-4aef-9f28-370f4061d1ee tempest-VolumesActionsTest-370018746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14720d35-e6b1-4928-8b21-879a9b855c5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:39:59 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-c5eb8645-36ea-4aef-9f28-370f4061d1ee tempest-VolumesActionsTest-370018746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (732c7eb8-8643-4c00-a5a7-e7219b610802) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:39:59 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-c5eb8645-36ea-4aef-9f28-370f4061d1ee tempest-VolumesActionsTest-370018746 None] Volume 97ff9d7d-e8bd-41c7-9f76-a5f60ee07c2d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-97ff9d7d-e8bd-41c7-9f76-a5f60ee07c2d', 'volume_size': 1} Sep 22 15:39:59 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-c5eb8645-36ea-4aef-9f28-370f4061d1ee tempest-VolumesActionsTest-370018746 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:39:59 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-c5eb8645-36ea-4aef-9f28-370f4061d1ee tempest-VolumesActionsTest-370018746 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:39:59 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-c5eb8645-36ea-4aef-9f28-370f4061d1ee tempest-VolumesActionsTest-370018746 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:39:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-634699199',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97ff9d7d-e8bd-41c7-9f76-a5f60ee07c2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a6e6db79b124a28acc4a325500a8405',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:39:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:39:59Z,use_quota=True,user_id='87f0730725c0472389f7c7fab9d258a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)}" {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 15:39:59 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-c5eb8645-36ea-4aef-9f28-370f4061d1ee tempest-VolumesActionsTest-370018746 None] Creating volume 97ff9d7d-e8bd-41c7-9f76-a5f60ee07c2d {{(pid=86212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 15:39:59 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-c5eb8645-36ea-4aef-9f28-370f4061d1ee tempest-VolumesActionsTest-370018746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:39:59 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-c5eb8645-36ea-4aef-9f28-370f4061d1ee tempest-VolumesActionsTest-370018746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:39:59 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-c5eb8645-36ea-4aef-9f28-370f4061d1ee tempest-VolumesActionsTest-370018746 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:39:59 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-c5eb8645-36ea-4aef-9f28-370f4061d1ee tempest-VolumesActionsTest-370018746 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:39:59 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-c5eb8645-36ea-4aef-9f28-370f4061d1ee tempest-VolumesActionsTest-370018746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:39:59 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-c5eb8645-36ea-4aef-9f28-370f4061d1ee tempest-VolumesActionsTest-370018746 None] Selected osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 as target Quobyte volume. {{(pid=86212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 15:39:59 devstack cinder-volume[86212]: INFO cinder.volume.drivers.remotefs [None req-c5eb8645-36ea-4aef-9f28-370f4061d1ee tempest-VolumesActionsTest-370018746 None] casted to osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 Sep 22 15:39:59 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-c5eb8645-36ea-4aef-9f28-370f4061d1ee tempest-VolumesActionsTest-370018746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-97ff9d7d-e8bd-41c7-9f76-a5f60ee07c2d 1073741824 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:39:59 devstack sudo[90890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-97ff9d7d-e8bd-41c7-9f76-a5f60ee07c2d 1073741824 Sep 22 15:39:59 devstack sudo[90890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:40:00 devstack sudo[90890]: pam_unix(sudo:session): session closed for user root Sep 22 15:40:00 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-c5eb8645-36ea-4aef-9f28-370f4061d1ee tempest-VolumesActionsTest-370018746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-97ff9d7d-e8bd-41c7-9f76-a5f60ee07c2d 1073741824" returned: 0 in 0.659s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:40:00 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-c5eb8645-36ea-4aef-9f28-370f4061d1ee tempest-VolumesActionsTest-370018746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-97ff9d7d-e8bd-41c7-9f76-a5f60ee07c2d {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:40:00 devstack sudo[90895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-97ff9d7d-e8bd-41c7-9f76-a5f60ee07c2d Sep 22 15:40:00 devstack sudo[90895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:40:00 devstack sudo[90895]: pam_unix(sudo:session): session closed for user root Sep 22 15:40:00 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-c5eb8645-36ea-4aef-9f28-370f4061d1ee tempest-VolumesActionsTest-370018746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-97ff9d7d-e8bd-41c7-9f76-a5f60ee07c2d" returned: 0 in 0.412s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:40:00 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-c5eb8645-36ea-4aef-9f28-370f4061d1ee tempest-VolumesActionsTest-370018746 None] <== create_volume: return (1168ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'} {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 15:40:00 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-c5eb8645-36ea-4aef-9f28-370f4061d1ee tempest-VolumesActionsTest-370018746 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.171s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:40:00 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-c5eb8645-36ea-4aef-9f28-370f4061d1ee tempest-VolumesActionsTest-370018746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (732c7eb8-8643-4c00-a5a7-e7219b610802) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-97ff9d7d-e8bd-41c7-9f76-a5f60ee07c2d', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:40:00 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-c5eb8645-36ea-4aef-9f28-370f4061d1ee tempest-VolumesActionsTest-370018746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bcd9fb12-a90f-4ff3-a6ff-ade2d531524f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:40:00 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-c5eb8645-36ea-4aef-9f28-370f4061d1ee tempest-VolumesActionsTest-370018746 None] Volume volume-97ff9d7d-e8bd-41c7-9f76-a5f60ee07c2d (97ff9d7d-e8bd-41c7-9f76-a5f60ee07c2d): created successfully Sep 22 15:40:00 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-c5eb8645-36ea-4aef-9f28-370f4061d1ee tempest-VolumesActionsTest-370018746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bcd9fb12-a90f-4ff3-a6ff-ade2d531524f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:40:00 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-c5eb8645-36ea-4aef-9f28-370f4061d1ee tempest-VolumesActionsTest-370018746 None] Flow 'volume_create_manager' (d30a927b-1214-4ac3-af8f-62aebd727c00) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:40:00 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-c5eb8645-36ea-4aef-9f28-370f4061d1ee tempest-VolumesActionsTest-370018746 None] Created volume successfully. Sep 22 15:40:01 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-d6b9b363-6361-472b-b3ef-aaaa85ec864d tempest-VolumesActionsTest-370018746 None] Acquiring lock "cinder-97ff9d7d-e8bd-41c7-9f76-a5f60ee07c2d" by "attach_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:40:01 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-d6b9b363-6361-472b-b3ef-aaaa85ec864d tempest-VolumesActionsTest-370018746 None] Lock "cinder-97ff9d7d-e8bd-41c7-9f76-a5f60ee07c2d" acquired by "attach_volume" :: waited 0.034s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:40:01 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-d6b9b363-6361-472b-b3ef-aaaa85ec864d tempest-VolumesActionsTest-370018746 None] Attaching volume 97ff9d7d-e8bd-41c7-9f76-a5f60ee07c2d to instance 6fa90164-6db9-411e-a453-71f3695134d1 at mountpoint /dev/vdb on host None. Sep 22 15:40:01 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-d6b9b363-6361-472b-b3ef-aaaa85ec864d tempest-VolumesActionsTest-370018746 None] Attach volume completed successfully. Sep 22 15:40:01 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-d6b9b363-6361-472b-b3ef-aaaa85ec864d tempest-VolumesActionsTest-370018746 None] Lock "cinder-97ff9d7d-e8bd-41c7-9f76-a5f60ee07c2d" released by "attach_volume" :: held 0.145s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:40:02 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-0fa7d2fc-e0fa-4a4a-adfe-81c7bb26a048 tempest-VolumesActionsTest-1421548241 None] Terminate volume connection completed successfully. Sep 22 15:40:02 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-0fa7d2fc-e0fa-4a4a-adfe-81c7bb26a048 tempest-VolumesActionsTest-1421548241 None] Acquiring lock "cinder-97ff9d7d-e8bd-41c7-9f76-a5f60ee07c2d-detach_volume" by "detach_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:40:02 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-0fa7d2fc-e0fa-4a4a-adfe-81c7bb26a048 tempest-VolumesActionsTest-1421548241 None] Lock "cinder-97ff9d7d-e8bd-41c7-9f76-a5f60ee07c2d-detach_volume" acquired by "detach_volume" :: waited 0.023s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:40:02 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-0fa7d2fc-e0fa-4a4a-adfe-81c7bb26a048 tempest-VolumesActionsTest-1421548241 None] Detaching volume 97ff9d7d-e8bd-41c7-9f76-a5f60ee07c2d from instance 6fa90164-6db9-411e-a453-71f3695134d1. Sep 22 15:40:02 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-0fa7d2fc-e0fa-4a4a-adfe-81c7bb26a048 tempest-VolumesActionsTest-1421548241 None] Detach volume completed successfully. Sep 22 15:40:02 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-0fa7d2fc-e0fa-4a4a-adfe-81c7bb26a048 tempest-VolumesActionsTest-1421548241 None] Lock "cinder-97ff9d7d-e8bd-41c7-9f76-a5f60ee07c2d-detach_volume" released by "detach_volume" :: held 0.088s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:40:02 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-7bfe98a9-6e60-4a91-8f92-a786a8a3da79 tempest-VolumesActionsTest-370018746 None] Acquiring lock "cinder-97ff9d7d-e8bd-41c7-9f76-a5f60ee07c2d-detach_volume" by "detach_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:40:03 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-7bfe98a9-6e60-4a91-8f92-a786a8a3da79 tempest-VolumesActionsTest-370018746 None] Lock "cinder-97ff9d7d-e8bd-41c7-9f76-a5f60ee07c2d-detach_volume" acquired by "detach_volume" :: waited 0.031s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:40:03 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-7bfe98a9-6e60-4a91-8f92-a786a8a3da79 tempest-VolumesActionsTest-370018746 None] Volume detach called, but volume not attached. Sep 22 15:40:03 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-7bfe98a9-6e60-4a91-8f92-a786a8a3da79 tempest-VolumesActionsTest-370018746 None] Lock "cinder-97ff9d7d-e8bd-41c7-9f76-a5f60ee07c2d-detach_volume" released by "detach_volume" :: held 0.026s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:40:03 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-7b09ec0b-ab73-4f11-822e-008d3ef24e1d tempest-VolumesActionsTest-370018746 None] Acquiring lock "cinder-97ff9d7d-e8bd-41c7-9f76-a5f60ee07c2d-delete_volume" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:40:03 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-7b09ec0b-ab73-4f11-822e-008d3ef24e1d tempest-VolumesActionsTest-370018746 None] Lock "cinder-97ff9d7d-e8bd-41c7-9f76-a5f60ee07c2d-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:40:03 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-7b09ec0b-ab73-4f11-822e-008d3ef24e1d tempest-VolumesActionsTest-370018746 None] Acquiring lock "cinder-quobyte-97ff9d7d-e8bd-41c7-9f76-a5f60ee07c2d" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:40:03 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-7b09ec0b-ab73-4f11-822e-008d3ef24e1d tempest-VolumesActionsTest-370018746 None] Lock "cinder-quobyte-97ff9d7d-e8bd-41c7-9f76-a5f60ee07c2d" acquired by "delete_volume" :: waited 0.035s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:40:03 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[4af3da20-eea4-4d3e-b9b3-03b3194cf657]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:40:03 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-7b09ec0b-ab73-4f11-822e-008d3ef24e1d tempest-VolumesActionsTest-370018746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-97ff9d7d-e8bd-41c7-9f76-a5f60ee07c2d {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:40:04 devstack sudo[90908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-97ff9d7d-e8bd-41c7-9f76-a5f60ee07c2d Sep 22 15:40:04 devstack sudo[90908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:40:04 devstack sudo[90908]: pam_unix(sudo:session): session closed for user root Sep 22 15:40:04 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-7b09ec0b-ab73-4f11-822e-008d3ef24e1d tempest-VolumesActionsTest-370018746 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-97ff9d7d-e8bd-41c7-9f76-a5f60ee07c2d" returned: 0 in 0.953s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:40:04 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-7b09ec0b-ab73-4f11-822e-008d3ef24e1d tempest-VolumesActionsTest-370018746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-97ff9d7d-e8bd-41c7-9f76-a5f60ee07c2d {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:40:04 devstack sudo[90928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-97ff9d7d-e8bd-41c7-9f76-a5f60ee07c2d Sep 22 15:40:04 devstack sudo[90928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:40:05 devstack sudo[90928]: pam_unix(sudo:session): session closed for user root Sep 22 15:40:05 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-7b09ec0b-ab73-4f11-822e-008d3ef24e1d tempest-VolumesActionsTest-370018746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-97ff9d7d-e8bd-41c7-9f76-a5f60ee07c2d" returned: 0 in 0.541s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:40:05 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-7b09ec0b-ab73-4f11-822e-008d3ef24e1d tempest-VolumesActionsTest-370018746 None] Lock "cinder-quobyte-97ff9d7d-e8bd-41c7-9f76-a5f60ee07c2d" released by "delete_volume" :: held 1.641s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:40:05 devstack cinder-volume[86212]: DEBUG cinder.quota [None req-7b09ec0b-ab73-4f11-822e-008d3ef24e1d tempest-VolumesActionsTest-370018746 None] Created reservations ['c2b4c493-5cf5-4273-a78a-8003e1c1be96', '2bca41ef-0670-48f0-8f96-bc4a732ed942', '99ea0821-8365-490c-bc8c-34d53a29bd55', '7f2760dd-5b7f-4c26-acfd-64c18c872a1d'] {{(pid=86212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 15:40:05 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-7b09ec0b-ab73-4f11-822e-008d3ef24e1d tempest-VolumesActionsTest-370018746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:40:05 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-7b09ec0b-ab73-4f11-822e-008d3ef24e1d tempest-VolumesActionsTest-370018746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:40:05 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-7b09ec0b-ab73-4f11-822e-008d3ef24e1d tempest-VolumesActionsTest-370018746 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:40:05 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-7b09ec0b-ab73-4f11-822e-008d3ef24e1d tempest-VolumesActionsTest-370018746 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:40:05 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-7b09ec0b-ab73-4f11-822e-008d3ef24e1d tempest-VolumesActionsTest-370018746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:40:05 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-7b09ec0b-ab73-4f11-822e-008d3ef24e1d tempest-VolumesActionsTest-370018746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:40:05 devstack sudo[90933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc Sep 22 15:40:05 devstack sudo[90933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:40:05 devstack sudo[90933]: pam_unix(sudo:session): session closed for user root Sep 22 15:40:05 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-7b09ec0b-ab73-4f11-822e-008d3ef24e1d tempest-VolumesActionsTest-370018746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc" returned: 0 in 0.398s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:40:06 devstack cinder-volume[86212]: DEBUG cinder.manager [None req-7b09ec0b-ab73-4f11-822e-008d3ef24e1d tempest-VolumesActionsTest-370018746 None] Notifying Schedulers of capabilities ... {{(pid=86212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 15:40:06 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-7b09ec0b-ab73-4f11-822e-008d3ef24e1d tempest-VolumesActionsTest-370018746 None] Deleted volume successfully. Sep 22 15:40:06 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-7b09ec0b-ab73-4f11-822e-008d3ef24e1d tempest-VolumesActionsTest-370018746 None] Lock "cinder-97ff9d7d-e8bd-41c7-9f76-a5f60ee07c2d-delete_volume" released by "delete_volume" :: held 2.574s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:40:09 devstack cinder-volume[86212]: INFO cinder.volume.manager [req-a3610068-a79b-411c-9afa-329f6a088db6 req-53d185e4-6e74-4d83-a3e1-326008d17c98 tempest-ServerActionsTestOtherA-1816233839 None] Terminate volume connection completed successfully. Sep 22 15:40:09 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [req-a3610068-a79b-411c-9afa-329f6a088db6 req-53d185e4-6e74-4d83-a3e1-326008d17c98 tempest-ServerActionsTestOtherA-1816233839 None] Deleting attachment 7c5ad421-6afb-4345-8c99-3da1a76c53ba. {{(pid=86212) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 22 15:40:11 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-29d7f363-d4b7-48a7-a0fe-42a17d8353c5 tempest-AttachVolumeShelveTestJSON-269480047 None] Acquiring lock "cinder-4dc9ae44-eae2-4a0e-b4b0-4ee60b9c54b2-delete_volume" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:40:11 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-29d7f363-d4b7-48a7-a0fe-42a17d8353c5 tempest-AttachVolumeShelveTestJSON-269480047 None] Lock "cinder-4dc9ae44-eae2-4a0e-b4b0-4ee60b9c54b2-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:40:11 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-29d7f363-d4b7-48a7-a0fe-42a17d8353c5 tempest-AttachVolumeShelveTestJSON-269480047 None] Acquiring lock "cinder-quobyte-4dc9ae44-eae2-4a0e-b4b0-4ee60b9c54b2" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:40:11 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-29d7f363-d4b7-48a7-a0fe-42a17d8353c5 tempest-AttachVolumeShelveTestJSON-269480047 None] Lock "cinder-quobyte-4dc9ae44-eae2-4a0e-b4b0-4ee60b9c54b2" acquired by "delete_volume" :: waited 0.046s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:40:11 devstack cinder-volume[86212]: DEBUG cinder.volume.flows.manager.create_volume [None req-2cc0be6d-50cf-49df-ba5a-a4ad55d665c7 tempest-VolumesActionsTest-370018746 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 15:40:11 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-2cc0be6d-50cf-49df-ba5a-a4ad55d665c7 tempest-VolumesActionsTest-370018746 None] Flow 'volume_create_manager' (4d0f22fe-f98d-48cc-945e-7eeb3cf63830) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:40:11 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-2cc0be6d-50cf-49df-ba5a-a4ad55d665c7 tempest-VolumesActionsTest-370018746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0088c60c-a618-4feb-947f-b2dbfd5fcf6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:40:11 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[00d20bd7-49a8-42b8-ac70-8602040d304c]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:40:11 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-29d7f363-d4b7-48a7-a0fe-42a17d8353c5 tempest-AttachVolumeShelveTestJSON-269480047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-4dc9ae44-eae2-4a0e-b4b0-4ee60b9c54b2 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:40:11 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-2cc0be6d-50cf-49df-ba5a-a4ad55d665c7 tempest-VolumesActionsTest-370018746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0088c60c-a618-4feb-947f-b2dbfd5fcf6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:40:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-882642989',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c7cc1a7-7383-4be1-b5cc-eae087cfa6e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a6e6db79b124a28acc4a325500a8405',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:40:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:40:12Z,use_quota=True,user_id='87f0730725c0472389f7c7fab9d258a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:40:11 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-2cc0be6d-50cf-49df-ba5a-a4ad55d665c7 tempest-VolumesActionsTest-370018746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffa0bf98-3da0-498f-bcf4-7d6e545fc7f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:40:11 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-2cc0be6d-50cf-49df-ba5a-a4ad55d665c7 tempest-VolumesActionsTest-370018746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffa0bf98-3da0-498f-bcf4-7d6e545fc7f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:40:11 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-2cc0be6d-50cf-49df-ba5a-a4ad55d665c7 tempest-VolumesActionsTest-370018746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71478d08-9c44-4268-8753-9f7650ca3159) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:40:11 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-2cc0be6d-50cf-49df-ba5a-a4ad55d665c7 tempest-VolumesActionsTest-370018746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71478d08-9c44-4268-8753-9f7650ca3159) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1c7cc1a7-7383-4be1-b5cc-eae087cfa6e5', 'volume_name': 'volume-1c7cc1a7-7383-4be1-b5cc-eae087cfa6e5', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:40:11 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-2cc0be6d-50cf-49df-ba5a-a4ad55d665c7 tempest-VolumesActionsTest-370018746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c32cfaf-1d17-4061-8da9-969c2df9f1c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:40:11 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-2cc0be6d-50cf-49df-ba5a-a4ad55d665c7 tempest-VolumesActionsTest-370018746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c32cfaf-1d17-4061-8da9-969c2df9f1c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:40:11 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-2cc0be6d-50cf-49df-ba5a-a4ad55d665c7 tempest-VolumesActionsTest-370018746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2a994b2-9c66-4a45-885a-c3831fef7ef1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:40:11 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-2cc0be6d-50cf-49df-ba5a-a4ad55d665c7 tempest-VolumesActionsTest-370018746 None] Volume 1c7cc1a7-7383-4be1-b5cc-eae087cfa6e5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1c7cc1a7-7383-4be1-b5cc-eae087cfa6e5', 'volume_size': 1} Sep 22 15:40:11 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-2cc0be6d-50cf-49df-ba5a-a4ad55d665c7 tempest-VolumesActionsTest-370018746 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:40:11 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-2cc0be6d-50cf-49df-ba5a-a4ad55d665c7 tempest-VolumesActionsTest-370018746 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:40:11 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-2cc0be6d-50cf-49df-ba5a-a4ad55d665c7 tempest-VolumesActionsTest-370018746 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:40:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-882642989',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c7cc1a7-7383-4be1-b5cc-eae087cfa6e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a6e6db79b124a28acc4a325500a8405',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:40:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:40:12Z,use_quota=True,user_id='87f0730725c0472389f7c7fab9d258a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)}" {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 15:40:11 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-2cc0be6d-50cf-49df-ba5a-a4ad55d665c7 tempest-VolumesActionsTest-370018746 None] Creating volume 1c7cc1a7-7383-4be1-b5cc-eae087cfa6e5 {{(pid=86212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 15:40:11 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-2cc0be6d-50cf-49df-ba5a-a4ad55d665c7 tempest-VolumesActionsTest-370018746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:40:11 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-2cc0be6d-50cf-49df-ba5a-a4ad55d665c7 tempest-VolumesActionsTest-370018746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:40:11 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-2cc0be6d-50cf-49df-ba5a-a4ad55d665c7 tempest-VolumesActionsTest-370018746 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:40:11 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-2cc0be6d-50cf-49df-ba5a-a4ad55d665c7 tempest-VolumesActionsTest-370018746 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:40:11 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-2cc0be6d-50cf-49df-ba5a-a4ad55d665c7 tempest-VolumesActionsTest-370018746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:40:11 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-2cc0be6d-50cf-49df-ba5a-a4ad55d665c7 tempest-VolumesActionsTest-370018746 None] Selected osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 as target Quobyte volume. {{(pid=86212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 15:40:11 devstack cinder-volume[86212]: INFO cinder.volume.drivers.remotefs [None req-2cc0be6d-50cf-49df-ba5a-a4ad55d665c7 tempest-VolumesActionsTest-370018746 None] casted to osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 Sep 22 15:40:11 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-2cc0be6d-50cf-49df-ba5a-a4ad55d665c7 tempest-VolumesActionsTest-370018746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-1c7cc1a7-7383-4be1-b5cc-eae087cfa6e5 1073741824 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:40:11 devstack sudo[91018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-1c7cc1a7-7383-4be1-b5cc-eae087cfa6e5 1073741824 Sep 22 15:40:11 devstack sudo[91018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:40:11 devstack sudo[91015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-4dc9ae44-eae2-4a0e-b4b0-4ee60b9c54b2 Sep 22 15:40:11 devstack sudo[91015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:40:12 devstack sudo[91015]: pam_unix(sudo:session): session closed for user root Sep 22 15:40:12 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-29d7f363-d4b7-48a7-a0fe-42a17d8353c5 tempest-AttachVolumeShelveTestJSON-269480047 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-4dc9ae44-eae2-4a0e-b4b0-4ee60b9c54b2" returned: 0 in 0.509s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:40:12 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-29d7f363-d4b7-48a7-a0fe-42a17d8353c5 tempest-AttachVolumeShelveTestJSON-269480047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-4dc9ae44-eae2-4a0e-b4b0-4ee60b9c54b2 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:40:12 devstack sudo[91029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-4dc9ae44-eae2-4a0e-b4b0-4ee60b9c54b2 Sep 22 15:40:12 devstack sudo[91029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:40:12 devstack sudo[91018]: pam_unix(sudo:session): session closed for user root Sep 22 15:40:12 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-2cc0be6d-50cf-49df-ba5a-a4ad55d665c7 tempest-VolumesActionsTest-370018746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-1c7cc1a7-7383-4be1-b5cc-eae087cfa6e5 1073741824" returned: 0 in 0.679s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:40:12 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-2cc0be6d-50cf-49df-ba5a-a4ad55d665c7 tempest-VolumesActionsTest-370018746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-1c7cc1a7-7383-4be1-b5cc-eae087cfa6e5 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:40:12 devstack sudo[91031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-1c7cc1a7-7383-4be1-b5cc-eae087cfa6e5 Sep 22 15:40:12 devstack sudo[91031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:40:12 devstack sudo[91029]: pam_unix(sudo:session): session closed for user root Sep 22 15:40:12 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-29d7f363-d4b7-48a7-a0fe-42a17d8353c5 tempest-AttachVolumeShelveTestJSON-269480047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-4dc9ae44-eae2-4a0e-b4b0-4ee60b9c54b2" returned: 0 in 0.417s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:40:12 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-29d7f363-d4b7-48a7-a0fe-42a17d8353c5 tempest-AttachVolumeShelveTestJSON-269480047 None] Lock "cinder-quobyte-4dc9ae44-eae2-4a0e-b4b0-4ee60b9c54b2" released by "delete_volume" :: held 1.070s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:40:12 devstack cinder-volume[86212]: DEBUG cinder.quota [None req-29d7f363-d4b7-48a7-a0fe-42a17d8353c5 tempest-AttachVolumeShelveTestJSON-269480047 None] Created reservations ['4d575ff9-534a-40c0-beb4-52089a0b77bd', '622c1b39-fe9e-42a6-9c58-04899d39b14e', '0fd3ada2-dbc4-4812-807d-ec455f4de343', '1b077330-0c3c-4f8b-8cad-c24630a62886'] {{(pid=86212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 15:40:12 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-29d7f363-d4b7-48a7-a0fe-42a17d8353c5 tempest-AttachVolumeShelveTestJSON-269480047 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:40:12 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-29d7f363-d4b7-48a7-a0fe-42a17d8353c5 tempest-AttachVolumeShelveTestJSON-269480047 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:40:12 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-29d7f363-d4b7-48a7-a0fe-42a17d8353c5 tempest-AttachVolumeShelveTestJSON-269480047 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:40:12 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-29d7f363-d4b7-48a7-a0fe-42a17d8353c5 tempest-AttachVolumeShelveTestJSON-269480047 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:40:12 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-29d7f363-d4b7-48a7-a0fe-42a17d8353c5 tempest-AttachVolumeShelveTestJSON-269480047 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:40:12 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-29d7f363-d4b7-48a7-a0fe-42a17d8353c5 tempest-AttachVolumeShelveTestJSON-269480047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:40:12 devstack sudo[91034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc Sep 22 15:40:12 devstack sudo[91034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:40:13 devstack sudo[91031]: pam_unix(sudo:session): session closed for user root Sep 22 15:40:13 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-2cc0be6d-50cf-49df-ba5a-a4ad55d665c7 tempest-VolumesActionsTest-370018746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-1c7cc1a7-7383-4be1-b5cc-eae087cfa6e5" returned: 0 in 0.461s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:40:13 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-2cc0be6d-50cf-49df-ba5a-a4ad55d665c7 tempest-VolumesActionsTest-370018746 None] <== create_volume: return (1202ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'} {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 15:40:13 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-2cc0be6d-50cf-49df-ba5a-a4ad55d665c7 tempest-VolumesActionsTest-370018746 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.206s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:40:13 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-2cc0be6d-50cf-49df-ba5a-a4ad55d665c7 tempest-VolumesActionsTest-370018746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2a994b2-9c66-4a45-885a-c3831fef7ef1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c7cc1a7-7383-4be1-b5cc-eae087cfa6e5', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:40:13 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-2cc0be6d-50cf-49df-ba5a-a4ad55d665c7 tempest-VolumesActionsTest-370018746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ead7346-8ee0-4c78-baf1-35f323c1e073) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:40:13 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-2cc0be6d-50cf-49df-ba5a-a4ad55d665c7 tempest-VolumesActionsTest-370018746 None] Volume volume-1c7cc1a7-7383-4be1-b5cc-eae087cfa6e5 (1c7cc1a7-7383-4be1-b5cc-eae087cfa6e5): created successfully Sep 22 15:40:13 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-2cc0be6d-50cf-49df-ba5a-a4ad55d665c7 tempest-VolumesActionsTest-370018746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ead7346-8ee0-4c78-baf1-35f323c1e073) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:40:13 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-2cc0be6d-50cf-49df-ba5a-a4ad55d665c7 tempest-VolumesActionsTest-370018746 None] Flow 'volume_create_manager' (4d0f22fe-f98d-48cc-945e-7eeb3cf63830) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:40:13 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-2cc0be6d-50cf-49df-ba5a-a4ad55d665c7 tempest-VolumesActionsTest-370018746 None] Created volume successfully. Sep 22 15:40:13 devstack sudo[91034]: pam_unix(sudo:session): session closed for user root Sep 22 15:40:13 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-29d7f363-d4b7-48a7-a0fe-42a17d8353c5 tempest-AttachVolumeShelveTestJSON-269480047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc" returned: 0 in 0.368s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:40:13 devstack cinder-volume[86212]: DEBUG cinder.manager [None req-29d7f363-d4b7-48a7-a0fe-42a17d8353c5 tempest-AttachVolumeShelveTestJSON-269480047 None] Notifying Schedulers of capabilities ... {{(pid=86212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 15:40:13 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-29d7f363-d4b7-48a7-a0fe-42a17d8353c5 tempest-AttachVolumeShelveTestJSON-269480047 None] Deleted volume successfully. Sep 22 15:40:13 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-29d7f363-d4b7-48a7-a0fe-42a17d8353c5 tempest-AttachVolumeShelveTestJSON-269480047 None] Lock "cinder-4dc9ae44-eae2-4a0e-b4b0-4ee60b9c54b2-delete_volume" released by "delete_volume" :: held 1.782s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:40:14 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-faa0e116-2f55-4bea-9df9-ad23c99052c5 tempest-VolumesActionsTest-1421548241 None] Acquiring lock "cinder-1c7cc1a7-7383-4be1-b5cc-eae087cfa6e5-delete_volume" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:40:14 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-faa0e116-2f55-4bea-9df9-ad23c99052c5 tempest-VolumesActionsTest-1421548241 None] Lock "cinder-1c7cc1a7-7383-4be1-b5cc-eae087cfa6e5-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:40:14 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-faa0e116-2f55-4bea-9df9-ad23c99052c5 tempest-VolumesActionsTest-1421548241 None] Acquiring lock "cinder-quobyte-1c7cc1a7-7383-4be1-b5cc-eae087cfa6e5" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:40:14 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-faa0e116-2f55-4bea-9df9-ad23c99052c5 tempest-VolumesActionsTest-1421548241 None] Lock "cinder-quobyte-1c7cc1a7-7383-4be1-b5cc-eae087cfa6e5" acquired by "delete_volume" :: waited 0.062s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:40:14 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[306f145e-c4d5-4b90-aeb8-a00371c8cf94]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:40:14 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-faa0e116-2f55-4bea-9df9-ad23c99052c5 tempest-VolumesActionsTest-1421548241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-1c7cc1a7-7383-4be1-b5cc-eae087cfa6e5 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:40:14 devstack sudo[91093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-1c7cc1a7-7383-4be1-b5cc-eae087cfa6e5 Sep 22 15:40:14 devstack sudo[91093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:40:15 devstack sudo[91093]: pam_unix(sudo:session): session closed for user root Sep 22 15:40:15 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-faa0e116-2f55-4bea-9df9-ad23c99052c5 tempest-VolumesActionsTest-1421548241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-1c7cc1a7-7383-4be1-b5cc-eae087cfa6e5" returned: 0 in 0.808s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:40:15 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-faa0e116-2f55-4bea-9df9-ad23c99052c5 tempest-VolumesActionsTest-1421548241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-1c7cc1a7-7383-4be1-b5cc-eae087cfa6e5 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:40:15 devstack sudo[91110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-1c7cc1a7-7383-4be1-b5cc-eae087cfa6e5 Sep 22 15:40:15 devstack sudo[91110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:40:15 devstack sudo[91110]: pam_unix(sudo:session): session closed for user root Sep 22 15:40:15 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-faa0e116-2f55-4bea-9df9-ad23c99052c5 tempest-VolumesActionsTest-1421548241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-1c7cc1a7-7383-4be1-b5cc-eae087cfa6e5" returned: 0 in 0.383s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:40:15 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-faa0e116-2f55-4bea-9df9-ad23c99052c5 tempest-VolumesActionsTest-1421548241 None] Lock "cinder-quobyte-1c7cc1a7-7383-4be1-b5cc-eae087cfa6e5" released by "delete_volume" :: held 1.293s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:40:15 devstack cinder-volume[86212]: DEBUG cinder.quota [None req-faa0e116-2f55-4bea-9df9-ad23c99052c5 tempest-VolumesActionsTest-1421548241 None] Created reservations ['4f47e3b4-69b5-4f6e-b0a3-fa0ee772c5e8', 'fa913fd1-7e56-4168-b329-a98b661739bc', 'f82afda8-4b72-4483-8d89-61f492d8e466', 'd7d2b0e3-e059-4ef4-89c8-0d9f93aab550'] {{(pid=86212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 15:40:15 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-faa0e116-2f55-4bea-9df9-ad23c99052c5 tempest-VolumesActionsTest-1421548241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:40:15 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-faa0e116-2f55-4bea-9df9-ad23c99052c5 tempest-VolumesActionsTest-1421548241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:40:15 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-faa0e116-2f55-4bea-9df9-ad23c99052c5 tempest-VolumesActionsTest-1421548241 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:40:15 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-faa0e116-2f55-4bea-9df9-ad23c99052c5 tempest-VolumesActionsTest-1421548241 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:40:15 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-faa0e116-2f55-4bea-9df9-ad23c99052c5 tempest-VolumesActionsTest-1421548241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:40:15 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-faa0e116-2f55-4bea-9df9-ad23c99052c5 tempest-VolumesActionsTest-1421548241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:40:15 devstack sudo[91116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc Sep 22 15:40:15 devstack sudo[91116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:40:16 devstack sudo[91116]: pam_unix(sudo:session): session closed for user root Sep 22 15:40:16 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-faa0e116-2f55-4bea-9df9-ad23c99052c5 tempest-VolumesActionsTest-1421548241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc" returned: 0 in 0.324s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:40:16 devstack cinder-volume[86212]: DEBUG cinder.manager [None req-faa0e116-2f55-4bea-9df9-ad23c99052c5 tempest-VolumesActionsTest-1421548241 None] Notifying Schedulers of capabilities ... {{(pid=86212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 15:40:16 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-faa0e116-2f55-4bea-9df9-ad23c99052c5 tempest-VolumesActionsTest-1421548241 None] Deleted volume successfully. Sep 22 15:40:16 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-faa0e116-2f55-4bea-9df9-ad23c99052c5 tempest-VolumesActionsTest-1421548241 None] Lock "cinder-1c7cc1a7-7383-4be1-b5cc-eae087cfa6e5-delete_volume" released by "delete_volume" :: held 2.012s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:40:17 devstack cinder-volume[86212]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1f99bc5-226c-4e3c-95fb-d1627e46c47f tempest-VolumesActionsTest-370018746 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 15:40:17 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-b1f99bc5-226c-4e3c-95fb-d1627e46c47f tempest-VolumesActionsTest-370018746 None] Flow 'volume_create_manager' (d5541728-8423-4aaf-946f-e344b75afeec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:40:17 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-b1f99bc5-226c-4e3c-95fb-d1627e46c47f tempest-VolumesActionsTest-370018746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ee380c0-a7a3-4c09-82b1-cded49b75d55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:40:17 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-b1f99bc5-226c-4e3c-95fb-d1627e46c47f tempest-VolumesActionsTest-370018746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ee380c0-a7a3-4c09-82b1-cded49b75d55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:40:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1232454864',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c65cfe3-9760-4ee8-bba8-d22864a42431,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a6e6db79b124a28acc4a325500a8405',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:40:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:40:17Z,use_quota=True,user_id='87f0730725c0472389f7c7fab9d258a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:40:17 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-b1f99bc5-226c-4e3c-95fb-d1627e46c47f tempest-VolumesActionsTest-370018746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (356a0777-26f2-4c6d-ac6f-b84d2ca91fea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:40:17 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-b1f99bc5-226c-4e3c-95fb-d1627e46c47f tempest-VolumesActionsTest-370018746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (356a0777-26f2-4c6d-ac6f-b84d2ca91fea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:40:17 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-b1f99bc5-226c-4e3c-95fb-d1627e46c47f tempest-VolumesActionsTest-370018746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e10b1a5-9f8e-4c52-ae9e-d1eefc60732f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:40:17 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-b1f99bc5-226c-4e3c-95fb-d1627e46c47f tempest-VolumesActionsTest-370018746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e10b1a5-9f8e-4c52-ae9e-d1eefc60732f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0c65cfe3-9760-4ee8-bba8-d22864a42431', 'volume_name': 'volume-0c65cfe3-9760-4ee8-bba8-d22864a42431', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:40:17 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-b1f99bc5-226c-4e3c-95fb-d1627e46c47f tempest-VolumesActionsTest-370018746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40926e51-73ca-4264-8d0f-418dacc003ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:40:17 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-b1f99bc5-226c-4e3c-95fb-d1627e46c47f tempest-VolumesActionsTest-370018746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40926e51-73ca-4264-8d0f-418dacc003ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:40:17 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-b1f99bc5-226c-4e3c-95fb-d1627e46c47f tempest-VolumesActionsTest-370018746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ab8a098-5cf4-45a5-8582-869f51f33635) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:40:17 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-b1f99bc5-226c-4e3c-95fb-d1627e46c47f tempest-VolumesActionsTest-370018746 None] Volume 0c65cfe3-9760-4ee8-bba8-d22864a42431: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0c65cfe3-9760-4ee8-bba8-d22864a42431', 'volume_size': 1} Sep 22 15:40:17 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-b1f99bc5-226c-4e3c-95fb-d1627e46c47f tempest-VolumesActionsTest-370018746 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:40:17 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-b1f99bc5-226c-4e3c-95fb-d1627e46c47f tempest-VolumesActionsTest-370018746 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:40:17 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-b1f99bc5-226c-4e3c-95fb-d1627e46c47f tempest-VolumesActionsTest-370018746 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:40:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1232454864',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c65cfe3-9760-4ee8-bba8-d22864a42431,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a6e6db79b124a28acc4a325500a8405',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:40:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:40:17Z,use_quota=True,user_id='87f0730725c0472389f7c7fab9d258a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)}" {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 15:40:17 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-b1f99bc5-226c-4e3c-95fb-d1627e46c47f tempest-VolumesActionsTest-370018746 None] Creating volume 0c65cfe3-9760-4ee8-bba8-d22864a42431 {{(pid=86212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 15:40:17 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-b1f99bc5-226c-4e3c-95fb-d1627e46c47f tempest-VolumesActionsTest-370018746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:40:17 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-b1f99bc5-226c-4e3c-95fb-d1627e46c47f tempest-VolumesActionsTest-370018746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:40:17 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-b1f99bc5-226c-4e3c-95fb-d1627e46c47f tempest-VolumesActionsTest-370018746 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:40:17 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-b1f99bc5-226c-4e3c-95fb-d1627e46c47f tempest-VolumesActionsTest-370018746 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:40:17 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-b1f99bc5-226c-4e3c-95fb-d1627e46c47f tempest-VolumesActionsTest-370018746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:40:17 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-b1f99bc5-226c-4e3c-95fb-d1627e46c47f tempest-VolumesActionsTest-370018746 None] Selected osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 as target Quobyte volume. {{(pid=86212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 15:40:17 devstack cinder-volume[86212]: INFO cinder.volume.drivers.remotefs [None req-b1f99bc5-226c-4e3c-95fb-d1627e46c47f tempest-VolumesActionsTest-370018746 None] casted to osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 Sep 22 15:40:17 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-b1f99bc5-226c-4e3c-95fb-d1627e46c47f tempest-VolumesActionsTest-370018746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-0c65cfe3-9760-4ee8-bba8-d22864a42431 1073741824 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:40:17 devstack sudo[91124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-0c65cfe3-9760-4ee8-bba8-d22864a42431 1073741824 Sep 22 15:40:17 devstack sudo[91124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:40:18 devstack sudo[91124]: pam_unix(sudo:session): session closed for user root Sep 22 15:40:18 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-b1f99bc5-226c-4e3c-95fb-d1627e46c47f tempest-VolumesActionsTest-370018746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-0c65cfe3-9760-4ee8-bba8-d22864a42431 1073741824" returned: 0 in 0.646s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:40:18 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-b1f99bc5-226c-4e3c-95fb-d1627e46c47f tempest-VolumesActionsTest-370018746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-0c65cfe3-9760-4ee8-bba8-d22864a42431 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:40:18 devstack sudo[91131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-0c65cfe3-9760-4ee8-bba8-d22864a42431 Sep 22 15:40:18 devstack sudo[91131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:40:18 devstack sudo[91131]: pam_unix(sudo:session): session closed for user root Sep 22 15:40:18 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-b1f99bc5-226c-4e3c-95fb-d1627e46c47f tempest-VolumesActionsTest-370018746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-0c65cfe3-9760-4ee8-bba8-d22864a42431" returned: 0 in 0.715s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:40:18 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-b1f99bc5-226c-4e3c-95fb-d1627e46c47f tempest-VolumesActionsTest-370018746 None] <== create_volume: return (1451ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'} {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 15:40:18 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-b1f99bc5-226c-4e3c-95fb-d1627e46c47f tempest-VolumesActionsTest-370018746 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.453s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:40:18 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-b1f99bc5-226c-4e3c-95fb-d1627e46c47f tempest-VolumesActionsTest-370018746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ab8a098-5cf4-45a5-8582-869f51f33635) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c65cfe3-9760-4ee8-bba8-d22864a42431', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:40:18 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-b1f99bc5-226c-4e3c-95fb-d1627e46c47f tempest-VolumesActionsTest-370018746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (093dc738-2d8e-4ded-9d00-ad72d9e25396) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:40:19 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-b1f99bc5-226c-4e3c-95fb-d1627e46c47f tempest-VolumesActionsTest-370018746 None] Volume volume-0c65cfe3-9760-4ee8-bba8-d22864a42431 (0c65cfe3-9760-4ee8-bba8-d22864a42431): created successfully Sep 22 15:40:19 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-b1f99bc5-226c-4e3c-95fb-d1627e46c47f tempest-VolumesActionsTest-370018746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (093dc738-2d8e-4ded-9d00-ad72d9e25396) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:40:19 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-b1f99bc5-226c-4e3c-95fb-d1627e46c47f tempest-VolumesActionsTest-370018746 None] Flow 'volume_create_manager' (d5541728-8423-4aaf-946f-e344b75afeec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:40:19 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-b1f99bc5-226c-4e3c-95fb-d1627e46c47f tempest-VolumesActionsTest-370018746 None] Created volume successfully. Sep 22 15:40:19 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-029700e0-1cc8-4767-85ee-dad0e060f6f7 tempest-VolumesActionsTest-1421548241 None] Acquiring lock "cinder-0c65cfe3-9760-4ee8-bba8-d22864a42431-delete_volume" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:40:19 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-029700e0-1cc8-4767-85ee-dad0e060f6f7 tempest-VolumesActionsTest-1421548241 None] Lock "cinder-0c65cfe3-9760-4ee8-bba8-d22864a42431-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:40:19 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-029700e0-1cc8-4767-85ee-dad0e060f6f7 tempest-VolumesActionsTest-1421548241 None] Acquiring lock "cinder-quobyte-0c65cfe3-9760-4ee8-bba8-d22864a42431" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:40:19 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-029700e0-1cc8-4767-85ee-dad0e060f6f7 tempest-VolumesActionsTest-1421548241 None] Lock "cinder-quobyte-0c65cfe3-9760-4ee8-bba8-d22864a42431" acquired by "delete_volume" :: waited 0.032s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:40:19 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cd0ea8c-f6f2-454b-947b-cc0c8fd667d9]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:40:19 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-029700e0-1cc8-4767-85ee-dad0e060f6f7 tempest-VolumesActionsTest-1421548241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-0c65cfe3-9760-4ee8-bba8-d22864a42431 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:40:20 devstack sudo[91136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-0c65cfe3-9760-4ee8-bba8-d22864a42431 Sep 22 15:40:20 devstack sudo[91136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:40:20 devstack cinder-volume[86212]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5bcf74d-8439-4416-9b51-a5d95232c3eb tempest-ServerActionsTestOtherA-1816233839 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 15:40:20 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-c5bcf74d-8439-4416-9b51-a5d95232c3eb tempest-ServerActionsTestOtherA-1816233839 None] Flow 'volume_create_manager' (134acc8b-60bc-41d2-b145-c3478c36824e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:40:20 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-c5bcf74d-8439-4416-9b51-a5d95232c3eb tempest-ServerActionsTestOtherA-1816233839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18fc5103-6edb-4135-b275-cce1a853b123) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:40:20 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-c5bcf74d-8439-4416-9b51-a5d95232c3eb tempest-ServerActionsTestOtherA-1816233839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18fc5103-6edb-4135-b275-cce1a853b123) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:40:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-2040709420',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b34b3a9c-1fb7-420e-a501-1fb9425cc913,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c05506a15e87408ea1d2542c3f5c8e14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:40:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:40:20Z,use_quota=True,user_id='9b8b3ceb4b52490aaf75da231d786280',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:40:20 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-c5bcf74d-8439-4416-9b51-a5d95232c3eb tempest-ServerActionsTestOtherA-1816233839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5262196a-783f-4f91-aa54-ec65f9c466fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:40:20 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-c5bcf74d-8439-4416-9b51-a5d95232c3eb tempest-ServerActionsTestOtherA-1816233839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5262196a-783f-4f91-aa54-ec65f9c466fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:40:20 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-c5bcf74d-8439-4416-9b51-a5d95232c3eb tempest-ServerActionsTestOtherA-1816233839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06d11f82-e184-420d-8ffa-eed0a70ada81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:40:20 devstack cinder-volume[86212]: DEBUG cinder.image.glance [None req-c5bcf74d-8439-4416-9b51-a5d95232c3eb tempest-ServerActionsTestOtherA-1816233839 None] Creating Keystone auth plugin from conf {{(pid=86212) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 22 15:40:20 devstack sudo[91136]: pam_unix(sudo:session): session closed for user root Sep 22 15:40:20 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-029700e0-1cc8-4767-85ee-dad0e060f6f7 tempest-VolumesActionsTest-1421548241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-0c65cfe3-9760-4ee8-bba8-d22864a42431" returned: 0 in 0.788s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:40:20 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-029700e0-1cc8-4767-85ee-dad0e060f6f7 tempest-VolumesActionsTest-1421548241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-0c65cfe3-9760-4ee8-bba8-d22864a42431 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:40:20 devstack sudo[91141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-0c65cfe3-9760-4ee8-bba8-d22864a42431 Sep 22 15:40:20 devstack sudo[91141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:40:21 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-c5bcf74d-8439-4416-9b51-a5d95232c3eb tempest-ServerActionsTestOtherA-1816233839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06d11f82-e184-420d-8ffa-eed0a70ada81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b34b3a9c-1fb7-420e-a501-1fb9425cc913', 'volume_name': 'volume-b34b3a9c-1fb7-420e-a501-1fb9425cc913', 'volume_size': 1, 'image_id': '6995c6ae-03d1-45bf-bf55-00575d1858e8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6995c6ae-03d1-45bf-bf55-00575d1858e8', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '28219d994ba546ed905a95ed90257a43', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6995c6ae-03d1-45bf-bf55-00575d1858e8', 'created_at': datetime.datetime(2026, 9, 22, 13, 30, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 13, 30, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6995c6ae-03d1-45bf-bf55-00575d1858e8/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:40:21 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-c5bcf74d-8439-4416-9b51-a5d95232c3eb tempest-ServerActionsTestOtherA-1816233839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f539fe31-92e6-4fea-bd8b-06dd2750fa17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:40:21 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-c5bcf74d-8439-4416-9b51-a5d95232c3eb tempest-ServerActionsTestOtherA-1816233839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f539fe31-92e6-4fea-bd8b-06dd2750fa17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:40:21 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-c5bcf74d-8439-4416-9b51-a5d95232c3eb tempest-ServerActionsTestOtherA-1816233839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3571e5f-bcb8-48f8-94d7-784c9764e807) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:40:21 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-c5bcf74d-8439-4416-9b51-a5d95232c3eb tempest-ServerActionsTestOtherA-1816233839 None] Volume b34b3a9c-1fb7-420e-a501-1fb9425cc913: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b34b3a9c-1fb7-420e-a501-1fb9425cc913', 'volume_size': 1, 'image_id': '6995c6ae-03d1-45bf-bf55-00575d1858e8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6995c6ae-03d1-45bf-bf55-00575d1858e8', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '28219d994ba546ed905a95ed90257a43', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6995c6ae-03d1-45bf-bf55-00575d1858e8', 'created_at': datetime.datetime(2026, 9, 22, 13, 30, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 13, 30, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6995c6ae-03d1-45bf-bf55-00575d1858e8/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 22 15:40:21 devstack sudo[91141]: pam_unix(sudo:session): session closed for user root Sep 22 15:40:21 devstack cinder-volume[86212]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5bcf74d-8439-4416-9b51-a5d95232c3eb tempest-ServerActionsTestOtherA-1816233839 None] Trying to clone b34b3a9c-1fb7-420e-a501-1fb9425cc913 from image 6995c6ae-03d1-45bf-bf55-00575d1858e8 at location (None, [{'url': 'file:///opt/stack/data/glance/images/6995c6ae-03d1-45bf-bf55-00575d1858e8', 'metadata': {}}]). {{(pid=86212) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 22 15:40:21 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-029700e0-1cc8-4767-85ee-dad0e060f6f7 tempest-VolumesActionsTest-1421548241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-0c65cfe3-9760-4ee8-bba8-d22864a42431" returned: 0 in 0.563s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:40:21 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-029700e0-1cc8-4767-85ee-dad0e060f6f7 tempest-VolumesActionsTest-1421548241 None] Lock "cinder-quobyte-0c65cfe3-9760-4ee8-bba8-d22864a42431" released by "delete_volume" :: held 1.420s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:40:21 devstack cinder-volume[86212]: DEBUG cinder.quota [None req-029700e0-1cc8-4767-85ee-dad0e060f6f7 tempest-VolumesActionsTest-1421548241 None] Created reservations ['f80d1df4-60e3-4024-bdfc-d97a4770dcb6', '70f1892d-0d2e-4028-84c4-1331783a22f5', '896c6293-0172-4201-808d-e7c92ec95aa0', 'ce9d72fa-cc2d-439e-a655-d8cc496e5f5d'] {{(pid=86212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 15:40:21 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-029700e0-1cc8-4767-85ee-dad0e060f6f7 tempest-VolumesActionsTest-1421548241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:40:21 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-029700e0-1cc8-4767-85ee-dad0e060f6f7 tempest-VolumesActionsTest-1421548241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:40:21 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-029700e0-1cc8-4767-85ee-dad0e060f6f7 tempest-VolumesActionsTest-1421548241 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:40:21 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-029700e0-1cc8-4767-85ee-dad0e060f6f7 tempest-VolumesActionsTest-1421548241 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:40:21 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-029700e0-1cc8-4767-85ee-dad0e060f6f7 tempest-VolumesActionsTest-1421548241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:40:21 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-029700e0-1cc8-4767-85ee-dad0e060f6f7 tempest-VolumesActionsTest-1421548241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:40:21 devstack sudo[91167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc Sep 22 15:40:21 devstack sudo[91167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:40:22 devstack cinder-volume[86212]: DEBUG cinder.image.image_utils [None req-c5bcf74d-8439-4416-9b51-a5d95232c3eb tempest-ServerActionsTestOtherA-1816233839 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_6995c6ae-03d1-45bf-bf55-00575d1858e8_jtrxx9pqdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86212) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 22 15:40:22 devstack cinder-volume[86212]: INFO cinder.image.image_utils [None req-c5bcf74d-8439-4416-9b51-a5d95232c3eb tempest-ServerActionsTestOtherA-1816233839 None] Image download 20.69 MB at 20.69 MB/s Sep 22 15:40:22 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[84689538-4b21-4c50-864d-219a48a2fbcf]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:40:22 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-c5bcf74d-8439-4416-9b51-a5d95232c3eb tempest-ServerActionsTestOtherA-1816233839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6995c6ae-03d1-45bf-bf55-00575d1858e8_jtrxx9pqdevstack@QuobyteHD {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:40:22 devstack sudo[91167]: pam_unix(sudo:session): session closed for user root Sep 22 15:40:22 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-029700e0-1cc8-4767-85ee-dad0e060f6f7 tempest-VolumesActionsTest-1421548241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc" returned: 0 in 0.480s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:40:22 devstack cinder-volume[86212]: DEBUG cinder.manager [None req-029700e0-1cc8-4767-85ee-dad0e060f6f7 tempest-VolumesActionsTest-1421548241 None] Notifying Schedulers of capabilities ... {{(pid=86212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 15:40:22 devstack sudo[91170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6995c6ae-03d1-45bf-bf55-00575d1858e8_jtrxx9pqdevstack@QuobyteHD Sep 22 15:40:22 devstack sudo[91170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:40:22 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-029700e0-1cc8-4767-85ee-dad0e060f6f7 tempest-VolumesActionsTest-1421548241 None] Deleted volume successfully. Sep 22 15:40:22 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-029700e0-1cc8-4767-85ee-dad0e060f6f7 tempest-VolumesActionsTest-1421548241 None] Lock "cinder-0c65cfe3-9760-4ee8-bba8-d22864a42431-delete_volume" released by "delete_volume" :: held 2.724s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:40:22 devstack sudo[91170]: pam_unix(sudo:session): session closed for user root Sep 22 15:40:22 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-c5bcf74d-8439-4416-9b51-a5d95232c3eb tempest-ServerActionsTestOtherA-1816233839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6995c6ae-03d1-45bf-bf55-00575d1858e8_jtrxx9pqdevstack@QuobyteHD" returned: 0 in 0.538s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:40:22 devstack cinder-volume[86212]: DEBUG cinder.image.image_utils [None req-c5bcf74d-8439-4416-9b51-a5d95232c3eb tempest-ServerActionsTestOtherA-1816233839 None] Temporary image 6995c6ae-03d1-45bf-bf55-00575d1858e8 is fetched for user 9b8b3ceb4b52490aaf75da231d786280. {{(pid=86212) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 22 15:40:22 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f42d6cb-0bff-4a1f-aa36-7995e8d5ca87]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:40:22 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-c5bcf74d-8439-4416-9b51-a5d95232c3eb tempest-ServerActionsTestOtherA-1816233839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6995c6ae-03d1-45bf-bf55-00575d1858e8_jtrxx9pqdevstack@QuobyteHD {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:40:23 devstack sudo[91178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6995c6ae-03d1-45bf-bf55-00575d1858e8_jtrxx9pqdevstack@QuobyteHD Sep 22 15:40:23 devstack sudo[91178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:40:23 devstack cinder-volume[86212]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf59a740-c9fc-4e63-bd25-b9c6bd7a53fe tempest-VolumesActionsTest-370018746 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 15:40:23 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-cf59a740-c9fc-4e63-bd25-b9c6bd7a53fe tempest-VolumesActionsTest-370018746 None] Flow 'volume_create_manager' (6d3f7d84-513d-40cc-95ed-411bd3d32b9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:40:23 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-cf59a740-c9fc-4e63-bd25-b9c6bd7a53fe tempest-VolumesActionsTest-370018746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43579b5b-f60c-4baa-8887-db6f810bf24b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:40:23 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-cf59a740-c9fc-4e63-bd25-b9c6bd7a53fe tempest-VolumesActionsTest-370018746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43579b5b-f60c-4baa-8887-db6f810bf24b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:40:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1561761119',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3cf1fb6d-3b13-4c50-8b99-92fd499ee2da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a6e6db79b124a28acc4a325500a8405',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:40:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:40:23Z,use_quota=True,user_id='87f0730725c0472389f7c7fab9d258a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:40:23 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-cf59a740-c9fc-4e63-bd25-b9c6bd7a53fe tempest-VolumesActionsTest-370018746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2eb7af99-43d9-49ff-955f-3f585d5a5dd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:40:23 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-cf59a740-c9fc-4e63-bd25-b9c6bd7a53fe tempest-VolumesActionsTest-370018746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2eb7af99-43d9-49ff-955f-3f585d5a5dd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:40:23 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-cf59a740-c9fc-4e63-bd25-b9c6bd7a53fe tempest-VolumesActionsTest-370018746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85fb5960-0a36-498e-9e34-2726b93ffea9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:40:23 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-cf59a740-c9fc-4e63-bd25-b9c6bd7a53fe tempest-VolumesActionsTest-370018746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85fb5960-0a36-498e-9e34-2726b93ffea9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3cf1fb6d-3b13-4c50-8b99-92fd499ee2da', 'volume_name': 'volume-3cf1fb6d-3b13-4c50-8b99-92fd499ee2da', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:40:23 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-cf59a740-c9fc-4e63-bd25-b9c6bd7a53fe tempest-VolumesActionsTest-370018746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (babb5dc0-da26-448e-bea9-9c86a589f5ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:40:23 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-cf59a740-c9fc-4e63-bd25-b9c6bd7a53fe tempest-VolumesActionsTest-370018746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (babb5dc0-da26-448e-bea9-9c86a589f5ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:40:23 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-cf59a740-c9fc-4e63-bd25-b9c6bd7a53fe tempest-VolumesActionsTest-370018746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a67328a-5764-4749-a7a4-99d418ddac57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:40:23 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-cf59a740-c9fc-4e63-bd25-b9c6bd7a53fe tempest-VolumesActionsTest-370018746 None] Volume 3cf1fb6d-3b13-4c50-8b99-92fd499ee2da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3cf1fb6d-3b13-4c50-8b99-92fd499ee2da', 'volume_size': 1} Sep 22 15:40:23 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-cf59a740-c9fc-4e63-bd25-b9c6bd7a53fe tempest-VolumesActionsTest-370018746 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:40:23 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-cf59a740-c9fc-4e63-bd25-b9c6bd7a53fe tempest-VolumesActionsTest-370018746 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:40:23 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-cf59a740-c9fc-4e63-bd25-b9c6bd7a53fe tempest-VolumesActionsTest-370018746 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:40:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1561761119',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3cf1fb6d-3b13-4c50-8b99-92fd499ee2da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a6e6db79b124a28acc4a325500a8405',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:40:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:40:23Z,use_quota=True,user_id='87f0730725c0472389f7c7fab9d258a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)}" {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 15:40:23 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-cf59a740-c9fc-4e63-bd25-b9c6bd7a53fe tempest-VolumesActionsTest-370018746 None] Creating volume 3cf1fb6d-3b13-4c50-8b99-92fd499ee2da {{(pid=86212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 15:40:23 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-cf59a740-c9fc-4e63-bd25-b9c6bd7a53fe tempest-VolumesActionsTest-370018746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:40:23 devstack sudo[91178]: pam_unix(sudo:session): session closed for user root Sep 22 15:40:23 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-cf59a740-c9fc-4e63-bd25-b9c6bd7a53fe tempest-VolumesActionsTest-370018746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:40:23 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-cf59a740-c9fc-4e63-bd25-b9c6bd7a53fe tempest-VolumesActionsTest-370018746 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:40:23 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-cf59a740-c9fc-4e63-bd25-b9c6bd7a53fe tempest-VolumesActionsTest-370018746 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:40:23 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-cf59a740-c9fc-4e63-bd25-b9c6bd7a53fe tempest-VolumesActionsTest-370018746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:40:23 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-cf59a740-c9fc-4e63-bd25-b9c6bd7a53fe tempest-VolumesActionsTest-370018746 None] Selected osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 as target Quobyte volume. {{(pid=86212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 15:40:23 devstack cinder-volume[86212]: INFO cinder.volume.drivers.remotefs [None req-cf59a740-c9fc-4e63-bd25-b9c6bd7a53fe tempest-VolumesActionsTest-370018746 None] casted to osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 Sep 22 15:40:23 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-cf59a740-c9fc-4e63-bd25-b9c6bd7a53fe tempest-VolumesActionsTest-370018746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-3cf1fb6d-3b13-4c50-8b99-92fd499ee2da 1073741824 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:40:23 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-c5bcf74d-8439-4416-9b51-a5d95232c3eb tempest-ServerActionsTestOtherA-1816233839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6995c6ae-03d1-45bf-bf55-00575d1858e8_jtrxx9pqdevstack@QuobyteHD" returned: 0 in 0.442s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:40:23 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-c5bcf74d-8439-4416-9b51-a5d95232c3eb tempest-ServerActionsTestOtherA-1816233839 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:40:23 devstack sudo[91184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-3cf1fb6d-3b13-4c50-8b99-92fd499ee2da 1073741824 Sep 22 15:40:23 devstack sudo[91184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:40:23 devstack sudo[91184]: pam_unix(sudo:session): session closed for user root Sep 22 15:40:23 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-cf59a740-c9fc-4e63-bd25-b9c6bd7a53fe tempest-VolumesActionsTest-370018746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-3cf1fb6d-3b13-4c50-8b99-92fd499ee2da 1073741824" returned: 0 in 0.551s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:40:23 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-cf59a740-c9fc-4e63-bd25-b9c6bd7a53fe tempest-VolumesActionsTest-370018746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-3cf1fb6d-3b13-4c50-8b99-92fd499ee2da {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:40:23 devstack sudo[91190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-3cf1fb6d-3b13-4c50-8b99-92fd499ee2da Sep 22 15:40:23 devstack sudo[91190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:40:24 devstack sudo[91190]: pam_unix(sudo:session): session closed for user root Sep 22 15:40:24 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-cf59a740-c9fc-4e63-bd25-b9c6bd7a53fe tempest-VolumesActionsTest-370018746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-3cf1fb6d-3b13-4c50-8b99-92fd499ee2da" returned: 0 in 0.278s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:40:24 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-cf59a740-c9fc-4e63-bd25-b9c6bd7a53fe tempest-VolumesActionsTest-370018746 None] <== create_volume: return (886ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'} {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 15:40:24 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-cf59a740-c9fc-4e63-bd25-b9c6bd7a53fe tempest-VolumesActionsTest-370018746 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.889s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:40:24 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-c5bcf74d-8439-4416-9b51-a5d95232c3eb tempest-ServerActionsTestOtherA-1816233839 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.860s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:40:24 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-c5bcf74d-8439-4416-9b51-a5d95232c3eb tempest-ServerActionsTestOtherA-1816233839 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:40:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-2040709420',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b34b3a9c-1fb7-420e-a501-1fb9425cc913,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c05506a15e87408ea1d2542c3f5c8e14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:40:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:40:20Z,use_quota=True,user_id='9b8b3ceb4b52490aaf75da231d786280',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)}" {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 15:40:24 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-c5bcf74d-8439-4416-9b51-a5d95232c3eb tempest-ServerActionsTestOtherA-1816233839 None] Creating volume b34b3a9c-1fb7-420e-a501-1fb9425cc913 {{(pid=86212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 15:40:24 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-c5bcf74d-8439-4416-9b51-a5d95232c3eb tempest-ServerActionsTestOtherA-1816233839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:40:24 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-c5bcf74d-8439-4416-9b51-a5d95232c3eb tempest-ServerActionsTestOtherA-1816233839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:40:24 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-c5bcf74d-8439-4416-9b51-a5d95232c3eb tempest-ServerActionsTestOtherA-1816233839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:40:24 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-c5bcf74d-8439-4416-9b51-a5d95232c3eb tempest-ServerActionsTestOtherA-1816233839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:40:24 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-c5bcf74d-8439-4416-9b51-a5d95232c3eb tempest-ServerActionsTestOtherA-1816233839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:40:24 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-c5bcf74d-8439-4416-9b51-a5d95232c3eb tempest-ServerActionsTestOtherA-1816233839 None] Selected osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 as target Quobyte volume. {{(pid=86212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 15:40:24 devstack cinder-volume[86212]: INFO cinder.volume.drivers.remotefs [None req-c5bcf74d-8439-4416-9b51-a5d95232c3eb tempest-ServerActionsTestOtherA-1816233839 None] casted to osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 Sep 22 15:40:24 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-c5bcf74d-8439-4416-9b51-a5d95232c3eb tempest-ServerActionsTestOtherA-1816233839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b34b3a9c-1fb7-420e-a501-1fb9425cc913 1073741824 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:40:24 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-cf59a740-c9fc-4e63-bd25-b9c6bd7a53fe tempest-VolumesActionsTest-370018746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a67328a-5764-4749-a7a4-99d418ddac57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3cf1fb6d-3b13-4c50-8b99-92fd499ee2da', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:40:24 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-cf59a740-c9fc-4e63-bd25-b9c6bd7a53fe tempest-VolumesActionsTest-370018746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4a64b4c-6415-4ea1-b74b-f51d5dc7b349) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:40:24 devstack sudo[91193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b34b3a9c-1fb7-420e-a501-1fb9425cc913 1073741824 Sep 22 15:40:24 devstack sudo[91193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:40:24 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-cf59a740-c9fc-4e63-bd25-b9c6bd7a53fe tempest-VolumesActionsTest-370018746 None] Volume volume-3cf1fb6d-3b13-4c50-8b99-92fd499ee2da (3cf1fb6d-3b13-4c50-8b99-92fd499ee2da): created successfully Sep 22 15:40:24 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-cf59a740-c9fc-4e63-bd25-b9c6bd7a53fe tempest-VolumesActionsTest-370018746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4a64b4c-6415-4ea1-b74b-f51d5dc7b349) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:40:24 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-cf59a740-c9fc-4e63-bd25-b9c6bd7a53fe tempest-VolumesActionsTest-370018746 None] Flow 'volume_create_manager' (6d3f7d84-513d-40cc-95ed-411bd3d32b9c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:40:24 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-cf59a740-c9fc-4e63-bd25-b9c6bd7a53fe tempest-VolumesActionsTest-370018746 None] Created volume successfully. Sep 22 15:40:24 devstack sudo[91193]: pam_unix(sudo:session): session closed for user root Sep 22 15:40:24 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-c5bcf74d-8439-4416-9b51-a5d95232c3eb tempest-ServerActionsTestOtherA-1816233839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b34b3a9c-1fb7-420e-a501-1fb9425cc913 1073741824" returned: 0 in 0.573s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:40:24 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-c5bcf74d-8439-4416-9b51-a5d95232c3eb tempest-ServerActionsTestOtherA-1816233839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b34b3a9c-1fb7-420e-a501-1fb9425cc913 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:40:24 devstack sudo[91201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b34b3a9c-1fb7-420e-a501-1fb9425cc913 Sep 22 15:40:24 devstack sudo[91201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:40:25 devstack sudo[91201]: pam_unix(sudo:session): session closed for user root Sep 22 15:40:25 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-c5bcf74d-8439-4416-9b51-a5d95232c3eb tempest-ServerActionsTestOtherA-1816233839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b34b3a9c-1fb7-420e-a501-1fb9425cc913" returned: 0 in 0.296s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:40:25 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-c5bcf74d-8439-4416-9b51-a5d95232c3eb tempest-ServerActionsTestOtherA-1816233839 None] <== create_volume: return (927ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'} {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 15:40:25 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-c5bcf74d-8439-4416-9b51-a5d95232c3eb tempest-ServerActionsTestOtherA-1816233839 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.933s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:40:25 devstack cinder-volume[86212]: DEBUG cinder.volume.volume_utils [None req-c5bcf74d-8439-4416-9b51-a5d95232c3eb tempest-ServerActionsTestOtherA-1816233839 None] Attempting download of 6995c6ae-03d1-45bf-bf55-00575d1858e8 ((None, [{'url': 'file:///opt/stack/data/glance/images/6995c6ae-03d1-45bf-bf55-00575d1858e8', 'metadata': {}}])) to volume b34b3a9c-1fb7-420e-a501-1fb9425cc913. {{(pid=86212) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 22 15:40:25 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[bee1591f-ad3e-4129-881e-ef69d7aa05a4]: (4, 'raw') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:40:25 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-c5bcf74d-8439-4416-9b51-a5d95232c3eb tempest-ServerActionsTestOtherA-1816233839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6995c6ae-03d1-45bf-bf55-00575d1858e8_gfnx1vi5 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:40:25 devstack sudo[91204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6995c6ae-03d1-45bf-bf55-00575d1858e8_gfnx1vi5 Sep 22 15:40:25 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-389ec2bb-de14-4768-929c-bc74ac703582 tempest-VolumesActionsTest-1421548241 None] Acquiring lock "cinder-3cf1fb6d-3b13-4c50-8b99-92fd499ee2da-delete_volume" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:40:25 devstack sudo[91204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:40:25 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-389ec2bb-de14-4768-929c-bc74ac703582 tempest-VolumesActionsTest-1421548241 None] Lock "cinder-3cf1fb6d-3b13-4c50-8b99-92fd499ee2da-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:40:25 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-389ec2bb-de14-4768-929c-bc74ac703582 tempest-VolumesActionsTest-1421548241 None] Acquiring lock "cinder-quobyte-3cf1fb6d-3b13-4c50-8b99-92fd499ee2da" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:40:25 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-389ec2bb-de14-4768-929c-bc74ac703582 tempest-VolumesActionsTest-1421548241 None] Lock "cinder-quobyte-3cf1fb6d-3b13-4c50-8b99-92fd499ee2da" acquired by "delete_volume" :: waited 0.029s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:40:25 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[841ff578-e204-43b5-be98-c6b3056d9ab1]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:40:25 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-389ec2bb-de14-4768-929c-bc74ac703582 tempest-VolumesActionsTest-1421548241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-3cf1fb6d-3b13-4c50-8b99-92fd499ee2da {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:40:25 devstack sudo[91204]: pam_unix(sudo:session): session closed for user root Sep 22 15:40:25 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-c5bcf74d-8439-4416-9b51-a5d95232c3eb tempest-ServerActionsTestOtherA-1816233839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6995c6ae-03d1-45bf-bf55-00575d1858e8_gfnx1vi5" returned: 0 in 0.513s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:40:25 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-c5bcf74d-8439-4416-9b51-a5d95232c3eb tempest-ServerActionsTestOtherA-1816233839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6995c6ae-03d1-45bf-bf55-00575d1858e8_gfnx1vi5 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:40:25 devstack sudo[91206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-3cf1fb6d-3b13-4c50-8b99-92fd499ee2da Sep 22 15:40:25 devstack sudo[91206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:40:25 devstack sudo[91209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6995c6ae-03d1-45bf-bf55-00575d1858e8_gfnx1vi5 Sep 22 15:40:25 devstack sudo[91209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:40:26 devstack sudo[91206]: pam_unix(sudo:session): session closed for user root Sep 22 15:40:26 devstack sudo[91209]: pam_unix(sudo:session): session closed for user root Sep 22 15:40:26 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-389ec2bb-de14-4768-929c-bc74ac703582 tempest-VolumesActionsTest-1421548241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-3cf1fb6d-3b13-4c50-8b99-92fd499ee2da" returned: 0 in 0.580s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:40:26 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-389ec2bb-de14-4768-929c-bc74ac703582 tempest-VolumesActionsTest-1421548241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-3cf1fb6d-3b13-4c50-8b99-92fd499ee2da {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:40:26 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-c5bcf74d-8439-4416-9b51-a5d95232c3eb tempest-ServerActionsTestOtherA-1816233839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6995c6ae-03d1-45bf-bf55-00575d1858e8_gfnx1vi5" returned: 1 in 0.409s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:40:26 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-c5bcf74d-8439-4416-9b51-a5d95232c3eb tempest-ServerActionsTestOtherA-1816233839 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6995c6ae-03d1-45bf-bf55-00575d1858e8_gfnx1vi5' failed. Not Retrying. {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 22 15:40:26 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a08e92d-3a34-450a-8c39-206919a913f3]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:40:26 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-c5bcf74d-8439-4416-9b51-a5d95232c3eb tempest-ServerActionsTestOtherA-1816233839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6995c6ae-03d1-45bf-bf55-00575d1858e8_jtrxx9pqdevstack@QuobyteHD {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:40:26 devstack sudo[91217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-3cf1fb6d-3b13-4c50-8b99-92fd499ee2da Sep 22 15:40:26 devstack sudo[91217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:40:26 devstack sudo[91218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6995c6ae-03d1-45bf-bf55-00575d1858e8_jtrxx9pqdevstack@QuobyteHD Sep 22 15:40:26 devstack sudo[91218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:40:26 devstack sudo[91217]: pam_unix(sudo:session): session closed for user root Sep 22 15:40:26 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-389ec2bb-de14-4768-929c-bc74ac703582 tempest-VolumesActionsTest-1421548241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-3cf1fb6d-3b13-4c50-8b99-92fd499ee2da" returned: 0 in 0.388s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:40:26 devstack sudo[91218]: pam_unix(sudo:session): session closed for user root Sep 22 15:40:26 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-c5bcf74d-8439-4416-9b51-a5d95232c3eb tempest-ServerActionsTestOtherA-1816233839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6995c6ae-03d1-45bf-bf55-00575d1858e8_jtrxx9pqdevstack@QuobyteHD" returned: 0 in 0.392s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:40:26 devstack cinder-volume[86212]: DEBUG cinder.image.image_utils [None req-c5bcf74d-8439-4416-9b51-a5d95232c3eb tempest-ServerActionsTestOtherA-1816233839 None] 6995c6ae-03d1-45bf-bf55-00575d1858e8 was qcow2, converting to qcow2 {{(pid=86212) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 22 15:40:26 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-c5bcf74d-8439-4416-9b51-a5d95232c3eb tempest-ServerActionsTestOtherA-1816233839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6995c6ae-03d1-45bf-bf55-00575d1858e8_jtrxx9pqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b34b3a9c-1fb7-420e-a501-1fb9425cc913 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:40:26 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-389ec2bb-de14-4768-929c-bc74ac703582 tempest-VolumesActionsTest-1421548241 None] Lock "cinder-quobyte-3cf1fb6d-3b13-4c50-8b99-92fd499ee2da" released by "delete_volume" :: held 1.071s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:40:26 devstack sudo[91225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6995c6ae-03d1-45bf-bf55-00575d1858e8_jtrxx9pqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b34b3a9c-1fb7-420e-a501-1fb9425cc913 Sep 22 15:40:26 devstack sudo[91225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:40:26 devstack cinder-volume[86212]: DEBUG cinder.quota [None req-389ec2bb-de14-4768-929c-bc74ac703582 tempest-VolumesActionsTest-1421548241 None] Created reservations ['a511ebb0-e75b-462e-91b3-801a0819b6bd', '7f042b99-c118-4d39-bf86-87c6251f29b2', 'f0a564a8-7ea4-40b4-af14-6f8a2a07dd19', '204d1607-6e46-4dd3-8067-f873b0822352'] {{(pid=86212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 15:40:26 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-389ec2bb-de14-4768-929c-bc74ac703582 tempest-VolumesActionsTest-1421548241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:40:26 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-389ec2bb-de14-4768-929c-bc74ac703582 tempest-VolumesActionsTest-1421548241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:40:26 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-389ec2bb-de14-4768-929c-bc74ac703582 tempest-VolumesActionsTest-1421548241 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:40:26 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-389ec2bb-de14-4768-929c-bc74ac703582 tempest-VolumesActionsTest-1421548241 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:40:26 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-389ec2bb-de14-4768-929c-bc74ac703582 tempest-VolumesActionsTest-1421548241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.043s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:40:26 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-389ec2bb-de14-4768-929c-bc74ac703582 tempest-VolumesActionsTest-1421548241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:40:26 devstack sudo[91227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc Sep 22 15:40:26 devstack sudo[91227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:40:27 devstack sudo[91227]: pam_unix(sudo:session): session closed for user root Sep 22 15:40:27 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-389ec2bb-de14-4768-929c-bc74ac703582 tempest-VolumesActionsTest-1421548241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc" returned: 0 in 0.414s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:40:27 devstack cinder-volume[86212]: DEBUG cinder.manager [None req-389ec2bb-de14-4768-929c-bc74ac703582 tempest-VolumesActionsTest-1421548241 None] Notifying Schedulers of capabilities ... {{(pid=86212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 15:40:27 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-389ec2bb-de14-4768-929c-bc74ac703582 tempest-VolumesActionsTest-1421548241 None] Deleted volume successfully. Sep 22 15:40:27 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-389ec2bb-de14-4768-929c-bc74ac703582 tempest-VolumesActionsTest-1421548241 None] Lock "cinder-3cf1fb6d-3b13-4c50-8b99-92fd499ee2da-delete_volume" released by "delete_volume" :: held 1.884s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:40:28 devstack cinder-volume[86212]: DEBUG cinder.volume.flows.manager.create_volume [None req-c02a58fb-7093-4f4a-a915-457d950bb675 tempest-VolumesActionsTest-370018746 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 15:40:28 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-c02a58fb-7093-4f4a-a915-457d950bb675 tempest-VolumesActionsTest-370018746 None] Flow 'volume_create_manager' (9fa550d5-322f-494a-bb2a-615b4586f2a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:40:28 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-c02a58fb-7093-4f4a-a915-457d950bb675 tempest-VolumesActionsTest-370018746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2039be5-4a72-450a-b021-2f0f7e468ca9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:40:28 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-c02a58fb-7093-4f4a-a915-457d950bb675 tempest-VolumesActionsTest-370018746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2039be5-4a72-450a-b021-2f0f7e468ca9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:40:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1865735650',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=468ed4c3-4f57-4b58-8a5e-ed2f3a9256f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a6e6db79b124a28acc4a325500a8405',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:40:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:40:29Z,use_quota=True,user_id='87f0730725c0472389f7c7fab9d258a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:40:28 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-c02a58fb-7093-4f4a-a915-457d950bb675 tempest-VolumesActionsTest-370018746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0caa8243-a7bc-4fa7-a1c4-42a22b470ff0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:40:28 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-c02a58fb-7093-4f4a-a915-457d950bb675 tempest-VolumesActionsTest-370018746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0caa8243-a7bc-4fa7-a1c4-42a22b470ff0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:40:28 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-c02a58fb-7093-4f4a-a915-457d950bb675 tempest-VolumesActionsTest-370018746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cdc7353d-8963-4992-aaf5-5e9c3fdd99d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:40:28 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-c02a58fb-7093-4f4a-a915-457d950bb675 tempest-VolumesActionsTest-370018746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cdc7353d-8963-4992-aaf5-5e9c3fdd99d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '468ed4c3-4f57-4b58-8a5e-ed2f3a9256f0', 'volume_name': 'volume-468ed4c3-4f57-4b58-8a5e-ed2f3a9256f0', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:40:28 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-c02a58fb-7093-4f4a-a915-457d950bb675 tempest-VolumesActionsTest-370018746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e56a1a2-e8a0-44f6-a93d-ac1858ff2317) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:40:28 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-c02a58fb-7093-4f4a-a915-457d950bb675 tempest-VolumesActionsTest-370018746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e56a1a2-e8a0-44f6-a93d-ac1858ff2317) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:40:28 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-c02a58fb-7093-4f4a-a915-457d950bb675 tempest-VolumesActionsTest-370018746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84852ee2-cddf-4109-ab2c-0ca62965eb9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:40:28 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-c02a58fb-7093-4f4a-a915-457d950bb675 tempest-VolumesActionsTest-370018746 None] Volume 468ed4c3-4f57-4b58-8a5e-ed2f3a9256f0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-468ed4c3-4f57-4b58-8a5e-ed2f3a9256f0', 'volume_size': 1} Sep 22 15:40:28 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-c02a58fb-7093-4f4a-a915-457d950bb675 tempest-VolumesActionsTest-370018746 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:40:28 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-c02a58fb-7093-4f4a-a915-457d950bb675 tempest-VolumesActionsTest-370018746 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:40:28 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-c02a58fb-7093-4f4a-a915-457d950bb675 tempest-VolumesActionsTest-370018746 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:40:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1865735650',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=468ed4c3-4f57-4b58-8a5e-ed2f3a9256f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a6e6db79b124a28acc4a325500a8405',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:40:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:40:29Z,use_quota=True,user_id='87f0730725c0472389f7c7fab9d258a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)}" {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 15:40:28 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-c02a58fb-7093-4f4a-a915-457d950bb675 tempest-VolumesActionsTest-370018746 None] Creating volume 468ed4c3-4f57-4b58-8a5e-ed2f3a9256f0 {{(pid=86212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 15:40:28 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-c02a58fb-7093-4f4a-a915-457d950bb675 tempest-VolumesActionsTest-370018746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:40:28 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-c02a58fb-7093-4f4a-a915-457d950bb675 tempest-VolumesActionsTest-370018746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:40:28 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-c02a58fb-7093-4f4a-a915-457d950bb675 tempest-VolumesActionsTest-370018746 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:40:28 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-c02a58fb-7093-4f4a-a915-457d950bb675 tempest-VolumesActionsTest-370018746 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:40:28 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-c02a58fb-7093-4f4a-a915-457d950bb675 tempest-VolumesActionsTest-370018746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:40:28 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-c02a58fb-7093-4f4a-a915-457d950bb675 tempest-VolumesActionsTest-370018746 None] Selected osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 as target Quobyte volume. {{(pid=86212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 15:40:28 devstack cinder-volume[86212]: INFO cinder.volume.drivers.remotefs [None req-c02a58fb-7093-4f4a-a915-457d950bb675 tempest-VolumesActionsTest-370018746 None] casted to osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 Sep 22 15:40:28 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-c02a58fb-7093-4f4a-a915-457d950bb675 tempest-VolumesActionsTest-370018746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-468ed4c3-4f57-4b58-8a5e-ed2f3a9256f0 1073741824 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:40:28 devstack sudo[91272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-468ed4c3-4f57-4b58-8a5e-ed2f3a9256f0 1073741824 Sep 22 15:40:28 devstack sudo[91272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:40:29 devstack sudo[91225]: pam_unix(sudo:session): session closed for user root Sep 22 15:40:29 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-c5bcf74d-8439-4416-9b51-a5d95232c3eb tempest-ServerActionsTestOtherA-1816233839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6995c6ae-03d1-45bf-bf55-00575d1858e8_jtrxx9pqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b34b3a9c-1fb7-420e-a501-1fb9425cc913" returned: 0 in 2.800s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:40:29 devstack cinder-volume[86212]: DEBUG cinder.image.image_utils [None req-c5bcf74d-8439-4416-9b51-a5d95232c3eb tempest-ServerActionsTestOtherA-1816233839 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_6995c6ae-03d1-45bf-bf55-00575d1858e8_jtrxx9pqdevstack@QuobyteHD, size 112.00 MB, duration 2.80 sec, destination /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b34b3a9c-1fb7-420e-a501-1fb9425cc913 {{(pid=86212) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 22 15:40:29 devstack cinder-volume[86212]: INFO cinder.image.image_utils [None req-c5bcf74d-8439-4416-9b51-a5d95232c3eb tempest-ServerActionsTestOtherA-1816233839 None] Converted 112.00 MB image at 39.95 MB/s Sep 22 15:40:29 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-c5bcf74d-8439-4416-9b51-a5d95232c3eb tempest-ServerActionsTestOtherA-1816233839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b34b3a9c-1fb7-420e-a501-1fb9425cc913 1G {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:40:29 devstack sudo[91297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b34b3a9c-1fb7-420e-a501-1fb9425cc913 1G Sep 22 15:40:29 devstack sudo[91297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:40:29 devstack sudo[91272]: pam_unix(sudo:session): session closed for user root Sep 22 15:40:29 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-c02a58fb-7093-4f4a-a915-457d950bb675 tempest-VolumesActionsTest-370018746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-468ed4c3-4f57-4b58-8a5e-ed2f3a9256f0 1073741824" returned: 0 in 0.720s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:40:29 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-c02a58fb-7093-4f4a-a915-457d950bb675 tempest-VolumesActionsTest-370018746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-468ed4c3-4f57-4b58-8a5e-ed2f3a9256f0 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:40:29 devstack sudo[91300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-468ed4c3-4f57-4b58-8a5e-ed2f3a9256f0 Sep 22 15:40:29 devstack sudo[91300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:40:29 devstack sudo[91297]: pam_unix(sudo:session): session closed for user root Sep 22 15:40:29 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-c5bcf74d-8439-4416-9b51-a5d95232c3eb tempest-ServerActionsTestOtherA-1816233839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b34b3a9c-1fb7-420e-a501-1fb9425cc913 1G" returned: 0 in 0.394s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:40:29 devstack cinder-volume[86212]: DEBUG cinder.volume.volume_utils [None req-c5bcf74d-8439-4416-9b51-a5d95232c3eb tempest-ServerActionsTestOtherA-1816233839 None] Downloaded image 6995c6ae-03d1-45bf-bf55-00575d1858e8 ((None, [{'url': 'file:///opt/stack/data/glance/images/6995c6ae-03d1-45bf-bf55-00575d1858e8', 'metadata': {}}])) to volume b34b3a9c-1fb7-420e-a501-1fb9425cc913 successfully. {{(pid=86212) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 22 15:40:29 devstack cinder-volume[86212]: DEBUG cinder.image.image_utils [None req-c5bcf74d-8439-4416-9b51-a5d95232c3eb tempest-ServerActionsTestOtherA-1816233839 None] Temporary image 6995c6ae-03d1-45bf-bf55-00575d1858e8 for user 9b8b3ceb4b52490aaf75da231d786280 is deleted. {{(pid=86212) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 22 15:40:29 devstack cinder-volume[86212]: DEBUG cinder.volume.volume_utils [None req-c5bcf74d-8439-4416-9b51-a5d95232c3eb tempest-ServerActionsTestOtherA-1816233839 None] Marking volume b34b3a9c-1fb7-420e-a501-1fb9425cc913 as bootable. {{(pid=86212) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 22 15:40:29 devstack cinder-volume[86212]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5bcf74d-8439-4416-9b51-a5d95232c3eb tempest-ServerActionsTestOtherA-1816233839 None] Copying metadata from image 6995c6ae-03d1-45bf-bf55-00575d1858e8 to b34b3a9c-1fb7-420e-a501-1fb9425cc913. {{(pid=86212) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 22 15:40:29 devstack cinder-volume[86212]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5bcf74d-8439-4416-9b51-a5d95232c3eb tempest-ServerActionsTestOtherA-1816233839 None] Creating volume glance metadata for volume b34b3a9c-1fb7-420e-a501-1fb9425cc913 backed by image 6995c6ae-03d1-45bf-bf55-00575d1858e8 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '6995c6ae-03d1-45bf-bf55-00575d1858e8', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86212) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 22 15:40:29 devstack sudo[91300]: pam_unix(sudo:session): session closed for user root Sep 22 15:40:29 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-c02a58fb-7093-4f4a-a915-457d950bb675 tempest-VolumesActionsTest-370018746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-468ed4c3-4f57-4b58-8a5e-ed2f3a9256f0" returned: 0 in 0.287s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:40:29 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-c02a58fb-7093-4f4a-a915-457d950bb675 tempest-VolumesActionsTest-370018746 None] <== create_volume: return (1061ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'} {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 15:40:29 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-c02a58fb-7093-4f4a-a915-457d950bb675 tempest-VolumesActionsTest-370018746 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.064s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:40:29 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-c02a58fb-7093-4f4a-a915-457d950bb675 tempest-VolumesActionsTest-370018746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84852ee2-cddf-4109-ab2c-0ca62965eb9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-468ed4c3-4f57-4b58-8a5e-ed2f3a9256f0', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:40:29 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-c02a58fb-7093-4f4a-a915-457d950bb675 tempest-VolumesActionsTest-370018746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fccc18e1-f79a-4be5-b8c4-687d57104e00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:40:29 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-c5bcf74d-8439-4416-9b51-a5d95232c3eb tempest-ServerActionsTestOtherA-1816233839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3571e5f-bcb8-48f8-94d7-784c9764e807) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b34b3a9c-1fb7-420e-a501-1fb9425cc913', 'volume_size': 1, 'image_id': '6995c6ae-03d1-45bf-bf55-00575d1858e8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6995c6ae-03d1-45bf-bf55-00575d1858e8', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '28219d994ba546ed905a95ed90257a43', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6995c6ae-03d1-45bf-bf55-00575d1858e8', 'created_at': datetime.datetime(2026, 9, 22, 13, 30, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 13, 30, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6995c6ae-03d1-45bf-bf55-00575d1858e8/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:40:29 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-c5bcf74d-8439-4416-9b51-a5d95232c3eb tempest-ServerActionsTestOtherA-1816233839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d2f1c65-025a-4c9e-bdf6-4bd49dd91d96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:40:29 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-c02a58fb-7093-4f4a-a915-457d950bb675 tempest-VolumesActionsTest-370018746 None] Volume volume-468ed4c3-4f57-4b58-8a5e-ed2f3a9256f0 (468ed4c3-4f57-4b58-8a5e-ed2f3a9256f0): created successfully Sep 22 15:40:29 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-c02a58fb-7093-4f4a-a915-457d950bb675 tempest-VolumesActionsTest-370018746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fccc18e1-f79a-4be5-b8c4-687d57104e00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:40:30 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-c02a58fb-7093-4f4a-a915-457d950bb675 tempest-VolumesActionsTest-370018746 None] Flow 'volume_create_manager' (9fa550d5-322f-494a-bb2a-615b4586f2a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:40:30 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-c5bcf74d-8439-4416-9b51-a5d95232c3eb tempest-ServerActionsTestOtherA-1816233839 None] Volume volume-b34b3a9c-1fb7-420e-a501-1fb9425cc913 (b34b3a9c-1fb7-420e-a501-1fb9425cc913): created successfully Sep 22 15:40:30 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-c5bcf74d-8439-4416-9b51-a5d95232c3eb tempest-ServerActionsTestOtherA-1816233839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d2f1c65-025a-4c9e-bdf6-4bd49dd91d96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:40:30 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-c5bcf74d-8439-4416-9b51-a5d95232c3eb tempest-ServerActionsTestOtherA-1816233839 None] Flow 'volume_create_manager' (134acc8b-60bc-41d2-b145-c3478c36824e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:40:30 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-c02a58fb-7093-4f4a-a915-457d950bb675 tempest-VolumesActionsTest-370018746 None] Created volume successfully. Sep 22 15:40:30 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-c5bcf74d-8439-4416-9b51-a5d95232c3eb tempest-ServerActionsTestOtherA-1816233839 None] Created volume successfully. Sep 22 15:40:30 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-6ed068d7-28a4-4c45-b57e-a86194bde5bc tempest-VolumesActionsTest-1421548241 None] Acquiring lock "cinder-468ed4c3-4f57-4b58-8a5e-ed2f3a9256f0-delete_volume" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:40:30 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-6ed068d7-28a4-4c45-b57e-a86194bde5bc tempest-VolumesActionsTest-1421548241 None] Lock "cinder-468ed4c3-4f57-4b58-8a5e-ed2f3a9256f0-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:40:31 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-6ed068d7-28a4-4c45-b57e-a86194bde5bc tempest-VolumesActionsTest-1421548241 None] Acquiring lock "cinder-quobyte-468ed4c3-4f57-4b58-8a5e-ed2f3a9256f0" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:40:31 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-6ed068d7-28a4-4c45-b57e-a86194bde5bc tempest-VolumesActionsTest-1421548241 None] Lock "cinder-quobyte-468ed4c3-4f57-4b58-8a5e-ed2f3a9256f0" acquired by "delete_volume" :: waited 0.021s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:40:31 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2282273-2d2b-4d7f-b75e-d3758e05667b]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:40:31 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-6ed068d7-28a4-4c45-b57e-a86194bde5bc tempest-VolumesActionsTest-1421548241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-468ed4c3-4f57-4b58-8a5e-ed2f3a9256f0 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:40:31 devstack sudo[91313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-468ed4c3-4f57-4b58-8a5e-ed2f3a9256f0 Sep 22 15:40:31 devstack sudo[91313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:40:31 devstack sudo[91313]: pam_unix(sudo:session): session closed for user root Sep 22 15:40:31 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-6ed068d7-28a4-4c45-b57e-a86194bde5bc tempest-VolumesActionsTest-1421548241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-468ed4c3-4f57-4b58-8a5e-ed2f3a9256f0" returned: 0 in 0.531s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:40:31 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-6ed068d7-28a4-4c45-b57e-a86194bde5bc tempest-VolumesActionsTest-1421548241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-468ed4c3-4f57-4b58-8a5e-ed2f3a9256f0 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:40:31 devstack sudo[91333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-468ed4c3-4f57-4b58-8a5e-ed2f3a9256f0 Sep 22 15:40:31 devstack sudo[91333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:40:32 devstack sudo[91333]: pam_unix(sudo:session): session closed for user root Sep 22 15:40:32 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-6ed068d7-28a4-4c45-b57e-a86194bde5bc tempest-VolumesActionsTest-1421548241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-468ed4c3-4f57-4b58-8a5e-ed2f3a9256f0" returned: 0 in 0.541s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:40:32 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-6ed068d7-28a4-4c45-b57e-a86194bde5bc tempest-VolumesActionsTest-1421548241 None] Lock "cinder-quobyte-468ed4c3-4f57-4b58-8a5e-ed2f3a9256f0" released by "delete_volume" :: held 1.159s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:40:32 devstack cinder-volume[86212]: DEBUG cinder.quota [None req-6ed068d7-28a4-4c45-b57e-a86194bde5bc tempest-VolumesActionsTest-1421548241 None] Created reservations ['0e102073-b767-49ca-a35a-039e979492fc', '9b740586-469c-4feb-a8e5-10df88d89dd5', '33e34641-3ceb-4c5c-b0b0-97af56d9b5de', '50bca4bf-1ab7-40d9-848e-eea778a60402'] {{(pid=86212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 15:40:32 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-6ed068d7-28a4-4c45-b57e-a86194bde5bc tempest-VolumesActionsTest-1421548241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:40:32 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-6ed068d7-28a4-4c45-b57e-a86194bde5bc tempest-VolumesActionsTest-1421548241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:40:32 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-6ed068d7-28a4-4c45-b57e-a86194bde5bc tempest-VolumesActionsTest-1421548241 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:40:32 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-6ed068d7-28a4-4c45-b57e-a86194bde5bc tempest-VolumesActionsTest-1421548241 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:40:32 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-6ed068d7-28a4-4c45-b57e-a86194bde5bc tempest-VolumesActionsTest-1421548241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:40:32 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-6ed068d7-28a4-4c45-b57e-a86194bde5bc tempest-VolumesActionsTest-1421548241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:40:32 devstack sudo[91337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc Sep 22 15:40:32 devstack sudo[91337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:40:32 devstack sudo[91337]: pam_unix(sudo:session): session closed for user root Sep 22 15:40:32 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-6ed068d7-28a4-4c45-b57e-a86194bde5bc tempest-VolumesActionsTest-1421548241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc" returned: 0 in 0.336s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:40:32 devstack cinder-volume[86212]: DEBUG cinder.manager [None req-6ed068d7-28a4-4c45-b57e-a86194bde5bc tempest-VolumesActionsTest-1421548241 None] Notifying Schedulers of capabilities ... {{(pid=86212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 15:40:32 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-6ed068d7-28a4-4c45-b57e-a86194bde5bc tempest-VolumesActionsTest-1421548241 None] Deleted volume successfully. Sep 22 15:40:32 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-6ed068d7-28a4-4c45-b57e-a86194bde5bc tempest-VolumesActionsTest-1421548241 None] Lock "cinder-468ed4c3-4f57-4b58-8a5e-ed2f3a9256f0-delete_volume" released by "delete_volume" :: held 1.914s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:40:34 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [req-ba90b780-c836-4821-b0b5-04567a943770 req-5936bee1-ac59-4241-b073-ecbec8ead8af tempest-ServerActionsTestOtherA-1816233839 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:40:34 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [req-ba90b780-c836-4821-b0b5-04567a943770 req-5936bee1-ac59-4241-b073-ecbec8ead8af tempest-ServerActionsTestOtherA-1816233839 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:40:34 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [req-ba90b780-c836-4821-b0b5-04567a943770 req-5936bee1-ac59-4241-b073-ecbec8ead8af tempest-ServerActionsTestOtherA-1816233839 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.031s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:40:34 devstack cinder-volume[86212]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6674c36-af4f-49ef-b328-a388419ea53b tempest-VolumesActionsTest-370018746 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 15:40:34 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-f6674c36-af4f-49ef-b328-a388419ea53b tempest-VolumesActionsTest-370018746 None] Flow 'volume_create_manager' (77d3ac69-3459-4a82-8b63-ca4bfecc7a15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:40:34 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-f6674c36-af4f-49ef-b328-a388419ea53b tempest-VolumesActionsTest-370018746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ab5947c-a8ee-4101-a58a-e6bf0db2c8a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:40:34 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [req-ba90b780-c836-4821-b0b5-04567a943770 req-5936bee1-ac59-4241-b073-ecbec8ead8af tempest-ServerActionsTestOtherA-1816233839 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31', 'name': 'volume-b34b3a9c-1fb7-420e-a501-1fb9425cc913', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd0c0e8f3-ac93-4f70-a7e0-bcd1575c535a', 'enforce_multipath': True} {{(pid=86212) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 22 15:40:34 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-f6674c36-af4f-49ef-b328-a388419ea53b tempest-VolumesActionsTest-370018746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ab5947c-a8ee-4101-a58a-e6bf0db2c8a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:40:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-413738949',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b70dfce0-b779-4687-b3d5-d2bca8799fad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a6e6db79b124a28acc4a325500a8405',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:40:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:40:34Z,use_quota=True,user_id='87f0730725c0472389f7c7fab9d258a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:40:34 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-f6674c36-af4f-49ef-b328-a388419ea53b tempest-VolumesActionsTest-370018746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70f0d37f-fa6c-4360-b246-a42f63397361) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:40:34 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-f6674c36-af4f-49ef-b328-a388419ea53b tempest-VolumesActionsTest-370018746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70f0d37f-fa6c-4360-b246-a42f63397361) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:40:34 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-f6674c36-af4f-49ef-b328-a388419ea53b tempest-VolumesActionsTest-370018746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10fcf454-53ac-4bf9-96b4-e24b3a38ada0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:40:34 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-f6674c36-af4f-49ef-b328-a388419ea53b tempest-VolumesActionsTest-370018746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10fcf454-53ac-4bf9-96b4-e24b3a38ada0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b70dfce0-b779-4687-b3d5-d2bca8799fad', 'volume_name': 'volume-b70dfce0-b779-4687-b3d5-d2bca8799fad', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:40:34 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-f6674c36-af4f-49ef-b328-a388419ea53b tempest-VolumesActionsTest-370018746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ca9c0cc-7d90-4b47-88f7-38f8b89b5892) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:40:34 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-f6674c36-af4f-49ef-b328-a388419ea53b tempest-VolumesActionsTest-370018746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ca9c0cc-7d90-4b47-88f7-38f8b89b5892) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:40:34 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-f6674c36-af4f-49ef-b328-a388419ea53b tempest-VolumesActionsTest-370018746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0078462f-f56f-4a0a-857f-3fe28fcc64c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:40:34 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-f6674c36-af4f-49ef-b328-a388419ea53b tempest-VolumesActionsTest-370018746 None] Volume b70dfce0-b779-4687-b3d5-d2bca8799fad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b70dfce0-b779-4687-b3d5-d2bca8799fad', 'volume_size': 1} Sep 22 15:40:34 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-f6674c36-af4f-49ef-b328-a388419ea53b tempest-VolumesActionsTest-370018746 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:40:34 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-f6674c36-af4f-49ef-b328-a388419ea53b tempest-VolumesActionsTest-370018746 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:40:34 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-f6674c36-af4f-49ef-b328-a388419ea53b tempest-VolumesActionsTest-370018746 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:40:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-413738949',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b70dfce0-b779-4687-b3d5-d2bca8799fad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a6e6db79b124a28acc4a325500a8405',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:40:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:40:34Z,use_quota=True,user_id='87f0730725c0472389f7c7fab9d258a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)}" {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 15:40:34 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-f6674c36-af4f-49ef-b328-a388419ea53b tempest-VolumesActionsTest-370018746 None] Creating volume b70dfce0-b779-4687-b3d5-d2bca8799fad {{(pid=86212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 15:40:34 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-f6674c36-af4f-49ef-b328-a388419ea53b tempest-VolumesActionsTest-370018746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:40:34 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-f6674c36-af4f-49ef-b328-a388419ea53b tempest-VolumesActionsTest-370018746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:40:34 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-f6674c36-af4f-49ef-b328-a388419ea53b tempest-VolumesActionsTest-370018746 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:40:34 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-f6674c36-af4f-49ef-b328-a388419ea53b tempest-VolumesActionsTest-370018746 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:40:34 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-f6674c36-af4f-49ef-b328-a388419ea53b tempest-VolumesActionsTest-370018746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:40:34 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-f6674c36-af4f-49ef-b328-a388419ea53b tempest-VolumesActionsTest-370018746 None] Selected osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 as target Quobyte volume. {{(pid=86212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 15:40:34 devstack cinder-volume[86212]: INFO cinder.volume.drivers.remotefs [None req-f6674c36-af4f-49ef-b328-a388419ea53b tempest-VolumesActionsTest-370018746 None] casted to osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 Sep 22 15:40:34 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-f6674c36-af4f-49ef-b328-a388419ea53b tempest-VolumesActionsTest-370018746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b70dfce0-b779-4687-b3d5-d2bca8799fad 1073741824 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:40:34 devstack sudo[91348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b70dfce0-b779-4687-b3d5-d2bca8799fad 1073741824 Sep 22 15:40:34 devstack sudo[91348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:40:34 devstack cinder-volume[86212]: INFO cinder.volume.manager [req-ba90b780-c836-4821-b0b5-04567a943770 req-5936bee1-ac59-4241-b073-ecbec8ead8af tempest-ServerActionsTestOtherA-1816233839 None] attachment_update completed successfully. Sep 22 15:40:34 devstack sudo[91348]: pam_unix(sudo:session): session closed for user root Sep 22 15:40:34 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-f6674c36-af4f-49ef-b328-a388419ea53b tempest-VolumesActionsTest-370018746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b70dfce0-b779-4687-b3d5-d2bca8799fad 1073741824" returned: 0 in 0.651s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:40:34 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-f6674c36-af4f-49ef-b328-a388419ea53b tempest-VolumesActionsTest-370018746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b70dfce0-b779-4687-b3d5-d2bca8799fad {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:40:35 devstack sudo[91354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b70dfce0-b779-4687-b3d5-d2bca8799fad Sep 22 15:40:35 devstack sudo[91354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:40:35 devstack sudo[91354]: pam_unix(sudo:session): session closed for user root Sep 22 15:40:35 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-f6674c36-af4f-49ef-b328-a388419ea53b tempest-VolumesActionsTest-370018746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b70dfce0-b779-4687-b3d5-d2bca8799fad" returned: 0 in 0.360s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:40:35 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-f6674c36-af4f-49ef-b328-a388419ea53b tempest-VolumesActionsTest-370018746 None] <== create_volume: return (1097ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'} {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 15:40:35 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-f6674c36-af4f-49ef-b328-a388419ea53b tempest-VolumesActionsTest-370018746 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.104s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:40:35 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-f6674c36-af4f-49ef-b328-a388419ea53b tempest-VolumesActionsTest-370018746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0078462f-f56f-4a0a-857f-3fe28fcc64c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b70dfce0-b779-4687-b3d5-d2bca8799fad', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:40:35 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-f6674c36-af4f-49ef-b328-a388419ea53b tempest-VolumesActionsTest-370018746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (110f5fb1-44fa-4243-aa6b-83d5e0520fb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:40:35 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-f6674c36-af4f-49ef-b328-a388419ea53b tempest-VolumesActionsTest-370018746 None] Volume volume-b70dfce0-b779-4687-b3d5-d2bca8799fad (b70dfce0-b779-4687-b3d5-d2bca8799fad): created successfully Sep 22 15:40:35 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-f6674c36-af4f-49ef-b328-a388419ea53b tempest-VolumesActionsTest-370018746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (110f5fb1-44fa-4243-aa6b-83d5e0520fb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:40:35 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-f6674c36-af4f-49ef-b328-a388419ea53b tempest-VolumesActionsTest-370018746 None] Flow 'volume_create_manager' (77d3ac69-3459-4a82-8b63-ca4bfecc7a15) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:40:35 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-f6674c36-af4f-49ef-b328-a388419ea53b tempest-VolumesActionsTest-370018746 None] Created volume successfully. Sep 22 15:40:37 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-5667bc0a-d7e1-4452-85b6-9cc6d5267019 tempest-VolumesActionsTest-370018746 None] Acquiring lock "cinder-b70dfce0-b779-4687-b3d5-d2bca8799fad-delete_volume" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:40:37 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-5667bc0a-d7e1-4452-85b6-9cc6d5267019 tempest-VolumesActionsTest-370018746 None] Lock "cinder-b70dfce0-b779-4687-b3d5-d2bca8799fad-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:40:37 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-5667bc0a-d7e1-4452-85b6-9cc6d5267019 tempest-VolumesActionsTest-370018746 None] Acquiring lock "cinder-quobyte-b70dfce0-b779-4687-b3d5-d2bca8799fad" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:40:37 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-5667bc0a-d7e1-4452-85b6-9cc6d5267019 tempest-VolumesActionsTest-370018746 None] Lock "cinder-quobyte-b70dfce0-b779-4687-b3d5-d2bca8799fad" acquired by "delete_volume" :: waited 0.024s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:40:37 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9e75d2c-d11b-4494-81c0-01f88c09da51]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:40:37 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-5667bc0a-d7e1-4452-85b6-9cc6d5267019 tempest-VolumesActionsTest-370018746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b70dfce0-b779-4687-b3d5-d2bca8799fad {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:40:37 devstack sudo[91360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b70dfce0-b779-4687-b3d5-d2bca8799fad Sep 22 15:40:37 devstack sudo[91360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:40:37 devstack sudo[91360]: pam_unix(sudo:session): session closed for user root Sep 22 15:40:37 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-5667bc0a-d7e1-4452-85b6-9cc6d5267019 tempest-VolumesActionsTest-370018746 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b70dfce0-b779-4687-b3d5-d2bca8799fad" returned: 0 in 0.569s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:40:37 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-5667bc0a-d7e1-4452-85b6-9cc6d5267019 tempest-VolumesActionsTest-370018746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b70dfce0-b779-4687-b3d5-d2bca8799fad {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:40:37 devstack sudo[91365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b70dfce0-b779-4687-b3d5-d2bca8799fad Sep 22 15:40:37 devstack sudo[91365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:40:38 devstack sudo[91365]: pam_unix(sudo:session): session closed for user root Sep 22 15:40:38 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-5667bc0a-d7e1-4452-85b6-9cc6d5267019 tempest-VolumesActionsTest-370018746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b70dfce0-b779-4687-b3d5-d2bca8799fad" returned: 0 in 0.486s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:40:38 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-5667bc0a-d7e1-4452-85b6-9cc6d5267019 tempest-VolumesActionsTest-370018746 None] Lock "cinder-quobyte-b70dfce0-b779-4687-b3d5-d2bca8799fad" released by "delete_volume" :: held 1.153s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:40:38 devstack cinder-volume[86212]: DEBUG cinder.quota [None req-5667bc0a-d7e1-4452-85b6-9cc6d5267019 tempest-VolumesActionsTest-370018746 None] Created reservations ['ecafe381-8d59-4624-b22d-a2058fb08437', 'f49d1bad-ce7c-46c9-b633-467949e70592', '348acace-48c3-414b-b468-b9605c1870ad', '0d40c313-4ef1-476c-b569-eaeb2f29bf6f'] {{(pid=86212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 15:40:38 devstack cinder-volume[86212]: DEBUG oslo_service.periodic_task [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86212) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 22 15:40:38 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:40:38 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:40:38 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:40:38 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:40:38 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:40:38 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:40:38 devstack sudo[91469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc Sep 22 15:40:38 devstack sudo[91469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:40:38 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-5667bc0a-d7e1-4452-85b6-9cc6d5267019 tempest-VolumesActionsTest-370018746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:40:38 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-5667bc0a-d7e1-4452-85b6-9cc6d5267019 tempest-VolumesActionsTest-370018746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:40:38 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-5667bc0a-d7e1-4452-85b6-9cc6d5267019 tempest-VolumesActionsTest-370018746 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:40:38 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-5667bc0a-d7e1-4452-85b6-9cc6d5267019 tempest-VolumesActionsTest-370018746 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:40:38 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-5667bc0a-d7e1-4452-85b6-9cc6d5267019 tempest-VolumesActionsTest-370018746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.052s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:40:38 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-5667bc0a-d7e1-4452-85b6-9cc6d5267019 tempest-VolumesActionsTest-370018746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:40:38 devstack sudo[91479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc Sep 22 15:40:38 devstack sudo[91479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:40:39 devstack sudo[91469]: pam_unix(sudo:session): session closed for user root Sep 22 15:40:39 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc" returned: 0 in 0.841s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:40:39 devstack cinder-volume[86212]: DEBUG cinder.manager [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] Notifying Schedulers of capabilities ... {{(pid=86212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 15:40:39 devstack cinder-volume[86212]: DEBUG oslo_service.periodic_task [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] Running periodic task VolumeManager._thread_info {{(pid=86212) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 22 15:40:39 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] thread count: 28 {{(pid=86212) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 22 15:40:39 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] thread info: [<_MainThread(MainThread, started 136163191222400)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86212) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 22 15:40:39 devstack sudo[91479]: pam_unix(sudo:session): session closed for user root Sep 22 15:40:39 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-5667bc0a-d7e1-4452-85b6-9cc6d5267019 tempest-VolumesActionsTest-370018746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc" returned: 0 in 0.605s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:40:39 devstack cinder-volume[86212]: DEBUG cinder.manager [None req-5667bc0a-d7e1-4452-85b6-9cc6d5267019 tempest-VolumesActionsTest-370018746 None] Notifying Schedulers of capabilities ... {{(pid=86212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 15:40:39 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-5667bc0a-d7e1-4452-85b6-9cc6d5267019 tempest-VolumesActionsTest-370018746 None] Deleted volume successfully. Sep 22 15:40:39 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-5667bc0a-d7e1-4452-85b6-9cc6d5267019 tempest-VolumesActionsTest-370018746 None] Lock "cinder-b70dfce0-b779-4687-b3d5-d2bca8799fad-delete_volume" released by "delete_volume" :: held 2.471s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:40:41 devstack cinder-volume[86212]: DEBUG cinder.volume.flows.manager.create_volume [None req-c7dd9243-3dad-4255-bdc2-4c32ff3f112b tempest-AttachVolumeNegativeTest-382120543 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 15:40:41 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-c7dd9243-3dad-4255-bdc2-4c32ff3f112b tempest-AttachVolumeNegativeTest-382120543 None] Flow 'volume_create_manager' (b3b41ed4-db7b-4884-a9ec-9dd947948747) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:40:41 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-c7dd9243-3dad-4255-bdc2-4c32ff3f112b tempest-AttachVolumeNegativeTest-382120543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f556d75a-7acf-447c-abd7-f0e0556bdf73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:40:41 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-c7dd9243-3dad-4255-bdc2-4c32ff3f112b tempest-AttachVolumeNegativeTest-382120543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f556d75a-7acf-447c-abd7-f0e0556bdf73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:40:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1067171682',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26c22efb-0997-489c-9964-5777eaea0d33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e189bea702e54595ab5d405d04d4e342',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:40:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:40:41Z,use_quota=True,user_id='ad6a5d22339042abb9842ea9d6925310',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:40:41 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-c7dd9243-3dad-4255-bdc2-4c32ff3f112b tempest-AttachVolumeNegativeTest-382120543 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d78f2c49-112b-4b53-91fe-fed00d1ae424) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:40:41 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-c7dd9243-3dad-4255-bdc2-4c32ff3f112b tempest-AttachVolumeNegativeTest-382120543 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d78f2c49-112b-4b53-91fe-fed00d1ae424) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:40:41 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-c7dd9243-3dad-4255-bdc2-4c32ff3f112b tempest-AttachVolumeNegativeTest-382120543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2d66ce0-a385-4a2e-a4b2-9a4aa4a7aaa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:40:41 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-c7dd9243-3dad-4255-bdc2-4c32ff3f112b tempest-AttachVolumeNegativeTest-382120543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2d66ce0-a385-4a2e-a4b2-9a4aa4a7aaa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '26c22efb-0997-489c-9964-5777eaea0d33', 'volume_name': 'volume-26c22efb-0997-489c-9964-5777eaea0d33', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:40:41 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-c7dd9243-3dad-4255-bdc2-4c32ff3f112b tempest-AttachVolumeNegativeTest-382120543 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31e2f99a-ca16-4e64-a915-acd4b6a6d525) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:40:41 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-c7dd9243-3dad-4255-bdc2-4c32ff3f112b tempest-AttachVolumeNegativeTest-382120543 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31e2f99a-ca16-4e64-a915-acd4b6a6d525) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:40:41 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-c7dd9243-3dad-4255-bdc2-4c32ff3f112b tempest-AttachVolumeNegativeTest-382120543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16509c2a-9120-4041-bb39-ec7f7108a241) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:40:41 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-c7dd9243-3dad-4255-bdc2-4c32ff3f112b tempest-AttachVolumeNegativeTest-382120543 None] Volume 26c22efb-0997-489c-9964-5777eaea0d33: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-26c22efb-0997-489c-9964-5777eaea0d33', 'volume_size': 1} Sep 22 15:40:41 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-c7dd9243-3dad-4255-bdc2-4c32ff3f112b tempest-AttachVolumeNegativeTest-382120543 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:40:41 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-c7dd9243-3dad-4255-bdc2-4c32ff3f112b tempest-AttachVolumeNegativeTest-382120543 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:40:41 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-c7dd9243-3dad-4255-bdc2-4c32ff3f112b tempest-AttachVolumeNegativeTest-382120543 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:40:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1067171682',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26c22efb-0997-489c-9964-5777eaea0d33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e189bea702e54595ab5d405d04d4e342',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:40:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:40:41Z,use_quota=True,user_id='ad6a5d22339042abb9842ea9d6925310',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)}" {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 15:40:41 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-c7dd9243-3dad-4255-bdc2-4c32ff3f112b tempest-AttachVolumeNegativeTest-382120543 None] Creating volume 26c22efb-0997-489c-9964-5777eaea0d33 {{(pid=86212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 15:40:41 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-c7dd9243-3dad-4255-bdc2-4c32ff3f112b tempest-AttachVolumeNegativeTest-382120543 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:40:41 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-c7dd9243-3dad-4255-bdc2-4c32ff3f112b tempest-AttachVolumeNegativeTest-382120543 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:40:41 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-c7dd9243-3dad-4255-bdc2-4c32ff3f112b tempest-AttachVolumeNegativeTest-382120543 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:40:41 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-c7dd9243-3dad-4255-bdc2-4c32ff3f112b tempest-AttachVolumeNegativeTest-382120543 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:40:41 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-c7dd9243-3dad-4255-bdc2-4c32ff3f112b tempest-AttachVolumeNegativeTest-382120543 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:40:41 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-c7dd9243-3dad-4255-bdc2-4c32ff3f112b tempest-AttachVolumeNegativeTest-382120543 None] Selected osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 as target Quobyte volume. {{(pid=86212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 15:40:41 devstack cinder-volume[86212]: INFO cinder.volume.drivers.remotefs [None req-c7dd9243-3dad-4255-bdc2-4c32ff3f112b tempest-AttachVolumeNegativeTest-382120543 None] casted to osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 Sep 22 15:40:41 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-c7dd9243-3dad-4255-bdc2-4c32ff3f112b tempest-AttachVolumeNegativeTest-382120543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-26c22efb-0997-489c-9964-5777eaea0d33 1073741824 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:40:41 devstack sudo[91822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-26c22efb-0997-489c-9964-5777eaea0d33 1073741824 Sep 22 15:40:41 devstack sudo[91822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:40:42 devstack sudo[91822]: pam_unix(sudo:session): session closed for user root Sep 22 15:40:42 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-c7dd9243-3dad-4255-bdc2-4c32ff3f112b tempest-AttachVolumeNegativeTest-382120543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-26c22efb-0997-489c-9964-5777eaea0d33 1073741824" returned: 0 in 0.649s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:40:42 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-c7dd9243-3dad-4255-bdc2-4c32ff3f112b tempest-AttachVolumeNegativeTest-382120543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-26c22efb-0997-489c-9964-5777eaea0d33 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:40:42 devstack sudo[91832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-26c22efb-0997-489c-9964-5777eaea0d33 Sep 22 15:40:42 devstack sudo[91832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:40:42 devstack sudo[91832]: pam_unix(sudo:session): session closed for user root Sep 22 15:40:42 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-c7dd9243-3dad-4255-bdc2-4c32ff3f112b tempest-AttachVolumeNegativeTest-382120543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-26c22efb-0997-489c-9964-5777eaea0d33" returned: 0 in 0.453s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:40:42 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-c7dd9243-3dad-4255-bdc2-4c32ff3f112b tempest-AttachVolumeNegativeTest-382120543 None] <== create_volume: return (1175ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'} {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 15:40:42 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-c7dd9243-3dad-4255-bdc2-4c32ff3f112b tempest-AttachVolumeNegativeTest-382120543 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.180s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:40:42 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-c7dd9243-3dad-4255-bdc2-4c32ff3f112b tempest-AttachVolumeNegativeTest-382120543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16509c2a-9120-4041-bb39-ec7f7108a241) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-26c22efb-0997-489c-9964-5777eaea0d33', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:40:42 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-c7dd9243-3dad-4255-bdc2-4c32ff3f112b tempest-AttachVolumeNegativeTest-382120543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c1e38ab-24c1-49e7-8ca7-88f5c96b240e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:40:42 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-c7dd9243-3dad-4255-bdc2-4c32ff3f112b tempest-AttachVolumeNegativeTest-382120543 None] Volume volume-26c22efb-0997-489c-9964-5777eaea0d33 (26c22efb-0997-489c-9964-5777eaea0d33): created successfully Sep 22 15:40:42 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-c7dd9243-3dad-4255-bdc2-4c32ff3f112b tempest-AttachVolumeNegativeTest-382120543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c1e38ab-24c1-49e7-8ca7-88f5c96b240e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:40:42 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-c7dd9243-3dad-4255-bdc2-4c32ff3f112b tempest-AttachVolumeNegativeTest-382120543 None] Flow 'volume_create_manager' (b3b41ed4-db7b-4884-a9ec-9dd947948747) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:40:42 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-c7dd9243-3dad-4255-bdc2-4c32ff3f112b tempest-AttachVolumeNegativeTest-382120543 None] Created volume successfully. Sep 22 15:40:44 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [req-77d4729e-13ac-49b6-8183-61200ed5bce6 req-4b8b1a86-1b36-4f72-b56c-d990350c65cf tempest-AttachVolumeNegativeTest-382120543 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:40:44 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [req-77d4729e-13ac-49b6-8183-61200ed5bce6 req-4b8b1a86-1b36-4f72-b56c-d990350c65cf tempest-AttachVolumeNegativeTest-382120543 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:40:45 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [req-77d4729e-13ac-49b6-8183-61200ed5bce6 req-4b8b1a86-1b36-4f72-b56c-d990350c65cf tempest-AttachVolumeNegativeTest-382120543 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.029s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:40:45 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [req-77d4729e-13ac-49b6-8183-61200ed5bce6 req-4b8b1a86-1b36-4f72-b56c-d990350c65cf tempest-AttachVolumeNegativeTest-382120543 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31', 'name': 'volume-26c22efb-0997-489c-9964-5777eaea0d33', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f3498465-0927-4233-9478-a3328bbe0c80', 'enforce_multipath': True} {{(pid=86212) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 22 15:40:45 devstack cinder-volume[86212]: INFO cinder.volume.manager [req-77d4729e-13ac-49b6-8183-61200ed5bce6 req-4b8b1a86-1b36-4f72-b56c-d990350c65cf tempest-AttachVolumeNegativeTest-382120543 None] attachment_update completed successfully. Sep 22 15:40:55 devstack cinder-volume[86212]: DEBUG dbcounter [-] [86212] Writing DB stats cinder:SELECT=78,cinder:UPDATE=78,cinder:DELETE=8,cinder:INSERT=27 {{(pid=86212) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 22 15:40:55 devstack cinder-volume[86212]: DEBUG dbcounter [-] [86212] Writing DB stats cinder:SELECT=82,cinder:INSERT=24,cinder:UPDATE=98,cinder:DELETE=7 {{(pid=86212) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 22 15:41:00 devstack cinder-volume[86212]: INFO cinder.volume.manager [req-897553b6-5041-4b47-be99-912ee9ac6692 req-e96e39fa-52b1-4c26-9468-1133baf02d50 tempest-ServerActionsTestOtherA-1816233839 None] Terminate volume connection completed successfully. Sep 22 15:41:00 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [req-897553b6-5041-4b47-be99-912ee9ac6692 req-e96e39fa-52b1-4c26-9468-1133baf02d50 tempest-ServerActionsTestOtherA-1816233839 None] Deleting attachment d0c0e8f3-ac93-4f70-a7e0-bcd1575c535a. {{(pid=86212) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 22 15:41:05 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [req-897553b6-5041-4b47-be99-912ee9ac6692 req-fc3ad4fa-9590-472c-bb33-7315c2bcd542 tempest-ServerActionsTestOtherA-1816233839 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:41:05 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [req-897553b6-5041-4b47-be99-912ee9ac6692 req-fc3ad4fa-9590-472c-bb33-7315c2bcd542 tempest-ServerActionsTestOtherA-1816233839 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:41:05 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [req-897553b6-5041-4b47-be99-912ee9ac6692 req-fc3ad4fa-9590-472c-bb33-7315c2bcd542 tempest-ServerActionsTestOtherA-1816233839 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.040s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:41:06 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [req-897553b6-5041-4b47-be99-912ee9ac6692 req-fc3ad4fa-9590-472c-bb33-7315c2bcd542 tempest-ServerActionsTestOtherA-1816233839 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31', 'name': 'volume-b34b3a9c-1fb7-420e-a501-1fb9425cc913', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e05368e8-a0ec-4f95-93fb-13b7f6bbdff5', 'enforce_multipath': True} {{(pid=86212) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 22 15:41:06 devstack cinder-volume[86212]: INFO cinder.volume.manager [req-897553b6-5041-4b47-be99-912ee9ac6692 req-fc3ad4fa-9590-472c-bb33-7315c2bcd542 tempest-ServerActionsTestOtherA-1816233839 None] attachment_update completed successfully. Sep 22 15:41:10 devstack cinder-volume[86212]: DEBUG cinder.volume.flows.manager.create_volume [None req-f99acd51-bec5-42a0-8640-150209821bcf tempest-SnapshotMetadataTestJSON-1978808501 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 15:41:10 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-f99acd51-bec5-42a0-8640-150209821bcf tempest-SnapshotMetadataTestJSON-1978808501 None] Flow 'volume_create_manager' (90b67006-df1a-45af-803c-9b0e1b27d565) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:41:10 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-f99acd51-bec5-42a0-8640-150209821bcf tempest-SnapshotMetadataTestJSON-1978808501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (daa93156-b12a-4442-9fcf-ab677faa6e18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:41:10 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-f99acd51-bec5-42a0-8640-150209821bcf tempest-SnapshotMetadataTestJSON-1978808501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (daa93156-b12a-4442-9fcf-ab677faa6e18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:41:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-98514928',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4bcd1edd-b263-4e84-bc6f-f58a3a10302a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='997856d6009147f0b776fab4235a598e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:41:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:41:10Z,use_quota=True,user_id='167fdef70d1248ceb392183a5c6e7732',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:41:10 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-f99acd51-bec5-42a0-8640-150209821bcf tempest-SnapshotMetadataTestJSON-1978808501 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ddc48ff-e6df-4546-a023-9e6f4244c9c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:41:10 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-f99acd51-bec5-42a0-8640-150209821bcf tempest-SnapshotMetadataTestJSON-1978808501 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ddc48ff-e6df-4546-a023-9e6f4244c9c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:41:10 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-f99acd51-bec5-42a0-8640-150209821bcf tempest-SnapshotMetadataTestJSON-1978808501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12e2d1b3-dead-4aa4-b51d-9139000355f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:41:10 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-f99acd51-bec5-42a0-8640-150209821bcf tempest-SnapshotMetadataTestJSON-1978808501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12e2d1b3-dead-4aa4-b51d-9139000355f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4bcd1edd-b263-4e84-bc6f-f58a3a10302a', 'volume_name': 'volume-4bcd1edd-b263-4e84-bc6f-f58a3a10302a', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:41:10 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-f99acd51-bec5-42a0-8640-150209821bcf tempest-SnapshotMetadataTestJSON-1978808501 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ac8cd3e-b05e-4980-ab54-2bd390df82f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:41:10 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-f99acd51-bec5-42a0-8640-150209821bcf tempest-SnapshotMetadataTestJSON-1978808501 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ac8cd3e-b05e-4980-ab54-2bd390df82f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:41:10 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-f99acd51-bec5-42a0-8640-150209821bcf tempest-SnapshotMetadataTestJSON-1978808501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d2cb852-bde5-477d-8736-aca80e38f579) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:41:10 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-f99acd51-bec5-42a0-8640-150209821bcf tempest-SnapshotMetadataTestJSON-1978808501 None] Volume 4bcd1edd-b263-4e84-bc6f-f58a3a10302a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4bcd1edd-b263-4e84-bc6f-f58a3a10302a', 'volume_size': 1} Sep 22 15:41:10 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-f99acd51-bec5-42a0-8640-150209821bcf tempest-SnapshotMetadataTestJSON-1978808501 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:41:10 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-f99acd51-bec5-42a0-8640-150209821bcf tempest-SnapshotMetadataTestJSON-1978808501 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:41:10 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-f99acd51-bec5-42a0-8640-150209821bcf tempest-SnapshotMetadataTestJSON-1978808501 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:41:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-98514928',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4bcd1edd-b263-4e84-bc6f-f58a3a10302a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='997856d6009147f0b776fab4235a598e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:41:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:41:10Z,use_quota=True,user_id='167fdef70d1248ceb392183a5c6e7732',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)}" {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 15:41:10 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-f99acd51-bec5-42a0-8640-150209821bcf tempest-SnapshotMetadataTestJSON-1978808501 None] Creating volume 4bcd1edd-b263-4e84-bc6f-f58a3a10302a {{(pid=86212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 15:41:10 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-f99acd51-bec5-42a0-8640-150209821bcf tempest-SnapshotMetadataTestJSON-1978808501 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:41:10 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-f99acd51-bec5-42a0-8640-150209821bcf tempest-SnapshotMetadataTestJSON-1978808501 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:41:10 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-f99acd51-bec5-42a0-8640-150209821bcf tempest-SnapshotMetadataTestJSON-1978808501 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:41:10 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-f99acd51-bec5-42a0-8640-150209821bcf tempest-SnapshotMetadataTestJSON-1978808501 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:41:10 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-f99acd51-bec5-42a0-8640-150209821bcf tempest-SnapshotMetadataTestJSON-1978808501 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:41:10 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-f99acd51-bec5-42a0-8640-150209821bcf tempest-SnapshotMetadataTestJSON-1978808501 None] Selected osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 as target Quobyte volume. {{(pid=86212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 15:41:10 devstack cinder-volume[86212]: INFO cinder.volume.drivers.remotefs [None req-f99acd51-bec5-42a0-8640-150209821bcf tempest-SnapshotMetadataTestJSON-1978808501 None] casted to osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 Sep 22 15:41:10 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-f99acd51-bec5-42a0-8640-150209821bcf tempest-SnapshotMetadataTestJSON-1978808501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-4bcd1edd-b263-4e84-bc6f-f58a3a10302a 1073741824 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:41:10 devstack sudo[92128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-4bcd1edd-b263-4e84-bc6f-f58a3a10302a 1073741824 Sep 22 15:41:10 devstack sudo[92128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:41:11 devstack sudo[92128]: pam_unix(sudo:session): session closed for user root Sep 22 15:41:11 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-f99acd51-bec5-42a0-8640-150209821bcf tempest-SnapshotMetadataTestJSON-1978808501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-4bcd1edd-b263-4e84-bc6f-f58a3a10302a 1073741824" returned: 0 in 1.025s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:41:11 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-f99acd51-bec5-42a0-8640-150209821bcf tempest-SnapshotMetadataTestJSON-1978808501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-4bcd1edd-b263-4e84-bc6f-f58a3a10302a {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:41:11 devstack sudo[92135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-4bcd1edd-b263-4e84-bc6f-f58a3a10302a Sep 22 15:41:11 devstack sudo[92135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:41:11 devstack sudo[92135]: pam_unix(sudo:session): session closed for user root Sep 22 15:41:11 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-f99acd51-bec5-42a0-8640-150209821bcf tempest-SnapshotMetadataTestJSON-1978808501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-4bcd1edd-b263-4e84-bc6f-f58a3a10302a" returned: 0 in 0.475s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:41:11 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-f99acd51-bec5-42a0-8640-150209821bcf tempest-SnapshotMetadataTestJSON-1978808501 None] <== create_volume: return (1608ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'} {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 15:41:11 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-f99acd51-bec5-42a0-8640-150209821bcf tempest-SnapshotMetadataTestJSON-1978808501 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.613s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:41:11 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-f99acd51-bec5-42a0-8640-150209821bcf tempest-SnapshotMetadataTestJSON-1978808501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d2cb852-bde5-477d-8736-aca80e38f579) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4bcd1edd-b263-4e84-bc6f-f58a3a10302a', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:41:11 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-f99acd51-bec5-42a0-8640-150209821bcf tempest-SnapshotMetadataTestJSON-1978808501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38593e76-9f9d-4804-82f8-b87d2fe1a8e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:41:12 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-f99acd51-bec5-42a0-8640-150209821bcf tempest-SnapshotMetadataTestJSON-1978808501 None] Volume volume-4bcd1edd-b263-4e84-bc6f-f58a3a10302a (4bcd1edd-b263-4e84-bc6f-f58a3a10302a): created successfully Sep 22 15:41:12 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-f99acd51-bec5-42a0-8640-150209821bcf tempest-SnapshotMetadataTestJSON-1978808501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38593e76-9f9d-4804-82f8-b87d2fe1a8e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:41:12 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-f99acd51-bec5-42a0-8640-150209821bcf tempest-SnapshotMetadataTestJSON-1978808501 None] Flow 'volume_create_manager' (90b67006-df1a-45af-803c-9b0e1b27d565) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:41:12 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-f99acd51-bec5-42a0-8640-150209821bcf tempest-SnapshotMetadataTestJSON-1978808501 None] Created volume successfully. Sep 22 15:41:13 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-59ec2a19-3570-4a12-a657-c88a84bd2745 tempest-SnapshotMetadataTestJSON-1978808501 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:41:13 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-59ec2a19-3570-4a12-a657-c88a84bd2745 tempest-SnapshotMetadataTestJSON-1978808501 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:41:13 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-59ec2a19-3570-4a12-a657-c88a84bd2745 tempest-SnapshotMetadataTestJSON-1978808501 None] Creating offline snapshot e01d2c61-6e14-4418-ab34-31014c4781f8 of volume 4bcd1edd-b263-4e84-bc6f-f58a3a10302a {{(pid=86212) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 22 15:41:13 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f1664cd-0a29-46c5-8d02-1ed8ffdb069d]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:41:13 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-59ec2a19-3570-4a12-a657-c88a84bd2745 tempest-SnapshotMetadataTestJSON-1978808501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-4bcd1edd-b263-4e84-bc6f-f58a3a10302a {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:41:14 devstack sudo[92176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-4bcd1edd-b263-4e84-bc6f-f58a3a10302a Sep 22 15:41:14 devstack sudo[92176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:41:14 devstack sudo[92176]: pam_unix(sudo:session): session closed for user root Sep 22 15:41:14 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-59ec2a19-3570-4a12-a657-c88a84bd2745 tempest-SnapshotMetadataTestJSON-1978808501 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-4bcd1edd-b263-4e84-bc6f-f58a3a10302a" returned: 0 in 0.457s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:41:14 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-59ec2a19-3570-4a12-a657-c88a84bd2745 tempest-SnapshotMetadataTestJSON-1978808501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-4bcd1edd-b263-4e84-bc6f-f58a3a10302a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-4bcd1edd-b263-4e84-bc6f-f58a3a10302a.e01d2c61-6e14-4418-ab34-31014c4781f8 1G {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:41:14 devstack sudo[92181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-4bcd1edd-b263-4e84-bc6f-f58a3a10302a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-4bcd1edd-b263-4e84-bc6f-f58a3a10302a.e01d2c61-6e14-4418-ab34-31014c4781f8 1G Sep 22 15:41:14 devstack sudo[92181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:41:14 devstack sudo[92181]: pam_unix(sudo:session): session closed for user root Sep 22 15:41:14 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-59ec2a19-3570-4a12-a657-c88a84bd2745 tempest-SnapshotMetadataTestJSON-1978808501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-4bcd1edd-b263-4e84-bc6f-f58a3a10302a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-4bcd1edd-b263-4e84-bc6f-f58a3a10302a.e01d2c61-6e14-4418-ab34-31014c4781f8 1G" returned: 0 in 0.536s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:41:14 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-59ec2a19-3570-4a12-a657-c88a84bd2745 tempest-SnapshotMetadataTestJSON-1978808501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4bcd1edd-b263-4e84-bc6f-f58a3a10302a -F qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-4bcd1edd-b263-4e84-bc6f-f58a3a10302a.e01d2c61-6e14-4418-ab34-31014c4781f8 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:41:14 devstack sudo[92187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4bcd1edd-b263-4e84-bc6f-f58a3a10302a -F qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-4bcd1edd-b263-4e84-bc6f-f58a3a10302a.e01d2c61-6e14-4418-ab34-31014c4781f8 Sep 22 15:41:14 devstack sudo[92187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:41:15 devstack sudo[92187]: pam_unix(sudo:session): session closed for user root Sep 22 15:41:15 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-59ec2a19-3570-4a12-a657-c88a84bd2745 tempest-SnapshotMetadataTestJSON-1978808501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4bcd1edd-b263-4e84-bc6f-f58a3a10302a -F qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-4bcd1edd-b263-4e84-bc6f-f58a3a10302a.e01d2c61-6e14-4418-ab34-31014c4781f8" returned: 0 in 0.457s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:41:15 devstack cinder-volume[86212]: WARNING cinder.volume.drivers.remotefs [None req-59ec2a19-3570-4a12-a657-c88a84bd2745 tempest-SnapshotMetadataTestJSON-1978808501 None] /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-4bcd1edd-b263-4e84-bc6f-f58a3a10302a.e01d2c61-6e14-4418-ab34-31014c4781f8 is being set with open permissions: ugo+rw Sep 22 15:41:15 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-59ec2a19-3570-4a12-a657-c88a84bd2745 tempest-SnapshotMetadataTestJSON-1978808501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-4bcd1edd-b263-4e84-bc6f-f58a3a10302a.e01d2c61-6e14-4418-ab34-31014c4781f8 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:41:15 devstack sudo[92192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-4bcd1edd-b263-4e84-bc6f-f58a3a10302a.e01d2c61-6e14-4418-ab34-31014c4781f8 Sep 22 15:41:15 devstack sudo[92192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:41:15 devstack sudo[92192]: pam_unix(sudo:session): session closed for user root Sep 22 15:41:15 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-59ec2a19-3570-4a12-a657-c88a84bd2745 tempest-SnapshotMetadataTestJSON-1978808501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-4bcd1edd-b263-4e84-bc6f-f58a3a10302a.e01d2c61-6e14-4418-ab34-31014c4781f8" returned: 0 in 0.478s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:41:15 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-59ec2a19-3570-4a12-a657-c88a84bd2745 tempest-SnapshotMetadataTestJSON-1978808501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-4bcd1edd-b263-4e84-bc6f-f58a3a10302a.info {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:41:15 devstack sudo[92195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-4bcd1edd-b263-4e84-bc6f-f58a3a10302a.info Sep 22 15:41:15 devstack sudo[92195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:41:16 devstack sudo[92195]: pam_unix(sudo:session): session closed for user root Sep 22 15:41:16 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-59ec2a19-3570-4a12-a657-c88a84bd2745 tempest-SnapshotMetadataTestJSON-1978808501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-4bcd1edd-b263-4e84-bc6f-f58a3a10302a.info" returned: 0 in 0.266s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:41:16 devstack cinder-volume[86212]: WARNING cinder.volume.drivers.remotefs [None req-59ec2a19-3570-4a12-a657-c88a84bd2745 tempest-SnapshotMetadataTestJSON-1978808501 None] /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-4bcd1edd-b263-4e84-bc6f-f58a3a10302a.info is being set with open permissions: ugo+rw Sep 22 15:41:16 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-59ec2a19-3570-4a12-a657-c88a84bd2745 tempest-SnapshotMetadataTestJSON-1978808501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-4bcd1edd-b263-4e84-bc6f-f58a3a10302a.info {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:41:16 devstack sudo[92198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-4bcd1edd-b263-4e84-bc6f-f58a3a10302a.info Sep 22 15:41:16 devstack sudo[92198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:41:16 devstack sudo[92198]: pam_unix(sudo:session): session closed for user root Sep 22 15:41:16 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-59ec2a19-3570-4a12-a657-c88a84bd2745 tempest-SnapshotMetadataTestJSON-1978808501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-4bcd1edd-b263-4e84-bc6f-f58a3a10302a.info" returned: 0 in 0.257s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:41:16 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-59ec2a19-3570-4a12-a657-c88a84bd2745 tempest-SnapshotMetadataTestJSON-1978808501 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.596s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:41:16 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-59ec2a19-3570-4a12-a657-c88a84bd2745 tempest-SnapshotMetadataTestJSON-1978808501 None] Create snapshot completed successfully Sep 22 15:41:17 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-be695993-5780-43db-9110-4d5379674bba tempest-SnapshotMetadataTestJSON-1978808501 None] Acquiring lock "cinder-e01d2c61-6e14-4418-ab34-31014c4781f8-delete_snapshot" by "delete_snapshot" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:41:17 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-be695993-5780-43db-9110-4d5379674bba tempest-SnapshotMetadataTestJSON-1978808501 None] Lock "cinder-e01d2c61-6e14-4418-ab34-31014c4781f8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:41:17 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-be695993-5780-43db-9110-4d5379674bba tempest-SnapshotMetadataTestJSON-1978808501 None] Acquiring lock "cinder-quobyte-4bcd1edd-b263-4e84-bc6f-f58a3a10302a" by "delete_snapshot" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:41:17 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-be695993-5780-43db-9110-4d5379674bba tempest-SnapshotMetadataTestJSON-1978808501 None] Lock "cinder-quobyte-4bcd1edd-b263-4e84-bc6f-f58a3a10302a" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:41:17 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-be695993-5780-43db-9110-4d5379674bba tempest-SnapshotMetadataTestJSON-1978808501 None] Acquiring lock "cinder-quobyte-e01d2c61-6e14-4418-ab34-31014c4781f8" by "_delete_snapshot" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:41:17 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-be695993-5780-43db-9110-4d5379674bba tempest-SnapshotMetadataTestJSON-1978808501 None] Lock "cinder-quobyte-e01d2c61-6e14-4418-ab34-31014c4781f8" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:41:18 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-be695993-5780-43db-9110-4d5379674bba tempest-SnapshotMetadataTestJSON-1978808501 None] Deleting offline snapshot e01d2c61-6e14-4418-ab34-31014c4781f8 of volume 4bcd1edd-b263-4e84-bc6f-f58a3a10302a {{(pid=86212) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 22 15:41:18 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-be695993-5780-43db-9110-4d5379674bba tempest-SnapshotMetadataTestJSON-1978808501 None] snapshot_file for this snap is: volume-4bcd1edd-b263-4e84-bc6f-f58a3a10302a.e01d2c61-6e14-4418-ab34-31014c4781f8 {{(pid=86212) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 22 15:41:18 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa9ed498-a037-49ee-acb5-0145e4bacc86]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:41:18 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-be695993-5780-43db-9110-4d5379674bba tempest-SnapshotMetadataTestJSON-1978808501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-4bcd1edd-b263-4e84-bc6f-f58a3a10302a.e01d2c61-6e14-4418-ab34-31014c4781f8 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:41:18 devstack sudo[92203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-4bcd1edd-b263-4e84-bc6f-f58a3a10302a.e01d2c61-6e14-4418-ab34-31014c4781f8 Sep 22 15:41:18 devstack sudo[92203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:41:18 devstack sudo[92203]: pam_unix(sudo:session): session closed for user root Sep 22 15:41:18 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-be695993-5780-43db-9110-4d5379674bba tempest-SnapshotMetadataTestJSON-1978808501 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-4bcd1edd-b263-4e84-bc6f-f58a3a10302a.e01d2c61-6e14-4418-ab34-31014c4781f8" returned: 0 in 0.398s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:41:18 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-be695993-5780-43db-9110-4d5379674bba tempest-SnapshotMetadataTestJSON-1978808501 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4bcd1edd-b263-4e84-bc6f-f58a3a10302a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86212) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 22 15:41:18 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[850b7da2-f347-45f2-b1db-0bb52571fa58]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:41:18 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-be695993-5780-43db-9110-4d5379674bba tempest-SnapshotMetadataTestJSON-1978808501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-4bcd1edd-b263-4e84-bc6f-f58a3a10302a {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:41:18 devstack sudo[92208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-4bcd1edd-b263-4e84-bc6f-f58a3a10302a Sep 22 15:41:18 devstack sudo[92208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:41:18 devstack sudo[92208]: pam_unix(sudo:session): session closed for user root Sep 22 15:41:18 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-be695993-5780-43db-9110-4d5379674bba tempest-SnapshotMetadataTestJSON-1978808501 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-4bcd1edd-b263-4e84-bc6f-f58a3a10302a" returned: 0 in 0.434s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:41:18 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-be695993-5780-43db-9110-4d5379674bba tempest-SnapshotMetadataTestJSON-1978808501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-4bcd1edd-b263-4e84-bc6f-f58a3a10302a.e01d2c61-6e14-4418-ab34-31014c4781f8 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:41:18 devstack sudo[92214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-4bcd1edd-b263-4e84-bc6f-f58a3a10302a.e01d2c61-6e14-4418-ab34-31014c4781f8 Sep 22 15:41:18 devstack sudo[92214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:41:19 devstack sudo[92214]: pam_unix(sudo:session): session closed for user root Sep 22 15:41:19 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-be695993-5780-43db-9110-4d5379674bba tempest-SnapshotMetadataTestJSON-1978808501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-4bcd1edd-b263-4e84-bc6f-f58a3a10302a.e01d2c61-6e14-4418-ab34-31014c4781f8" returned: 0 in 0.338s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:41:19 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-be695993-5780-43db-9110-4d5379674bba tempest-SnapshotMetadataTestJSON-1978808501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-4bcd1edd-b263-4e84-bc6f-f58a3a10302a.e01d2c61-6e14-4418-ab34-31014c4781f8 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:41:19 devstack sudo[92219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-4bcd1edd-b263-4e84-bc6f-f58a3a10302a.e01d2c61-6e14-4418-ab34-31014c4781f8 Sep 22 15:41:19 devstack sudo[92219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:41:19 devstack sudo[92219]: pam_unix(sudo:session): session closed for user root Sep 22 15:41:19 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-be695993-5780-43db-9110-4d5379674bba tempest-SnapshotMetadataTestJSON-1978808501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-4bcd1edd-b263-4e84-bc6f-f58a3a10302a.e01d2c61-6e14-4418-ab34-31014c4781f8" returned: 0 in 0.263s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:41:19 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-be695993-5780-43db-9110-4d5379674bba tempest-SnapshotMetadataTestJSON-1978808501 None] Lock "cinder-quobyte-e01d2c61-6e14-4418-ab34-31014c4781f8" released by "_delete_snapshot" :: held 1.571s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:41:19 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-be695993-5780-43db-9110-4d5379674bba tempest-SnapshotMetadataTestJSON-1978808501 None] Lock "cinder-quobyte-4bcd1edd-b263-4e84-bc6f-f58a3a10302a" released by "delete_snapshot" :: held 1.609s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:41:19 devstack cinder-volume[86212]: DEBUG cinder.quota [None req-be695993-5780-43db-9110-4d5379674bba tempest-SnapshotMetadataTestJSON-1978808501 None] Created reservations ['4ce954e5-fbd2-454a-86d1-04402ccfc74a', '1f919f7d-dafa-4451-818c-a35850e66429', 'cf82f644-521c-48d5-8344-7141c49c7bc5', '906f69a5-6558-40fe-81a8-90d18fb89944'] {{(pid=86212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 15:41:19 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-be695993-5780-43db-9110-4d5379674bba tempest-SnapshotMetadataTestJSON-1978808501 None] Delete snapshot completed successfully. Sep 22 15:41:19 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-be695993-5780-43db-9110-4d5379674bba tempest-SnapshotMetadataTestJSON-1978808501 None] Lock "cinder-e01d2c61-6e14-4418-ab34-31014c4781f8-delete_snapshot" released by "delete_snapshot" :: held 1.797s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:41:20 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-7638f82f-7228-4cfb-acb2-3032ef2e15eb tempest-SnapshotMetadataTestJSON-1978808501 None] Acquiring lock "cinder-4bcd1edd-b263-4e84-bc6f-f58a3a10302a-delete_volume" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:41:20 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-7638f82f-7228-4cfb-acb2-3032ef2e15eb tempest-SnapshotMetadataTestJSON-1978808501 None] Lock "cinder-4bcd1edd-b263-4e84-bc6f-f58a3a10302a-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:41:20 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-7638f82f-7228-4cfb-acb2-3032ef2e15eb tempest-SnapshotMetadataTestJSON-1978808501 None] Acquiring lock "cinder-quobyte-4bcd1edd-b263-4e84-bc6f-f58a3a10302a" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:41:20 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-7638f82f-7228-4cfb-acb2-3032ef2e15eb tempest-SnapshotMetadataTestJSON-1978808501 None] Lock "cinder-quobyte-4bcd1edd-b263-4e84-bc6f-f58a3a10302a" acquired by "delete_volume" :: waited 0.030s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:41:20 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdd478c8-d6ea-4cb2-afeb-7efb4373880a]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:41:20 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-7638f82f-7228-4cfb-acb2-3032ef2e15eb tempest-SnapshotMetadataTestJSON-1978808501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-4bcd1edd-b263-4e84-bc6f-f58a3a10302a {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:41:20 devstack sudo[92222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-4bcd1edd-b263-4e84-bc6f-f58a3a10302a Sep 22 15:41:20 devstack sudo[92222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:41:20 devstack sudo[92222]: pam_unix(sudo:session): session closed for user root Sep 22 15:41:20 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-7638f82f-7228-4cfb-acb2-3032ef2e15eb tempest-SnapshotMetadataTestJSON-1978808501 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-4bcd1edd-b263-4e84-bc6f-f58a3a10302a" returned: 0 in 0.440s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:41:20 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-7638f82f-7228-4cfb-acb2-3032ef2e15eb tempest-SnapshotMetadataTestJSON-1978808501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-4bcd1edd-b263-4e84-bc6f-f58a3a10302a {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:41:20 devstack sudo[92228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-4bcd1edd-b263-4e84-bc6f-f58a3a10302a Sep 22 15:41:20 devstack sudo[92228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:41:21 devstack sudo[92228]: pam_unix(sudo:session): session closed for user root Sep 22 15:41:21 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-7638f82f-7228-4cfb-acb2-3032ef2e15eb tempest-SnapshotMetadataTestJSON-1978808501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-4bcd1edd-b263-4e84-bc6f-f58a3a10302a" returned: 0 in 0.277s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:41:21 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-7638f82f-7228-4cfb-acb2-3032ef2e15eb tempest-SnapshotMetadataTestJSON-1978808501 None] Lock "cinder-quobyte-4bcd1edd-b263-4e84-bc6f-f58a3a10302a" released by "delete_volume" :: held 0.791s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:41:21 devstack cinder-volume[86212]: DEBUG cinder.quota [None req-7638f82f-7228-4cfb-acb2-3032ef2e15eb tempest-SnapshotMetadataTestJSON-1978808501 None] Created reservations ['8bbbf837-49ad-42b3-8f08-28684531543b', '440de7ea-a2d2-4fdd-8df9-8ba006eb0694', '0b5eaa5e-22c2-477a-ad24-024161e801c8', '607e8f55-5ded-4127-afe1-0d4e0a3b3686'] {{(pid=86212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 15:41:21 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-7638f82f-7228-4cfb-acb2-3032ef2e15eb tempest-SnapshotMetadataTestJSON-1978808501 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:41:21 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-7638f82f-7228-4cfb-acb2-3032ef2e15eb tempest-SnapshotMetadataTestJSON-1978808501 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:41:21 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-7638f82f-7228-4cfb-acb2-3032ef2e15eb tempest-SnapshotMetadataTestJSON-1978808501 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:41:21 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-7638f82f-7228-4cfb-acb2-3032ef2e15eb tempest-SnapshotMetadataTestJSON-1978808501 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:41:21 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-7638f82f-7228-4cfb-acb2-3032ef2e15eb tempest-SnapshotMetadataTestJSON-1978808501 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:41:21 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-7638f82f-7228-4cfb-acb2-3032ef2e15eb tempest-SnapshotMetadataTestJSON-1978808501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:41:21 devstack sudo[92231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc Sep 22 15:41:21 devstack sudo[92231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:41:21 devstack sudo[92231]: pam_unix(sudo:session): session closed for user root Sep 22 15:41:21 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-7638f82f-7228-4cfb-acb2-3032ef2e15eb tempest-SnapshotMetadataTestJSON-1978808501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc" returned: 0 in 0.355s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:41:21 devstack cinder-volume[86212]: DEBUG cinder.manager [None req-7638f82f-7228-4cfb-acb2-3032ef2e15eb tempest-SnapshotMetadataTestJSON-1978808501 None] Notifying Schedulers of capabilities ... {{(pid=86212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 15:41:21 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-7638f82f-7228-4cfb-acb2-3032ef2e15eb tempest-SnapshotMetadataTestJSON-1978808501 None] Deleted volume successfully. Sep 22 15:41:21 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-7638f82f-7228-4cfb-acb2-3032ef2e15eb tempest-SnapshotMetadataTestJSON-1978808501 None] Lock "cinder-4bcd1edd-b263-4e84-bc6f-f58a3a10302a-delete_volume" released by "delete_volume" :: held 1.442s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:41:24 devstack cinder-volume[86212]: DEBUG cinder.volume.flows.manager.create_volume [None req-85fbc3b5-5a92-4367-ba28-620b6cdabe21 tempest-AttachVolumeTestJSON-678247873 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 15:41:24 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-85fbc3b5-5a92-4367-ba28-620b6cdabe21 tempest-AttachVolumeTestJSON-678247873 None] Flow 'volume_create_manager' (d5957fdb-d159-477d-b20d-299622daac9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:41:24 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-85fbc3b5-5a92-4367-ba28-620b6cdabe21 tempest-AttachVolumeTestJSON-678247873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9187d6a3-d0a1-4460-931f-514faab1aa7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:41:24 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-85fbc3b5-5a92-4367-ba28-620b6cdabe21 tempest-AttachVolumeTestJSON-678247873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9187d6a3-d0a1-4460-931f-514faab1aa7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:41:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1555405089',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e50aa326-af76-40e8-93a1-d4e3882bdf34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db03ba1cc4824283bbed3f55dc9e492e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:41:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:41:24Z,use_quota=True,user_id='2ed3340ecc074224bdb9447ca6deadd1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:41:24 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-85fbc3b5-5a92-4367-ba28-620b6cdabe21 tempest-AttachVolumeTestJSON-678247873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61dd1922-9c71-4645-beaa-98e9b98d44ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:41:24 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-85fbc3b5-5a92-4367-ba28-620b6cdabe21 tempest-AttachVolumeTestJSON-678247873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61dd1922-9c71-4645-beaa-98e9b98d44ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:41:24 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-85fbc3b5-5a92-4367-ba28-620b6cdabe21 tempest-AttachVolumeTestJSON-678247873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (008a5276-2619-4e8e-be15-2c89cc0e7b46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:41:24 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-85fbc3b5-5a92-4367-ba28-620b6cdabe21 tempest-AttachVolumeTestJSON-678247873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (008a5276-2619-4e8e-be15-2c89cc0e7b46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e50aa326-af76-40e8-93a1-d4e3882bdf34', 'volume_name': 'volume-e50aa326-af76-40e8-93a1-d4e3882bdf34', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:41:24 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-85fbc3b5-5a92-4367-ba28-620b6cdabe21 tempest-AttachVolumeTestJSON-678247873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94609eb3-4a14-464e-85fc-7dbcbd41bde0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:41:24 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-85fbc3b5-5a92-4367-ba28-620b6cdabe21 tempest-AttachVolumeTestJSON-678247873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94609eb3-4a14-464e-85fc-7dbcbd41bde0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:41:24 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-85fbc3b5-5a92-4367-ba28-620b6cdabe21 tempest-AttachVolumeTestJSON-678247873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ce4b97c-bf4c-4a0c-81b2-23bec10e7fa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:41:24 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-85fbc3b5-5a92-4367-ba28-620b6cdabe21 tempest-AttachVolumeTestJSON-678247873 None] Volume e50aa326-af76-40e8-93a1-d4e3882bdf34: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e50aa326-af76-40e8-93a1-d4e3882bdf34', 'volume_size': 1} Sep 22 15:41:24 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-85fbc3b5-5a92-4367-ba28-620b6cdabe21 tempest-AttachVolumeTestJSON-678247873 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:41:24 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-85fbc3b5-5a92-4367-ba28-620b6cdabe21 tempest-AttachVolumeTestJSON-678247873 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:41:24 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-85fbc3b5-5a92-4367-ba28-620b6cdabe21 tempest-AttachVolumeTestJSON-678247873 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:41:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1555405089',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e50aa326-af76-40e8-93a1-d4e3882bdf34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db03ba1cc4824283bbed3f55dc9e492e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:41:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:41:24Z,use_quota=True,user_id='2ed3340ecc074224bdb9447ca6deadd1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)}" {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 15:41:24 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-85fbc3b5-5a92-4367-ba28-620b6cdabe21 tempest-AttachVolumeTestJSON-678247873 None] Creating volume e50aa326-af76-40e8-93a1-d4e3882bdf34 {{(pid=86212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 15:41:24 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-85fbc3b5-5a92-4367-ba28-620b6cdabe21 tempest-AttachVolumeTestJSON-678247873 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:41:24 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-85fbc3b5-5a92-4367-ba28-620b6cdabe21 tempest-AttachVolumeTestJSON-678247873 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:41:24 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-85fbc3b5-5a92-4367-ba28-620b6cdabe21 tempest-AttachVolumeTestJSON-678247873 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:41:24 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-85fbc3b5-5a92-4367-ba28-620b6cdabe21 tempest-AttachVolumeTestJSON-678247873 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:41:24 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-85fbc3b5-5a92-4367-ba28-620b6cdabe21 tempest-AttachVolumeTestJSON-678247873 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:41:24 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-85fbc3b5-5a92-4367-ba28-620b6cdabe21 tempest-AttachVolumeTestJSON-678247873 None] Selected osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 as target Quobyte volume. {{(pid=86212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 15:41:24 devstack cinder-volume[86212]: INFO cinder.volume.drivers.remotefs [None req-85fbc3b5-5a92-4367-ba28-620b6cdabe21 tempest-AttachVolumeTestJSON-678247873 None] casted to osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 Sep 22 15:41:24 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-85fbc3b5-5a92-4367-ba28-620b6cdabe21 tempest-AttachVolumeTestJSON-678247873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-e50aa326-af76-40e8-93a1-d4e3882bdf34 1073741824 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:41:24 devstack sudo[92271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-e50aa326-af76-40e8-93a1-d4e3882bdf34 1073741824 Sep 22 15:41:24 devstack sudo[92271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:41:24 devstack sudo[92271]: pam_unix(sudo:session): session closed for user root Sep 22 15:41:24 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-85fbc3b5-5a92-4367-ba28-620b6cdabe21 tempest-AttachVolumeTestJSON-678247873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-e50aa326-af76-40e8-93a1-d4e3882bdf34 1073741824" returned: 0 in 0.552s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:41:24 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-85fbc3b5-5a92-4367-ba28-620b6cdabe21 tempest-AttachVolumeTestJSON-678247873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-e50aa326-af76-40e8-93a1-d4e3882bdf34 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:41:24 devstack sudo[92279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-e50aa326-af76-40e8-93a1-d4e3882bdf34 Sep 22 15:41:24 devstack sudo[92279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:41:25 devstack sudo[92279]: pam_unix(sudo:session): session closed for user root Sep 22 15:41:25 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-85fbc3b5-5a92-4367-ba28-620b6cdabe21 tempest-AttachVolumeTestJSON-678247873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-e50aa326-af76-40e8-93a1-d4e3882bdf34" returned: 0 in 0.294s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:41:25 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-85fbc3b5-5a92-4367-ba28-620b6cdabe21 tempest-AttachVolumeTestJSON-678247873 None] <== create_volume: return (960ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'} {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 15:41:25 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-85fbc3b5-5a92-4367-ba28-620b6cdabe21 tempest-AttachVolumeTestJSON-678247873 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.963s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:41:25 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-85fbc3b5-5a92-4367-ba28-620b6cdabe21 tempest-AttachVolumeTestJSON-678247873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ce4b97c-bf4c-4a0c-81b2-23bec10e7fa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e50aa326-af76-40e8-93a1-d4e3882bdf34', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:41:25 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-85fbc3b5-5a92-4367-ba28-620b6cdabe21 tempest-AttachVolumeTestJSON-678247873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ed95ddf-c4ae-4ff8-add2-a4a9cffdbcd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:41:25 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-85fbc3b5-5a92-4367-ba28-620b6cdabe21 tempest-AttachVolumeTestJSON-678247873 None] Volume volume-e50aa326-af76-40e8-93a1-d4e3882bdf34 (e50aa326-af76-40e8-93a1-d4e3882bdf34): created successfully Sep 22 15:41:25 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-85fbc3b5-5a92-4367-ba28-620b6cdabe21 tempest-AttachVolumeTestJSON-678247873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ed95ddf-c4ae-4ff8-add2-a4a9cffdbcd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:41:25 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-85fbc3b5-5a92-4367-ba28-620b6cdabe21 tempest-AttachVolumeTestJSON-678247873 None] Flow 'volume_create_manager' (d5957fdb-d159-477d-b20d-299622daac9a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:41:25 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-85fbc3b5-5a92-4367-ba28-620b6cdabe21 tempest-AttachVolumeTestJSON-678247873 None] Created volume successfully. Sep 22 15:41:27 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [req-60b6e048-5ee8-4c64-922d-7d892ec48278 req-97f55fc4-eb0b-4f0e-aa23-b0e70239977e tempest-AttachVolumeTestJSON-678247873 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:41:27 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [req-60b6e048-5ee8-4c64-922d-7d892ec48278 req-97f55fc4-eb0b-4f0e-aa23-b0e70239977e tempest-AttachVolumeTestJSON-678247873 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:41:27 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [req-60b6e048-5ee8-4c64-922d-7d892ec48278 req-97f55fc4-eb0b-4f0e-aa23-b0e70239977e tempest-AttachVolumeTestJSON-678247873 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:41:27 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [req-60b6e048-5ee8-4c64-922d-7d892ec48278 req-97f55fc4-eb0b-4f0e-aa23-b0e70239977e tempest-AttachVolumeTestJSON-678247873 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31', 'name': 'volume-e50aa326-af76-40e8-93a1-d4e3882bdf34', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '65991ae4-5fae-4c2d-a8b4-670171e06e80', 'enforce_multipath': True} {{(pid=86212) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 22 15:41:27 devstack cinder-volume[86212]: INFO cinder.volume.manager [req-60b6e048-5ee8-4c64-922d-7d892ec48278 req-97f55fc4-eb0b-4f0e-aa23-b0e70239977e tempest-AttachVolumeTestJSON-678247873 None] attachment_update completed successfully. Sep 22 15:41:30 devstack cinder-volume[86212]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d664df8-8960-454a-9762-4c327d0312e3 tempest-VolumesDeleteCascade-1450357542 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 15:41:30 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-1d664df8-8960-454a-9762-4c327d0312e3 tempest-VolumesDeleteCascade-1450357542 None] Flow 'volume_create_manager' (abb2fc41-9e72-4796-959b-3f877bcae468) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:41:30 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-1d664df8-8960-454a-9762-4c327d0312e3 tempest-VolumesDeleteCascade-1450357542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17a101b6-c61e-40a1-8522-8f62367ec1e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:41:30 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-1d664df8-8960-454a-9762-4c327d0312e3 tempest-VolumesDeleteCascade-1450357542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17a101b6-c61e-40a1-8522-8f62367ec1e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:41:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-199266548',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13f64fbe-4e14-4a85-8bfe-2475fd9deabc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df9442c87b5e4dbf9a29b0dc9956f68d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:41:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:41:30Z,use_quota=True,user_id='96b87f8d32ad4e72b45f2b231469edae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:41:30 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-1d664df8-8960-454a-9762-4c327d0312e3 tempest-VolumesDeleteCascade-1450357542 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4637dac-ee27-4855-b95d-d54d97629d1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:41:30 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-1d664df8-8960-454a-9762-4c327d0312e3 tempest-VolumesDeleteCascade-1450357542 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4637dac-ee27-4855-b95d-d54d97629d1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:41:30 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-1d664df8-8960-454a-9762-4c327d0312e3 tempest-VolumesDeleteCascade-1450357542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2389a22c-5daf-4299-b6c8-28e082c774c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:41:30 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-1d664df8-8960-454a-9762-4c327d0312e3 tempest-VolumesDeleteCascade-1450357542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2389a22c-5daf-4299-b6c8-28e082c774c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '13f64fbe-4e14-4a85-8bfe-2475fd9deabc', 'volume_name': 'volume-13f64fbe-4e14-4a85-8bfe-2475fd9deabc', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:41:30 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-1d664df8-8960-454a-9762-4c327d0312e3 tempest-VolumesDeleteCascade-1450357542 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fe46379-55cd-41d5-8801-0151854177a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:41:30 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-1d664df8-8960-454a-9762-4c327d0312e3 tempest-VolumesDeleteCascade-1450357542 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fe46379-55cd-41d5-8801-0151854177a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:41:30 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-1d664df8-8960-454a-9762-4c327d0312e3 tempest-VolumesDeleteCascade-1450357542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f921ed36-be89-498e-9656-d2ebe26c6665) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:41:30 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-1d664df8-8960-454a-9762-4c327d0312e3 tempest-VolumesDeleteCascade-1450357542 None] Volume 13f64fbe-4e14-4a85-8bfe-2475fd9deabc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-13f64fbe-4e14-4a85-8bfe-2475fd9deabc', 'volume_size': 1} Sep 22 15:41:30 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-1d664df8-8960-454a-9762-4c327d0312e3 tempest-VolumesDeleteCascade-1450357542 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:41:30 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-1d664df8-8960-454a-9762-4c327d0312e3 tempest-VolumesDeleteCascade-1450357542 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:41:30 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-1d664df8-8960-454a-9762-4c327d0312e3 tempest-VolumesDeleteCascade-1450357542 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:41:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-199266548',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13f64fbe-4e14-4a85-8bfe-2475fd9deabc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df9442c87b5e4dbf9a29b0dc9956f68d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:41:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:41:30Z,use_quota=True,user_id='96b87f8d32ad4e72b45f2b231469edae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)}" {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 15:41:30 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-1d664df8-8960-454a-9762-4c327d0312e3 tempest-VolumesDeleteCascade-1450357542 None] Creating volume 13f64fbe-4e14-4a85-8bfe-2475fd9deabc {{(pid=86212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 15:41:30 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-1d664df8-8960-454a-9762-4c327d0312e3 tempest-VolumesDeleteCascade-1450357542 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:41:30 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-1d664df8-8960-454a-9762-4c327d0312e3 tempest-VolumesDeleteCascade-1450357542 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:41:30 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-1d664df8-8960-454a-9762-4c327d0312e3 tempest-VolumesDeleteCascade-1450357542 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:41:30 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-1d664df8-8960-454a-9762-4c327d0312e3 tempest-VolumesDeleteCascade-1450357542 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:41:30 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-1d664df8-8960-454a-9762-4c327d0312e3 tempest-VolumesDeleteCascade-1450357542 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:41:30 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-1d664df8-8960-454a-9762-4c327d0312e3 tempest-VolumesDeleteCascade-1450357542 None] Selected osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 as target Quobyte volume. {{(pid=86212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 15:41:30 devstack cinder-volume[86212]: INFO cinder.volume.drivers.remotefs [None req-1d664df8-8960-454a-9762-4c327d0312e3 tempest-VolumesDeleteCascade-1450357542 None] casted to osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 Sep 22 15:41:30 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-1d664df8-8960-454a-9762-4c327d0312e3 tempest-VolumesDeleteCascade-1450357542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-13f64fbe-4e14-4a85-8bfe-2475fd9deabc 1073741824 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:41:30 devstack sudo[92357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-13f64fbe-4e14-4a85-8bfe-2475fd9deabc 1073741824 Sep 22 15:41:30 devstack sudo[92357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:41:30 devstack sudo[92357]: pam_unix(sudo:session): session closed for user root Sep 22 15:41:30 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-1d664df8-8960-454a-9762-4c327d0312e3 tempest-VolumesDeleteCascade-1450357542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-13f64fbe-4e14-4a85-8bfe-2475fd9deabc 1073741824" returned: 0 in 0.461s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:41:30 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-1d664df8-8960-454a-9762-4c327d0312e3 tempest-VolumesDeleteCascade-1450357542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-13f64fbe-4e14-4a85-8bfe-2475fd9deabc {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:41:30 devstack sudo[92363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-13f64fbe-4e14-4a85-8bfe-2475fd9deabc Sep 22 15:41:30 devstack sudo[92363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:41:31 devstack sudo[92363]: pam_unix(sudo:session): session closed for user root Sep 22 15:41:31 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-1d664df8-8960-454a-9762-4c327d0312e3 tempest-VolumesDeleteCascade-1450357542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-13f64fbe-4e14-4a85-8bfe-2475fd9deabc" returned: 0 in 0.352s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:41:31 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-1d664df8-8960-454a-9762-4c327d0312e3 tempest-VolumesDeleteCascade-1450357542 None] <== create_volume: return (869ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'} {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 15:41:31 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-1d664df8-8960-454a-9762-4c327d0312e3 tempest-VolumesDeleteCascade-1450357542 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.872s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:41:31 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-1d664df8-8960-454a-9762-4c327d0312e3 tempest-VolumesDeleteCascade-1450357542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f921ed36-be89-498e-9656-d2ebe26c6665) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-13f64fbe-4e14-4a85-8bfe-2475fd9deabc', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:41:31 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-1d664df8-8960-454a-9762-4c327d0312e3 tempest-VolumesDeleteCascade-1450357542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2bbae12e-8c43-41c0-8705-8da6bd45e865) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:41:31 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-1d664df8-8960-454a-9762-4c327d0312e3 tempest-VolumesDeleteCascade-1450357542 None] Volume volume-13f64fbe-4e14-4a85-8bfe-2475fd9deabc (13f64fbe-4e14-4a85-8bfe-2475fd9deabc): created successfully Sep 22 15:41:31 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-1d664df8-8960-454a-9762-4c327d0312e3 tempest-VolumesDeleteCascade-1450357542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2bbae12e-8c43-41c0-8705-8da6bd45e865) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:41:31 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-1d664df8-8960-454a-9762-4c327d0312e3 tempest-VolumesDeleteCascade-1450357542 None] Flow 'volume_create_manager' (abb2fc41-9e72-4796-959b-3f877bcae468) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:41:31 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-1d664df8-8960-454a-9762-4c327d0312e3 tempest-VolumesDeleteCascade-1450357542 None] Created volume successfully. Sep 22 15:41:32 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-314894e1-fd03-4cfb-86ab-ed0f62fc5094 tempest-VolumesDeleteCascade-1450357542 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:41:32 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-314894e1-fd03-4cfb-86ab-ed0f62fc5094 tempest-VolumesDeleteCascade-1450357542 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:41:32 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-314894e1-fd03-4cfb-86ab-ed0f62fc5094 tempest-VolumesDeleteCascade-1450357542 None] Creating offline snapshot f8535130-adf6-4450-951f-264cec1dfa5f of volume 13f64fbe-4e14-4a85-8bfe-2475fd9deabc {{(pid=86212) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 22 15:41:32 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[39603eb6-c62c-4ce6-bab5-0bc0ee92a373]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:41:32 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-314894e1-fd03-4cfb-86ab-ed0f62fc5094 tempest-VolumesDeleteCascade-1450357542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-13f64fbe-4e14-4a85-8bfe-2475fd9deabc {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:41:32 devstack sudo[92396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-13f64fbe-4e14-4a85-8bfe-2475fd9deabc Sep 22 15:41:32 devstack sudo[92396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:41:32 devstack sudo[92396]: pam_unix(sudo:session): session closed for user root Sep 22 15:41:32 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-314894e1-fd03-4cfb-86ab-ed0f62fc5094 tempest-VolumesDeleteCascade-1450357542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-13f64fbe-4e14-4a85-8bfe-2475fd9deabc" returned: 0 in 0.486s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:41:32 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-314894e1-fd03-4cfb-86ab-ed0f62fc5094 tempest-VolumesDeleteCascade-1450357542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-13f64fbe-4e14-4a85-8bfe-2475fd9deabc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-13f64fbe-4e14-4a85-8bfe-2475fd9deabc.f8535130-adf6-4450-951f-264cec1dfa5f 1G {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:41:32 devstack sudo[92402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-13f64fbe-4e14-4a85-8bfe-2475fd9deabc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-13f64fbe-4e14-4a85-8bfe-2475fd9deabc.f8535130-adf6-4450-951f-264cec1dfa5f 1G Sep 22 15:41:32 devstack sudo[92402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:41:33 devstack sudo[92402]: pam_unix(sudo:session): session closed for user root Sep 22 15:41:33 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-314894e1-fd03-4cfb-86ab-ed0f62fc5094 tempest-VolumesDeleteCascade-1450357542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-13f64fbe-4e14-4a85-8bfe-2475fd9deabc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-13f64fbe-4e14-4a85-8bfe-2475fd9deabc.f8535130-adf6-4450-951f-264cec1dfa5f 1G" returned: 0 in 0.705s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:41:33 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-314894e1-fd03-4cfb-86ab-ed0f62fc5094 tempest-VolumesDeleteCascade-1450357542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-13f64fbe-4e14-4a85-8bfe-2475fd9deabc -F qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-13f64fbe-4e14-4a85-8bfe-2475fd9deabc.f8535130-adf6-4450-951f-264cec1dfa5f {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:41:33 devstack sudo[92429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-13f64fbe-4e14-4a85-8bfe-2475fd9deabc -F qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-13f64fbe-4e14-4a85-8bfe-2475fd9deabc.f8535130-adf6-4450-951f-264cec1dfa5f Sep 22 15:41:33 devstack sudo[92429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:41:33 devstack sudo[92429]: pam_unix(sudo:session): session closed for user root Sep 22 15:41:33 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-314894e1-fd03-4cfb-86ab-ed0f62fc5094 tempest-VolumesDeleteCascade-1450357542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-13f64fbe-4e14-4a85-8bfe-2475fd9deabc -F qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-13f64fbe-4e14-4a85-8bfe-2475fd9deabc.f8535130-adf6-4450-951f-264cec1dfa5f" returned: 0 in 0.341s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:41:33 devstack cinder-volume[86212]: WARNING cinder.volume.drivers.remotefs [None req-314894e1-fd03-4cfb-86ab-ed0f62fc5094 tempest-VolumesDeleteCascade-1450357542 None] /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-13f64fbe-4e14-4a85-8bfe-2475fd9deabc.f8535130-adf6-4450-951f-264cec1dfa5f is being set with open permissions: ugo+rw Sep 22 15:41:33 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-314894e1-fd03-4cfb-86ab-ed0f62fc5094 tempest-VolumesDeleteCascade-1450357542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-13f64fbe-4e14-4a85-8bfe-2475fd9deabc.f8535130-adf6-4450-951f-264cec1dfa5f {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:41:33 devstack sudo[92441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-13f64fbe-4e14-4a85-8bfe-2475fd9deabc.f8535130-adf6-4450-951f-264cec1dfa5f Sep 22 15:41:33 devstack sudo[92441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:41:34 devstack sudo[92441]: pam_unix(sudo:session): session closed for user root Sep 22 15:41:34 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-314894e1-fd03-4cfb-86ab-ed0f62fc5094 tempest-VolumesDeleteCascade-1450357542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-13f64fbe-4e14-4a85-8bfe-2475fd9deabc.f8535130-adf6-4450-951f-264cec1dfa5f" returned: 0 in 0.350s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:41:34 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-314894e1-fd03-4cfb-86ab-ed0f62fc5094 tempest-VolumesDeleteCascade-1450357542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-13f64fbe-4e14-4a85-8bfe-2475fd9deabc.info {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:41:34 devstack sudo[92481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-13f64fbe-4e14-4a85-8bfe-2475fd9deabc.info Sep 22 15:41:34 devstack sudo[92481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:41:34 devstack sudo[92481]: pam_unix(sudo:session): session closed for user root Sep 22 15:41:34 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-314894e1-fd03-4cfb-86ab-ed0f62fc5094 tempest-VolumesDeleteCascade-1450357542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-13f64fbe-4e14-4a85-8bfe-2475fd9deabc.info" returned: 0 in 0.390s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:41:34 devstack cinder-volume[86212]: WARNING cinder.volume.drivers.remotefs [None req-314894e1-fd03-4cfb-86ab-ed0f62fc5094 tempest-VolumesDeleteCascade-1450357542 None] /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-13f64fbe-4e14-4a85-8bfe-2475fd9deabc.info is being set with open permissions: ugo+rw Sep 22 15:41:34 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-314894e1-fd03-4cfb-86ab-ed0f62fc5094 tempest-VolumesDeleteCascade-1450357542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-13f64fbe-4e14-4a85-8bfe-2475fd9deabc.info {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:41:34 devstack sudo[92505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-13f64fbe-4e14-4a85-8bfe-2475fd9deabc.info Sep 22 15:41:34 devstack sudo[92505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:41:35 devstack sudo[92505]: pam_unix(sudo:session): session closed for user root Sep 22 15:41:35 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-314894e1-fd03-4cfb-86ab-ed0f62fc5094 tempest-VolumesDeleteCascade-1450357542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-13f64fbe-4e14-4a85-8bfe-2475fd9deabc.info" returned: 0 in 0.457s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:41:35 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-314894e1-fd03-4cfb-86ab-ed0f62fc5094 tempest-VolumesDeleteCascade-1450357542 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.940s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:41:35 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-314894e1-fd03-4cfb-86ab-ed0f62fc5094 tempest-VolumesDeleteCascade-1450357542 None] Create snapshot completed successfully Sep 22 15:41:36 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-64ad9f7d-0965-4793-ac4a-d51f75294a57 tempest-VolumesDeleteCascade-1450357542 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:41:36 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-64ad9f7d-0965-4793-ac4a-d51f75294a57 tempest-VolumesDeleteCascade-1450357542 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:41:36 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-64ad9f7d-0965-4793-ac4a-d51f75294a57 tempest-VolumesDeleteCascade-1450357542 None] Creating offline snapshot 275f486b-bf79-4f6b-9077-1f6c40157153 of volume 13f64fbe-4e14-4a85-8bfe-2475fd9deabc {{(pid=86212) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 22 15:41:36 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[06b9a7c8-89e6-4376-92b1-c1c4aa3cb0cf]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:41:36 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-64ad9f7d-0965-4793-ac4a-d51f75294a57 tempest-VolumesDeleteCascade-1450357542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-13f64fbe-4e14-4a85-8bfe-2475fd9deabc.f8535130-adf6-4450-951f-264cec1dfa5f {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:41:36 devstack sudo[92541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-13f64fbe-4e14-4a85-8bfe-2475fd9deabc.f8535130-adf6-4450-951f-264cec1dfa5f Sep 22 15:41:36 devstack sudo[92541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:41:36 devstack sudo[92541]: pam_unix(sudo:session): session closed for user root Sep 22 15:41:37 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-64ad9f7d-0965-4793-ac4a-d51f75294a57 tempest-VolumesDeleteCascade-1450357542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-13f64fbe-4e14-4a85-8bfe-2475fd9deabc.f8535130-adf6-4450-951f-264cec1dfa5f" returned: 0 in 0.851s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:41:37 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-64ad9f7d-0965-4793-ac4a-d51f75294a57 tempest-VolumesDeleteCascade-1450357542 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-13f64fbe-4e14-4a85-8bfe-2475fd9deabc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86212) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 22 15:41:37 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-64ad9f7d-0965-4793-ac4a-d51f75294a57 tempest-VolumesDeleteCascade-1450357542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-13f64fbe-4e14-4a85-8bfe-2475fd9deabc.f8535130-adf6-4450-951f-264cec1dfa5f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-13f64fbe-4e14-4a85-8bfe-2475fd9deabc.275f486b-bf79-4f6b-9077-1f6c40157153 1G {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:41:37 devstack sudo[92549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-13f64fbe-4e14-4a85-8bfe-2475fd9deabc.f8535130-adf6-4450-951f-264cec1dfa5f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-13f64fbe-4e14-4a85-8bfe-2475fd9deabc.275f486b-bf79-4f6b-9077-1f6c40157153 1G Sep 22 15:41:37 devstack sudo[92549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:41:37 devstack sudo[92549]: pam_unix(sudo:session): session closed for user root Sep 22 15:41:37 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-64ad9f7d-0965-4793-ac4a-d51f75294a57 tempest-VolumesDeleteCascade-1450357542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-13f64fbe-4e14-4a85-8bfe-2475fd9deabc.f8535130-adf6-4450-951f-264cec1dfa5f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-13f64fbe-4e14-4a85-8bfe-2475fd9deabc.275f486b-bf79-4f6b-9077-1f6c40157153 1G" returned: 0 in 0.752s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:41:37 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-64ad9f7d-0965-4793-ac4a-d51f75294a57 tempest-VolumesDeleteCascade-1450357542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-13f64fbe-4e14-4a85-8bfe-2475fd9deabc.f8535130-adf6-4450-951f-264cec1dfa5f -F qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-13f64fbe-4e14-4a85-8bfe-2475fd9deabc.275f486b-bf79-4f6b-9077-1f6c40157153 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:41:37 devstack sudo[92557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-13f64fbe-4e14-4a85-8bfe-2475fd9deabc.f8535130-adf6-4450-951f-264cec1dfa5f -F qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-13f64fbe-4e14-4a85-8bfe-2475fd9deabc.275f486b-bf79-4f6b-9077-1f6c40157153 Sep 22 15:41:37 devstack sudo[92557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:41:38 devstack sudo[92557]: pam_unix(sudo:session): session closed for user root Sep 22 15:41:38 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-64ad9f7d-0965-4793-ac4a-d51f75294a57 tempest-VolumesDeleteCascade-1450357542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-13f64fbe-4e14-4a85-8bfe-2475fd9deabc.f8535130-adf6-4450-951f-264cec1dfa5f -F qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-13f64fbe-4e14-4a85-8bfe-2475fd9deabc.275f486b-bf79-4f6b-9077-1f6c40157153" returned: 0 in 0.510s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:41:38 devstack cinder-volume[86212]: WARNING cinder.volume.drivers.remotefs [None req-64ad9f7d-0965-4793-ac4a-d51f75294a57 tempest-VolumesDeleteCascade-1450357542 None] /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-13f64fbe-4e14-4a85-8bfe-2475fd9deabc.275f486b-bf79-4f6b-9077-1f6c40157153 is being set with open permissions: ugo+rw Sep 22 15:41:38 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-64ad9f7d-0965-4793-ac4a-d51f75294a57 tempest-VolumesDeleteCascade-1450357542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-13f64fbe-4e14-4a85-8bfe-2475fd9deabc.275f486b-bf79-4f6b-9077-1f6c40157153 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:41:38 devstack sudo[92562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-13f64fbe-4e14-4a85-8bfe-2475fd9deabc.275f486b-bf79-4f6b-9077-1f6c40157153 Sep 22 15:41:38 devstack sudo[92562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:41:38 devstack cinder-volume[86212]: DEBUG oslo_service.periodic_task [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86212) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 22 15:41:38 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:41:38 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:41:38 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:41:38 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:41:38 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:41:38 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:41:38 devstack sudo[92564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc Sep 22 15:41:38 devstack sudo[92564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:41:38 devstack sudo[92562]: pam_unix(sudo:session): session closed for user root Sep 22 15:41:38 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-64ad9f7d-0965-4793-ac4a-d51f75294a57 tempest-VolumesDeleteCascade-1450357542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-13f64fbe-4e14-4a85-8bfe-2475fd9deabc.275f486b-bf79-4f6b-9077-1f6c40157153" returned: 0 in 0.418s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:41:38 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-64ad9f7d-0965-4793-ac4a-d51f75294a57 tempest-VolumesDeleteCascade-1450357542 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.715s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:41:38 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-64ad9f7d-0965-4793-ac4a-d51f75294a57 tempest-VolumesDeleteCascade-1450357542 None] Create snapshot completed successfully Sep 22 15:41:38 devstack sudo[92564]: pam_unix(sudo:session): session closed for user root Sep 22 15:41:38 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc" returned: 0 in 0.416s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:41:38 devstack cinder-volume[86212]: DEBUG cinder.manager [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] Notifying Schedulers of capabilities ... {{(pid=86212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 15:41:38 devstack cinder-volume[86212]: DEBUG oslo_service.periodic_task [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] Running periodic task VolumeManager._thread_info {{(pid=86212) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 22 15:41:38 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] thread count: 28 {{(pid=86212) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 22 15:41:38 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] thread info: [<_MainThread(MainThread, started 136163191222400)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86212) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 22 15:41:39 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-e911874d-9850-4b44-be45-04762e3806f3 tempest-VolumesDeleteCascade-1450357542 None] Acquiring lock "cinder-13f64fbe-4e14-4a85-8bfe-2475fd9deabc-delete_volume" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:41:39 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-e911874d-9850-4b44-be45-04762e3806f3 tempest-VolumesDeleteCascade-1450357542 None] Lock "cinder-13f64fbe-4e14-4a85-8bfe-2475fd9deabc-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:41:39 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-e911874d-9850-4b44-be45-04762e3806f3 tempest-VolumesDeleteCascade-1450357542 None] Performing cascade delete. {{(pid=86212) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 22 15:41:39 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-e911874d-9850-4b44-be45-04762e3806f3 tempest-VolumesDeleteCascade-1450357542 None] Acquiring lock "cinder-275f486b-bf79-4f6b-9077-1f6c40157153-delete_snapshot" by "delete_snapshot" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:41:39 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-e911874d-9850-4b44-be45-04762e3806f3 tempest-VolumesDeleteCascade-1450357542 None] Lock "cinder-275f486b-bf79-4f6b-9077-1f6c40157153-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:41:39 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-e911874d-9850-4b44-be45-04762e3806f3 tempest-VolumesDeleteCascade-1450357542 None] Acquiring lock "cinder-quobyte-13f64fbe-4e14-4a85-8bfe-2475fd9deabc" by "delete_snapshot" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:41:39 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-e911874d-9850-4b44-be45-04762e3806f3 tempest-VolumesDeleteCascade-1450357542 None] Lock "cinder-quobyte-13f64fbe-4e14-4a85-8bfe-2475fd9deabc" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:41:39 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-e911874d-9850-4b44-be45-04762e3806f3 tempest-VolumesDeleteCascade-1450357542 None] Acquiring lock "cinder-quobyte-275f486b-bf79-4f6b-9077-1f6c40157153" by "_delete_snapshot" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:41:39 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-e911874d-9850-4b44-be45-04762e3806f3 tempest-VolumesDeleteCascade-1450357542 None] Lock "cinder-quobyte-275f486b-bf79-4f6b-9077-1f6c40157153" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:41:39 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-e911874d-9850-4b44-be45-04762e3806f3 tempest-VolumesDeleteCascade-1450357542 None] Deleting offline snapshot 275f486b-bf79-4f6b-9077-1f6c40157153 of volume 13f64fbe-4e14-4a85-8bfe-2475fd9deabc {{(pid=86212) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 22 15:41:39 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-e911874d-9850-4b44-be45-04762e3806f3 tempest-VolumesDeleteCascade-1450357542 None] snapshot_file for this snap is: volume-13f64fbe-4e14-4a85-8bfe-2475fd9deabc.275f486b-bf79-4f6b-9077-1f6c40157153 {{(pid=86212) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 22 15:41:39 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[8757f9ad-5c96-489b-9665-5c1dfeb64bd1]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:41:39 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-e911874d-9850-4b44-be45-04762e3806f3 tempest-VolumesDeleteCascade-1450357542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-13f64fbe-4e14-4a85-8bfe-2475fd9deabc.275f486b-bf79-4f6b-9077-1f6c40157153 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:41:39 devstack sudo[92574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-13f64fbe-4e14-4a85-8bfe-2475fd9deabc.275f486b-bf79-4f6b-9077-1f6c40157153 Sep 22 15:41:39 devstack sudo[92574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:41:39 devstack sudo[92574]: pam_unix(sudo:session): session closed for user root Sep 22 15:41:39 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-e911874d-9850-4b44-be45-04762e3806f3 tempest-VolumesDeleteCascade-1450357542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-13f64fbe-4e14-4a85-8bfe-2475fd9deabc.275f486b-bf79-4f6b-9077-1f6c40157153" returned: 0 in 0.556s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:41:39 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-e911874d-9850-4b44-be45-04762e3806f3 tempest-VolumesDeleteCascade-1450357542 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-13f64fbe-4e14-4a85-8bfe-2475fd9deabc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86212) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 22 15:41:40 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[af073569-2b85-4662-865b-e6aec9038cea]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:41:40 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-e911874d-9850-4b44-be45-04762e3806f3 tempest-VolumesDeleteCascade-1450357542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-13f64fbe-4e14-4a85-8bfe-2475fd9deabc.f8535130-adf6-4450-951f-264cec1dfa5f {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:41:40 devstack sudo[92582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-13f64fbe-4e14-4a85-8bfe-2475fd9deabc.f8535130-adf6-4450-951f-264cec1dfa5f Sep 22 15:41:40 devstack sudo[92582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:41:40 devstack sudo[92582]: pam_unix(sudo:session): session closed for user root Sep 22 15:41:40 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-e911874d-9850-4b44-be45-04762e3806f3 tempest-VolumesDeleteCascade-1450357542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-13f64fbe-4e14-4a85-8bfe-2475fd9deabc.f8535130-adf6-4450-951f-264cec1dfa5f" returned: 0 in 0.636s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:41:40 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-e911874d-9850-4b44-be45-04762e3806f3 tempest-VolumesDeleteCascade-1450357542 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-13f64fbe-4e14-4a85-8bfe-2475fd9deabc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86212) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 22 15:41:40 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-e911874d-9850-4b44-be45-04762e3806f3 tempest-VolumesDeleteCascade-1450357542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-13f64fbe-4e14-4a85-8bfe-2475fd9deabc.275f486b-bf79-4f6b-9077-1f6c40157153 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:41:40 devstack sudo[92587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-13f64fbe-4e14-4a85-8bfe-2475fd9deabc.275f486b-bf79-4f6b-9077-1f6c40157153 Sep 22 15:41:40 devstack sudo[92587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:41:41 devstack sudo[92587]: pam_unix(sudo:session): session closed for user root Sep 22 15:41:41 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-e911874d-9850-4b44-be45-04762e3806f3 tempest-VolumesDeleteCascade-1450357542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-13f64fbe-4e14-4a85-8bfe-2475fd9deabc.275f486b-bf79-4f6b-9077-1f6c40157153" returned: 0 in 0.589s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:41:41 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-e911874d-9850-4b44-be45-04762e3806f3 tempest-VolumesDeleteCascade-1450357542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-13f64fbe-4e14-4a85-8bfe-2475fd9deabc.275f486b-bf79-4f6b-9077-1f6c40157153 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:41:41 devstack sudo[92600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-13f64fbe-4e14-4a85-8bfe-2475fd9deabc.275f486b-bf79-4f6b-9077-1f6c40157153 Sep 22 15:41:41 devstack sudo[92600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:41:41 devstack sudo[92600]: pam_unix(sudo:session): session closed for user root Sep 22 15:41:41 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-e911874d-9850-4b44-be45-04762e3806f3 tempest-VolumesDeleteCascade-1450357542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-13f64fbe-4e14-4a85-8bfe-2475fd9deabc.275f486b-bf79-4f6b-9077-1f6c40157153" returned: 0 in 0.644s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:41:41 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-e911874d-9850-4b44-be45-04762e3806f3 tempest-VolumesDeleteCascade-1450357542 None] Lock "cinder-quobyte-275f486b-bf79-4f6b-9077-1f6c40157153" released by "_delete_snapshot" :: held 2.586s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:41:41 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-e911874d-9850-4b44-be45-04762e3806f3 tempest-VolumesDeleteCascade-1450357542 None] Lock "cinder-quobyte-13f64fbe-4e14-4a85-8bfe-2475fd9deabc" released by "delete_snapshot" :: held 2.618s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:41:42 devstack cinder-volume[86212]: DEBUG cinder.quota [None req-e911874d-9850-4b44-be45-04762e3806f3 tempest-VolumesDeleteCascade-1450357542 None] Created reservations ['90493ab9-599a-40e8-9652-b47b820b3bcd', '4571650b-87b8-41a2-ac7c-13703641bbf6', 'c35d285d-9c02-497a-9275-93cf214313d4', 'b8a32770-1566-4cf7-ac09-10d8fc98176d'] {{(pid=86212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 15:41:42 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-e911874d-9850-4b44-be45-04762e3806f3 tempest-VolumesDeleteCascade-1450357542 None] Delete snapshot completed successfully. Sep 22 15:41:42 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-e911874d-9850-4b44-be45-04762e3806f3 tempest-VolumesDeleteCascade-1450357542 None] Lock "cinder-275f486b-bf79-4f6b-9077-1f6c40157153-delete_snapshot" released by "delete_snapshot" :: held 2.839s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:41:42 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-e911874d-9850-4b44-be45-04762e3806f3 tempest-VolumesDeleteCascade-1450357542 None] Acquiring lock "cinder-f8535130-adf6-4450-951f-264cec1dfa5f-delete_snapshot" by "delete_snapshot" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:41:42 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-e911874d-9850-4b44-be45-04762e3806f3 tempest-VolumesDeleteCascade-1450357542 None] Lock "cinder-f8535130-adf6-4450-951f-264cec1dfa5f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:41:42 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-e911874d-9850-4b44-be45-04762e3806f3 tempest-VolumesDeleteCascade-1450357542 None] Acquiring lock "cinder-quobyte-13f64fbe-4e14-4a85-8bfe-2475fd9deabc" by "delete_snapshot" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:41:42 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-e911874d-9850-4b44-be45-04762e3806f3 tempest-VolumesDeleteCascade-1450357542 None] Lock "cinder-quobyte-13f64fbe-4e14-4a85-8bfe-2475fd9deabc" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:41:42 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-e911874d-9850-4b44-be45-04762e3806f3 tempest-VolumesDeleteCascade-1450357542 None] Acquiring lock "cinder-quobyte-f8535130-adf6-4450-951f-264cec1dfa5f" by "_delete_snapshot" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:41:42 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-e911874d-9850-4b44-be45-04762e3806f3 tempest-VolumesDeleteCascade-1450357542 None] Lock "cinder-quobyte-f8535130-adf6-4450-951f-264cec1dfa5f" acquired by "_delete_snapshot" :: waited 0.055s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:41:42 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-e911874d-9850-4b44-be45-04762e3806f3 tempest-VolumesDeleteCascade-1450357542 None] Deleting offline snapshot f8535130-adf6-4450-951f-264cec1dfa5f of volume 13f64fbe-4e14-4a85-8bfe-2475fd9deabc {{(pid=86212) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 22 15:41:42 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-e911874d-9850-4b44-be45-04762e3806f3 tempest-VolumesDeleteCascade-1450357542 None] snapshot_file for this snap is: volume-13f64fbe-4e14-4a85-8bfe-2475fd9deabc.f8535130-adf6-4450-951f-264cec1dfa5f {{(pid=86212) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 22 15:41:42 devstack cinder-volume[86212]: INFO cinder.volume.manager [req-0f74fee2-1873-4753-8471-1687735f3407 req-20ae9c96-cd42-4958-a5a1-edf14f9c6164 tempest-AttachVolumeNegativeTest-382120543 None] Terminate volume connection completed successfully. Sep 22 15:41:42 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [req-0f74fee2-1873-4753-8471-1687735f3407 req-20ae9c96-cd42-4958-a5a1-edf14f9c6164 tempest-AttachVolumeNegativeTest-382120543 None] Deleting attachment f3498465-0927-4233-9478-a3328bbe0c80. {{(pid=86212) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 22 15:41:42 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[985b072f-6812-4e03-ba2d-d09981abe8a9]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:41:42 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-e911874d-9850-4b44-be45-04762e3806f3 tempest-VolumesDeleteCascade-1450357542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-13f64fbe-4e14-4a85-8bfe-2475fd9deabc.f8535130-adf6-4450-951f-264cec1dfa5f {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:41:42 devstack sudo[92625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-13f64fbe-4e14-4a85-8bfe-2475fd9deabc.f8535130-adf6-4450-951f-264cec1dfa5f Sep 22 15:41:42 devstack sudo[92625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:41:43 devstack sudo[92625]: pam_unix(sudo:session): session closed for user root Sep 22 15:41:43 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-e911874d-9850-4b44-be45-04762e3806f3 tempest-VolumesDeleteCascade-1450357542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-13f64fbe-4e14-4a85-8bfe-2475fd9deabc.f8535130-adf6-4450-951f-264cec1dfa5f" returned: 0 in 0.715s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:41:43 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-e911874d-9850-4b44-be45-04762e3806f3 tempest-VolumesDeleteCascade-1450357542 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-13f64fbe-4e14-4a85-8bfe-2475fd9deabc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86212) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 22 15:41:43 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb4ad5d3-eec6-4694-ac7b-01ae380e0371]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:41:43 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-e911874d-9850-4b44-be45-04762e3806f3 tempest-VolumesDeleteCascade-1450357542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-13f64fbe-4e14-4a85-8bfe-2475fd9deabc {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:41:43 devstack sudo[92635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-13f64fbe-4e14-4a85-8bfe-2475fd9deabc Sep 22 15:41:43 devstack sudo[92635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:41:43 devstack sudo[92635]: pam_unix(sudo:session): session closed for user root Sep 22 15:41:43 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-e911874d-9850-4b44-be45-04762e3806f3 tempest-VolumesDeleteCascade-1450357542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-13f64fbe-4e14-4a85-8bfe-2475fd9deabc" returned: 0 in 0.602s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:41:43 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-e911874d-9850-4b44-be45-04762e3806f3 tempest-VolumesDeleteCascade-1450357542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-13f64fbe-4e14-4a85-8bfe-2475fd9deabc.f8535130-adf6-4450-951f-264cec1dfa5f {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:41:43 devstack sudo[92651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-13f64fbe-4e14-4a85-8bfe-2475fd9deabc.f8535130-adf6-4450-951f-264cec1dfa5f Sep 22 15:41:43 devstack sudo[92651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:41:44 devstack cinder-volume[86212]: INFO cinder.volume.manager [req-590b2ee8-1fe3-465f-b387-f4c33efc46c9 req-c5cf069c-68e1-4c82-96c9-8d6f3feb8b58 tempest-ServerActionsTestOtherA-1816233839 None] Terminate volume connection completed successfully. Sep 22 15:41:44 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [req-590b2ee8-1fe3-465f-b387-f4c33efc46c9 req-c5cf069c-68e1-4c82-96c9-8d6f3feb8b58 tempest-ServerActionsTestOtherA-1816233839 None] Deleting attachment e05368e8-a0ec-4f95-93fb-13b7f6bbdff5. {{(pid=86212) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 22 15:41:44 devstack sudo[92651]: pam_unix(sudo:session): session closed for user root Sep 22 15:41:44 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-e911874d-9850-4b44-be45-04762e3806f3 tempest-VolumesDeleteCascade-1450357542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-13f64fbe-4e14-4a85-8bfe-2475fd9deabc.f8535130-adf6-4450-951f-264cec1dfa5f" returned: 0 in 0.834s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:41:44 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-e911874d-9850-4b44-be45-04762e3806f3 tempest-VolumesDeleteCascade-1450357542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-13f64fbe-4e14-4a85-8bfe-2475fd9deabc.f8535130-adf6-4450-951f-264cec1dfa5f {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:41:44 devstack sudo[92669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-13f64fbe-4e14-4a85-8bfe-2475fd9deabc.f8535130-adf6-4450-951f-264cec1dfa5f Sep 22 15:41:44 devstack sudo[92669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:41:44 devstack cinder-volume[86212]: DEBUG cinder.coordination [req-590b2ee8-1fe3-465f-b387-f4c33efc46c9 req-764c896f-7cfd-4ecf-ba5e-ec6a994b393f tempest-ServerActionsTestOtherA-1816233839 None] Acquiring lock "cinder-b34b3a9c-1fb7-420e-a501-1fb9425cc913-delete_volume" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:41:44 devstack cinder-volume[86212]: DEBUG cinder.coordination [req-590b2ee8-1fe3-465f-b387-f4c33efc46c9 req-764c896f-7cfd-4ecf-ba5e-ec6a994b393f tempest-ServerActionsTestOtherA-1816233839 None] Lock "cinder-b34b3a9c-1fb7-420e-a501-1fb9425cc913-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:41:44 devstack cinder-volume[86212]: DEBUG cinder.coordination [req-590b2ee8-1fe3-465f-b387-f4c33efc46c9 req-764c896f-7cfd-4ecf-ba5e-ec6a994b393f tempest-ServerActionsTestOtherA-1816233839 None] Acquiring lock "cinder-quobyte-b34b3a9c-1fb7-420e-a501-1fb9425cc913" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:41:44 devstack cinder-volume[86212]: DEBUG cinder.coordination [req-590b2ee8-1fe3-465f-b387-f4c33efc46c9 req-764c896f-7cfd-4ecf-ba5e-ec6a994b393f tempest-ServerActionsTestOtherA-1816233839 None] Lock "cinder-quobyte-b34b3a9c-1fb7-420e-a501-1fb9425cc913" acquired by "delete_volume" :: waited 0.036s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:41:44 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[0482eef3-6422-4967-bd48-2a14dd5596ae]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:41:44 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [req-590b2ee8-1fe3-465f-b387-f4c33efc46c9 req-764c896f-7cfd-4ecf-ba5e-ec6a994b393f tempest-ServerActionsTestOtherA-1816233839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b34b3a9c-1fb7-420e-a501-1fb9425cc913 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:41:45 devstack sudo[92669]: pam_unix(sudo:session): session closed for user root Sep 22 15:41:45 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-e911874d-9850-4b44-be45-04762e3806f3 tempest-VolumesDeleteCascade-1450357542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-13f64fbe-4e14-4a85-8bfe-2475fd9deabc.f8535130-adf6-4450-951f-264cec1dfa5f" returned: 0 in 0.485s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:41:45 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-e911874d-9850-4b44-be45-04762e3806f3 tempest-VolumesDeleteCascade-1450357542 None] Lock "cinder-quobyte-f8535130-adf6-4450-951f-264cec1dfa5f" released by "_delete_snapshot" :: held 2.838s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:41:45 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-e911874d-9850-4b44-be45-04762e3806f3 tempest-VolumesDeleteCascade-1450357542 None] Lock "cinder-quobyte-13f64fbe-4e14-4a85-8bfe-2475fd9deabc" released by "delete_snapshot" :: held 2.927s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:41:45 devstack sudo[92672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b34b3a9c-1fb7-420e-a501-1fb9425cc913 Sep 22 15:41:45 devstack sudo[92672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:41:45 devstack cinder-volume[86212]: DEBUG cinder.quota [None req-e911874d-9850-4b44-be45-04762e3806f3 tempest-VolumesDeleteCascade-1450357542 None] Created reservations ['65c75caa-c9f7-4f6e-9589-bae542d17b7c', 'fa97212d-1140-448f-af2e-9fde86faf1f1', '8c857810-bb3c-4941-bbd5-b6a48f5c081f', '539fc04f-00bd-4563-8424-ee16e814a5ad'] {{(pid=86212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 15:41:45 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-e911874d-9850-4b44-be45-04762e3806f3 tempest-VolumesDeleteCascade-1450357542 None] Delete snapshot completed successfully. Sep 22 15:41:45 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-e911874d-9850-4b44-be45-04762e3806f3 tempest-VolumesDeleteCascade-1450357542 None] Lock "cinder-f8535130-adf6-4450-951f-264cec1dfa5f-delete_snapshot" released by "delete_snapshot" :: held 3.456s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:41:45 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-e911874d-9850-4b44-be45-04762e3806f3 tempest-VolumesDeleteCascade-1450357542 None] Snapshots deleted, issuing volume delete {{(pid=86212) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 22 15:41:45 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-e911874d-9850-4b44-be45-04762e3806f3 tempest-VolumesDeleteCascade-1450357542 None] Acquiring lock "cinder-quobyte-13f64fbe-4e14-4a85-8bfe-2475fd9deabc" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:41:45 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-e911874d-9850-4b44-be45-04762e3806f3 tempest-VolumesDeleteCascade-1450357542 None] Lock "cinder-quobyte-13f64fbe-4e14-4a85-8bfe-2475fd9deabc" acquired by "delete_volume" :: waited 0.037s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:41:45 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a7bc817-e69f-4f4b-8c45-ccb06e72cc63]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:41:45 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-e911874d-9850-4b44-be45-04762e3806f3 tempest-VolumesDeleteCascade-1450357542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-13f64fbe-4e14-4a85-8bfe-2475fd9deabc {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:41:45 devstack sudo[92672]: pam_unix(sudo:session): session closed for user root Sep 22 15:41:45 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [req-590b2ee8-1fe3-465f-b387-f4c33efc46c9 req-764c896f-7cfd-4ecf-ba5e-ec6a994b393f tempest-ServerActionsTestOtherA-1816233839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b34b3a9c-1fb7-420e-a501-1fb9425cc913" returned: 0 in 0.926s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:41:45 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [req-590b2ee8-1fe3-465f-b387-f4c33efc46c9 req-764c896f-7cfd-4ecf-ba5e-ec6a994b393f tempest-ServerActionsTestOtherA-1816233839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b34b3a9c-1fb7-420e-a501-1fb9425cc913 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:41:45 devstack sudo[92679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b34b3a9c-1fb7-420e-a501-1fb9425cc913 Sep 22 15:41:45 devstack sudo[92679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:41:46 devstack sudo[92677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-13f64fbe-4e14-4a85-8bfe-2475fd9deabc Sep 22 15:41:46 devstack sudo[92677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:41:46 devstack sudo[92679]: pam_unix(sudo:session): session closed for user root Sep 22 15:41:46 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [req-590b2ee8-1fe3-465f-b387-f4c33efc46c9 req-764c896f-7cfd-4ecf-ba5e-ec6a994b393f tempest-ServerActionsTestOtherA-1816233839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b34b3a9c-1fb7-420e-a501-1fb9425cc913" returned: 0 in 0.371s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:41:46 devstack cinder-volume[86212]: DEBUG cinder.coordination [req-590b2ee8-1fe3-465f-b387-f4c33efc46c9 req-764c896f-7cfd-4ecf-ba5e-ec6a994b393f tempest-ServerActionsTestOtherA-1816233839 None] Lock "cinder-quobyte-b34b3a9c-1fb7-420e-a501-1fb9425cc913" released by "delete_volume" :: held 1.384s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:41:46 devstack cinder-volume[86212]: DEBUG cinder.quota [req-590b2ee8-1fe3-465f-b387-f4c33efc46c9 req-764c896f-7cfd-4ecf-ba5e-ec6a994b393f tempest-ServerActionsTestOtherA-1816233839 None] Created reservations ['58aea45a-22f5-4e38-9634-e53f8cf98e3d', '0a4e11fe-ed92-4687-ac8c-e9ae022feea1', 'd73bb00f-802b-4926-a988-79c9eb8f207f', 'd9373ff6-b975-468b-a3dc-c9334627e904'] {{(pid=86212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 15:41:46 devstack sudo[92677]: pam_unix(sudo:session): session closed for user root Sep 22 15:41:46 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-e911874d-9850-4b44-be45-04762e3806f3 tempest-VolumesDeleteCascade-1450357542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-13f64fbe-4e14-4a85-8bfe-2475fd9deabc" returned: 0 in 0.728s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:41:46 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-e911874d-9850-4b44-be45-04762e3806f3 tempest-VolumesDeleteCascade-1450357542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-13f64fbe-4e14-4a85-8bfe-2475fd9deabc {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:41:46 devstack sudo[92687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-13f64fbe-4e14-4a85-8bfe-2475fd9deabc Sep 22 15:41:46 devstack sudo[92687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:41:46 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [req-590b2ee8-1fe3-465f-b387-f4c33efc46c9 req-764c896f-7cfd-4ecf-ba5e-ec6a994b393f tempest-ServerActionsTestOtherA-1816233839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:41:46 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [req-590b2ee8-1fe3-465f-b387-f4c33efc46c9 req-764c896f-7cfd-4ecf-ba5e-ec6a994b393f tempest-ServerActionsTestOtherA-1816233839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:41:46 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [req-590b2ee8-1fe3-465f-b387-f4c33efc46c9 req-764c896f-7cfd-4ecf-ba5e-ec6a994b393f tempest-ServerActionsTestOtherA-1816233839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:41:46 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [req-590b2ee8-1fe3-465f-b387-f4c33efc46c9 req-764c896f-7cfd-4ecf-ba5e-ec6a994b393f tempest-ServerActionsTestOtherA-1816233839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:41:46 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [req-590b2ee8-1fe3-465f-b387-f4c33efc46c9 req-764c896f-7cfd-4ecf-ba5e-ec6a994b393f tempest-ServerActionsTestOtherA-1816233839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:41:46 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [req-590b2ee8-1fe3-465f-b387-f4c33efc46c9 req-764c896f-7cfd-4ecf-ba5e-ec6a994b393f tempest-ServerActionsTestOtherA-1816233839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:41:46 devstack sudo[92689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc Sep 22 15:41:46 devstack sudo[92689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:41:46 devstack sudo[92689]: pam_unix(sudo:session): session closed for user root Sep 22 15:41:46 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [req-590b2ee8-1fe3-465f-b387-f4c33efc46c9 req-764c896f-7cfd-4ecf-ba5e-ec6a994b393f tempest-ServerActionsTestOtherA-1816233839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc" returned: 0 in 0.353s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:41:46 devstack cinder-volume[86212]: DEBUG cinder.manager [req-590b2ee8-1fe3-465f-b387-f4c33efc46c9 req-764c896f-7cfd-4ecf-ba5e-ec6a994b393f tempest-ServerActionsTestOtherA-1816233839 None] Notifying Schedulers of capabilities ... {{(pid=86212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 15:41:46 devstack cinder-volume[86212]: INFO cinder.volume.manager [req-590b2ee8-1fe3-465f-b387-f4c33efc46c9 req-764c896f-7cfd-4ecf-ba5e-ec6a994b393f tempest-ServerActionsTestOtherA-1816233839 None] Deleted volume successfully. Sep 22 15:41:46 devstack sudo[92687]: pam_unix(sudo:session): session closed for user root Sep 22 15:41:46 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-e911874d-9850-4b44-be45-04762e3806f3 tempest-VolumesDeleteCascade-1450357542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-13f64fbe-4e14-4a85-8bfe-2475fd9deabc" returned: 0 in 0.471s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:41:46 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-e911874d-9850-4b44-be45-04762e3806f3 tempest-VolumesDeleteCascade-1450357542 None] Lock "cinder-quobyte-13f64fbe-4e14-4a85-8bfe-2475fd9deabc" released by "delete_volume" :: held 1.338s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:41:47 devstack cinder-volume[86212]: DEBUG cinder.coordination [req-590b2ee8-1fe3-465f-b387-f4c33efc46c9 req-764c896f-7cfd-4ecf-ba5e-ec6a994b393f tempest-ServerActionsTestOtherA-1816233839 None] Lock "cinder-b34b3a9c-1fb7-420e-a501-1fb9425cc913-delete_volume" released by "delete_volume" :: held 2.286s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:41:47 devstack cinder-volume[86212]: DEBUG cinder.quota [None req-e911874d-9850-4b44-be45-04762e3806f3 tempest-VolumesDeleteCascade-1450357542 None] Created reservations ['d5371556-adea-4784-864e-a99ff9f61186', '8fbcddc4-f0b1-4324-b8fd-17f0bacea7fe', '7a32b3e8-7845-46fb-8525-0a08b03d1932', '50519257-75e5-4bb6-83ae-0b80a4e2d4b7'] {{(pid=86212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 15:41:47 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-e911874d-9850-4b44-be45-04762e3806f3 tempest-VolumesDeleteCascade-1450357542 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:41:47 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-e911874d-9850-4b44-be45-04762e3806f3 tempest-VolumesDeleteCascade-1450357542 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:41:47 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-e911874d-9850-4b44-be45-04762e3806f3 tempest-VolumesDeleteCascade-1450357542 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:41:47 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-e911874d-9850-4b44-be45-04762e3806f3 tempest-VolumesDeleteCascade-1450357542 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:41:47 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-e911874d-9850-4b44-be45-04762e3806f3 tempest-VolumesDeleteCascade-1450357542 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:41:47 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-e911874d-9850-4b44-be45-04762e3806f3 tempest-VolumesDeleteCascade-1450357542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:41:47 devstack sudo[92695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc Sep 22 15:41:47 devstack sudo[92695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:41:47 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-3dd36e29-9672-47f4-9858-987a0182360e tempest-ServerActionsTestOtherA-1816233839 None] Acquiring lock "cinder-34a55037-d1d2-4edd-8350-32536e5cd337-delete_volume" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:41:47 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-3dd36e29-9672-47f4-9858-987a0182360e tempest-ServerActionsTestOtherA-1816233839 None] Lock "cinder-34a55037-d1d2-4edd-8350-32536e5cd337-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:41:47 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-3dd36e29-9672-47f4-9858-987a0182360e tempest-ServerActionsTestOtherA-1816233839 None] Acquiring lock "cinder-quobyte-34a55037-d1d2-4edd-8350-32536e5cd337" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:41:47 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-3dd36e29-9672-47f4-9858-987a0182360e tempest-ServerActionsTestOtherA-1816233839 None] Lock "cinder-quobyte-34a55037-d1d2-4edd-8350-32536e5cd337" acquired by "delete_volume" :: waited 0.047s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:41:47 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcf823e3-f1bf-48bb-a7e8-b179eee36b2a]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:41:47 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-3dd36e29-9672-47f4-9858-987a0182360e tempest-ServerActionsTestOtherA-1816233839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-34a55037-d1d2-4edd-8350-32536e5cd337 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:41:47 devstack sudo[92695]: pam_unix(sudo:session): session closed for user root Sep 22 15:41:47 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-e911874d-9850-4b44-be45-04762e3806f3 tempest-VolumesDeleteCascade-1450357542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc" returned: 0 in 0.508s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:41:47 devstack cinder-volume[86212]: DEBUG cinder.manager [None req-e911874d-9850-4b44-be45-04762e3806f3 tempest-VolumesDeleteCascade-1450357542 None] Notifying Schedulers of capabilities ... {{(pid=86212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 15:41:47 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-e911874d-9850-4b44-be45-04762e3806f3 tempest-VolumesDeleteCascade-1450357542 None] Deleted volume successfully. Sep 22 15:41:47 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-e911874d-9850-4b44-be45-04762e3806f3 tempest-VolumesDeleteCascade-1450357542 None] Lock "cinder-13f64fbe-4e14-4a85-8bfe-2475fd9deabc-delete_volume" released by "delete_volume" :: held 8.666s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:41:47 devstack sudo[92697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-34a55037-d1d2-4edd-8350-32536e5cd337 Sep 22 15:41:47 devstack sudo[92697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:41:48 devstack sudo[92697]: pam_unix(sudo:session): session closed for user root Sep 22 15:41:48 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-3dd36e29-9672-47f4-9858-987a0182360e tempest-ServerActionsTestOtherA-1816233839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-34a55037-d1d2-4edd-8350-32536e5cd337" returned: 0 in 0.608s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:41:48 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-3dd36e29-9672-47f4-9858-987a0182360e tempest-ServerActionsTestOtherA-1816233839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-34a55037-d1d2-4edd-8350-32536e5cd337 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:41:48 devstack sudo[92703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-34a55037-d1d2-4edd-8350-32536e5cd337 Sep 22 15:41:48 devstack sudo[92703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:41:48 devstack cinder-volume[86212]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4c98dc5-dbec-418e-96c3-48c0ccc40db0 tempest-VolumesDeleteCascade-1450357542 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 15:41:48 devstack sudo[92703]: pam_unix(sudo:session): session closed for user root Sep 22 15:41:48 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-e4c98dc5-dbec-418e-96c3-48c0ccc40db0 tempest-VolumesDeleteCascade-1450357542 None] Flow 'volume_create_manager' (b7dbb247-f0a5-404a-a7d4-2b3c6f75bc8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:41:48 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-e4c98dc5-dbec-418e-96c3-48c0ccc40db0 tempest-VolumesDeleteCascade-1450357542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0192359f-12c2-4311-bed4-4c7b5a5570ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:41:48 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-3dd36e29-9672-47f4-9858-987a0182360e tempest-ServerActionsTestOtherA-1816233839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-34a55037-d1d2-4edd-8350-32536e5cd337" returned: 0 in 0.576s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:41:48 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-e4c98dc5-dbec-418e-96c3-48c0ccc40db0 tempest-VolumesDeleteCascade-1450357542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0192359f-12c2-4311-bed4-4c7b5a5570ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:41:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-43619033',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b48edaf-c133-416a-9f49-bcb83416a009,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df9442c87b5e4dbf9a29b0dc9956f68d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:41:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:41:49Z,use_quota=True,user_id='96b87f8d32ad4e72b45f2b231469edae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:41:48 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-e4c98dc5-dbec-418e-96c3-48c0ccc40db0 tempest-VolumesDeleteCascade-1450357542 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (630070af-094e-450f-be0e-4748bb95e03e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:41:48 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-e4c98dc5-dbec-418e-96c3-48c0ccc40db0 tempest-VolumesDeleteCascade-1450357542 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (630070af-094e-450f-be0e-4748bb95e03e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:41:48 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-e4c98dc5-dbec-418e-96c3-48c0ccc40db0 tempest-VolumesDeleteCascade-1450357542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ee5dce8-8172-4525-ae2d-91a055f83806) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:41:48 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-e4c98dc5-dbec-418e-96c3-48c0ccc40db0 tempest-VolumesDeleteCascade-1450357542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ee5dce8-8172-4525-ae2d-91a055f83806) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1b48edaf-c133-416a-9f49-bcb83416a009', 'volume_name': 'volume-1b48edaf-c133-416a-9f49-bcb83416a009', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:41:48 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-e4c98dc5-dbec-418e-96c3-48c0ccc40db0 tempest-VolumesDeleteCascade-1450357542 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd4a32dd-e031-41e2-a777-89629907392d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:41:48 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-e4c98dc5-dbec-418e-96c3-48c0ccc40db0 tempest-VolumesDeleteCascade-1450357542 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd4a32dd-e031-41e2-a777-89629907392d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:41:48 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-e4c98dc5-dbec-418e-96c3-48c0ccc40db0 tempest-VolumesDeleteCascade-1450357542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ebac8cf-4bab-416d-b1bc-f9068b61af11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:41:48 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-e4c98dc5-dbec-418e-96c3-48c0ccc40db0 tempest-VolumesDeleteCascade-1450357542 None] Volume 1b48edaf-c133-416a-9f49-bcb83416a009: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1b48edaf-c133-416a-9f49-bcb83416a009', 'volume_size': 1} Sep 22 15:41:48 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-e4c98dc5-dbec-418e-96c3-48c0ccc40db0 tempest-VolumesDeleteCascade-1450357542 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:41:48 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-e4c98dc5-dbec-418e-96c3-48c0ccc40db0 tempest-VolumesDeleteCascade-1450357542 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:41:48 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-e4c98dc5-dbec-418e-96c3-48c0ccc40db0 tempest-VolumesDeleteCascade-1450357542 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:41:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-43619033',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b48edaf-c133-416a-9f49-bcb83416a009,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df9442c87b5e4dbf9a29b0dc9956f68d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:41:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:41:49Z,use_quota=True,user_id='96b87f8d32ad4e72b45f2b231469edae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)}" {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 15:41:48 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-e4c98dc5-dbec-418e-96c3-48c0ccc40db0 tempest-VolumesDeleteCascade-1450357542 None] Creating volume 1b48edaf-c133-416a-9f49-bcb83416a009 {{(pid=86212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 15:41:48 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-e4c98dc5-dbec-418e-96c3-48c0ccc40db0 tempest-VolumesDeleteCascade-1450357542 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:41:48 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-e4c98dc5-dbec-418e-96c3-48c0ccc40db0 tempest-VolumesDeleteCascade-1450357542 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:41:48 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-e4c98dc5-dbec-418e-96c3-48c0ccc40db0 tempest-VolumesDeleteCascade-1450357542 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:41:48 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-e4c98dc5-dbec-418e-96c3-48c0ccc40db0 tempest-VolumesDeleteCascade-1450357542 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:41:48 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-e4c98dc5-dbec-418e-96c3-48c0ccc40db0 tempest-VolumesDeleteCascade-1450357542 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:41:48 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-e4c98dc5-dbec-418e-96c3-48c0ccc40db0 tempest-VolumesDeleteCascade-1450357542 None] Selected osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 as target Quobyte volume. {{(pid=86212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 15:41:48 devstack cinder-volume[86212]: INFO cinder.volume.drivers.remotefs [None req-e4c98dc5-dbec-418e-96c3-48c0ccc40db0 tempest-VolumesDeleteCascade-1450357542 None] casted to osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 Sep 22 15:41:48 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-e4c98dc5-dbec-418e-96c3-48c0ccc40db0 tempest-VolumesDeleteCascade-1450357542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-1b48edaf-c133-416a-9f49-bcb83416a009 1073741824 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:41:48 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-3dd36e29-9672-47f4-9858-987a0182360e tempest-ServerActionsTestOtherA-1816233839 None] Lock "cinder-quobyte-34a55037-d1d2-4edd-8350-32536e5cd337" released by "delete_volume" :: held 1.355s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:41:48 devstack sudo[92706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-1b48edaf-c133-416a-9f49-bcb83416a009 1073741824 Sep 22 15:41:48 devstack sudo[92706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:41:49 devstack cinder-volume[86212]: DEBUG cinder.quota [None req-3dd36e29-9672-47f4-9858-987a0182360e tempest-ServerActionsTestOtherA-1816233839 None] Created reservations ['33354a3e-da5b-4e54-ae6a-3ca72ad669e4', 'f4958f04-ecc7-4d51-bd75-d0eb7accae63', '960ef39f-438f-4f49-b33f-54ac25b45a69', '06a3f61f-61d4-4862-aad3-0322c5f16feb'] {{(pid=86212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 15:41:49 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-3dd36e29-9672-47f4-9858-987a0182360e tempest-ServerActionsTestOtherA-1816233839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:41:49 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-3dd36e29-9672-47f4-9858-987a0182360e tempest-ServerActionsTestOtherA-1816233839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:41:49 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-3dd36e29-9672-47f4-9858-987a0182360e tempest-ServerActionsTestOtherA-1816233839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:41:49 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-3dd36e29-9672-47f4-9858-987a0182360e tempest-ServerActionsTestOtherA-1816233839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:41:49 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-3dd36e29-9672-47f4-9858-987a0182360e tempest-ServerActionsTestOtherA-1816233839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:41:49 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-3dd36e29-9672-47f4-9858-987a0182360e tempest-ServerActionsTestOtherA-1816233839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:41:49 devstack sudo[92709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc Sep 22 15:41:49 devstack sudo[92709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:41:49 devstack sudo[92709]: pam_unix(sudo:session): session closed for user root Sep 22 15:41:49 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-3dd36e29-9672-47f4-9858-987a0182360e tempest-ServerActionsTestOtherA-1816233839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc" returned: 0 in 0.329s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:41:49 devstack cinder-volume[86212]: DEBUG cinder.manager [None req-3dd36e29-9672-47f4-9858-987a0182360e tempest-ServerActionsTestOtherA-1816233839 None] Notifying Schedulers of capabilities ... {{(pid=86212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 15:41:49 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-3dd36e29-9672-47f4-9858-987a0182360e tempest-ServerActionsTestOtherA-1816233839 None] Deleted volume successfully. Sep 22 15:41:49 devstack sudo[92706]: pam_unix(sudo:session): session closed for user root Sep 22 15:41:49 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-e4c98dc5-dbec-418e-96c3-48c0ccc40db0 tempest-VolumesDeleteCascade-1450357542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-1b48edaf-c133-416a-9f49-bcb83416a009 1073741824" returned: 0 in 0.623s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:41:49 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-3dd36e29-9672-47f4-9858-987a0182360e tempest-ServerActionsTestOtherA-1816233839 None] Lock "cinder-34a55037-d1d2-4edd-8350-32536e5cd337-delete_volume" released by "delete_volume" :: held 2.153s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:41:49 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-e4c98dc5-dbec-418e-96c3-48c0ccc40db0 tempest-VolumesDeleteCascade-1450357542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-1b48edaf-c133-416a-9f49-bcb83416a009 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:41:49 devstack sudo[92716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-1b48edaf-c133-416a-9f49-bcb83416a009 Sep 22 15:41:49 devstack sudo[92716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:41:49 devstack sudo[92716]: pam_unix(sudo:session): session closed for user root Sep 22 15:41:49 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-e4c98dc5-dbec-418e-96c3-48c0ccc40db0 tempest-VolumesDeleteCascade-1450357542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-1b48edaf-c133-416a-9f49-bcb83416a009" returned: 0 in 0.372s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:41:49 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-e4c98dc5-dbec-418e-96c3-48c0ccc40db0 tempest-VolumesDeleteCascade-1450357542 None] <== create_volume: return (1062ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'} {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 15:41:49 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-e4c98dc5-dbec-418e-96c3-48c0ccc40db0 tempest-VolumesDeleteCascade-1450357542 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.065s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:41:49 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-e4c98dc5-dbec-418e-96c3-48c0ccc40db0 tempest-VolumesDeleteCascade-1450357542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ebac8cf-4bab-416d-b1bc-f9068b61af11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b48edaf-c133-416a-9f49-bcb83416a009', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:41:50 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-e4c98dc5-dbec-418e-96c3-48c0ccc40db0 tempest-VolumesDeleteCascade-1450357542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fcaa65d5-814d-47dd-a8d2-22a9a8f39597) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:41:50 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-e4c98dc5-dbec-418e-96c3-48c0ccc40db0 tempest-VolumesDeleteCascade-1450357542 None] Volume volume-1b48edaf-c133-416a-9f49-bcb83416a009 (1b48edaf-c133-416a-9f49-bcb83416a009): created successfully Sep 22 15:41:50 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-e4c98dc5-dbec-418e-96c3-48c0ccc40db0 tempest-VolumesDeleteCascade-1450357542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fcaa65d5-814d-47dd-a8d2-22a9a8f39597) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:41:50 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-e4c98dc5-dbec-418e-96c3-48c0ccc40db0 tempest-VolumesDeleteCascade-1450357542 None] Flow 'volume_create_manager' (b7dbb247-f0a5-404a-a7d4-2b3c6f75bc8d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:41:50 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-e4c98dc5-dbec-418e-96c3-48c0ccc40db0 tempest-VolumesDeleteCascade-1450357542 None] Created volume successfully. Sep 22 15:41:51 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-08070d59-e865-4f63-bcfa-feb400d4361a tempest-VolumesDeleteCascade-1450357542 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:41:51 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-08070d59-e865-4f63-bcfa-feb400d4361a tempest-VolumesDeleteCascade-1450357542 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:41:51 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-08070d59-e865-4f63-bcfa-feb400d4361a tempest-VolumesDeleteCascade-1450357542 None] Creating offline snapshot d8d9559e-fe27-4b2d-a13c-52309eafb82e of volume 1b48edaf-c133-416a-9f49-bcb83416a009 {{(pid=86212) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 22 15:41:51 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[b07e2725-9199-4db4-a45a-5d3db1fe342b]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:41:51 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-08070d59-e865-4f63-bcfa-feb400d4361a tempest-VolumesDeleteCascade-1450357542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-1b48edaf-c133-416a-9f49-bcb83416a009 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:41:51 devstack sudo[92751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-1b48edaf-c133-416a-9f49-bcb83416a009 Sep 22 15:41:51 devstack sudo[92751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:41:51 devstack sudo[92751]: pam_unix(sudo:session): session closed for user root Sep 22 15:41:51 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-08070d59-e865-4f63-bcfa-feb400d4361a tempest-VolumesDeleteCascade-1450357542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-1b48edaf-c133-416a-9f49-bcb83416a009" returned: 0 in 0.623s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:41:51 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-08070d59-e865-4f63-bcfa-feb400d4361a tempest-VolumesDeleteCascade-1450357542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-1b48edaf-c133-416a-9f49-bcb83416a009,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-1b48edaf-c133-416a-9f49-bcb83416a009.d8d9559e-fe27-4b2d-a13c-52309eafb82e 1G {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:41:51 devstack sudo[92758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-1b48edaf-c133-416a-9f49-bcb83416a009,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-1b48edaf-c133-416a-9f49-bcb83416a009.d8d9559e-fe27-4b2d-a13c-52309eafb82e 1G Sep 22 15:41:51 devstack sudo[92758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:41:52 devstack sudo[92758]: pam_unix(sudo:session): session closed for user root Sep 22 15:41:52 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-08070d59-e865-4f63-bcfa-feb400d4361a tempest-VolumesDeleteCascade-1450357542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-1b48edaf-c133-416a-9f49-bcb83416a009,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-1b48edaf-c133-416a-9f49-bcb83416a009.d8d9559e-fe27-4b2d-a13c-52309eafb82e 1G" returned: 0 in 0.535s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:41:52 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-08070d59-e865-4f63-bcfa-feb400d4361a tempest-VolumesDeleteCascade-1450357542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b48edaf-c133-416a-9f49-bcb83416a009 -F qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-1b48edaf-c133-416a-9f49-bcb83416a009.d8d9559e-fe27-4b2d-a13c-52309eafb82e {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:41:52 devstack sudo[92764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b48edaf-c133-416a-9f49-bcb83416a009 -F qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-1b48edaf-c133-416a-9f49-bcb83416a009.d8d9559e-fe27-4b2d-a13c-52309eafb82e Sep 22 15:41:52 devstack sudo[92764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:41:52 devstack sudo[92764]: pam_unix(sudo:session): session closed for user root Sep 22 15:41:52 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-08070d59-e865-4f63-bcfa-feb400d4361a tempest-VolumesDeleteCascade-1450357542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b48edaf-c133-416a-9f49-bcb83416a009 -F qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-1b48edaf-c133-416a-9f49-bcb83416a009.d8d9559e-fe27-4b2d-a13c-52309eafb82e" returned: 0 in 0.332s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:41:52 devstack cinder-volume[86212]: WARNING cinder.volume.drivers.remotefs [None req-08070d59-e865-4f63-bcfa-feb400d4361a tempest-VolumesDeleteCascade-1450357542 None] /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-1b48edaf-c133-416a-9f49-bcb83416a009.d8d9559e-fe27-4b2d-a13c-52309eafb82e is being set with open permissions: ugo+rw Sep 22 15:41:52 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-08070d59-e865-4f63-bcfa-feb400d4361a tempest-VolumesDeleteCascade-1450357542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-1b48edaf-c133-416a-9f49-bcb83416a009.d8d9559e-fe27-4b2d-a13c-52309eafb82e {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:41:52 devstack sudo[92769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-1b48edaf-c133-416a-9f49-bcb83416a009.d8d9559e-fe27-4b2d-a13c-52309eafb82e Sep 22 15:41:52 devstack sudo[92769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:41:52 devstack sudo[92769]: pam_unix(sudo:session): session closed for user root Sep 22 15:41:52 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-08070d59-e865-4f63-bcfa-feb400d4361a tempest-VolumesDeleteCascade-1450357542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-1b48edaf-c133-416a-9f49-bcb83416a009.d8d9559e-fe27-4b2d-a13c-52309eafb82e" returned: 0 in 0.291s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:41:53 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-08070d59-e865-4f63-bcfa-feb400d4361a tempest-VolumesDeleteCascade-1450357542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-1b48edaf-c133-416a-9f49-bcb83416a009.info {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:41:53 devstack sudo[92772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-1b48edaf-c133-416a-9f49-bcb83416a009.info Sep 22 15:41:53 devstack sudo[92772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:41:53 devstack sudo[92772]: pam_unix(sudo:session): session closed for user root Sep 22 15:41:53 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-08070d59-e865-4f63-bcfa-feb400d4361a tempest-VolumesDeleteCascade-1450357542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-1b48edaf-c133-416a-9f49-bcb83416a009.info" returned: 0 in 0.355s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:41:53 devstack cinder-volume[86212]: WARNING cinder.volume.drivers.remotefs [None req-08070d59-e865-4f63-bcfa-feb400d4361a tempest-VolumesDeleteCascade-1450357542 None] /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-1b48edaf-c133-416a-9f49-bcb83416a009.info is being set with open permissions: ugo+rw Sep 22 15:41:53 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-08070d59-e865-4f63-bcfa-feb400d4361a tempest-VolumesDeleteCascade-1450357542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-1b48edaf-c133-416a-9f49-bcb83416a009.info {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:41:53 devstack sudo[92775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-1b48edaf-c133-416a-9f49-bcb83416a009.info Sep 22 15:41:53 devstack sudo[92775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:41:53 devstack sudo[92775]: pam_unix(sudo:session): session closed for user root Sep 22 15:41:53 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-08070d59-e865-4f63-bcfa-feb400d4361a tempest-VolumesDeleteCascade-1450357542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-1b48edaf-c133-416a-9f49-bcb83416a009.info" returned: 0 in 0.318s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:41:53 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-08070d59-e865-4f63-bcfa-feb400d4361a tempest-VolumesDeleteCascade-1450357542 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.596s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:41:53 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-08070d59-e865-4f63-bcfa-feb400d4361a tempest-VolumesDeleteCascade-1450357542 None] Create snapshot completed successfully Sep 22 15:41:54 devstack cinder-volume[86212]: DEBUG cinder.volume.flows.manager.create_volume [None req-f92359d4-da3a-4f42-be45-bbd55c14faf4 tempest-VolumesDeleteCascade-1450357542 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 15:41:55 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-f92359d4-da3a-4f42-be45-bbd55c14faf4 tempest-VolumesDeleteCascade-1450357542 None] Flow 'volume_create_manager' (b8fa5397-37c8-437a-9b86-b6964025657c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:41:55 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-f92359d4-da3a-4f42-be45-bbd55c14faf4 tempest-VolumesDeleteCascade-1450357542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31377676-c466-4298-9a52-0adc86bfc678) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:41:55 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-f92359d4-da3a-4f42-be45-bbd55c14faf4 tempest-VolumesDeleteCascade-1450357542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31377676-c466-4298-9a52-0adc86bfc678) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:41:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1757834433',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d06b7b02-f3dd-41c0-bae2-491b95c8fe16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df9442c87b5e4dbf9a29b0dc9956f68d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:41:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=d8d9559e-fe27-4b2d-a13c-52309eafb82e,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:41:55Z,use_quota=True,user_id='96b87f8d32ad4e72b45f2b231469edae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:41:55 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-f92359d4-da3a-4f42-be45-bbd55c14faf4 tempest-VolumesDeleteCascade-1450357542 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60344d4f-1752-4eb5-8fc4-7fa6b6148e10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:41:55 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-f92359d4-da3a-4f42-be45-bbd55c14faf4 tempest-VolumesDeleteCascade-1450357542 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60344d4f-1752-4eb5-8fc4-7fa6b6148e10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:41:55 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-f92359d4-da3a-4f42-be45-bbd55c14faf4 tempest-VolumesDeleteCascade-1450357542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d97d79a7-dd0e-4f0a-8f86-0e8e6a4b8c95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:41:55 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-f92359d4-da3a-4f42-be45-bbd55c14faf4 tempest-VolumesDeleteCascade-1450357542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d97d79a7-dd0e-4f0a-8f86-0e8e6a4b8c95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'd06b7b02-f3dd-41c0-bae2-491b95c8fe16', 'volume_name': 'volume-d06b7b02-f3dd-41c0-bae2-491b95c8fe16', 'volume_size': 1, 'snapshot_id': 'd8d9559e-fe27-4b2d-a13c-52309eafb82e'}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:41:55 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-f92359d4-da3a-4f42-be45-bbd55c14faf4 tempest-VolumesDeleteCascade-1450357542 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c3e3c89-7525-4cd1-8c3b-4bfdfbe096db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:41:55 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-f92359d4-da3a-4f42-be45-bbd55c14faf4 tempest-VolumesDeleteCascade-1450357542 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c3e3c89-7525-4cd1-8c3b-4bfdfbe096db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:41:55 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-f92359d4-da3a-4f42-be45-bbd55c14faf4 tempest-VolumesDeleteCascade-1450357542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65e069a1-3348-4f3a-92a7-8fc9e69f5faa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:41:55 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-f92359d4-da3a-4f42-be45-bbd55c14faf4 tempest-VolumesDeleteCascade-1450357542 None] Volume d06b7b02-f3dd-41c0-bae2-491b95c8fe16: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-d06b7b02-f3dd-41c0-bae2-491b95c8fe16', 'volume_size': 1, 'snapshot_id': 'd8d9559e-fe27-4b2d-a13c-52309eafb82e'} Sep 22 15:41:55 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-f92359d4-da3a-4f42-be45-bbd55c14faf4 tempest-VolumesDeleteCascade-1450357542 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:41:55 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-f92359d4-da3a-4f42-be45-bbd55c14faf4 tempest-VolumesDeleteCascade-1450357542 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:41:55 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-f92359d4-da3a-4f42-be45-bbd55c14faf4 tempest-VolumesDeleteCascade-1450357542 None] Acquiring lock "cinder-quobyte-d8d9559e-fe27-4b2d-a13c-52309eafb82e-d06b7b02-f3dd-41c0-bae2-491b95c8fe16" by "_create_volume_from_snapshot" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:41:55 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-f92359d4-da3a-4f42-be45-bbd55c14faf4 tempest-VolumesDeleteCascade-1450357542 None] Lock "cinder-quobyte-d8d9559e-fe27-4b2d-a13c-52309eafb82e-d06b7b02-f3dd-41c0-bae2-491b95c8fe16" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:41:55 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-f92359d4-da3a-4f42-be45-bbd55c14faf4 tempest-VolumesDeleteCascade-1450357542 None] Creating volume d06b7b02-f3dd-41c0-bae2-491b95c8fe16 from snapshot d8d9559e-fe27-4b2d-a13c-52309eafb82e {{(pid=86212) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 22 15:41:55 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-f92359d4-da3a-4f42-be45-bbd55c14faf4 tempest-VolumesDeleteCascade-1450357542 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:41:55 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-f92359d4-da3a-4f42-be45-bbd55c14faf4 tempest-VolumesDeleteCascade-1450357542 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:41:55 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-f92359d4-da3a-4f42-be45-bbd55c14faf4 tempest-VolumesDeleteCascade-1450357542 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:41:55 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-f92359d4-da3a-4f42-be45-bbd55c14faf4 tempest-VolumesDeleteCascade-1450357542 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:41:55 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-f92359d4-da3a-4f42-be45-bbd55c14faf4 tempest-VolumesDeleteCascade-1450357542 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:41:55 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-f92359d4-da3a-4f42-be45-bbd55c14faf4 tempest-VolumesDeleteCascade-1450357542 None] Selected osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 as target Quobyte volume. {{(pid=86212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 15:41:55 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-f92359d4-da3a-4f42-be45-bbd55c14faf4 tempest-VolumesDeleteCascade-1450357542 None] Acquiring lock "cinder-quobyte-d06b7b02-f3dd-41c0-bae2-491b95c8fe16" by "_copy_volume_from_snapshot" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:41:55 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-f92359d4-da3a-4f42-be45-bbd55c14faf4 tempest-VolumesDeleteCascade-1450357542 None] Lock "cinder-quobyte-d06b7b02-f3dd-41c0-bae2-491b95c8fe16" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:41:55 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-f92359d4-da3a-4f42-be45-bbd55c14faf4 tempest-VolumesDeleteCascade-1450357542 None] snapshot: d8d9559e-fe27-4b2d-a13c-52309eafb82e, volume: d06b7b02-f3dd-41c0-bae2-491b95c8fe16, {{(pid=86212) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 22 15:41:55 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-f92359d4-da3a-4f42-be45-bbd55c14faf4 tempest-VolumesDeleteCascade-1450357542 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:41:55 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-f92359d4-da3a-4f42-be45-bbd55c14faf4 tempest-VolumesDeleteCascade-1450357542 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:41:55 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-f92359d4-da3a-4f42-be45-bbd55c14faf4 tempest-VolumesDeleteCascade-1450357542 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:41:55 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-f92359d4-da3a-4f42-be45-bbd55c14faf4 tempest-VolumesDeleteCascade-1450357542 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:41:55 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-f92359d4-da3a-4f42-be45-bbd55c14faf4 tempest-VolumesDeleteCascade-1450357542 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:41:55 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6428066-acfb-4e31-9cc8-e147b56e34a0]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:41:55 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-f92359d4-da3a-4f42-be45-bbd55c14faf4 tempest-VolumesDeleteCascade-1450357542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-1b48edaf-c133-416a-9f49-bcb83416a009.d8d9559e-fe27-4b2d-a13c-52309eafb82e {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:41:55 devstack sudo[92783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-1b48edaf-c133-416a-9f49-bcb83416a009.d8d9559e-fe27-4b2d-a13c-52309eafb82e Sep 22 15:41:55 devstack sudo[92783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:41:55 devstack sudo[92783]: pam_unix(sudo:session): session closed for user root Sep 22 15:41:55 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-f92359d4-da3a-4f42-be45-bbd55c14faf4 tempest-VolumesDeleteCascade-1450357542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-1b48edaf-c133-416a-9f49-bcb83416a009.d8d9559e-fe27-4b2d-a13c-52309eafb82e" returned: 0 in 0.542s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:41:55 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-f92359d4-da3a-4f42-be45-bbd55c14faf4 tempest-VolumesDeleteCascade-1450357542 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1b48edaf-c133-416a-9f49-bcb83416a009(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86212) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 22 15:41:55 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[312ae37a-ade4-40ee-b392-7b948ddeb890]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:41:55 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-f92359d4-da3a-4f42-be45-bbd55c14faf4 tempest-VolumesDeleteCascade-1450357542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-1b48edaf-c133-416a-9f49-bcb83416a009 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:41:55 devstack sudo[92789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-1b48edaf-c133-416a-9f49-bcb83416a009 Sep 22 15:41:55 devstack sudo[92789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:41:56 devstack sudo[92789]: pam_unix(sudo:session): session closed for user root Sep 22 15:41:56 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-f92359d4-da3a-4f42-be45-bbd55c14faf4 tempest-VolumesDeleteCascade-1450357542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-1b48edaf-c133-416a-9f49-bcb83416a009" returned: 0 in 0.500s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:41:56 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-f92359d4-da3a-4f42-be45-bbd55c14faf4 tempest-VolumesDeleteCascade-1450357542 None] will copy from snapshot at /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-1b48edaf-c133-416a-9f49-bcb83416a009 {{(pid=86212) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 22 15:41:56 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-f92359d4-da3a-4f42-be45-bbd55c14faf4 tempest-VolumesDeleteCascade-1450357542 None] Creating direct copy from snapshot {{(pid=86212) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 22 15:41:56 devstack cinder-volume[86212]: DEBUG cinder.utils [None req-f92359d4-da3a-4f42-be45-bbd55c14faf4 tempest-VolumesDeleteCascade-1450357542 None] Path /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-d06b7b02-f3dd-41c0-bae2-491b95c8fe16 not found in is_blk_device check {{(pid=86212) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 22 15:41:56 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-f92359d4-da3a-4f42-be45-bbd55c14faf4 tempest-VolumesDeleteCascade-1450357542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-1b48edaf-c133-416a-9f49-bcb83416a009 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-d06b7b02-f3dd-41c0-bae2-491b95c8fe16 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:41:56 devstack sudo[92802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-1b48edaf-c133-416a-9f49-bcb83416a009 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-d06b7b02-f3dd-41c0-bae2-491b95c8fe16 Sep 22 15:41:56 devstack sudo[92802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:42:05 devstack cinder-volume[86212]: DEBUG dbcounter [-] [86212] Writing DB stats cinder:SELECT=84,cinder:UPDATE=66,cinder:INSERT=22,cinder:DELETE=3 {{(pid=86212) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 22 15:42:05 devstack cinder-volume[86212]: DEBUG dbcounter [-] [86212] Writing DB stats cinder:SELECT=67,cinder:UPDATE=74,cinder:DELETE=9,cinder:INSERT=13 {{(pid=86212) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 22 15:42:06 devstack sudo[92802]: pam_unix(sudo:session): session closed for user root Sep 22 15:42:06 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-f92359d4-da3a-4f42-be45-bbd55c14faf4 tempest-VolumesDeleteCascade-1450357542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-1b48edaf-c133-416a-9f49-bcb83416a009 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-d06b7b02-f3dd-41c0-bae2-491b95c8fe16" returned: 0 in 10.358s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:42:06 devstack cinder-volume[86212]: DEBUG cinder.image.image_utils [None req-f92359d4-da3a-4f42-be45-bbd55c14faf4 tempest-VolumesDeleteCascade-1450357542 None] Image conversion details: src /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-1b48edaf-c133-416a-9f49-bcb83416a009, size 1024.00 MB, duration 10.36 sec, destination /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-d06b7b02-f3dd-41c0-bae2-491b95c8fe16 {{(pid=86212) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 22 15:42:06 devstack cinder-volume[86212]: INFO cinder.image.image_utils [None req-f92359d4-da3a-4f42-be45-bbd55c14faf4 tempest-VolumesDeleteCascade-1450357542 None] Converted 1024.00 MB image at 98.84 MB/s Sep 22 15:42:06 devstack cinder-volume[86212]: WARNING cinder.volume.drivers.remotefs [None req-f92359d4-da3a-4f42-be45-bbd55c14faf4 tempest-VolumesDeleteCascade-1450357542 None] /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-d06b7b02-f3dd-41c0-bae2-491b95c8fe16 is being set with open permissions: ugo+rw Sep 22 15:42:06 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-f92359d4-da3a-4f42-be45-bbd55c14faf4 tempest-VolumesDeleteCascade-1450357542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-d06b7b02-f3dd-41c0-bae2-491b95c8fe16 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:42:06 devstack sudo[92909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-d06b7b02-f3dd-41c0-bae2-491b95c8fe16 Sep 22 15:42:06 devstack sudo[92909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:42:07 devstack sudo[92909]: pam_unix(sudo:session): session closed for user root Sep 22 15:42:07 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-f92359d4-da3a-4f42-be45-bbd55c14faf4 tempest-VolumesDeleteCascade-1450357542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-d06b7b02-f3dd-41c0-bae2-491b95c8fe16" returned: 0 in 0.344s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:42:07 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-f92359d4-da3a-4f42-be45-bbd55c14faf4 tempest-VolumesDeleteCascade-1450357542 None] Lock "cinder-quobyte-d06b7b02-f3dd-41c0-bae2-491b95c8fe16" released by "_copy_volume_from_snapshot" :: held 11.865s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:42:07 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-f92359d4-da3a-4f42-be45-bbd55c14faf4 tempest-VolumesDeleteCascade-1450357542 None] Lock "cinder-quobyte-d8d9559e-fe27-4b2d-a13c-52309eafb82e-d06b7b02-f3dd-41c0-bae2-491b95c8fe16" released by "_create_volume_from_snapshot" :: held 11.956s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:42:07 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-f92359d4-da3a-4f42-be45-bbd55c14faf4 tempest-VolumesDeleteCascade-1450357542 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.977s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:42:07 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-f92359d4-da3a-4f42-be45-bbd55c14faf4 tempest-VolumesDeleteCascade-1450357542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65e069a1-3348-4f3a-92a7-8fc9e69f5faa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d06b7b02-f3dd-41c0-bae2-491b95c8fe16', 'volume_size': 1, 'snapshot_id': 'd8d9559e-fe27-4b2d-a13c-52309eafb82e'}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:42:07 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-f92359d4-da3a-4f42-be45-bbd55c14faf4 tempest-VolumesDeleteCascade-1450357542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (867f547b-9637-4d16-93dc-7fdffbeb7bf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:42:07 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-f92359d4-da3a-4f42-be45-bbd55c14faf4 tempest-VolumesDeleteCascade-1450357542 None] Volume volume-d06b7b02-f3dd-41c0-bae2-491b95c8fe16 (d06b7b02-f3dd-41c0-bae2-491b95c8fe16): created successfully Sep 22 15:42:07 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-f92359d4-da3a-4f42-be45-bbd55c14faf4 tempest-VolumesDeleteCascade-1450357542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (867f547b-9637-4d16-93dc-7fdffbeb7bf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:42:07 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-f92359d4-da3a-4f42-be45-bbd55c14faf4 tempest-VolumesDeleteCascade-1450357542 None] Flow 'volume_create_manager' (b8fa5397-37c8-437a-9b86-b6964025657c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:42:07 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-f92359d4-da3a-4f42-be45-bbd55c14faf4 tempest-VolumesDeleteCascade-1450357542 None] Created volume successfully. Sep 22 15:42:07 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-6d6a21db-8b9c-45ac-9891-67e6e0aba377 tempest-VolumesDeleteCascade-1450357542 None] Acquiring lock "cinder-1b48edaf-c133-416a-9f49-bcb83416a009-delete_volume" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:42:07 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-6d6a21db-8b9c-45ac-9891-67e6e0aba377 tempest-VolumesDeleteCascade-1450357542 None] Lock "cinder-1b48edaf-c133-416a-9f49-bcb83416a009-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:42:08 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-6d6a21db-8b9c-45ac-9891-67e6e0aba377 tempest-VolumesDeleteCascade-1450357542 None] Performing cascade delete. {{(pid=86212) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 22 15:42:08 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-6d6a21db-8b9c-45ac-9891-67e6e0aba377 tempest-VolumesDeleteCascade-1450357542 None] Acquiring lock "cinder-d8d9559e-fe27-4b2d-a13c-52309eafb82e-delete_snapshot" by "delete_snapshot" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:42:08 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-6d6a21db-8b9c-45ac-9891-67e6e0aba377 tempest-VolumesDeleteCascade-1450357542 None] Lock "cinder-d8d9559e-fe27-4b2d-a13c-52309eafb82e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:42:08 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-6d6a21db-8b9c-45ac-9891-67e6e0aba377 tempest-VolumesDeleteCascade-1450357542 None] Acquiring lock "cinder-quobyte-1b48edaf-c133-416a-9f49-bcb83416a009" by "delete_snapshot" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:42:08 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-6d6a21db-8b9c-45ac-9891-67e6e0aba377 tempest-VolumesDeleteCascade-1450357542 None] Lock "cinder-quobyte-1b48edaf-c133-416a-9f49-bcb83416a009" acquired by "delete_snapshot" :: waited 0.034s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:42:08 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-6d6a21db-8b9c-45ac-9891-67e6e0aba377 tempest-VolumesDeleteCascade-1450357542 None] Acquiring lock "cinder-quobyte-d8d9559e-fe27-4b2d-a13c-52309eafb82e" by "_delete_snapshot" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:42:08 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-6d6a21db-8b9c-45ac-9891-67e6e0aba377 tempest-VolumesDeleteCascade-1450357542 None] Lock "cinder-quobyte-d8d9559e-fe27-4b2d-a13c-52309eafb82e" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:42:08 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-6d6a21db-8b9c-45ac-9891-67e6e0aba377 tempest-VolumesDeleteCascade-1450357542 None] Deleting offline snapshot d8d9559e-fe27-4b2d-a13c-52309eafb82e of volume 1b48edaf-c133-416a-9f49-bcb83416a009 {{(pid=86212) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 22 15:42:08 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-6d6a21db-8b9c-45ac-9891-67e6e0aba377 tempest-VolumesDeleteCascade-1450357542 None] snapshot_file for this snap is: volume-1b48edaf-c133-416a-9f49-bcb83416a009.d8d9559e-fe27-4b2d-a13c-52309eafb82e {{(pid=86212) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 22 15:42:08 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[113501df-cc6d-4663-a00a-5e88bd6b8873]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:42:08 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-6d6a21db-8b9c-45ac-9891-67e6e0aba377 tempest-VolumesDeleteCascade-1450357542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-1b48edaf-c133-416a-9f49-bcb83416a009.d8d9559e-fe27-4b2d-a13c-52309eafb82e {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:42:08 devstack sudo[92914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-1b48edaf-c133-416a-9f49-bcb83416a009.d8d9559e-fe27-4b2d-a13c-52309eafb82e Sep 22 15:42:08 devstack sudo[92914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:42:08 devstack sudo[92914]: pam_unix(sudo:session): session closed for user root Sep 22 15:42:08 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-6d6a21db-8b9c-45ac-9891-67e6e0aba377 tempest-VolumesDeleteCascade-1450357542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-1b48edaf-c133-416a-9f49-bcb83416a009.d8d9559e-fe27-4b2d-a13c-52309eafb82e" returned: 0 in 0.555s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:42:08 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-6d6a21db-8b9c-45ac-9891-67e6e0aba377 tempest-VolumesDeleteCascade-1450357542 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1b48edaf-c133-416a-9f49-bcb83416a009(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86212) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 22 15:42:08 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[b69274ae-1e36-4754-b832-9edd6e763048]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:42:08 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-6d6a21db-8b9c-45ac-9891-67e6e0aba377 tempest-VolumesDeleteCascade-1450357542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-1b48edaf-c133-416a-9f49-bcb83416a009 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:42:08 devstack sudo[92921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-1b48edaf-c133-416a-9f49-bcb83416a009 Sep 22 15:42:09 devstack sudo[92921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:42:09 devstack sudo[92921]: pam_unix(sudo:session): session closed for user root Sep 22 15:42:09 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-6d6a21db-8b9c-45ac-9891-67e6e0aba377 tempest-VolumesDeleteCascade-1450357542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-1b48edaf-c133-416a-9f49-bcb83416a009" returned: 0 in 0.799s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:42:09 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-6d6a21db-8b9c-45ac-9891-67e6e0aba377 tempest-VolumesDeleteCascade-1450357542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-1b48edaf-c133-416a-9f49-bcb83416a009.d8d9559e-fe27-4b2d-a13c-52309eafb82e {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:42:09 devstack sudo[92926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-1b48edaf-c133-416a-9f49-bcb83416a009.d8d9559e-fe27-4b2d-a13c-52309eafb82e Sep 22 15:42:09 devstack sudo[92926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:42:10 devstack sudo[92926]: pam_unix(sudo:session): session closed for user root Sep 22 15:42:10 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-6d6a21db-8b9c-45ac-9891-67e6e0aba377 tempest-VolumesDeleteCascade-1450357542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-1b48edaf-c133-416a-9f49-bcb83416a009.d8d9559e-fe27-4b2d-a13c-52309eafb82e" returned: 0 in 0.365s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:42:10 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-6d6a21db-8b9c-45ac-9891-67e6e0aba377 tempest-VolumesDeleteCascade-1450357542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-1b48edaf-c133-416a-9f49-bcb83416a009.d8d9559e-fe27-4b2d-a13c-52309eafb82e {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:42:10 devstack sudo[92931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-1b48edaf-c133-416a-9f49-bcb83416a009.d8d9559e-fe27-4b2d-a13c-52309eafb82e Sep 22 15:42:10 devstack sudo[92931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:42:10 devstack sudo[92931]: pam_unix(sudo:session): session closed for user root Sep 22 15:42:10 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-6d6a21db-8b9c-45ac-9891-67e6e0aba377 tempest-VolumesDeleteCascade-1450357542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-1b48edaf-c133-416a-9f49-bcb83416a009.d8d9559e-fe27-4b2d-a13c-52309eafb82e" returned: 0 in 0.283s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:42:10 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-6d6a21db-8b9c-45ac-9891-67e6e0aba377 tempest-VolumesDeleteCascade-1450357542 None] Lock "cinder-quobyte-d8d9559e-fe27-4b2d-a13c-52309eafb82e" released by "_delete_snapshot" :: held 2.198s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:42:10 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-6d6a21db-8b9c-45ac-9891-67e6e0aba377 tempest-VolumesDeleteCascade-1450357542 None] Lock "cinder-quobyte-1b48edaf-c133-416a-9f49-bcb83416a009" released by "delete_snapshot" :: held 2.238s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:42:10 devstack cinder-volume[86212]: DEBUG cinder.quota [None req-6d6a21db-8b9c-45ac-9891-67e6e0aba377 tempest-VolumesDeleteCascade-1450357542 None] Created reservations ['b2778c14-7316-4eb9-99b2-34821fd79d81', '00f9c864-942f-44ad-8c4c-4f6dc8ad51b9', 'bd9f2720-914c-4266-8ca9-38c4a3e74409', '615d9194-170c-4a91-80cb-dab6e36f99f6'] {{(pid=86212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 15:42:10 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-6d6a21db-8b9c-45ac-9891-67e6e0aba377 tempest-VolumesDeleteCascade-1450357542 None] Delete snapshot completed successfully. Sep 22 15:42:10 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-6d6a21db-8b9c-45ac-9891-67e6e0aba377 tempest-VolumesDeleteCascade-1450357542 None] Lock "cinder-d8d9559e-fe27-4b2d-a13c-52309eafb82e-delete_snapshot" released by "delete_snapshot" :: held 2.567s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:42:10 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-6d6a21db-8b9c-45ac-9891-67e6e0aba377 tempest-VolumesDeleteCascade-1450357542 None] Snapshots deleted, issuing volume delete {{(pid=86212) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 22 15:42:10 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-6d6a21db-8b9c-45ac-9891-67e6e0aba377 tempest-VolumesDeleteCascade-1450357542 None] Acquiring lock "cinder-quobyte-1b48edaf-c133-416a-9f49-bcb83416a009" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:42:10 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-6d6a21db-8b9c-45ac-9891-67e6e0aba377 tempest-VolumesDeleteCascade-1450357542 None] Lock "cinder-quobyte-1b48edaf-c133-416a-9f49-bcb83416a009" acquired by "delete_volume" :: waited 0.020s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:42:10 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[31c12375-bac3-4a12-80cc-674e37272ed8]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:42:10 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-6d6a21db-8b9c-45ac-9891-67e6e0aba377 tempest-VolumesDeleteCascade-1450357542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-1b48edaf-c133-416a-9f49-bcb83416a009 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:42:10 devstack sudo[92934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-1b48edaf-c133-416a-9f49-bcb83416a009 Sep 22 15:42:10 devstack sudo[92934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:42:11 devstack sudo[92934]: pam_unix(sudo:session): session closed for user root Sep 22 15:42:11 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-6d6a21db-8b9c-45ac-9891-67e6e0aba377 tempest-VolumesDeleteCascade-1450357542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-1b48edaf-c133-416a-9f49-bcb83416a009" returned: 0 in 0.432s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:42:11 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-6d6a21db-8b9c-45ac-9891-67e6e0aba377 tempest-VolumesDeleteCascade-1450357542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-1b48edaf-c133-416a-9f49-bcb83416a009 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:42:11 devstack sudo[92939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-1b48edaf-c133-416a-9f49-bcb83416a009 Sep 22 15:42:11 devstack sudo[92939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:42:11 devstack sudo[92939]: pam_unix(sudo:session): session closed for user root Sep 22 15:42:11 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-6d6a21db-8b9c-45ac-9891-67e6e0aba377 tempest-VolumesDeleteCascade-1450357542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-1b48edaf-c133-416a-9f49-bcb83416a009" returned: 0 in 0.280s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:42:11 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-6d6a21db-8b9c-45ac-9891-67e6e0aba377 tempest-VolumesDeleteCascade-1450357542 None] Lock "cinder-quobyte-1b48edaf-c133-416a-9f49-bcb83416a009" released by "delete_volume" :: held 0.812s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:42:11 devstack cinder-volume[86212]: DEBUG cinder.quota [None req-6d6a21db-8b9c-45ac-9891-67e6e0aba377 tempest-VolumesDeleteCascade-1450357542 None] Created reservations ['670183c1-2b9b-4758-8181-0cd9b9d830e2', 'cc29e5e4-bca8-4c52-a475-000349ca39d0', '70aa371d-5035-4fa0-9067-6a36077bb17a', 'a9fca5a6-bdd8-4103-a9a7-6f1b45c471e9'] {{(pid=86212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 15:42:11 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-6d6a21db-8b9c-45ac-9891-67e6e0aba377 tempest-VolumesDeleteCascade-1450357542 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:42:11 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-6d6a21db-8b9c-45ac-9891-67e6e0aba377 tempest-VolumesDeleteCascade-1450357542 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:42:11 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-6d6a21db-8b9c-45ac-9891-67e6e0aba377 tempest-VolumesDeleteCascade-1450357542 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:42:11 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-6d6a21db-8b9c-45ac-9891-67e6e0aba377 tempest-VolumesDeleteCascade-1450357542 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:42:11 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-6d6a21db-8b9c-45ac-9891-67e6e0aba377 tempest-VolumesDeleteCascade-1450357542 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:42:11 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-6d6a21db-8b9c-45ac-9891-67e6e0aba377 tempest-VolumesDeleteCascade-1450357542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:42:11 devstack sudo[92942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc Sep 22 15:42:11 devstack sudo[92942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:42:11 devstack sudo[92942]: pam_unix(sudo:session): session closed for user root Sep 22 15:42:11 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-6d6a21db-8b9c-45ac-9891-67e6e0aba377 tempest-VolumesDeleteCascade-1450357542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc" returned: 0 in 0.315s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:42:11 devstack cinder-volume[86212]: DEBUG cinder.manager [None req-6d6a21db-8b9c-45ac-9891-67e6e0aba377 tempest-VolumesDeleteCascade-1450357542 None] Notifying Schedulers of capabilities ... {{(pid=86212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 15:42:11 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-6d6a21db-8b9c-45ac-9891-67e6e0aba377 tempest-VolumesDeleteCascade-1450357542 None] Deleted volume successfully. Sep 22 15:42:11 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-6d6a21db-8b9c-45ac-9891-67e6e0aba377 tempest-VolumesDeleteCascade-1450357542 None] Lock "cinder-1b48edaf-c133-416a-9f49-bcb83416a009-delete_volume" released by "delete_volume" :: held 4.042s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:42:12 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-202d15b0-9f3a-4a55-ae61-7ce90a6d9a5f tempest-VolumesDeleteCascade-1450357542 None] Acquiring lock "cinder-d06b7b02-f3dd-41c0-bae2-491b95c8fe16-delete_volume" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:42:12 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-202d15b0-9f3a-4a55-ae61-7ce90a6d9a5f tempest-VolumesDeleteCascade-1450357542 None] Lock "cinder-d06b7b02-f3dd-41c0-bae2-491b95c8fe16-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:42:12 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-202d15b0-9f3a-4a55-ae61-7ce90a6d9a5f tempest-VolumesDeleteCascade-1450357542 None] Acquiring lock "cinder-quobyte-d06b7b02-f3dd-41c0-bae2-491b95c8fe16" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:42:12 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-202d15b0-9f3a-4a55-ae61-7ce90a6d9a5f tempest-VolumesDeleteCascade-1450357542 None] Lock "cinder-quobyte-d06b7b02-f3dd-41c0-bae2-491b95c8fe16" acquired by "delete_volume" :: waited 0.024s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:42:12 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2606ecc-2222-4282-8cd4-2a0e33930615]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:42:12 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-202d15b0-9f3a-4a55-ae61-7ce90a6d9a5f tempest-VolumesDeleteCascade-1450357542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-d06b7b02-f3dd-41c0-bae2-491b95c8fe16 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:42:12 devstack sudo[92945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-d06b7b02-f3dd-41c0-bae2-491b95c8fe16 Sep 22 15:42:12 devstack sudo[92945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:42:13 devstack sudo[92945]: pam_unix(sudo:session): session closed for user root Sep 22 15:42:13 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-202d15b0-9f3a-4a55-ae61-7ce90a6d9a5f tempest-VolumesDeleteCascade-1450357542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-d06b7b02-f3dd-41c0-bae2-491b95c8fe16" returned: 0 in 0.638s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:42:13 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-202d15b0-9f3a-4a55-ae61-7ce90a6d9a5f tempest-VolumesDeleteCascade-1450357542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-d06b7b02-f3dd-41c0-bae2-491b95c8fe16 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:42:13 devstack sudo[92950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-d06b7b02-f3dd-41c0-bae2-491b95c8fe16 Sep 22 15:42:13 devstack sudo[92950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:42:13 devstack sudo[92950]: pam_unix(sudo:session): session closed for user root Sep 22 15:42:13 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-202d15b0-9f3a-4a55-ae61-7ce90a6d9a5f tempest-VolumesDeleteCascade-1450357542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-d06b7b02-f3dd-41c0-bae2-491b95c8fe16" returned: 0 in 0.284s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:42:13 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-202d15b0-9f3a-4a55-ae61-7ce90a6d9a5f tempest-VolumesDeleteCascade-1450357542 None] Lock "cinder-quobyte-d06b7b02-f3dd-41c0-bae2-491b95c8fe16" released by "delete_volume" :: held 0.996s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:42:13 devstack cinder-volume[86212]: DEBUG cinder.quota [None req-202d15b0-9f3a-4a55-ae61-7ce90a6d9a5f tempest-VolumesDeleteCascade-1450357542 None] Created reservations ['d0d57ba5-eaf9-411a-8d32-158b424e5a0b', 'e35ef36b-a566-4c6b-b905-baaf8db12750', '0021d2f1-e682-45ea-a9c2-80e5886d63ff', 'c136f1fe-2c5b-47d7-8b5e-25e909450965'] {{(pid=86212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 15:42:13 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-202d15b0-9f3a-4a55-ae61-7ce90a6d9a5f tempest-VolumesDeleteCascade-1450357542 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:42:13 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-202d15b0-9f3a-4a55-ae61-7ce90a6d9a5f tempest-VolumesDeleteCascade-1450357542 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:42:13 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-202d15b0-9f3a-4a55-ae61-7ce90a6d9a5f tempest-VolumesDeleteCascade-1450357542 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:42:13 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-202d15b0-9f3a-4a55-ae61-7ce90a6d9a5f tempest-VolumesDeleteCascade-1450357542 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:42:13 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-202d15b0-9f3a-4a55-ae61-7ce90a6d9a5f tempest-VolumesDeleteCascade-1450357542 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:42:13 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-202d15b0-9f3a-4a55-ae61-7ce90a6d9a5f tempest-VolumesDeleteCascade-1450357542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:42:13 devstack sudo[92953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc Sep 22 15:42:13 devstack sudo[92953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:42:14 devstack sudo[92953]: pam_unix(sudo:session): session closed for user root Sep 22 15:42:14 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-202d15b0-9f3a-4a55-ae61-7ce90a6d9a5f tempest-VolumesDeleteCascade-1450357542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc" returned: 0 in 0.462s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:42:14 devstack cinder-volume[86212]: DEBUG cinder.manager [None req-202d15b0-9f3a-4a55-ae61-7ce90a6d9a5f tempest-VolumesDeleteCascade-1450357542 None] Notifying Schedulers of capabilities ... {{(pid=86212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 15:42:14 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-202d15b0-9f3a-4a55-ae61-7ce90a6d9a5f tempest-VolumesDeleteCascade-1450357542 None] Deleted volume successfully. Sep 22 15:42:14 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-202d15b0-9f3a-4a55-ae61-7ce90a6d9a5f tempest-VolumesDeleteCascade-1450357542 None] Lock "cinder-d06b7b02-f3dd-41c0-bae2-491b95c8fe16-delete_volume" released by "delete_volume" :: held 1.787s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:42:15 devstack cinder-volume[86212]: INFO cinder.volume.manager [req-c21f2e60-5906-435b-a9cd-5cbdaaa878a7 req-6aa48471-208c-4615-adbb-a1506ff6fda2 tempest-AttachVolumeTestJSON-678247873 None] Terminate volume connection completed successfully. Sep 22 15:42:15 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [req-c21f2e60-5906-435b-a9cd-5cbdaaa878a7 req-6aa48471-208c-4615-adbb-a1506ff6fda2 tempest-AttachVolumeTestJSON-678247873 None] Deleting attachment 65991ae4-5fae-4c2d-a8b4-670171e06e80. {{(pid=86212) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 22 15:42:25 devstack cinder-volume[86212]: DEBUG dbcounter [-] [86212] Writing DB stats cinder:SELECT=20,cinder:UPDATE=22,cinder:DELETE=1,cinder:INSERT=5 {{(pid=86212) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 22 15:42:25 devstack cinder-volume[86212]: DEBUG dbcounter [-] [86212] Writing DB stats cinder:UPDATE=26,cinder:INSERT=8,cinder:SELECT=16,cinder:DELETE=2 {{(pid=86212) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 22 15:42:29 devstack cinder-volume[86212]: DEBUG cinder.volume.flows.manager.create_volume [None req-5aa0e3dd-9249-46aa-b276-6ef69ce769eb tempest-AttachVolumeNegativeTest-382120543 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 15:42:29 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-5aa0e3dd-9249-46aa-b276-6ef69ce769eb tempest-AttachVolumeNegativeTest-382120543 None] Flow 'volume_create_manager' (be3ed9aa-bac7-40d0-af57-5560bb8d39dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:42:29 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-5aa0e3dd-9249-46aa-b276-6ef69ce769eb tempest-AttachVolumeNegativeTest-382120543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d2970c7-21b6-41b3-88a9-59b3af65d092) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:42:29 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-5aa0e3dd-9249-46aa-b276-6ef69ce769eb tempest-AttachVolumeNegativeTest-382120543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d2970c7-21b6-41b3-88a9-59b3af65d092) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:42:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-592209799',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd4a9ef7-d832-4db6-8d13-7dfc647d9146,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e189bea702e54595ab5d405d04d4e342',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:42:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:42:30Z,use_quota=True,user_id='ad6a5d22339042abb9842ea9d6925310',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:42:29 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-5aa0e3dd-9249-46aa-b276-6ef69ce769eb tempest-AttachVolumeNegativeTest-382120543 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbe34407-3e23-4099-83cc-fd890f9ec2ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:42:29 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-5aa0e3dd-9249-46aa-b276-6ef69ce769eb tempest-AttachVolumeNegativeTest-382120543 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbe34407-3e23-4099-83cc-fd890f9ec2ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:42:29 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-5aa0e3dd-9249-46aa-b276-6ef69ce769eb tempest-AttachVolumeNegativeTest-382120543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77233e30-791a-4bef-8651-17fc3bdda4dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:42:29 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-5aa0e3dd-9249-46aa-b276-6ef69ce769eb tempest-AttachVolumeNegativeTest-382120543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77233e30-791a-4bef-8651-17fc3bdda4dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dd4a9ef7-d832-4db6-8d13-7dfc647d9146', 'volume_name': 'volume-dd4a9ef7-d832-4db6-8d13-7dfc647d9146', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:42:29 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-5aa0e3dd-9249-46aa-b276-6ef69ce769eb tempest-AttachVolumeNegativeTest-382120543 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (901582df-b552-4a6b-9a0d-da2486ad2fb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:42:29 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-5aa0e3dd-9249-46aa-b276-6ef69ce769eb tempest-AttachVolumeNegativeTest-382120543 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (901582df-b552-4a6b-9a0d-da2486ad2fb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:42:29 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-5aa0e3dd-9249-46aa-b276-6ef69ce769eb tempest-AttachVolumeNegativeTest-382120543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ecd30d8-0a0b-4c40-857a-af5ec8ee532d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:42:29 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-5aa0e3dd-9249-46aa-b276-6ef69ce769eb tempest-AttachVolumeNegativeTest-382120543 None] Volume dd4a9ef7-d832-4db6-8d13-7dfc647d9146: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dd4a9ef7-d832-4db6-8d13-7dfc647d9146', 'volume_size': 1} Sep 22 15:42:29 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-5aa0e3dd-9249-46aa-b276-6ef69ce769eb tempest-AttachVolumeNegativeTest-382120543 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:42:29 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-5aa0e3dd-9249-46aa-b276-6ef69ce769eb tempest-AttachVolumeNegativeTest-382120543 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:42:29 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-5aa0e3dd-9249-46aa-b276-6ef69ce769eb tempest-AttachVolumeNegativeTest-382120543 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:42:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-592209799',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd4a9ef7-d832-4db6-8d13-7dfc647d9146,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e189bea702e54595ab5d405d04d4e342',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:42:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:42:30Z,use_quota=True,user_id='ad6a5d22339042abb9842ea9d6925310',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)}" {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 15:42:29 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-5aa0e3dd-9249-46aa-b276-6ef69ce769eb tempest-AttachVolumeNegativeTest-382120543 None] Creating volume dd4a9ef7-d832-4db6-8d13-7dfc647d9146 {{(pid=86212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 15:42:29 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-5aa0e3dd-9249-46aa-b276-6ef69ce769eb tempest-AttachVolumeNegativeTest-382120543 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:42:29 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-5aa0e3dd-9249-46aa-b276-6ef69ce769eb tempest-AttachVolumeNegativeTest-382120543 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:42:29 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-5aa0e3dd-9249-46aa-b276-6ef69ce769eb tempest-AttachVolumeNegativeTest-382120543 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:42:29 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-5aa0e3dd-9249-46aa-b276-6ef69ce769eb tempest-AttachVolumeNegativeTest-382120543 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:42:29 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-5aa0e3dd-9249-46aa-b276-6ef69ce769eb tempest-AttachVolumeNegativeTest-382120543 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:42:29 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-5aa0e3dd-9249-46aa-b276-6ef69ce769eb tempest-AttachVolumeNegativeTest-382120543 None] Selected osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 as target Quobyte volume. {{(pid=86212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 15:42:29 devstack cinder-volume[86212]: INFO cinder.volume.drivers.remotefs [None req-5aa0e3dd-9249-46aa-b276-6ef69ce769eb tempest-AttachVolumeNegativeTest-382120543 None] casted to osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 Sep 22 15:42:29 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-5aa0e3dd-9249-46aa-b276-6ef69ce769eb tempest-AttachVolumeNegativeTest-382120543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-dd4a9ef7-d832-4db6-8d13-7dfc647d9146 1073741824 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:42:29 devstack sudo[93138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-dd4a9ef7-d832-4db6-8d13-7dfc647d9146 1073741824 Sep 22 15:42:29 devstack sudo[93138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:42:30 devstack sudo[93138]: pam_unix(sudo:session): session closed for user root Sep 22 15:42:30 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-5aa0e3dd-9249-46aa-b276-6ef69ce769eb tempest-AttachVolumeNegativeTest-382120543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-dd4a9ef7-d832-4db6-8d13-7dfc647d9146 1073741824" returned: 0 in 0.795s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:42:30 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-5aa0e3dd-9249-46aa-b276-6ef69ce769eb tempest-AttachVolumeNegativeTest-382120543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-dd4a9ef7-d832-4db6-8d13-7dfc647d9146 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:42:30 devstack sudo[93179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-dd4a9ef7-d832-4db6-8d13-7dfc647d9146 Sep 22 15:42:30 devstack sudo[93179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:42:31 devstack sudo[93179]: pam_unix(sudo:session): session closed for user root Sep 22 15:42:31 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-5aa0e3dd-9249-46aa-b276-6ef69ce769eb tempest-AttachVolumeNegativeTest-382120543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-dd4a9ef7-d832-4db6-8d13-7dfc647d9146" returned: 0 in 0.528s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:42:31 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-5aa0e3dd-9249-46aa-b276-6ef69ce769eb tempest-AttachVolumeNegativeTest-382120543 None] <== create_volume: return (1402ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'} {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 15:42:31 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-5aa0e3dd-9249-46aa-b276-6ef69ce769eb tempest-AttachVolumeNegativeTest-382120543 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.413s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:42:31 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-5aa0e3dd-9249-46aa-b276-6ef69ce769eb tempest-AttachVolumeNegativeTest-382120543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ecd30d8-0a0b-4c40-857a-af5ec8ee532d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd4a9ef7-d832-4db6-8d13-7dfc647d9146', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:42:31 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-5aa0e3dd-9249-46aa-b276-6ef69ce769eb tempest-AttachVolumeNegativeTest-382120543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c039f5c-e291-4444-80a4-cfcf5a18a2ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:42:31 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-5aa0e3dd-9249-46aa-b276-6ef69ce769eb tempest-AttachVolumeNegativeTest-382120543 None] Volume volume-dd4a9ef7-d832-4db6-8d13-7dfc647d9146 (dd4a9ef7-d832-4db6-8d13-7dfc647d9146): created successfully Sep 22 15:42:31 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-5aa0e3dd-9249-46aa-b276-6ef69ce769eb tempest-AttachVolumeNegativeTest-382120543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c039f5c-e291-4444-80a4-cfcf5a18a2ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:42:31 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-5aa0e3dd-9249-46aa-b276-6ef69ce769eb tempest-AttachVolumeNegativeTest-382120543 None] Flow 'volume_create_manager' (be3ed9aa-bac7-40d0-af57-5560bb8d39dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:42:31 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-5aa0e3dd-9249-46aa-b276-6ef69ce769eb tempest-AttachVolumeNegativeTest-382120543 None] Created volume successfully. Sep 22 15:42:35 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [req-be8d14a6-4d3a-44a0-ab3f-60250c92fe11 req-9cdad0a3-f478-47eb-a886-fa8c0fce0f13 tempest-AttachVolumeNegativeTest-382120543 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:42:35 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [req-be8d14a6-4d3a-44a0-ab3f-60250c92fe11 req-9cdad0a3-f478-47eb-a886-fa8c0fce0f13 tempest-AttachVolumeNegativeTest-382120543 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:42:35 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [req-be8d14a6-4d3a-44a0-ab3f-60250c92fe11 req-9cdad0a3-f478-47eb-a886-fa8c0fce0f13 tempest-AttachVolumeNegativeTest-382120543 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.049s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:42:35 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [req-be8d14a6-4d3a-44a0-ab3f-60250c92fe11 req-9cdad0a3-f478-47eb-a886-fa8c0fce0f13 tempest-AttachVolumeNegativeTest-382120543 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31', 'name': 'volume-dd4a9ef7-d832-4db6-8d13-7dfc647d9146', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '08f33c54-448f-492f-8e9f-228b35c502bf', 'enforce_multipath': True} {{(pid=86212) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 22 15:42:36 devstack cinder-volume[86212]: INFO cinder.volume.manager [req-be8d14a6-4d3a-44a0-ab3f-60250c92fe11 req-9cdad0a3-f478-47eb-a886-fa8c0fce0f13 tempest-AttachVolumeNegativeTest-382120543 None] attachment_update completed successfully. Sep 22 15:42:38 devstack cinder-volume[86212]: DEBUG oslo_service.periodic_task [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86212) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 22 15:42:38 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:42:38 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:42:38 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:42:38 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:42:38 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:42:38 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:42:38 devstack sudo[93738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc Sep 22 15:42:38 devstack sudo[93738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:42:39 devstack sudo[93738]: pam_unix(sudo:session): session closed for user root Sep 22 15:42:39 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc" returned: 0 in 0.724s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:42:39 devstack cinder-volume[86212]: DEBUG cinder.manager [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] Notifying Schedulers of capabilities ... {{(pid=86212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 15:42:39 devstack cinder-volume[86212]: DEBUG oslo_service.periodic_task [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] Running periodic task VolumeManager._thread_info {{(pid=86212) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 22 15:42:39 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] thread count: 28 {{(pid=86212) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 22 15:42:39 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] thread info: [<_MainThread(MainThread, started 136163191222400)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86212) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 22 15:42:41 devstack cinder-volume[86212]: INFO cinder.volume.manager [req-fb65a979-b8a3-41fb-952e-256235ea762d req-89d3d6d9-700e-4c3b-9c5d-f534cbe150d7 tempest-AttachVolumeNegativeTest-382120543 None] Terminate volume connection completed successfully. Sep 22 15:42:41 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [req-fb65a979-b8a3-41fb-952e-256235ea762d req-89d3d6d9-700e-4c3b-9c5d-f534cbe150d7 tempest-AttachVolumeNegativeTest-382120543 None] Deleting attachment 08f33c54-448f-492f-8e9f-228b35c502bf. {{(pid=86212) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 22 15:42:47 devstack cinder-volume[86212]: DEBUG cinder.volume.flows.manager.create_volume [None req-83371810-6597-4ec9-9e88-5259ea6a13c4 tempest-VolumesActionsTest-1755689979 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 15:42:47 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-83371810-6597-4ec9-9e88-5259ea6a13c4 tempest-VolumesActionsTest-1755689979 None] Flow 'volume_create_manager' (36b2bc64-c324-4657-b4b3-0e9eeeedf58c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:42:47 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-83371810-6597-4ec9-9e88-5259ea6a13c4 tempest-VolumesActionsTest-1755689979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ddd8b72-0547-4460-bd50-767a483f7377) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:42:47 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-83371810-6597-4ec9-9e88-5259ea6a13c4 tempest-VolumesActionsTest-1755689979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ddd8b72-0547-4460-bd50-767a483f7377) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:42:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1722307353',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3d7dcfb-3dac-4e67-bb79-a529324e3637,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3b9dfaee9264797ae182ff0d226b4d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:42:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:42:47Z,use_quota=True,user_id='c2adb0af6d614a7ab17ce1b7482af645',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:42:47 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-83371810-6597-4ec9-9e88-5259ea6a13c4 tempest-VolumesActionsTest-1755689979 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e85bd959-d5fd-4d4b-931d-12dee6696538) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:42:47 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-83371810-6597-4ec9-9e88-5259ea6a13c4 tempest-VolumesActionsTest-1755689979 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e85bd959-d5fd-4d4b-931d-12dee6696538) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:42:47 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-83371810-6597-4ec9-9e88-5259ea6a13c4 tempest-VolumesActionsTest-1755689979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37a33f7a-da57-47ef-9590-9b31f537c092) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:42:47 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-83371810-6597-4ec9-9e88-5259ea6a13c4 tempest-VolumesActionsTest-1755689979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37a33f7a-da57-47ef-9590-9b31f537c092) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd3d7dcfb-3dac-4e67-bb79-a529324e3637', 'volume_name': 'volume-d3d7dcfb-3dac-4e67-bb79-a529324e3637', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:42:47 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-83371810-6597-4ec9-9e88-5259ea6a13c4 tempest-VolumesActionsTest-1755689979 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5670c3d7-01a1-4f78-9425-ad632cc039b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:42:47 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-83371810-6597-4ec9-9e88-5259ea6a13c4 tempest-VolumesActionsTest-1755689979 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5670c3d7-01a1-4f78-9425-ad632cc039b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:42:47 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-83371810-6597-4ec9-9e88-5259ea6a13c4 tempest-VolumesActionsTest-1755689979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68bbc2d3-6803-4bea-b2d9-03ebe9b63046) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:42:47 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-83371810-6597-4ec9-9e88-5259ea6a13c4 tempest-VolumesActionsTest-1755689979 None] Volume d3d7dcfb-3dac-4e67-bb79-a529324e3637: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d3d7dcfb-3dac-4e67-bb79-a529324e3637', 'volume_size': 1} Sep 22 15:42:47 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-83371810-6597-4ec9-9e88-5259ea6a13c4 tempest-VolumesActionsTest-1755689979 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:42:47 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-83371810-6597-4ec9-9e88-5259ea6a13c4 tempest-VolumesActionsTest-1755689979 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:42:47 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-83371810-6597-4ec9-9e88-5259ea6a13c4 tempest-VolumesActionsTest-1755689979 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:42:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1722307353',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3d7dcfb-3dac-4e67-bb79-a529324e3637,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3b9dfaee9264797ae182ff0d226b4d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:42:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:42:47Z,use_quota=True,user_id='c2adb0af6d614a7ab17ce1b7482af645',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)}" {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 15:42:47 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-83371810-6597-4ec9-9e88-5259ea6a13c4 tempest-VolumesActionsTest-1755689979 None] Creating volume d3d7dcfb-3dac-4e67-bb79-a529324e3637 {{(pid=86212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 15:42:47 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-83371810-6597-4ec9-9e88-5259ea6a13c4 tempest-VolumesActionsTest-1755689979 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:42:47 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-83371810-6597-4ec9-9e88-5259ea6a13c4 tempest-VolumesActionsTest-1755689979 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:42:47 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-83371810-6597-4ec9-9e88-5259ea6a13c4 tempest-VolumesActionsTest-1755689979 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:42:47 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-83371810-6597-4ec9-9e88-5259ea6a13c4 tempest-VolumesActionsTest-1755689979 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:42:47 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-83371810-6597-4ec9-9e88-5259ea6a13c4 tempest-VolumesActionsTest-1755689979 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:42:47 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-83371810-6597-4ec9-9e88-5259ea6a13c4 tempest-VolumesActionsTest-1755689979 None] Selected osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 as target Quobyte volume. {{(pid=86212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 15:42:47 devstack cinder-volume[86212]: INFO cinder.volume.drivers.remotefs [None req-83371810-6597-4ec9-9e88-5259ea6a13c4 tempest-VolumesActionsTest-1755689979 None] casted to osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 Sep 22 15:42:47 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-83371810-6597-4ec9-9e88-5259ea6a13c4 tempest-VolumesActionsTest-1755689979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-d3d7dcfb-3dac-4e67-bb79-a529324e3637 1073741824 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:42:47 devstack sudo[93833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-d3d7dcfb-3dac-4e67-bb79-a529324e3637 1073741824 Sep 22 15:42:47 devstack sudo[93833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:42:48 devstack sudo[93833]: pam_unix(sudo:session): session closed for user root Sep 22 15:42:48 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-83371810-6597-4ec9-9e88-5259ea6a13c4 tempest-VolumesActionsTest-1755689979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-d3d7dcfb-3dac-4e67-bb79-a529324e3637 1073741824" returned: 0 in 1.241s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:42:48 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-83371810-6597-4ec9-9e88-5259ea6a13c4 tempest-VolumesActionsTest-1755689979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-d3d7dcfb-3dac-4e67-bb79-a529324e3637 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:42:48 devstack sudo[93840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-d3d7dcfb-3dac-4e67-bb79-a529324e3637 Sep 22 15:42:48 devstack sudo[93840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:42:49 devstack sudo[93840]: pam_unix(sudo:session): session closed for user root Sep 22 15:42:49 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-83371810-6597-4ec9-9e88-5259ea6a13c4 tempest-VolumesActionsTest-1755689979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-d3d7dcfb-3dac-4e67-bb79-a529324e3637" returned: 0 in 0.647s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:42:49 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-83371810-6597-4ec9-9e88-5259ea6a13c4 tempest-VolumesActionsTest-1755689979 None] <== create_volume: return (2014ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'} {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 15:42:49 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-83371810-6597-4ec9-9e88-5259ea6a13c4 tempest-VolumesActionsTest-1755689979 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.016s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:42:49 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-83371810-6597-4ec9-9e88-5259ea6a13c4 tempest-VolumesActionsTest-1755689979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68bbc2d3-6803-4bea-b2d9-03ebe9b63046) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d3d7dcfb-3dac-4e67-bb79-a529324e3637', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:42:49 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-83371810-6597-4ec9-9e88-5259ea6a13c4 tempest-VolumesActionsTest-1755689979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a6b8fcb-a69a-46a5-b950-2935e862dbb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:42:49 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-83371810-6597-4ec9-9e88-5259ea6a13c4 tempest-VolumesActionsTest-1755689979 None] Volume volume-d3d7dcfb-3dac-4e67-bb79-a529324e3637 (d3d7dcfb-3dac-4e67-bb79-a529324e3637): created successfully Sep 22 15:42:49 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-83371810-6597-4ec9-9e88-5259ea6a13c4 tempest-VolumesActionsTest-1755689979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a6b8fcb-a69a-46a5-b950-2935e862dbb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:42:49 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-83371810-6597-4ec9-9e88-5259ea6a13c4 tempest-VolumesActionsTest-1755689979 None] Flow 'volume_create_manager' (36b2bc64-c324-4657-b4b3-0e9eeeedf58c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:42:49 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-83371810-6597-4ec9-9e88-5259ea6a13c4 tempest-VolumesActionsTest-1755689979 None] Created volume successfully. Sep 22 15:42:50 devstack cinder-volume[86212]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4fcc6b0-9b71-41d1-aca3-d3dcbe578c7a tempest-ServerRescueNegativeTestJSON-964762752 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 15:42:50 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-a4fcc6b0-9b71-41d1-aca3-d3dcbe578c7a tempest-ServerRescueNegativeTestJSON-964762752 None] Flow 'volume_create_manager' (6ea0e10b-0362-4166-a557-cce197931487) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:42:50 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-a4fcc6b0-9b71-41d1-aca3-d3dcbe578c7a tempest-ServerRescueNegativeTestJSON-964762752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aedd541c-ef13-4228-b6ab-fb1ba04a952c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:42:50 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-a4fcc6b0-9b71-41d1-aca3-d3dcbe578c7a tempest-ServerRescueNegativeTestJSON-964762752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aedd541c-ef13-4228-b6ab-fb1ba04a952c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:42:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-2008400964',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cce3afe9-4432-44c2-bee9-6d9f098f18a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8464d49af6414efd9798aa8270fc903a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:42:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:42:50Z,use_quota=True,user_id='16607bb51c6e4678bc433c938d5578ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:42:50 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-a4fcc6b0-9b71-41d1-aca3-d3dcbe578c7a tempest-ServerRescueNegativeTestJSON-964762752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9aeb3be3-ae68-4d4b-91a1-dc2ed52d95fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:42:50 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-a4fcc6b0-9b71-41d1-aca3-d3dcbe578c7a tempest-ServerRescueNegativeTestJSON-964762752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9aeb3be3-ae68-4d4b-91a1-dc2ed52d95fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:42:50 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-a4fcc6b0-9b71-41d1-aca3-d3dcbe578c7a tempest-ServerRescueNegativeTestJSON-964762752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02a479f8-106d-407c-86ad-c7436a7487c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:42:50 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-a4fcc6b0-9b71-41d1-aca3-d3dcbe578c7a tempest-ServerRescueNegativeTestJSON-964762752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02a479f8-106d-407c-86ad-c7436a7487c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cce3afe9-4432-44c2-bee9-6d9f098f18a2', 'volume_name': 'volume-cce3afe9-4432-44c2-bee9-6d9f098f18a2', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:42:50 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-a4fcc6b0-9b71-41d1-aca3-d3dcbe578c7a tempest-ServerRescueNegativeTestJSON-964762752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ac46cd8-8920-46db-b57f-39dd77a137b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:42:50 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-a4fcc6b0-9b71-41d1-aca3-d3dcbe578c7a tempest-ServerRescueNegativeTestJSON-964762752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ac46cd8-8920-46db-b57f-39dd77a137b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:42:50 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-a4fcc6b0-9b71-41d1-aca3-d3dcbe578c7a tempest-ServerRescueNegativeTestJSON-964762752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1681643c-645c-4854-8339-3c19d7b3f93a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:42:50 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-a4fcc6b0-9b71-41d1-aca3-d3dcbe578c7a tempest-ServerRescueNegativeTestJSON-964762752 None] Volume cce3afe9-4432-44c2-bee9-6d9f098f18a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cce3afe9-4432-44c2-bee9-6d9f098f18a2', 'volume_size': 1} Sep 22 15:42:50 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-a4fcc6b0-9b71-41d1-aca3-d3dcbe578c7a tempest-ServerRescueNegativeTestJSON-964762752 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:42:50 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-a4fcc6b0-9b71-41d1-aca3-d3dcbe578c7a tempest-ServerRescueNegativeTestJSON-964762752 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:42:50 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-a4fcc6b0-9b71-41d1-aca3-d3dcbe578c7a tempest-ServerRescueNegativeTestJSON-964762752 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:42:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-2008400964',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cce3afe9-4432-44c2-bee9-6d9f098f18a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8464d49af6414efd9798aa8270fc903a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:42:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:42:50Z,use_quota=True,user_id='16607bb51c6e4678bc433c938d5578ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)}" {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 15:42:50 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-a4fcc6b0-9b71-41d1-aca3-d3dcbe578c7a tempest-ServerRescueNegativeTestJSON-964762752 None] Creating volume cce3afe9-4432-44c2-bee9-6d9f098f18a2 {{(pid=86212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 15:42:50 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-a4fcc6b0-9b71-41d1-aca3-d3dcbe578c7a tempest-ServerRescueNegativeTestJSON-964762752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:42:50 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-a4fcc6b0-9b71-41d1-aca3-d3dcbe578c7a tempest-ServerRescueNegativeTestJSON-964762752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:42:50 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-a4fcc6b0-9b71-41d1-aca3-d3dcbe578c7a tempest-ServerRescueNegativeTestJSON-964762752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:42:50 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-a4fcc6b0-9b71-41d1-aca3-d3dcbe578c7a tempest-ServerRescueNegativeTestJSON-964762752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:42:50 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-a4fcc6b0-9b71-41d1-aca3-d3dcbe578c7a tempest-ServerRescueNegativeTestJSON-964762752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:42:50 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-a4fcc6b0-9b71-41d1-aca3-d3dcbe578c7a tempest-ServerRescueNegativeTestJSON-964762752 None] Selected osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 as target Quobyte volume. {{(pid=86212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 15:42:50 devstack cinder-volume[86212]: INFO cinder.volume.drivers.remotefs [None req-a4fcc6b0-9b71-41d1-aca3-d3dcbe578c7a tempest-ServerRescueNegativeTestJSON-964762752 None] casted to osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 Sep 22 15:42:50 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-a4fcc6b0-9b71-41d1-aca3-d3dcbe578c7a tempest-ServerRescueNegativeTestJSON-964762752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-cce3afe9-4432-44c2-bee9-6d9f098f18a2 1073741824 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:42:50 devstack sudo[93866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-cce3afe9-4432-44c2-bee9-6d9f098f18a2 1073741824 Sep 22 15:42:50 devstack sudo[93866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:42:51 devstack sudo[93866]: pam_unix(sudo:session): session closed for user root Sep 22 15:42:51 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-a4fcc6b0-9b71-41d1-aca3-d3dcbe578c7a tempest-ServerRescueNegativeTestJSON-964762752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-cce3afe9-4432-44c2-bee9-6d9f098f18a2 1073741824" returned: 0 in 1.046s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:42:51 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-a4fcc6b0-9b71-41d1-aca3-d3dcbe578c7a tempest-ServerRescueNegativeTestJSON-964762752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-cce3afe9-4432-44c2-bee9-6d9f098f18a2 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:42:51 devstack sudo[93897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-cce3afe9-4432-44c2-bee9-6d9f098f18a2 Sep 22 15:42:51 devstack sudo[93897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:42:52 devstack sudo[93897]: pam_unix(sudo:session): session closed for user root Sep 22 15:42:52 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-a4fcc6b0-9b71-41d1-aca3-d3dcbe578c7a tempest-ServerRescueNegativeTestJSON-964762752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-cce3afe9-4432-44c2-bee9-6d9f098f18a2" returned: 0 in 0.324s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:42:52 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-a4fcc6b0-9b71-41d1-aca3-d3dcbe578c7a tempest-ServerRescueNegativeTestJSON-964762752 None] <== create_volume: return (1491ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'} {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 15:42:52 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-a4fcc6b0-9b71-41d1-aca3-d3dcbe578c7a tempest-ServerRescueNegativeTestJSON-964762752 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.496s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:42:52 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-a4fcc6b0-9b71-41d1-aca3-d3dcbe578c7a tempest-ServerRescueNegativeTestJSON-964762752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1681643c-645c-4854-8339-3c19d7b3f93a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cce3afe9-4432-44c2-bee9-6d9f098f18a2', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:42:52 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-a4fcc6b0-9b71-41d1-aca3-d3dcbe578c7a tempest-ServerRescueNegativeTestJSON-964762752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fd4a06d-b6ed-470c-933c-5206375c5f90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:42:52 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-a4fcc6b0-9b71-41d1-aca3-d3dcbe578c7a tempest-ServerRescueNegativeTestJSON-964762752 None] Volume volume-cce3afe9-4432-44c2-bee9-6d9f098f18a2 (cce3afe9-4432-44c2-bee9-6d9f098f18a2): created successfully Sep 22 15:42:52 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-a4fcc6b0-9b71-41d1-aca3-d3dcbe578c7a tempest-ServerRescueNegativeTestJSON-964762752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fd4a06d-b6ed-470c-933c-5206375c5f90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:42:52 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-a4fcc6b0-9b71-41d1-aca3-d3dcbe578c7a tempest-ServerRescueNegativeTestJSON-964762752 None] Flow 'volume_create_manager' (6ea0e10b-0362-4166-a557-cce197931487) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:42:52 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-a4fcc6b0-9b71-41d1-aca3-d3dcbe578c7a tempest-ServerRescueNegativeTestJSON-964762752 None] Created volume successfully. Sep 22 15:43:02 devstack cinder-volume[86212]: DEBUG dbcounter [-] [86212] Writing DB stats cinder:UPDATE=10,cinder:SELECT=12,cinder:DELETE=1,cinder:INSERT=1 {{(pid=86212) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 22 15:43:02 devstack cinder-volume[86212]: DEBUG dbcounter [-] [86212] Writing DB stats cinder:SELECT=15,cinder:INSERT=2,cinder:UPDATE=11,cinder:DELETE=2 {{(pid=86212) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 22 15:43:07 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-fda531ef-a951-4185-acd1-3cee4e42f88a tempest-VolumesActionsTest-1755689979 None] Acquiring lock "cinder-d3d7dcfb-3dac-4e67-bb79-a529324e3637" by "attach_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:43:07 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-fda531ef-a951-4185-acd1-3cee4e42f88a tempest-VolumesActionsTest-1755689979 None] Lock "cinder-d3d7dcfb-3dac-4e67-bb79-a529324e3637" acquired by "attach_volume" :: waited 0.042s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:43:07 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-fda531ef-a951-4185-acd1-3cee4e42f88a tempest-VolumesActionsTest-1755689979 None] Attaching volume d3d7dcfb-3dac-4e67-bb79-a529324e3637 to instance 8f4d346e-8deb-48bb-8e7c-2bcfbc456fb6 at mountpoint /dev/vdb on host None. Sep 22 15:43:07 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-fda531ef-a951-4185-acd1-3cee4e42f88a tempest-VolumesActionsTest-1755689979 None] Attach volume completed successfully. Sep 22 15:43:07 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-fda531ef-a951-4185-acd1-3cee4e42f88a tempest-VolumesActionsTest-1755689979 None] Lock "cinder-d3d7dcfb-3dac-4e67-bb79-a529324e3637" released by "attach_volume" :: held 0.233s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:43:07 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-87467e3b-3ec0-47d3-b566-c1b1b1f732bb tempest-VolumesActionsTest-1755689979 None] Acquiring lock "cinder-d3d7dcfb-3dac-4e67-bb79-a529324e3637-detach_volume" by "detach_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:43:07 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-87467e3b-3ec0-47d3-b566-c1b1b1f732bb tempest-VolumesActionsTest-1755689979 None] Lock "cinder-d3d7dcfb-3dac-4e67-bb79-a529324e3637-detach_volume" acquired by "detach_volume" :: waited 0.063s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:43:07 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-87467e3b-3ec0-47d3-b566-c1b1b1f732bb tempest-VolumesActionsTest-1755689979 None] Detaching volume d3d7dcfb-3dac-4e67-bb79-a529324e3637 from instance 8f4d346e-8deb-48bb-8e7c-2bcfbc456fb6. Sep 22 15:43:08 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-87467e3b-3ec0-47d3-b566-c1b1b1f732bb tempest-VolumesActionsTest-1755689979 None] Detach volume completed successfully. Sep 22 15:43:08 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-87467e3b-3ec0-47d3-b566-c1b1b1f732bb tempest-VolumesActionsTest-1755689979 None] Lock "cinder-d3d7dcfb-3dac-4e67-bb79-a529324e3637-detach_volume" released by "detach_volume" :: held 0.256s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:43:15 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-17466c3c-65a7-4579-9886-4b0fe71f4302 tempest-ServerRescueNegativeTestJSON-964762752 None] Acquiring lock "cinder-cce3afe9-4432-44c2-bee9-6d9f098f18a2-delete_volume" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:43:15 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-17466c3c-65a7-4579-9886-4b0fe71f4302 tempest-ServerRescueNegativeTestJSON-964762752 None] Lock "cinder-cce3afe9-4432-44c2-bee9-6d9f098f18a2-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:43:15 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-17466c3c-65a7-4579-9886-4b0fe71f4302 tempest-ServerRescueNegativeTestJSON-964762752 None] Acquiring lock "cinder-quobyte-cce3afe9-4432-44c2-bee9-6d9f098f18a2" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:43:15 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-17466c3c-65a7-4579-9886-4b0fe71f4302 tempest-ServerRescueNegativeTestJSON-964762752 None] Lock "cinder-quobyte-cce3afe9-4432-44c2-bee9-6d9f098f18a2" acquired by "delete_volume" :: waited 0.038s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:43:15 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cde379c-82f5-4298-9510-9a82321a4f13]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:43:15 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-17466c3c-65a7-4579-9886-4b0fe71f4302 tempest-ServerRescueNegativeTestJSON-964762752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-cce3afe9-4432-44c2-bee9-6d9f098f18a2 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:43:16 devstack sudo[94274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-cce3afe9-4432-44c2-bee9-6d9f098f18a2 Sep 22 15:43:16 devstack sudo[94274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:43:17 devstack sudo[94274]: pam_unix(sudo:session): session closed for user root Sep 22 15:43:17 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-17466c3c-65a7-4579-9886-4b0fe71f4302 tempest-ServerRescueNegativeTestJSON-964762752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-cce3afe9-4432-44c2-bee9-6d9f098f18a2" returned: 0 in 1.566s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:43:17 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-17466c3c-65a7-4579-9886-4b0fe71f4302 tempest-ServerRescueNegativeTestJSON-964762752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-cce3afe9-4432-44c2-bee9-6d9f098f18a2 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:43:17 devstack sudo[94296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-cce3afe9-4432-44c2-bee9-6d9f098f18a2 Sep 22 15:43:17 devstack sudo[94296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:43:17 devstack sudo[94296]: pam_unix(sudo:session): session closed for user root Sep 22 15:43:17 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-17466c3c-65a7-4579-9886-4b0fe71f4302 tempest-ServerRescueNegativeTestJSON-964762752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-cce3afe9-4432-44c2-bee9-6d9f098f18a2" returned: 0 in 0.596s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:43:18 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-17466c3c-65a7-4579-9886-4b0fe71f4302 tempest-ServerRescueNegativeTestJSON-964762752 None] Lock "cinder-quobyte-cce3afe9-4432-44c2-bee9-6d9f098f18a2" released by "delete_volume" :: held 2.351s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:43:18 devstack cinder-volume[86212]: DEBUG cinder.quota [None req-17466c3c-65a7-4579-9886-4b0fe71f4302 tempest-ServerRescueNegativeTestJSON-964762752 None] Created reservations ['0376f2ce-21bb-4fc3-b46a-65e9fa1a50d6', '4529ab0d-ccda-4a62-a5cf-7392e5b1b6ca', '40e3f2c6-9b63-4a4d-b026-0981e11d86f6', '56eb93d3-015b-4190-984e-201d98cadd95'] {{(pid=86212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 15:43:18 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-17466c3c-65a7-4579-9886-4b0fe71f4302 tempest-ServerRescueNegativeTestJSON-964762752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:43:18 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-17466c3c-65a7-4579-9886-4b0fe71f4302 tempest-ServerRescueNegativeTestJSON-964762752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:43:18 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-17466c3c-65a7-4579-9886-4b0fe71f4302 tempest-ServerRescueNegativeTestJSON-964762752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:43:18 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-17466c3c-65a7-4579-9886-4b0fe71f4302 tempest-ServerRescueNegativeTestJSON-964762752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:43:18 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-17466c3c-65a7-4579-9886-4b0fe71f4302 tempest-ServerRescueNegativeTestJSON-964762752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.052s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:43:18 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-17466c3c-65a7-4579-9886-4b0fe71f4302 tempest-ServerRescueNegativeTestJSON-964762752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:43:18 devstack sudo[94300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc Sep 22 15:43:18 devstack sudo[94300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:43:18 devstack sudo[94300]: pam_unix(sudo:session): session closed for user root Sep 22 15:43:18 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-17466c3c-65a7-4579-9886-4b0fe71f4302 tempest-ServerRescueNegativeTestJSON-964762752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc" returned: 0 in 0.534s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:43:18 devstack cinder-volume[86212]: DEBUG cinder.manager [None req-17466c3c-65a7-4579-9886-4b0fe71f4302 tempest-ServerRescueNegativeTestJSON-964762752 None] Notifying Schedulers of capabilities ... {{(pid=86212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 15:43:18 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-17466c3c-65a7-4579-9886-4b0fe71f4302 tempest-ServerRescueNegativeTestJSON-964762752 None] Deleted volume successfully. Sep 22 15:43:19 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-17466c3c-65a7-4579-9886-4b0fe71f4302 tempest-ServerRescueNegativeTestJSON-964762752 None] Lock "cinder-cce3afe9-4432-44c2-bee9-6d9f098f18a2-delete_volume" released by "delete_volume" :: held 3.527s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:43:28 devstack cinder-volume[86212]: DEBUG dbcounter [-] [86212] Writing DB stats cinder:INSERT=2,cinder:SELECT=11,cinder:UPDATE=14 {{(pid=86212) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 22 15:43:28 devstack cinder-volume[86212]: DEBUG dbcounter [-] [86212] Writing DB stats cinder:SELECT=12,cinder:INSERT=4,cinder:UPDATE=8,cinder:DELETE=1 {{(pid=86212) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 22 15:43:35 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-fd04ec5a-bdbe-4e98-a76b-97f734b8c81a tempest-VolumesActionsTest-1755689979 None] Acquiring lock "cinder-d3d7dcfb-3dac-4e67-bb79-a529324e3637" by "attach_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:43:35 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-fd04ec5a-bdbe-4e98-a76b-97f734b8c81a tempest-VolumesActionsTest-1755689979 None] Lock "cinder-d3d7dcfb-3dac-4e67-bb79-a529324e3637" acquired by "attach_volume" :: waited 0.032s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:43:35 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-fd04ec5a-bdbe-4e98-a76b-97f734b8c81a tempest-VolumesActionsTest-1755689979 None] Attaching volume d3d7dcfb-3dac-4e67-bb79-a529324e3637 to instance 60a3c0cc-645f-4864-9848-efd9a8b1732b at mountpoint /dev/vdb on host None. Sep 22 15:43:35 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-fd04ec5a-bdbe-4e98-a76b-97f734b8c81a tempest-VolumesActionsTest-1755689979 None] Attach volume completed successfully. Sep 22 15:43:35 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-fd04ec5a-bdbe-4e98-a76b-97f734b8c81a tempest-VolumesActionsTest-1755689979 None] Lock "cinder-d3d7dcfb-3dac-4e67-bb79-a529324e3637" released by "attach_volume" :: held 0.149s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:43:36 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-a1caad8d-cd7a-4745-9893-206e759d1585 tempest-VolumesActionsTest-1755689979 None] Acquiring lock "cinder-d3d7dcfb-3dac-4e67-bb79-a529324e3637-detach_volume" by "detach_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:43:36 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-a1caad8d-cd7a-4745-9893-206e759d1585 tempest-VolumesActionsTest-1755689979 None] Lock "cinder-d3d7dcfb-3dac-4e67-bb79-a529324e3637-detach_volume" acquired by "detach_volume" :: waited 0.034s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:43:36 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-a1caad8d-cd7a-4745-9893-206e759d1585 tempest-VolumesActionsTest-1755689979 None] Detaching volume d3d7dcfb-3dac-4e67-bb79-a529324e3637 from instance 60a3c0cc-645f-4864-9848-efd9a8b1732b. Sep 22 15:43:36 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-a1caad8d-cd7a-4745-9893-206e759d1585 tempest-VolumesActionsTest-1755689979 None] Detach volume completed successfully. Sep 22 15:43:36 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-a1caad8d-cd7a-4745-9893-206e759d1585 tempest-VolumesActionsTest-1755689979 None] Lock "cinder-d3d7dcfb-3dac-4e67-bb79-a529324e3637-detach_volume" released by "detach_volume" :: held 0.093s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:43:38 devstack cinder-volume[86212]: DEBUG oslo_service.periodic_task [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86212) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 22 15:43:38 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:43:38 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:43:38 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:43:38 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:43:38 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:43:38 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:43:38 devstack sudo[94582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc Sep 22 15:43:38 devstack sudo[94582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:43:38 devstack sudo[94582]: pam_unix(sudo:session): session closed for user root Sep 22 15:43:38 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc" returned: 0 in 0.343s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:43:38 devstack cinder-volume[86212]: DEBUG cinder.manager [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] Notifying Schedulers of capabilities ... {{(pid=86212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 15:43:38 devstack cinder-volume[86212]: DEBUG oslo_service.periodic_task [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] Running periodic task VolumeManager._thread_info {{(pid=86212) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 22 15:43:38 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] thread count: 28 {{(pid=86212) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 22 15:43:38 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] thread info: [<_MainThread(MainThread, started 136163191222400)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86212) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 22 15:43:41 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-412333ac-82c3-40d3-af86-cf071fdbd78e tempest-VolumesActionsTest-1755689979 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:43:41 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-412333ac-82c3-40d3-af86-cf071fdbd78e tempest-VolumesActionsTest-1755689979 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:43:41 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[d12cd777-84ca-4819-9422-4a2344a25246]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:43:41 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-412333ac-82c3-40d3-af86-cf071fdbd78e tempest-VolumesActionsTest-1755689979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-d3d7dcfb-3dac-4e67-bb79-a529324e3637 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:43:41 devstack sudo[94586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-d3d7dcfb-3dac-4e67-bb79-a529324e3637 Sep 22 15:43:41 devstack sudo[94586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:43:42 devstack sudo[94586]: pam_unix(sudo:session): session closed for user root Sep 22 15:43:42 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-412333ac-82c3-40d3-af86-cf071fdbd78e tempest-VolumesActionsTest-1755689979 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-d3d7dcfb-3dac-4e67-bb79-a529324e3637" returned: 0 in 0.399s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:43:42 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[82775ec1-0688-4014-8ac1-14b634a1f1a9]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:43:42 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-412333ac-82c3-40d3-af86-cf071fdbd78e tempest-VolumesActionsTest-1755689979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-d3d7dcfb-3dac-4e67-bb79-a529324e3637 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:43:42 devstack sudo[94592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-d3d7dcfb-3dac-4e67-bb79-a529324e3637 Sep 22 15:43:42 devstack sudo[94592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:43:42 devstack sudo[94592]: pam_unix(sudo:session): session closed for user root Sep 22 15:43:42 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-412333ac-82c3-40d3-af86-cf071fdbd78e tempest-VolumesActionsTest-1755689979 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-d3d7dcfb-3dac-4e67-bb79-a529324e3637" returned: 0 in 0.420s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:43:42 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-412333ac-82c3-40d3-af86-cf071fdbd78e tempest-VolumesActionsTest-1755689979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-d3d7dcfb-3dac-4e67-bb79-a529324e3637 /opt/stack/data/cinder/conversion/d3d7dcfb-3dac-4e67-bb79-a529324e3637.temp_image.6cca63a1-f7cb-487a-bec7-87eb9abc5d93p8dolpx8.img {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:43:42 devstack sudo[94597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-d3d7dcfb-3dac-4e67-bb79-a529324e3637 /opt/stack/data/cinder/conversion/d3d7dcfb-3dac-4e67-bb79-a529324e3637.temp_image.6cca63a1-f7cb-487a-bec7-87eb9abc5d93p8dolpx8.img Sep 22 15:43:42 devstack sudo[94597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:43:44 devstack cinder-volume[86212]: DEBUG cinder.volume.flows.manager.create_volume [None req-248c6e02-83a3-496c-83d7-fcd05b5b050f tempest-AttachVolumeNegativeTest-382120543 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 15:43:44 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-248c6e02-83a3-496c-83d7-fcd05b5b050f tempest-AttachVolumeNegativeTest-382120543 None] Flow 'volume_create_manager' (87e8d059-3524-4595-bdde-7f3857a64cfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:43:44 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-248c6e02-83a3-496c-83d7-fcd05b5b050f tempest-AttachVolumeNegativeTest-382120543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07dbd318-f3ad-4392-91f3-2294a939d475) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:43:44 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-248c6e02-83a3-496c-83d7-fcd05b5b050f tempest-AttachVolumeNegativeTest-382120543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07dbd318-f3ad-4392-91f3-2294a939d475) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:43:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-986661961',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4276d4cf-2155-4db7-aebd-5d4436f3e34a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e189bea702e54595ab5d405d04d4e342',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:43:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:43:44Z,use_quota=True,user_id='ad6a5d22339042abb9842ea9d6925310',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:43:44 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-248c6e02-83a3-496c-83d7-fcd05b5b050f tempest-AttachVolumeNegativeTest-382120543 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4eec36b4-219f-42fa-ad07-21c987f49183) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:43:44 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-248c6e02-83a3-496c-83d7-fcd05b5b050f tempest-AttachVolumeNegativeTest-382120543 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4eec36b4-219f-42fa-ad07-21c987f49183) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:43:44 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-248c6e02-83a3-496c-83d7-fcd05b5b050f tempest-AttachVolumeNegativeTest-382120543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2bc45c4-6a8c-40aa-adb4-88772ec48e7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:43:44 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-248c6e02-83a3-496c-83d7-fcd05b5b050f tempest-AttachVolumeNegativeTest-382120543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2bc45c4-6a8c-40aa-adb4-88772ec48e7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4276d4cf-2155-4db7-aebd-5d4436f3e34a', 'volume_name': 'volume-4276d4cf-2155-4db7-aebd-5d4436f3e34a', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:43:44 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-248c6e02-83a3-496c-83d7-fcd05b5b050f tempest-AttachVolumeNegativeTest-382120543 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (365147d1-e97c-4fa2-94e3-76a26b6aec44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:43:44 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-248c6e02-83a3-496c-83d7-fcd05b5b050f tempest-AttachVolumeNegativeTest-382120543 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (365147d1-e97c-4fa2-94e3-76a26b6aec44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:43:44 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-248c6e02-83a3-496c-83d7-fcd05b5b050f tempest-AttachVolumeNegativeTest-382120543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba8b35cd-03e7-480f-819a-358d6ed7f1db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:43:44 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-248c6e02-83a3-496c-83d7-fcd05b5b050f tempest-AttachVolumeNegativeTest-382120543 None] Volume 4276d4cf-2155-4db7-aebd-5d4436f3e34a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4276d4cf-2155-4db7-aebd-5d4436f3e34a', 'volume_size': 1} Sep 22 15:43:44 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-248c6e02-83a3-496c-83d7-fcd05b5b050f tempest-AttachVolumeNegativeTest-382120543 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:43:50 devstack cinder-volume[86212]: DEBUG cinder.volume.flows.manager.create_volume [None req-385be888-317f-44f9-89d1-4b4a15d8af62 tempest-AttachVolumeTestJSON-678247873 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 15:43:50 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-385be888-317f-44f9-89d1-4b4a15d8af62 tempest-AttachVolumeTestJSON-678247873 None] Flow 'volume_create_manager' (d08b87c9-8049-4f70-847e-d52804d4d43a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:43:50 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-385be888-317f-44f9-89d1-4b4a15d8af62 tempest-AttachVolumeTestJSON-678247873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e59cef4a-6330-4a59-bdcd-8c68a7236217) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:43:50 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-385be888-317f-44f9-89d1-4b4a15d8af62 tempest-AttachVolumeTestJSON-678247873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e59cef4a-6330-4a59-bdcd-8c68a7236217) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:43:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1779161562',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0b0aefc-a6a9-44ae-a223-b680aa0b7948,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db03ba1cc4824283bbed3f55dc9e492e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:43:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:43:50Z,use_quota=True,user_id='2ed3340ecc074224bdb9447ca6deadd1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:43:50 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-385be888-317f-44f9-89d1-4b4a15d8af62 tempest-AttachVolumeTestJSON-678247873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0740146c-3e2c-40d0-a6a1-aeea4f8a94d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:43:50 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-385be888-317f-44f9-89d1-4b4a15d8af62 tempest-AttachVolumeTestJSON-678247873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0740146c-3e2c-40d0-a6a1-aeea4f8a94d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:43:50 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-385be888-317f-44f9-89d1-4b4a15d8af62 tempest-AttachVolumeTestJSON-678247873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88e03b86-a831-487d-a825-7670d0c4c9d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:43:50 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-385be888-317f-44f9-89d1-4b4a15d8af62 tempest-AttachVolumeTestJSON-678247873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88e03b86-a831-487d-a825-7670d0c4c9d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f0b0aefc-a6a9-44ae-a223-b680aa0b7948', 'volume_name': 'volume-f0b0aefc-a6a9-44ae-a223-b680aa0b7948', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:43:50 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-385be888-317f-44f9-89d1-4b4a15d8af62 tempest-AttachVolumeTestJSON-678247873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dce671eb-2d9a-4dbd-b22a-b35f97a09869) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:43:50 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-385be888-317f-44f9-89d1-4b4a15d8af62 tempest-AttachVolumeTestJSON-678247873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dce671eb-2d9a-4dbd-b22a-b35f97a09869) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:43:50 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-385be888-317f-44f9-89d1-4b4a15d8af62 tempest-AttachVolumeTestJSON-678247873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a8c6499-ec64-4b4d-8d84-c2ac44043836) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:43:50 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-385be888-317f-44f9-89d1-4b4a15d8af62 tempest-AttachVolumeTestJSON-678247873 None] Volume f0b0aefc-a6a9-44ae-a223-b680aa0b7948: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f0b0aefc-a6a9-44ae-a223-b680aa0b7948', 'volume_size': 1} Sep 22 15:43:50 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-385be888-317f-44f9-89d1-4b4a15d8af62 tempest-AttachVolumeTestJSON-678247873 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:43:51 devstack sudo[94597]: pam_unix(sudo:session): session closed for user root Sep 22 15:43:51 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-412333ac-82c3-40d3-af86-cf071fdbd78e tempest-VolumesActionsTest-1755689979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-d3d7dcfb-3dac-4e67-bb79-a529324e3637 /opt/stack/data/cinder/conversion/d3d7dcfb-3dac-4e67-bb79-a529324e3637.temp_image.6cca63a1-f7cb-487a-bec7-87eb9abc5d93p8dolpx8.img" returned: 0 in 8.528s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:43:51 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba82a450-1041-4bf2-a35a-c5db5151b0a8]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:43:51 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-412333ac-82c3-40d3-af86-cf071fdbd78e tempest-VolumesActionsTest-1755689979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-d3d7dcfb-3dac-4e67-bb79-a529324e3637 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:43:51 devstack sudo[94621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-d3d7dcfb-3dac-4e67-bb79-a529324e3637 Sep 22 15:43:51 devstack sudo[94621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:43:51 devstack sudo[94621]: pam_unix(sudo:session): session closed for user root Sep 22 15:43:51 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-412333ac-82c3-40d3-af86-cf071fdbd78e tempest-VolumesActionsTest-1755689979 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-d3d7dcfb-3dac-4e67-bb79-a529324e3637" returned: 0 in 0.578s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:43:51 devstack cinder-volume[86212]: DEBUG cinder.image.image_utils [None req-412333ac-82c3-40d3-af86-cf071fdbd78e tempest-VolumesActionsTest-1755689979 None] Image conversion details: src /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-d3d7dcfb-3dac-4e67-bb79-a529324e3637, size 1024.00 MB, duration 8.53 sec, destination /opt/stack/data/cinder/conversion/d3d7dcfb-3dac-4e67-bb79-a529324e3637.temp_image.6cca63a1-f7cb-487a-bec7-87eb9abc5d93p8dolpx8.img {{(pid=86212) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 22 15:43:51 devstack cinder-volume[86212]: INFO cinder.image.image_utils [None req-412333ac-82c3-40d3-af86-cf071fdbd78e tempest-VolumesActionsTest-1755689979 None] Converted 1024.00 MB image at 120.06 MB/s Sep 22 15:43:51 devstack cinder-volume[86212]: DEBUG cinder.image.image_utils [None req-412333ac-82c3-40d3-af86-cf071fdbd78e tempest-VolumesActionsTest-1755689979 None] 6cca63a1-f7cb-487a-bec7-87eb9abc5d93 was raw, no need to convert to raw {{(pid=86212) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}} Sep 22 15:43:54 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-c1e0d6cf-7f50-4672-9887-83ddc769c842 tempest-GroupsV314Test-1152114611 None] Group tempest-GroupsV314Test-Group-1036297299: creating Sep 22 15:43:54 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-c1e0d6cf-7f50-4672-9887-83ddc769c842 tempest-GroupsV314Test-1152114611 None] Group tempest-GroupsV314Test-Group-1036297299: created successfully Sep 22 15:43:54 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-c1e0d6cf-7f50-4672-9887-83ddc769c842 tempest-GroupsV314Test-1152114611 None] Create group completed successfully. Sep 22 15:43:55 devstack cinder-volume[86212]: DEBUG cinder.volume.flows.manager.create_volume [None req-e73cbbed-47c2-4440-a2e2-866feb29c0b9 tempest-GroupsV314Test-1152114611 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 15:43:55 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-e73cbbed-47c2-4440-a2e2-866feb29c0b9 tempest-GroupsV314Test-1152114611 None] Flow 'volume_create_manager' (6474f394-5912-42b2-982b-ae8b3d626169) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:43:55 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-e73cbbed-47c2-4440-a2e2-866feb29c0b9 tempest-GroupsV314Test-1152114611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e72bc9d-16c2-4bbd-ad9f-1ebf1bf3d0c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:43:55 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-e73cbbed-47c2-4440-a2e2-866feb29c0b9 tempest-GroupsV314Test-1152114611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e72bc9d-16c2-4bbd-ad9f-1ebf1bf3d0c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:43:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-405988774',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0f90fbd8-e066-4221-ac3c-287577388c3b,host='devstack@QuobyteHD#QuobyteHD',id=d3c39961-3794-4118-8120-caf8e5503556,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed55b3d0547746f9a0c679d4e93302c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:43:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:43:56Z,use_quota=True,user_id='e2691226d1f1467e82b9f009767ff356',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de1e87c9-eac1-41af-b249-e1af17428f3b),volume_type_id=de1e87c9-eac1-41af-b249-e1af17428f3b)' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:43:55 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-e73cbbed-47c2-4440-a2e2-866feb29c0b9 tempest-GroupsV314Test-1152114611 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a772e207-a78e-4c4f-b77b-5349bf865c98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:43:55 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-e73cbbed-47c2-4440-a2e2-866feb29c0b9 tempest-GroupsV314Test-1152114611 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a772e207-a78e-4c4f-b77b-5349bf865c98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:43:55 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-e73cbbed-47c2-4440-a2e2-866feb29c0b9 tempest-GroupsV314Test-1152114611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a28a3649-b07b-4cb2-9b39-e5ab6c4bcf55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:43:55 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-e73cbbed-47c2-4440-a2e2-866feb29c0b9 tempest-GroupsV314Test-1152114611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a28a3649-b07b-4cb2-9b39-e5ab6c4bcf55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd3c39961-3794-4118-8120-caf8e5503556', 'volume_name': 'volume-d3c39961-3794-4118-8120-caf8e5503556', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:43:55 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-e73cbbed-47c2-4440-a2e2-866feb29c0b9 tempest-GroupsV314Test-1152114611 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2b99887-401a-47b3-ba0d-a1b6d0f334e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:43:55 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-e73cbbed-47c2-4440-a2e2-866feb29c0b9 tempest-GroupsV314Test-1152114611 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2b99887-401a-47b3-ba0d-a1b6d0f334e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:43:55 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-e73cbbed-47c2-4440-a2e2-866feb29c0b9 tempest-GroupsV314Test-1152114611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2387e75d-c45c-439e-954d-b7703c0204fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:43:55 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-e73cbbed-47c2-4440-a2e2-866feb29c0b9 tempest-GroupsV314Test-1152114611 None] Volume d3c39961-3794-4118-8120-caf8e5503556: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d3c39961-3794-4118-8120-caf8e5503556', 'volume_size': 1} Sep 22 15:43:55 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-e73cbbed-47c2-4440-a2e2-866feb29c0b9 tempest-GroupsV314Test-1152114611 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:44:05 devstack cinder-volume[86212]: DEBUG dbcounter [-] [86212] Writing DB stats cinder:UPDATE=8,cinder:SELECT=9 {{(pid=86212) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 22 15:44:05 devstack cinder-volume[86212]: DEBUG dbcounter [-] [86212] Writing DB stats cinder:SELECT=17,cinder:INSERT=2,cinder:UPDATE=4 {{(pid=86212) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 22 15:44:11 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-412333ac-82c3-40d3-af86-cf071fdbd78e tempest-VolumesActionsTest-1755689979 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 30.119s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:44:11 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-412333ac-82c3-40d3-af86-cf071fdbd78e tempest-VolumesActionsTest-1755689979 None] Uploaded volume to glance image-id: 6cca63a1-f7cb-487a-bec7-87eb9abc5d93. {{(pid=86212) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 22 15:44:11 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-248c6e02-83a3-496c-83d7-fcd05b5b050f tempest-AttachVolumeNegativeTest-382120543 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 27.263s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:44:11 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-248c6e02-83a3-496c-83d7-fcd05b5b050f tempest-AttachVolumeNegativeTest-382120543 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:43:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-986661961',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4276d4cf-2155-4db7-aebd-5d4436f3e34a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e189bea702e54595ab5d405d04d4e342',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:43:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:43:44Z,use_quota=True,user_id='ad6a5d22339042abb9842ea9d6925310',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)}" {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 15:44:11 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-248c6e02-83a3-496c-83d7-fcd05b5b050f tempest-AttachVolumeNegativeTest-382120543 None] Creating volume 4276d4cf-2155-4db7-aebd-5d4436f3e34a {{(pid=86212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 15:44:11 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-248c6e02-83a3-496c-83d7-fcd05b5b050f tempest-AttachVolumeNegativeTest-382120543 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:44:11 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-248c6e02-83a3-496c-83d7-fcd05b5b050f tempest-AttachVolumeNegativeTest-382120543 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:44:11 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-248c6e02-83a3-496c-83d7-fcd05b5b050f tempest-AttachVolumeNegativeTest-382120543 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:44:11 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-248c6e02-83a3-496c-83d7-fcd05b5b050f tempest-AttachVolumeNegativeTest-382120543 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:44:11 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-248c6e02-83a3-496c-83d7-fcd05b5b050f tempest-AttachVolumeNegativeTest-382120543 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:44:11 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-248c6e02-83a3-496c-83d7-fcd05b5b050f tempest-AttachVolumeNegativeTest-382120543 None] Selected osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 as target Quobyte volume. {{(pid=86212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 15:44:11 devstack cinder-volume[86212]: INFO cinder.volume.drivers.remotefs [None req-248c6e02-83a3-496c-83d7-fcd05b5b050f tempest-AttachVolumeNegativeTest-382120543 None] casted to osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 Sep 22 15:44:11 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-248c6e02-83a3-496c-83d7-fcd05b5b050f tempest-AttachVolumeNegativeTest-382120543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-4276d4cf-2155-4db7-aebd-5d4436f3e34a 1073741824 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:44:11 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-412333ac-82c3-40d3-af86-cf071fdbd78e tempest-VolumesActionsTest-1755689979 None] Copy volume to image completed successfully. Sep 22 15:44:11 devstack sudo[94630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-4276d4cf-2155-4db7-aebd-5d4436f3e34a 1073741824 Sep 22 15:44:11 devstack sudo[94630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:44:12 devstack sudo[94630]: pam_unix(sudo:session): session closed for user root Sep 22 15:44:12 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-248c6e02-83a3-496c-83d7-fcd05b5b050f tempest-AttachVolumeNegativeTest-382120543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-4276d4cf-2155-4db7-aebd-5d4436f3e34a 1073741824" returned: 0 in 0.481s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:44:12 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-248c6e02-83a3-496c-83d7-fcd05b5b050f tempest-AttachVolumeNegativeTest-382120543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-4276d4cf-2155-4db7-aebd-5d4436f3e34a {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:44:12 devstack sudo[94636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-4276d4cf-2155-4db7-aebd-5d4436f3e34a Sep 22 15:44:12 devstack sudo[94636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:44:12 devstack sudo[94636]: pam_unix(sudo:session): session closed for user root Sep 22 15:44:12 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-248c6e02-83a3-496c-83d7-fcd05b5b050f tempest-AttachVolumeNegativeTest-382120543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-4276d4cf-2155-4db7-aebd-5d4436f3e34a" returned: 0 in 0.255s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:44:12 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-248c6e02-83a3-496c-83d7-fcd05b5b050f tempest-AttachVolumeNegativeTest-382120543 None] <== create_volume: return (780ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'} {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 15:44:12 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-248c6e02-83a3-496c-83d7-fcd05b5b050f tempest-AttachVolumeNegativeTest-382120543 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.782s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:44:12 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-385be888-317f-44f9-89d1-4b4a15d8af62 tempest-AttachVolumeTestJSON-678247873 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 22.108s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:44:12 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-385be888-317f-44f9-89d1-4b4a15d8af62 tempest-AttachVolumeTestJSON-678247873 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:43:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1779161562',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0b0aefc-a6a9-44ae-a223-b680aa0b7948,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db03ba1cc4824283bbed3f55dc9e492e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:43:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:43:50Z,use_quota=True,user_id='2ed3340ecc074224bdb9447ca6deadd1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)}" {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 15:44:12 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-385be888-317f-44f9-89d1-4b4a15d8af62 tempest-AttachVolumeTestJSON-678247873 None] Creating volume f0b0aefc-a6a9-44ae-a223-b680aa0b7948 {{(pid=86212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 15:44:12 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-385be888-317f-44f9-89d1-4b4a15d8af62 tempest-AttachVolumeTestJSON-678247873 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:44:12 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-385be888-317f-44f9-89d1-4b4a15d8af62 tempest-AttachVolumeTestJSON-678247873 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:44:12 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-385be888-317f-44f9-89d1-4b4a15d8af62 tempest-AttachVolumeTestJSON-678247873 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:44:12 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-385be888-317f-44f9-89d1-4b4a15d8af62 tempest-AttachVolumeTestJSON-678247873 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:44:12 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-385be888-317f-44f9-89d1-4b4a15d8af62 tempest-AttachVolumeTestJSON-678247873 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:44:12 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-385be888-317f-44f9-89d1-4b4a15d8af62 tempest-AttachVolumeTestJSON-678247873 None] Selected osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 as target Quobyte volume. {{(pid=86212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 15:44:12 devstack cinder-volume[86212]: INFO cinder.volume.drivers.remotefs [None req-385be888-317f-44f9-89d1-4b4a15d8af62 tempest-AttachVolumeTestJSON-678247873 None] casted to osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 Sep 22 15:44:12 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-385be888-317f-44f9-89d1-4b4a15d8af62 tempest-AttachVolumeTestJSON-678247873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-f0b0aefc-a6a9-44ae-a223-b680aa0b7948 1073741824 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:44:12 devstack sudo[94639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-f0b0aefc-a6a9-44ae-a223-b680aa0b7948 1073741824 Sep 22 15:44:12 devstack sudo[94639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:44:12 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-248c6e02-83a3-496c-83d7-fcd05b5b050f tempest-AttachVolumeNegativeTest-382120543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba8b35cd-03e7-480f-819a-358d6ed7f1db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4276d4cf-2155-4db7-aebd-5d4436f3e34a', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:44:12 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-248c6e02-83a3-496c-83d7-fcd05b5b050f tempest-AttachVolumeNegativeTest-382120543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a2de403-325e-44eb-811b-981669b7a1d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:44:12 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-248c6e02-83a3-496c-83d7-fcd05b5b050f tempest-AttachVolumeNegativeTest-382120543 None] Volume volume-4276d4cf-2155-4db7-aebd-5d4436f3e34a (4276d4cf-2155-4db7-aebd-5d4436f3e34a): created successfully Sep 22 15:44:12 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-248c6e02-83a3-496c-83d7-fcd05b5b050f tempest-AttachVolumeNegativeTest-382120543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a2de403-325e-44eb-811b-981669b7a1d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:44:12 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-248c6e02-83a3-496c-83d7-fcd05b5b050f tempest-AttachVolumeNegativeTest-382120543 None] Flow 'volume_create_manager' (87e8d059-3524-4595-bdde-7f3857a64cfc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:44:12 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-248c6e02-83a3-496c-83d7-fcd05b5b050f tempest-AttachVolumeNegativeTest-382120543 None] Created volume successfully. Sep 22 15:44:12 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-33887d0f-40bb-4b53-a306-fd8bf2260926 tempest-VolumesActionsTest-1755689979 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:44:13 devstack sudo[94639]: pam_unix(sudo:session): session closed for user root Sep 22 15:44:13 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-385be888-317f-44f9-89d1-4b4a15d8af62 tempest-AttachVolumeTestJSON-678247873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-f0b0aefc-a6a9-44ae-a223-b680aa0b7948 1073741824" returned: 0 in 0.461s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:44:13 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-385be888-317f-44f9-89d1-4b4a15d8af62 tempest-AttachVolumeTestJSON-678247873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-f0b0aefc-a6a9-44ae-a223-b680aa0b7948 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:44:13 devstack sudo[94644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-f0b0aefc-a6a9-44ae-a223-b680aa0b7948 Sep 22 15:44:13 devstack sudo[94644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:44:13 devstack sudo[94644]: pam_unix(sudo:session): session closed for user root Sep 22 15:44:13 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-385be888-317f-44f9-89d1-4b4a15d8af62 tempest-AttachVolumeTestJSON-678247873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-f0b0aefc-a6a9-44ae-a223-b680aa0b7948" returned: 0 in 0.253s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:44:13 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-385be888-317f-44f9-89d1-4b4a15d8af62 tempest-AttachVolumeTestJSON-678247873 None] <== create_volume: return (758ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'} {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 15:44:13 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-385be888-317f-44f9-89d1-4b4a15d8af62 tempest-AttachVolumeTestJSON-678247873 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.761s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:44:13 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-e73cbbed-47c2-4440-a2e2-866feb29c0b9 tempest-GroupsV314Test-1152114611 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 17.489s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:44:13 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-e73cbbed-47c2-4440-a2e2-866feb29c0b9 tempest-GroupsV314Test-1152114611 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=0f90fbd8-e066-4221-ac3c-287577388c3b,created_at=2026-09-22T13:43:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-405988774',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0f90fbd8-e066-4221-ac3c-287577388c3b,host='devstack@QuobyteHD#QuobyteHD',id=d3c39961-3794-4118-8120-caf8e5503556,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed55b3d0547746f9a0c679d4e93302c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:43:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:43:56Z,use_quota=True,user_id='e2691226d1f1467e82b9f009767ff356',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de1e87c9-eac1-41af-b249-e1af17428f3b),volume_type_id=de1e87c9-eac1-41af-b249-e1af17428f3b)}" {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 15:44:13 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-e73cbbed-47c2-4440-a2e2-866feb29c0b9 tempest-GroupsV314Test-1152114611 None] Creating volume d3c39961-3794-4118-8120-caf8e5503556 {{(pid=86212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 15:44:13 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-e73cbbed-47c2-4440-a2e2-866feb29c0b9 tempest-GroupsV314Test-1152114611 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:44:13 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-e73cbbed-47c2-4440-a2e2-866feb29c0b9 tempest-GroupsV314Test-1152114611 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:44:13 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-e73cbbed-47c2-4440-a2e2-866feb29c0b9 tempest-GroupsV314Test-1152114611 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:44:13 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-e73cbbed-47c2-4440-a2e2-866feb29c0b9 tempest-GroupsV314Test-1152114611 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:44:13 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-e73cbbed-47c2-4440-a2e2-866feb29c0b9 tempest-GroupsV314Test-1152114611 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:44:13 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-e73cbbed-47c2-4440-a2e2-866feb29c0b9 tempest-GroupsV314Test-1152114611 None] Selected osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 as target Quobyte volume. {{(pid=86212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 15:44:13 devstack cinder-volume[86212]: INFO cinder.volume.drivers.remotefs [None req-e73cbbed-47c2-4440-a2e2-866feb29c0b9 tempest-GroupsV314Test-1152114611 None] casted to osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 Sep 22 15:44:13 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-e73cbbed-47c2-4440-a2e2-866feb29c0b9 tempest-GroupsV314Test-1152114611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-d3c39961-3794-4118-8120-caf8e5503556 1073741824 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:44:13 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-385be888-317f-44f9-89d1-4b4a15d8af62 tempest-AttachVolumeTestJSON-678247873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a8c6499-ec64-4b4d-8d84-c2ac44043836) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f0b0aefc-a6a9-44ae-a223-b680aa0b7948', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:44:13 devstack sudo[94647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-d3c39961-3794-4118-8120-caf8e5503556 1073741824 Sep 22 15:44:13 devstack sudo[94647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:44:13 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-385be888-317f-44f9-89d1-4b4a15d8af62 tempest-AttachVolumeTestJSON-678247873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a51e99b3-69ec-4a12-b6b1-8fdca2574ad7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:44:13 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-385be888-317f-44f9-89d1-4b4a15d8af62 tempest-AttachVolumeTestJSON-678247873 None] Volume volume-f0b0aefc-a6a9-44ae-a223-b680aa0b7948 (f0b0aefc-a6a9-44ae-a223-b680aa0b7948): created successfully Sep 22 15:44:13 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-385be888-317f-44f9-89d1-4b4a15d8af62 tempest-AttachVolumeTestJSON-678247873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a51e99b3-69ec-4a12-b6b1-8fdca2574ad7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:44:13 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-385be888-317f-44f9-89d1-4b4a15d8af62 tempest-AttachVolumeTestJSON-678247873 None] Flow 'volume_create_manager' (d08b87c9-8049-4f70-847e-d52804d4d43a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:44:13 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-385be888-317f-44f9-89d1-4b4a15d8af62 tempest-AttachVolumeTestJSON-678247873 None] Created volume successfully. Sep 22 15:44:14 devstack sudo[94647]: pam_unix(sudo:session): session closed for user root Sep 22 15:44:14 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-e73cbbed-47c2-4440-a2e2-866feb29c0b9 tempest-GroupsV314Test-1152114611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-d3c39961-3794-4118-8120-caf8e5503556 1073741824" returned: 0 in 0.592s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:44:14 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-e73cbbed-47c2-4440-a2e2-866feb29c0b9 tempest-GroupsV314Test-1152114611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-d3c39961-3794-4118-8120-caf8e5503556 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:44:14 devstack sudo[94659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-d3c39961-3794-4118-8120-caf8e5503556 Sep 22 15:44:14 devstack sudo[94659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:44:14 devstack sudo[94659]: pam_unix(sudo:session): session closed for user root Sep 22 15:44:14 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-e73cbbed-47c2-4440-a2e2-866feb29c0b9 tempest-GroupsV314Test-1152114611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-d3c39961-3794-4118-8120-caf8e5503556" returned: 0 in 0.334s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:44:14 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-e73cbbed-47c2-4440-a2e2-866feb29c0b9 tempest-GroupsV314Test-1152114611 None] <== create_volume: return (984ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'} {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 15:44:14 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-e73cbbed-47c2-4440-a2e2-866feb29c0b9 tempest-GroupsV314Test-1152114611 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.986s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:44:14 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-33887d0f-40bb-4b53-a306-fd8bf2260926 tempest-VolumesActionsTest-1755689979 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 1.465s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:44:14 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-e73cbbed-47c2-4440-a2e2-866feb29c0b9 tempest-GroupsV314Test-1152114611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2387e75d-c45c-439e-954d-b7703c0204fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d3c39961-3794-4118-8120-caf8e5503556', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:44:14 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-e73cbbed-47c2-4440-a2e2-866feb29c0b9 tempest-GroupsV314Test-1152114611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd882aa6-7a66-4eeb-a2ad-b8adcc4a3780) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:44:14 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[f19a0f30-5e03-40b1-8ad1-cfed1284d87e]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:44:14 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-33887d0f-40bb-4b53-a306-fd8bf2260926 tempest-VolumesActionsTest-1755689979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-d3d7dcfb-3dac-4e67-bb79-a529324e3637 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:44:14 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-e73cbbed-47c2-4440-a2e2-866feb29c0b9 tempest-GroupsV314Test-1152114611 None] Volume volume-d3c39961-3794-4118-8120-caf8e5503556 (d3c39961-3794-4118-8120-caf8e5503556): created successfully Sep 22 15:44:14 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-e73cbbed-47c2-4440-a2e2-866feb29c0b9 tempest-GroupsV314Test-1152114611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd882aa6-7a66-4eeb-a2ad-b8adcc4a3780) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:44:14 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-e73cbbed-47c2-4440-a2e2-866feb29c0b9 tempest-GroupsV314Test-1152114611 None] Flow 'volume_create_manager' (6474f394-5912-42b2-982b-ae8b3d626169) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:44:14 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-e73cbbed-47c2-4440-a2e2-866feb29c0b9 tempest-GroupsV314Test-1152114611 None] Created volume successfully. Sep 22 15:44:14 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [req-309274e9-2b6f-4c02-9402-d0acfb4aa21f req-e35f6584-4aeb-4ad3-9e73-efc04fb930fe tempest-AttachVolumeTestJSON-678247873 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:44:14 devstack sudo[94669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-d3d7dcfb-3dac-4e67-bb79-a529324e3637 Sep 22 15:44:14 devstack sudo[94669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:44:14 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [req-041cd94b-8360-431c-ac8d-ebdc9fdc3b72 req-1e26f987-a4cc-4d2c-8d01-f5f6469e03e4 tempest-AttachVolumeNegativeTest-382120543 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:44:14 devstack sudo[94669]: pam_unix(sudo:session): session closed for user root Sep 22 15:44:14 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-33887d0f-40bb-4b53-a306-fd8bf2260926 tempest-VolumesActionsTest-1755689979 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-d3d7dcfb-3dac-4e67-bb79-a529324e3637" returned: 0 in 0.447s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:44:14 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f75b9b3-c6fa-4b0c-8ef8-7a6c331c0a63]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:44:14 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-33887d0f-40bb-4b53-a306-fd8bf2260926 tempest-VolumesActionsTest-1755689979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-d3d7dcfb-3dac-4e67-bb79-a529324e3637 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:44:15 devstack sudo[94683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-d3d7dcfb-3dac-4e67-bb79-a529324e3637 Sep 22 15:44:15 devstack sudo[94683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:44:15 devstack sudo[94683]: pam_unix(sudo:session): session closed for user root Sep 22 15:44:15 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-33887d0f-40bb-4b53-a306-fd8bf2260926 tempest-VolumesActionsTest-1755689979 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-d3d7dcfb-3dac-4e67-bb79-a529324e3637" returned: 0 in 0.365s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:44:15 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-33887d0f-40bb-4b53-a306-fd8bf2260926 tempest-VolumesActionsTest-1755689979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-d3d7dcfb-3dac-4e67-bb79-a529324e3637 /opt/stack/data/cinder/conversion/d3d7dcfb-3dac-4e67-bb79-a529324e3637.temp_image.875f5dd8-0766-4032-9cf2-250fb11a30e3tj4mxdv6.img {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:44:15 devstack sudo[94688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-d3d7dcfb-3dac-4e67-bb79-a529324e3637 /opt/stack/data/cinder/conversion/d3d7dcfb-3dac-4e67-bb79-a529324e3637.temp_image.875f5dd8-0766-4032-9cf2-250fb11a30e3tj4mxdv6.img Sep 22 15:44:15 devstack sudo[94688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:44:21 devstack sudo[94688]: pam_unix(sudo:session): session closed for user root Sep 22 15:44:21 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-33887d0f-40bb-4b53-a306-fd8bf2260926 tempest-VolumesActionsTest-1755689979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-d3d7dcfb-3dac-4e67-bb79-a529324e3637 /opt/stack/data/cinder/conversion/d3d7dcfb-3dac-4e67-bb79-a529324e3637.temp_image.875f5dd8-0766-4032-9cf2-250fb11a30e3tj4mxdv6.img" returned: 0 in 5.744s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:44:21 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[139a03c2-0147-46bf-8872-25542438d5d6]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:44:21 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-33887d0f-40bb-4b53-a306-fd8bf2260926 tempest-VolumesActionsTest-1755689979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-d3d7dcfb-3dac-4e67-bb79-a529324e3637 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:44:21 devstack sudo[94702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-d3d7dcfb-3dac-4e67-bb79-a529324e3637 Sep 22 15:44:21 devstack sudo[94702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:44:21 devstack sudo[94702]: pam_unix(sudo:session): session closed for user root Sep 22 15:44:21 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-33887d0f-40bb-4b53-a306-fd8bf2260926 tempest-VolumesActionsTest-1755689979 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-d3d7dcfb-3dac-4e67-bb79-a529324e3637" returned: 0 in 0.522s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:44:21 devstack cinder-volume[86212]: DEBUG cinder.image.image_utils [None req-33887d0f-40bb-4b53-a306-fd8bf2260926 tempest-VolumesActionsTest-1755689979 None] Image conversion details: src /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-d3d7dcfb-3dac-4e67-bb79-a529324e3637, size 1024.00 MB, duration 5.75 sec, destination /opt/stack/data/cinder/conversion/d3d7dcfb-3dac-4e67-bb79-a529324e3637.temp_image.875f5dd8-0766-4032-9cf2-250fb11a30e3tj4mxdv6.img {{(pid=86212) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 22 15:44:21 devstack cinder-volume[86212]: INFO cinder.image.image_utils [None req-33887d0f-40bb-4b53-a306-fd8bf2260926 tempest-VolumesActionsTest-1755689979 None] Converted 1024.00 MB image at 178.23 MB/s Sep 22 15:44:21 devstack cinder-volume[86212]: DEBUG cinder.image.image_utils [None req-33887d0f-40bb-4b53-a306-fd8bf2260926 tempest-VolumesActionsTest-1755689979 None] 875f5dd8-0766-4032-9cf2-250fb11a30e3 was raw, converting to qcow2 {{(pid=86212) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1203}} Sep 22 15:44:21 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[e850ae82-39f3-4a40-b95c-3dbaf703726b]: (4, 'raw') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:44:21 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-33887d0f-40bb-4b53-a306-fd8bf2260926 tempest-VolumesActionsTest-1755689979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/d3d7dcfb-3dac-4e67-bb79-a529324e3637.temp_image.875f5dd8-0766-4032-9cf2-250fb11a30e3tj4mxdv6.img {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:44:21 devstack sudo[94707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/d3d7dcfb-3dac-4e67-bb79-a529324e3637.temp_image.875f5dd8-0766-4032-9cf2-250fb11a30e3tj4mxdv6.img Sep 22 15:44:21 devstack sudo[94707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:44:21 devstack sudo[94707]: pam_unix(sudo:session): session closed for user root Sep 22 15:44:21 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-33887d0f-40bb-4b53-a306-fd8bf2260926 tempest-VolumesActionsTest-1755689979 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/d3d7dcfb-3dac-4e67-bb79-a529324e3637.temp_image.875f5dd8-0766-4032-9cf2-250fb11a30e3tj4mxdv6.img" returned: 0 in 0.320s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:44:21 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-33887d0f-40bb-4b53-a306-fd8bf2260926 tempest-VolumesActionsTest-1755689979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/d3d7dcfb-3dac-4e67-bb79-a529324e3637.temp_image.875f5dd8-0766-4032-9cf2-250fb11a30e3tj4mxdv6.img {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:44:22 devstack sudo[94711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/d3d7dcfb-3dac-4e67-bb79-a529324e3637.temp_image.875f5dd8-0766-4032-9cf2-250fb11a30e3tj4mxdv6.img Sep 22 15:44:22 devstack sudo[94711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:44:22 devstack sudo[94711]: pam_unix(sudo:session): session closed for user root Sep 22 15:44:22 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-33887d0f-40bb-4b53-a306-fd8bf2260926 tempest-VolumesActionsTest-1755689979 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/d3d7dcfb-3dac-4e67-bb79-a529324e3637.temp_image.875f5dd8-0766-4032-9cf2-250fb11a30e3tj4mxdv6.img" returned: 1 in 0.317s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:44:22 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-33887d0f-40bb-4b53-a306-fd8bf2260926 tempest-VolumesActionsTest-1755689979 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/d3d7dcfb-3dac-4e67-bb79-a529324e3637.temp_image.875f5dd8-0766-4032-9cf2-250fb11a30e3tj4mxdv6.img' failed. Not Retrying. {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 22 15:44:22 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-33887d0f-40bb-4b53-a306-fd8bf2260926 tempest-VolumesActionsTest-1755689979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/d3d7dcfb-3dac-4e67-bb79-a529324e3637.temp_image.875f5dd8-0766-4032-9cf2-250fb11a30e3tj4mxdv6.img /opt/stack/data/cinder/conversion/vol_upload_rnbqn49d {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:44:22 devstack sudo[94716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/d3d7dcfb-3dac-4e67-bb79-a529324e3637.temp_image.875f5dd8-0766-4032-9cf2-250fb11a30e3tj4mxdv6.img /opt/stack/data/cinder/conversion/vol_upload_rnbqn49d Sep 22 15:44:22 devstack sudo[94716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:44:22 devstack sudo[94716]: pam_unix(sudo:session): session closed for user root Sep 22 15:44:22 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-33887d0f-40bb-4b53-a306-fd8bf2260926 tempest-VolumesActionsTest-1755689979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/d3d7dcfb-3dac-4e67-bb79-a529324e3637.temp_image.875f5dd8-0766-4032-9cf2-250fb11a30e3tj4mxdv6.img /opt/stack/data/cinder/conversion/vol_upload_rnbqn49d" returned: 0 in 0.251s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:44:22 devstack cinder-volume[86212]: DEBUG cinder.image.image_utils [None req-33887d0f-40bb-4b53-a306-fd8bf2260926 tempest-VolumesActionsTest-1755689979 None] Image conversion details: src /opt/stack/data/cinder/conversion/d3d7dcfb-3dac-4e67-bb79-a529324e3637.temp_image.875f5dd8-0766-4032-9cf2-250fb11a30e3tj4mxdv6.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_rnbqn49d {{(pid=86212) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 22 15:44:22 devstack cinder-volume[86212]: INFO cinder.image.image_utils [None req-33887d0f-40bb-4b53-a306-fd8bf2260926 tempest-VolumesActionsTest-1755689979 None] Converted 1024.00 MB image at 1024.00 MB/s Sep 22 15:44:22 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4be2ee6-3783-4ddb-ade1-0e52041c6e0a]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:44:22 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-33887d0f-40bb-4b53-a306-fd8bf2260926 tempest-VolumesActionsTest-1755689979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_rnbqn49d {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:44:22 devstack sudo[94722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_rnbqn49d Sep 22 15:44:22 devstack sudo[94722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:44:22 devstack sudo[94722]: pam_unix(sudo:session): session closed for user root Sep 22 15:44:22 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-33887d0f-40bb-4b53-a306-fd8bf2260926 tempest-VolumesActionsTest-1755689979 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_rnbqn49d" returned: 0 in 0.326s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:44:24 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-33887d0f-40bb-4b53-a306-fd8bf2260926 tempest-VolumesActionsTest-1755689979 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 9.596s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:44:24 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-33887d0f-40bb-4b53-a306-fd8bf2260926 tempest-VolumesActionsTest-1755689979 None] Uploaded volume to glance image-id: 875f5dd8-0766-4032-9cf2-250fb11a30e3. {{(pid=86212) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 22 15:44:24 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [req-309274e9-2b6f-4c02-9402-d0acfb4aa21f req-e35f6584-4aeb-4ad3-9e73-efc04fb930fe tempest-AttachVolumeTestJSON-678247873 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 9.402s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:44:24 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [req-309274e9-2b6f-4c02-9402-d0acfb4aa21f req-e35f6584-4aeb-4ad3-9e73-efc04fb930fe tempest-AttachVolumeTestJSON-678247873 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:44:24 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [req-041cd94b-8360-431c-ac8d-ebdc9fdc3b72 req-1e26f987-a4cc-4d2c-8d01-f5f6469e03e4 tempest-AttachVolumeNegativeTest-382120543 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 9.262s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:44:24 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-33887d0f-40bb-4b53-a306-fd8bf2260926 tempest-VolumesActionsTest-1755689979 None] Copy volume to image completed successfully. Sep 22 15:44:24 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [req-041cd94b-8360-431c-ac8d-ebdc9fdc3b72 req-1e26f987-a4cc-4d2c-8d01-f5f6469e03e4 tempest-AttachVolumeNegativeTest-382120543 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.080s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:44:24 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [req-309274e9-2b6f-4c02-9402-d0acfb4aa21f req-e35f6584-4aeb-4ad3-9e73-efc04fb930fe tempest-AttachVolumeTestJSON-678247873 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31', 'name': 'volume-f0b0aefc-a6a9-44ae-a223-b680aa0b7948', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'cf3e155b-2bf1-4943-9722-fd004c02d9f7', 'enforce_multipath': True} {{(pid=86212) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 22 15:44:24 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [req-041cd94b-8360-431c-ac8d-ebdc9fdc3b72 req-1e26f987-a4cc-4d2c-8d01-f5f6469e03e4 tempest-AttachVolumeNegativeTest-382120543 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31', 'name': 'volume-4276d4cf-2155-4db7-aebd-5d4436f3e34a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'bb335c70-429f-4835-93b7-d16e6de9d57b', 'enforce_multipath': True} {{(pid=86212) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 22 15:44:24 devstack cinder-volume[86212]: INFO cinder.volume.manager [req-309274e9-2b6f-4c02-9402-d0acfb4aa21f req-e35f6584-4aeb-4ad3-9e73-efc04fb930fe tempest-AttachVolumeTestJSON-678247873 None] attachment_update completed successfully. Sep 22 15:44:24 devstack cinder-volume[86212]: INFO cinder.volume.manager [req-041cd94b-8360-431c-ac8d-ebdc9fdc3b72 req-1e26f987-a4cc-4d2c-8d01-f5f6469e03e4 tempest-AttachVolumeNegativeTest-382120543 None] attachment_update completed successfully. Sep 22 15:44:25 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-73e5b8f8-5b28-4b15-885d-4566ffc585d9 tempest-GroupsV314Test-1152114611 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:44:25 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-73e5b8f8-5b28-4b15-885d-4566ffc585d9 tempest-GroupsV314Test-1152114611 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:44:25 devstack cinder-volume[86212]: INFO cinder.volume.drivers.remotefs [None req-73e5b8f8-5b28-4b15-885d-4566ffc585d9 tempest-GroupsV314Test-1152114611 None] Cloning volume d3c39961-3794-4118-8120-caf8e5503556 to volume 65f6df4c-c7c3-469c-aaee-abfef950480e Sep 22 15:44:25 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-73e5b8f8-5b28-4b15-885d-4566ffc585d9 tempest-GroupsV314Test-1152114611 None] Creating offline snapshot a1975627-0914-48cb-849a-8bd68bfed202 of volume d3c39961-3794-4118-8120-caf8e5503556 {{(pid=86212) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 22 15:44:25 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[766b0232-23e1-4677-aa7f-45ba927df441]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:44:25 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-73e5b8f8-5b28-4b15-885d-4566ffc585d9 tempest-GroupsV314Test-1152114611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-d3c39961-3794-4118-8120-caf8e5503556 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:44:25 devstack sudo[95145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-d3c39961-3794-4118-8120-caf8e5503556 Sep 22 15:44:25 devstack sudo[95145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:44:25 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-c04b376b-be9e-436e-b60d-b252622ffcc8 tempest-VolumesActionsTest-1755689979 None] Acquiring lock "cinder-d3d7dcfb-3dac-4e67-bb79-a529324e3637-delete_volume" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:44:25 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-c04b376b-be9e-436e-b60d-b252622ffcc8 tempest-VolumesActionsTest-1755689979 None] Lock "cinder-d3d7dcfb-3dac-4e67-bb79-a529324e3637-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:44:25 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-c04b376b-be9e-436e-b60d-b252622ffcc8 tempest-VolumesActionsTest-1755689979 None] Acquiring lock "cinder-quobyte-d3d7dcfb-3dac-4e67-bb79-a529324e3637" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:44:25 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-c04b376b-be9e-436e-b60d-b252622ffcc8 tempest-VolumesActionsTest-1755689979 None] Lock "cinder-quobyte-d3d7dcfb-3dac-4e67-bb79-a529324e3637" acquired by "delete_volume" :: waited 0.022s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:44:25 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[46423bff-c6df-469b-867d-0cdd585da940]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:44:25 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-c04b376b-be9e-436e-b60d-b252622ffcc8 tempest-VolumesActionsTest-1755689979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-d3d7dcfb-3dac-4e67-bb79-a529324e3637 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:44:25 devstack sudo[95145]: pam_unix(sudo:session): session closed for user root Sep 22 15:44:25 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-73e5b8f8-5b28-4b15-885d-4566ffc585d9 tempest-GroupsV314Test-1152114611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-d3c39961-3794-4118-8120-caf8e5503556" returned: 0 in 0.566s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:44:25 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-73e5b8f8-5b28-4b15-885d-4566ffc585d9 tempest-GroupsV314Test-1152114611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-d3c39961-3794-4118-8120-caf8e5503556,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-d3c39961-3794-4118-8120-caf8e5503556.a1975627-0914-48cb-849a-8bd68bfed202 1G {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:44:25 devstack sudo[95151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-d3c39961-3794-4118-8120-caf8e5503556,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-d3c39961-3794-4118-8120-caf8e5503556.a1975627-0914-48cb-849a-8bd68bfed202 1G Sep 22 15:44:25 devstack sudo[95151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:44:25 devstack sudo[95150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-d3d7dcfb-3dac-4e67-bb79-a529324e3637 Sep 22 15:44:25 devstack sudo[95150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:44:26 devstack sudo[95150]: pam_unix(sudo:session): session closed for user root Sep 22 15:44:26 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-c04b376b-be9e-436e-b60d-b252622ffcc8 tempest-VolumesActionsTest-1755689979 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-d3d7dcfb-3dac-4e67-bb79-a529324e3637" returned: 0 in 0.509s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:44:26 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-c04b376b-be9e-436e-b60d-b252622ffcc8 tempest-VolumesActionsTest-1755689979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-d3d7dcfb-3dac-4e67-bb79-a529324e3637 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:44:26 devstack sudo[95161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-d3d7dcfb-3dac-4e67-bb79-a529324e3637 Sep 22 15:44:26 devstack sudo[95161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:44:26 devstack sudo[95151]: pam_unix(sudo:session): session closed for user root Sep 22 15:44:26 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-73e5b8f8-5b28-4b15-885d-4566ffc585d9 tempest-GroupsV314Test-1152114611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-d3c39961-3794-4118-8120-caf8e5503556,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-d3c39961-3794-4118-8120-caf8e5503556.a1975627-0914-48cb-849a-8bd68bfed202 1G" returned: 0 in 0.578s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:44:26 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-73e5b8f8-5b28-4b15-885d-4566ffc585d9 tempest-GroupsV314Test-1152114611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d3c39961-3794-4118-8120-caf8e5503556 -F qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-d3c39961-3794-4118-8120-caf8e5503556.a1975627-0914-48cb-849a-8bd68bfed202 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:44:26 devstack sudo[95164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d3c39961-3794-4118-8120-caf8e5503556 -F qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-d3c39961-3794-4118-8120-caf8e5503556.a1975627-0914-48cb-849a-8bd68bfed202 Sep 22 15:44:26 devstack sudo[95164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:44:26 devstack cinder-volume[86212]: DEBUG cinder.volume.flows.manager.create_volume [None req-541239e6-00cc-4161-bf52-80fd5186fc8f tempest-AttachVolumeTestJSON-678247873 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 15:44:26 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-541239e6-00cc-4161-bf52-80fd5186fc8f tempest-AttachVolumeTestJSON-678247873 None] Flow 'volume_create_manager' (bc826a58-d488-4d47-8ccc-c98002613860) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:44:26 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-541239e6-00cc-4161-bf52-80fd5186fc8f tempest-AttachVolumeTestJSON-678247873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (243ceaa6-6231-4b1e-a9f6-ffb148544670) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:44:26 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-541239e6-00cc-4161-bf52-80fd5186fc8f tempest-AttachVolumeTestJSON-678247873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (243ceaa6-6231-4b1e-a9f6-ffb148544670) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:44:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-840152810',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2267f4be-a702-4821-8a42-bb5064a7eb84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db03ba1cc4824283bbed3f55dc9e492e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:44:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:44:26Z,use_quota=True,user_id='2ed3340ecc074224bdb9447ca6deadd1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:44:26 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-541239e6-00cc-4161-bf52-80fd5186fc8f tempest-AttachVolumeTestJSON-678247873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (515cab20-4c05-4061-aa11-a479e028d468) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:44:26 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-541239e6-00cc-4161-bf52-80fd5186fc8f tempest-AttachVolumeTestJSON-678247873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (515cab20-4c05-4061-aa11-a479e028d468) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:44:26 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-541239e6-00cc-4161-bf52-80fd5186fc8f tempest-AttachVolumeTestJSON-678247873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34953152-7b95-4e49-bf47-f26cba7fe9d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:44:26 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-541239e6-00cc-4161-bf52-80fd5186fc8f tempest-AttachVolumeTestJSON-678247873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34953152-7b95-4e49-bf47-f26cba7fe9d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2267f4be-a702-4821-8a42-bb5064a7eb84', 'volume_name': 'volume-2267f4be-a702-4821-8a42-bb5064a7eb84', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:44:26 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-541239e6-00cc-4161-bf52-80fd5186fc8f tempest-AttachVolumeTestJSON-678247873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e26f4ff6-acf8-4e39-9ae9-20ebef3933b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:44:26 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-541239e6-00cc-4161-bf52-80fd5186fc8f tempest-AttachVolumeTestJSON-678247873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e26f4ff6-acf8-4e39-9ae9-20ebef3933b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:44:26 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-541239e6-00cc-4161-bf52-80fd5186fc8f tempest-AttachVolumeTestJSON-678247873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4248aa96-2606-4b7d-9526-10bad456cf54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:44:26 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-541239e6-00cc-4161-bf52-80fd5186fc8f tempest-AttachVolumeTestJSON-678247873 None] Volume 2267f4be-a702-4821-8a42-bb5064a7eb84: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2267f4be-a702-4821-8a42-bb5064a7eb84', 'volume_size': 1} Sep 22 15:44:26 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-541239e6-00cc-4161-bf52-80fd5186fc8f tempest-AttachVolumeTestJSON-678247873 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:44:26 devstack sudo[95161]: pam_unix(sudo:session): session closed for user root Sep 22 15:44:26 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-c04b376b-be9e-436e-b60d-b252622ffcc8 tempest-VolumesActionsTest-1755689979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-d3d7dcfb-3dac-4e67-bb79-a529324e3637" returned: 0 in 0.319s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:44:26 devstack cinder-volume[86212]: INFO cinder.volume.manager [req-93f37f51-0a74-4af8-b42e-65f429ba050b req-4344f505-5cfe-4d01-881a-fd2fa12ec076 tempest-AttachVolumeNegativeTest-382120543 None] Terminate volume connection completed successfully. Sep 22 15:44:26 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [req-93f37f51-0a74-4af8-b42e-65f429ba050b req-4344f505-5cfe-4d01-881a-fd2fa12ec076 tempest-AttachVolumeNegativeTest-382120543 None] Deleting attachment bb335c70-429f-4835-93b7-d16e6de9d57b. {{(pid=86212) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 22 15:44:26 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-c04b376b-be9e-436e-b60d-b252622ffcc8 tempest-VolumesActionsTest-1755689979 None] Lock "cinder-quobyte-d3d7dcfb-3dac-4e67-bb79-a529324e3637" released by "delete_volume" :: held 0.893s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:44:26 devstack cinder-volume[86212]: DEBUG cinder.quota [None req-c04b376b-be9e-436e-b60d-b252622ffcc8 tempest-VolumesActionsTest-1755689979 None] Created reservations ['4e2fdb2d-e0d1-4a03-8166-c64140120783', '63205379-539d-499e-95bf-b6b4b2cac22f', '3fdabafd-a658-41dc-ac76-b9b72c2d94ba', '6cb7bfb6-21e0-47e4-a19f-910f5cf0b8c1'] {{(pid=86212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 15:44:26 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-c04b376b-be9e-436e-b60d-b252622ffcc8 tempest-VolumesActionsTest-1755689979 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:44:26 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-c04b376b-be9e-436e-b60d-b252622ffcc8 tempest-VolumesActionsTest-1755689979 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:44:26 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-c04b376b-be9e-436e-b60d-b252622ffcc8 tempest-VolumesActionsTest-1755689979 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:44:26 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-c04b376b-be9e-436e-b60d-b252622ffcc8 tempest-VolumesActionsTest-1755689979 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:44:26 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-c04b376b-be9e-436e-b60d-b252622ffcc8 tempest-VolumesActionsTest-1755689979 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:44:26 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-c04b376b-be9e-436e-b60d-b252622ffcc8 tempest-VolumesActionsTest-1755689979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:44:26 devstack sudo[95164]: pam_unix(sudo:session): session closed for user root Sep 22 15:44:26 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-73e5b8f8-5b28-4b15-885d-4566ffc585d9 tempest-GroupsV314Test-1152114611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d3c39961-3794-4118-8120-caf8e5503556 -F qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-d3c39961-3794-4118-8120-caf8e5503556.a1975627-0914-48cb-849a-8bd68bfed202" returned: 0 in 0.426s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:44:26 devstack cinder-volume[86212]: WARNING cinder.volume.drivers.remotefs [None req-73e5b8f8-5b28-4b15-885d-4566ffc585d9 tempest-GroupsV314Test-1152114611 None] /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-d3c39961-3794-4118-8120-caf8e5503556.a1975627-0914-48cb-849a-8bd68bfed202 is being set with open permissions: ugo+rw: NotImplementedError Sep 22 15:44:26 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-73e5b8f8-5b28-4b15-885d-4566ffc585d9 tempest-GroupsV314Test-1152114611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-d3c39961-3794-4118-8120-caf8e5503556.a1975627-0914-48cb-849a-8bd68bfed202 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:44:26 devstack sudo[95172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc Sep 22 15:44:26 devstack sudo[95172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:44:26 devstack sudo[95173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-d3c39961-3794-4118-8120-caf8e5503556.a1975627-0914-48cb-849a-8bd68bfed202 Sep 22 15:44:26 devstack sudo[95173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:44:27 devstack sudo[95172]: pam_unix(sudo:session): session closed for user root Sep 22 15:44:27 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-c04b376b-be9e-436e-b60d-b252622ffcc8 tempest-VolumesActionsTest-1755689979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc" returned: 0 in 0.278s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:44:27 devstack cinder-volume[86212]: DEBUG cinder.manager [None req-c04b376b-be9e-436e-b60d-b252622ffcc8 tempest-VolumesActionsTest-1755689979 None] Notifying Schedulers of capabilities ... {{(pid=86212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 15:44:27 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-c04b376b-be9e-436e-b60d-b252622ffcc8 tempest-VolumesActionsTest-1755689979 None] Deleted volume successfully. Sep 22 15:44:27 devstack sudo[95173]: pam_unix(sudo:session): session closed for user root Sep 22 15:44:27 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-73e5b8f8-5b28-4b15-885d-4566ffc585d9 tempest-GroupsV314Test-1152114611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-d3c39961-3794-4118-8120-caf8e5503556.a1975627-0914-48cb-849a-8bd68bfed202" returned: 0 in 0.275s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:44:27 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-c04b376b-be9e-436e-b60d-b252622ffcc8 tempest-VolumesActionsTest-1755689979 None] Lock "cinder-d3d7dcfb-3dac-4e67-bb79-a529324e3637-delete_volume" released by "delete_volume" :: held 1.491s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:44:27 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-73e5b8f8-5b28-4b15-885d-4566ffc585d9 tempest-GroupsV314Test-1152114611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-d3c39961-3794-4118-8120-caf8e5503556.info {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:44:27 devstack sudo[95178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-d3c39961-3794-4118-8120-caf8e5503556.info Sep 22 15:44:27 devstack sudo[95178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:44:27 devstack sudo[95178]: pam_unix(sudo:session): session closed for user root Sep 22 15:44:27 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-73e5b8f8-5b28-4b15-885d-4566ffc585d9 tempest-GroupsV314Test-1152114611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-d3c39961-3794-4118-8120-caf8e5503556.info" returned: 0 in 0.280s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:44:27 devstack cinder-volume[86212]: WARNING cinder.volume.drivers.remotefs [None req-73e5b8f8-5b28-4b15-885d-4566ffc585d9 tempest-GroupsV314Test-1152114611 None] /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-d3c39961-3794-4118-8120-caf8e5503556.info is being set with open permissions: ugo+rw: NotImplementedError Sep 22 15:44:27 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-73e5b8f8-5b28-4b15-885d-4566ffc585d9 tempest-GroupsV314Test-1152114611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-d3c39961-3794-4118-8120-caf8e5503556.info {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:44:27 devstack sudo[95182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-d3c39961-3794-4118-8120-caf8e5503556.info Sep 22 15:44:27 devstack sudo[95182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:44:27 devstack sudo[95182]: pam_unix(sudo:session): session closed for user root Sep 22 15:44:27 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-73e5b8f8-5b28-4b15-885d-4566ffc585d9 tempest-GroupsV314Test-1152114611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-d3c39961-3794-4118-8120-caf8e5503556.info" returned: 0 in 0.398s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:44:27 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-73e5b8f8-5b28-4b15-885d-4566ffc585d9 tempest-GroupsV314Test-1152114611 None] Acquiring lock "cinder-quobyte-65f6df4c-c7c3-469c-aaee-abfef950480e" by "_copy_volume_from_snapshot" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:44:27 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-73e5b8f8-5b28-4b15-885d-4566ffc585d9 tempest-GroupsV314Test-1152114611 None] Lock "cinder-quobyte-65f6df4c-c7c3-469c-aaee-abfef950480e" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:44:27 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-73e5b8f8-5b28-4b15-885d-4566ffc585d9 tempest-GroupsV314Test-1152114611 None] snapshot: a1975627-0914-48cb-849a-8bd68bfed202, volume: 65f6df4c-c7c3-469c-aaee-abfef950480e, {{(pid=86212) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 22 15:44:27 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-73e5b8f8-5b28-4b15-885d-4566ffc585d9 tempest-GroupsV314Test-1152114611 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:44:27 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-73e5b8f8-5b28-4b15-885d-4566ffc585d9 tempest-GroupsV314Test-1152114611 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:44:27 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-73e5b8f8-5b28-4b15-885d-4566ffc585d9 tempest-GroupsV314Test-1152114611 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:44:27 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-73e5b8f8-5b28-4b15-885d-4566ffc585d9 tempest-GroupsV314Test-1152114611 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:44:27 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-73e5b8f8-5b28-4b15-885d-4566ffc585d9 tempest-GroupsV314Test-1152114611 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:44:27 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8160ab1-d41d-422d-a98e-f7d9434d5b46]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:44:27 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-73e5b8f8-5b28-4b15-885d-4566ffc585d9 tempest-GroupsV314Test-1152114611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-d3c39961-3794-4118-8120-caf8e5503556.a1975627-0914-48cb-849a-8bd68bfed202 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:44:28 devstack sudo[95196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-d3c39961-3794-4118-8120-caf8e5503556.a1975627-0914-48cb-849a-8bd68bfed202 Sep 22 15:44:28 devstack sudo[95196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:44:28 devstack sudo[95196]: pam_unix(sudo:session): session closed for user root Sep 22 15:44:28 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-73e5b8f8-5b28-4b15-885d-4566ffc585d9 tempest-GroupsV314Test-1152114611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-d3c39961-3794-4118-8120-caf8e5503556.a1975627-0914-48cb-849a-8bd68bfed202" returned: 0 in 0.587s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:44:28 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-73e5b8f8-5b28-4b15-885d-4566ffc585d9 tempest-GroupsV314Test-1152114611 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d3c39961-3794-4118-8120-caf8e5503556(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86212) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 22 15:44:28 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[717b0798-63de-48bb-b091-099a35780fb9]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:44:28 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-73e5b8f8-5b28-4b15-885d-4566ffc585d9 tempest-GroupsV314Test-1152114611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-d3c39961-3794-4118-8120-caf8e5503556 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:44:28 devstack sudo[95212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-d3c39961-3794-4118-8120-caf8e5503556 Sep 22 15:44:28 devstack sudo[95212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:44:29 devstack sudo[95212]: pam_unix(sudo:session): session closed for user root Sep 22 15:44:29 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-73e5b8f8-5b28-4b15-885d-4566ffc585d9 tempest-GroupsV314Test-1152114611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-d3c39961-3794-4118-8120-caf8e5503556" returned: 0 in 0.490s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:44:29 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-73e5b8f8-5b28-4b15-885d-4566ffc585d9 tempest-GroupsV314Test-1152114611 None] will copy from snapshot at /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-d3c39961-3794-4118-8120-caf8e5503556 {{(pid=86212) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 22 15:44:29 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-73e5b8f8-5b28-4b15-885d-4566ffc585d9 tempest-GroupsV314Test-1152114611 None] Creating direct copy from snapshot {{(pid=86212) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 22 15:44:29 devstack cinder-volume[86212]: DEBUG cinder.utils [None req-73e5b8f8-5b28-4b15-885d-4566ffc585d9 tempest-GroupsV314Test-1152114611 None] Path /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-65f6df4c-c7c3-469c-aaee-abfef950480e not found in is_blk_device check {{(pid=86212) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 22 15:44:29 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-73e5b8f8-5b28-4b15-885d-4566ffc585d9 tempest-GroupsV314Test-1152114611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-d3c39961-3794-4118-8120-caf8e5503556 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-65f6df4c-c7c3-469c-aaee-abfef950480e {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:44:29 devstack sudo[95219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-d3c39961-3794-4118-8120-caf8e5503556 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-65f6df4c-c7c3-469c-aaee-abfef950480e Sep 22 15:44:29 devstack sudo[95219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:44:35 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-dd750b8e-bb4c-48b2-921e-eced0d765a57 tempest-AttachVolumeNegativeTest-382120543 None] Acquiring lock "cinder-4276d4cf-2155-4db7-aebd-5d4436f3e34a-delete_volume" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:44:35 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-dd750b8e-bb4c-48b2-921e-eced0d765a57 tempest-AttachVolumeNegativeTest-382120543 None] Lock "cinder-4276d4cf-2155-4db7-aebd-5d4436f3e34a-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:44:35 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-dd750b8e-bb4c-48b2-921e-eced0d765a57 tempest-AttachVolumeNegativeTest-382120543 None] Acquiring lock "cinder-quobyte-4276d4cf-2155-4db7-aebd-5d4436f3e34a" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:44:35 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-dd750b8e-bb4c-48b2-921e-eced0d765a57 tempest-AttachVolumeNegativeTest-382120543 None] Lock "cinder-quobyte-4276d4cf-2155-4db7-aebd-5d4436f3e34a" acquired by "delete_volume" :: waited 0.031s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:44:35 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac700513-2786-4a41-9529-b03d3c19ee77]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:44:35 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-dd750b8e-bb4c-48b2-921e-eced0d765a57 tempest-AttachVolumeNegativeTest-382120543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-4276d4cf-2155-4db7-aebd-5d4436f3e34a {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:44:35 devstack sudo[95282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-4276d4cf-2155-4db7-aebd-5d4436f3e34a Sep 22 15:44:35 devstack sudo[95282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:44:36 devstack sudo[95282]: pam_unix(sudo:session): session closed for user root Sep 22 15:44:36 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-dd750b8e-bb4c-48b2-921e-eced0d765a57 tempest-AttachVolumeNegativeTest-382120543 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-4276d4cf-2155-4db7-aebd-5d4436f3e34a" returned: 0 in 0.788s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:44:36 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-dd750b8e-bb4c-48b2-921e-eced0d765a57 tempest-AttachVolumeNegativeTest-382120543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-4276d4cf-2155-4db7-aebd-5d4436f3e34a {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:44:36 devstack sudo[95287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-4276d4cf-2155-4db7-aebd-5d4436f3e34a Sep 22 15:44:36 devstack sudo[95287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:44:36 devstack sudo[95287]: pam_unix(sudo:session): session closed for user root Sep 22 15:44:36 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-dd750b8e-bb4c-48b2-921e-eced0d765a57 tempest-AttachVolumeNegativeTest-382120543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-4276d4cf-2155-4db7-aebd-5d4436f3e34a" returned: 0 in 0.671s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:44:36 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-dd750b8e-bb4c-48b2-921e-eced0d765a57 tempest-AttachVolumeNegativeTest-382120543 None] Lock "cinder-quobyte-4276d4cf-2155-4db7-aebd-5d4436f3e34a" released by "delete_volume" :: held 1.570s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:44:37 devstack cinder-volume[86212]: DEBUG cinder.quota [None req-dd750b8e-bb4c-48b2-921e-eced0d765a57 tempest-AttachVolumeNegativeTest-382120543 None] Created reservations ['26d6c406-aa1f-49e0-8b8f-9c7d34013da5', 'ed38cf9d-b3e7-4933-93fe-1d802193ea15', '39ff0345-a336-4d97-8c2c-105ae46f1d95', 'b011cb48-c826-42a2-a508-cc5fbd5ed8c5'] {{(pid=86212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 15:44:37 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-dd750b8e-bb4c-48b2-921e-eced0d765a57 tempest-AttachVolumeNegativeTest-382120543 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:44:37 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-dd750b8e-bb4c-48b2-921e-eced0d765a57 tempest-AttachVolumeNegativeTest-382120543 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:44:37 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-dd750b8e-bb4c-48b2-921e-eced0d765a57 tempest-AttachVolumeNegativeTest-382120543 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:44:37 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-dd750b8e-bb4c-48b2-921e-eced0d765a57 tempest-AttachVolumeNegativeTest-382120543 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:44:37 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-dd750b8e-bb4c-48b2-921e-eced0d765a57 tempest-AttachVolumeNegativeTest-382120543 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:44:37 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-dd750b8e-bb4c-48b2-921e-eced0d765a57 tempest-AttachVolumeNegativeTest-382120543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:44:37 devstack sudo[95290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc Sep 22 15:44:37 devstack sudo[95290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:44:37 devstack sudo[95290]: pam_unix(sudo:session): session closed for user root Sep 22 15:44:37 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-dd750b8e-bb4c-48b2-921e-eced0d765a57 tempest-AttachVolumeNegativeTest-382120543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc" returned: 0 in 0.459s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:44:37 devstack cinder-volume[86212]: DEBUG cinder.manager [None req-dd750b8e-bb4c-48b2-921e-eced0d765a57 tempest-AttachVolumeNegativeTest-382120543 None] Notifying Schedulers of capabilities ... {{(pid=86212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 15:44:37 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-dd750b8e-bb4c-48b2-921e-eced0d765a57 tempest-AttachVolumeNegativeTest-382120543 None] Deleted volume successfully. Sep 22 15:44:37 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-dd750b8e-bb4c-48b2-921e-eced0d765a57 tempest-AttachVolumeNegativeTest-382120543 None] Lock "cinder-4276d4cf-2155-4db7-aebd-5d4436f3e34a-delete_volume" released by "delete_volume" :: held 2.575s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:44:38 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-665d4baa-7e27-4b8c-8adc-9fa041824391 tempest-AttachVolumeNegativeTest-382120543 None] Acquiring lock "cinder-dd4a9ef7-d832-4db6-8d13-7dfc647d9146-delete_volume" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:44:38 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-665d4baa-7e27-4b8c-8adc-9fa041824391 tempest-AttachVolumeNegativeTest-382120543 None] Lock "cinder-dd4a9ef7-d832-4db6-8d13-7dfc647d9146-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:44:38 devstack sudo[95219]: pam_unix(sudo:session): session closed for user root Sep 22 15:44:38 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-73e5b8f8-5b28-4b15-885d-4566ffc585d9 tempest-GroupsV314Test-1152114611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-d3c39961-3794-4118-8120-caf8e5503556 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-65f6df4c-c7c3-469c-aaee-abfef950480e" returned: 0 in 9.148s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:44:38 devstack cinder-volume[86212]: DEBUG cinder.image.image_utils [None req-73e5b8f8-5b28-4b15-885d-4566ffc585d9 tempest-GroupsV314Test-1152114611 None] Image conversion details: src /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-d3c39961-3794-4118-8120-caf8e5503556, size 1024.00 MB, duration 9.15 sec, destination /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-65f6df4c-c7c3-469c-aaee-abfef950480e {{(pid=86212) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 22 15:44:38 devstack cinder-volume[86212]: INFO cinder.image.image_utils [None req-73e5b8f8-5b28-4b15-885d-4566ffc585d9 tempest-GroupsV314Test-1152114611 None] Converted 1024.00 MB image at 111.92 MB/s Sep 22 15:44:38 devstack cinder-volume[86212]: WARNING cinder.volume.drivers.remotefs [None req-73e5b8f8-5b28-4b15-885d-4566ffc585d9 tempest-GroupsV314Test-1152114611 None] /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-65f6df4c-c7c3-469c-aaee-abfef950480e is being set with open permissions: ugo+rw: NotImplementedError Sep 22 15:44:38 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-73e5b8f8-5b28-4b15-885d-4566ffc585d9 tempest-GroupsV314Test-1152114611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-65f6df4c-c7c3-469c-aaee-abfef950480e {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:44:38 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-665d4baa-7e27-4b8c-8adc-9fa041824391 tempest-AttachVolumeNegativeTest-382120543 None] Acquiring lock "cinder-quobyte-dd4a9ef7-d832-4db6-8d13-7dfc647d9146" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:44:38 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-665d4baa-7e27-4b8c-8adc-9fa041824391 tempest-AttachVolumeNegativeTest-382120543 None] Lock "cinder-quobyte-dd4a9ef7-d832-4db6-8d13-7dfc647d9146" acquired by "delete_volume" :: waited 0.019s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:44:38 devstack sudo[95294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-65f6df4c-c7c3-469c-aaee-abfef950480e Sep 22 15:44:38 devstack sudo[95294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:44:38 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0327d87-76be-414b-8131-4e013b46ed30]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:44:38 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-665d4baa-7e27-4b8c-8adc-9fa041824391 tempest-AttachVolumeNegativeTest-382120543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-dd4a9ef7-d832-4db6-8d13-7dfc647d9146 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:44:38 devstack cinder-volume[86212]: DEBUG oslo_service.periodic_task [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] Running periodic task VolumeManager._thread_info {{(pid=86212) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 22 15:44:38 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] thread count: 28 {{(pid=86212) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 22 15:44:38 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] thread info: [<_MainThread(MainThread, started 136163191222400)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86212) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 22 15:44:38 devstack sudo[95296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-dd4a9ef7-d832-4db6-8d13-7dfc647d9146 Sep 22 15:44:38 devstack sudo[95296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:44:38 devstack sudo[95294]: pam_unix(sudo:session): session closed for user root Sep 22 15:44:38 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-73e5b8f8-5b28-4b15-885d-4566ffc585d9 tempest-GroupsV314Test-1152114611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-65f6df4c-c7c3-469c-aaee-abfef950480e" returned: 0 in 0.295s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:44:38 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-73e5b8f8-5b28-4b15-885d-4566ffc585d9 tempest-GroupsV314Test-1152114611 None] Lock "cinder-quobyte-65f6df4c-c7c3-469c-aaee-abfef950480e" released by "_copy_volume_from_snapshot" :: held 10.673s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:44:38 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-73e5b8f8-5b28-4b15-885d-4566ffc585d9 tempest-GroupsV314Test-1152114611 None] Acquiring lock "cinder-quobyte-a1975627-0914-48cb-849a-8bd68bfed202" by "_delete_snapshot" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:44:38 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-73e5b8f8-5b28-4b15-885d-4566ffc585d9 tempest-GroupsV314Test-1152114611 None] Lock "cinder-quobyte-a1975627-0914-48cb-849a-8bd68bfed202" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:44:38 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-73e5b8f8-5b28-4b15-885d-4566ffc585d9 tempest-GroupsV314Test-1152114611 None] Deleting offline snapshot a1975627-0914-48cb-849a-8bd68bfed202 of volume d3c39961-3794-4118-8120-caf8e5503556 {{(pid=86212) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 22 15:44:38 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-73e5b8f8-5b28-4b15-885d-4566ffc585d9 tempest-GroupsV314Test-1152114611 None] snapshot_file for this snap is: volume-d3c39961-3794-4118-8120-caf8e5503556.a1975627-0914-48cb-849a-8bd68bfed202 {{(pid=86212) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 22 15:44:38 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2689eee-c087-4971-8c49-0f64f08afbcb]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:44:38 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-73e5b8f8-5b28-4b15-885d-4566ffc585d9 tempest-GroupsV314Test-1152114611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-d3c39961-3794-4118-8120-caf8e5503556.a1975627-0914-48cb-849a-8bd68bfed202 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:44:38 devstack sudo[95296]: pam_unix(sudo:session): session closed for user root Sep 22 15:44:38 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-665d4baa-7e27-4b8c-8adc-9fa041824391 tempest-AttachVolumeNegativeTest-382120543 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-dd4a9ef7-d832-4db6-8d13-7dfc647d9146" returned: 0 in 0.422s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:44:38 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-665d4baa-7e27-4b8c-8adc-9fa041824391 tempest-AttachVolumeNegativeTest-382120543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-dd4a9ef7-d832-4db6-8d13-7dfc647d9146 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:44:38 devstack sudo[95299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-d3c39961-3794-4118-8120-caf8e5503556.a1975627-0914-48cb-849a-8bd68bfed202 Sep 22 15:44:38 devstack sudo[95299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:44:38 devstack sudo[95303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-dd4a9ef7-d832-4db6-8d13-7dfc647d9146 Sep 22 15:44:38 devstack sudo[95303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:44:39 devstack sudo[95303]: pam_unix(sudo:session): session closed for user root Sep 22 15:44:39 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-665d4baa-7e27-4b8c-8adc-9fa041824391 tempest-AttachVolumeNegativeTest-382120543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-dd4a9ef7-d832-4db6-8d13-7dfc647d9146" returned: 0 in 0.267s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:44:39 devstack sudo[95299]: pam_unix(sudo:session): session closed for user root Sep 22 15:44:39 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-73e5b8f8-5b28-4b15-885d-4566ffc585d9 tempest-GroupsV314Test-1152114611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-d3c39961-3794-4118-8120-caf8e5503556.a1975627-0914-48cb-849a-8bd68bfed202" returned: 0 in 0.408s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:44:39 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-73e5b8f8-5b28-4b15-885d-4566ffc585d9 tempest-GroupsV314Test-1152114611 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d3c39961-3794-4118-8120-caf8e5503556(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86212) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 22 15:44:39 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-665d4baa-7e27-4b8c-8adc-9fa041824391 tempest-AttachVolumeNegativeTest-382120543 None] Lock "cinder-quobyte-dd4a9ef7-d832-4db6-8d13-7dfc647d9146" released by "delete_volume" :: held 0.778s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:44:39 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b339c61-26fa-4dca-b616-1d4950ba126c]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:44:39 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-73e5b8f8-5b28-4b15-885d-4566ffc585d9 tempest-GroupsV314Test-1152114611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-d3c39961-3794-4118-8120-caf8e5503556 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:44:39 devstack cinder-volume[86212]: DEBUG cinder.quota [None req-665d4baa-7e27-4b8c-8adc-9fa041824391 tempest-AttachVolumeNegativeTest-382120543 None] Created reservations ['f651ff30-4fe5-4f72-8964-f16bb326f946', '12904077-0e4e-4ea0-8ab3-7cb4f6b28392', '6152118e-e6e8-40ae-b4cb-ad842327a693', 'e744491d-16c3-403d-9934-80341b228e3f'] {{(pid=86212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 15:44:39 devstack sudo[95310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-d3c39961-3794-4118-8120-caf8e5503556 Sep 22 15:44:39 devstack sudo[95310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:44:39 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-665d4baa-7e27-4b8c-8adc-9fa041824391 tempest-AttachVolumeNegativeTest-382120543 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:44:39 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-665d4baa-7e27-4b8c-8adc-9fa041824391 tempest-AttachVolumeNegativeTest-382120543 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:44:39 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-665d4baa-7e27-4b8c-8adc-9fa041824391 tempest-AttachVolumeNegativeTest-382120543 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:44:39 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-665d4baa-7e27-4b8c-8adc-9fa041824391 tempest-AttachVolumeNegativeTest-382120543 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:44:39 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-665d4baa-7e27-4b8c-8adc-9fa041824391 tempest-AttachVolumeNegativeTest-382120543 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:44:39 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-665d4baa-7e27-4b8c-8adc-9fa041824391 tempest-AttachVolumeNegativeTest-382120543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:44:39 devstack sudo[95312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc Sep 22 15:44:39 devstack sudo[95312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:44:39 devstack sudo[95312]: pam_unix(sudo:session): session closed for user root Sep 22 15:44:39 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-665d4baa-7e27-4b8c-8adc-9fa041824391 tempest-AttachVolumeNegativeTest-382120543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc" returned: 0 in 0.309s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:44:39 devstack cinder-volume[86212]: DEBUG cinder.manager [None req-665d4baa-7e27-4b8c-8adc-9fa041824391 tempest-AttachVolumeNegativeTest-382120543 None] Notifying Schedulers of capabilities ... {{(pid=86212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 15:44:39 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-665d4baa-7e27-4b8c-8adc-9fa041824391 tempest-AttachVolumeNegativeTest-382120543 None] Deleted volume successfully. Sep 22 15:44:39 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-665d4baa-7e27-4b8c-8adc-9fa041824391 tempest-AttachVolumeNegativeTest-382120543 None] Lock "cinder-dd4a9ef7-d832-4db6-8d13-7dfc647d9146-delete_volume" released by "delete_volume" :: held 1.375s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:44:39 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-ea47ce0d-7680-41ab-80d1-e18677bdc580 tempest-AttachVolumeNegativeTest-382120543 None] Acquiring lock "cinder-26c22efb-0997-489c-9964-5777eaea0d33-delete_volume" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:44:39 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-ea47ce0d-7680-41ab-80d1-e18677bdc580 tempest-AttachVolumeNegativeTest-382120543 None] Lock "cinder-26c22efb-0997-489c-9964-5777eaea0d33-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:44:39 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-ea47ce0d-7680-41ab-80d1-e18677bdc580 tempest-AttachVolumeNegativeTest-382120543 None] Acquiring lock "cinder-quobyte-26c22efb-0997-489c-9964-5777eaea0d33" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:44:39 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-ea47ce0d-7680-41ab-80d1-e18677bdc580 tempest-AttachVolumeNegativeTest-382120543 None] Lock "cinder-quobyte-26c22efb-0997-489c-9964-5777eaea0d33" acquired by "delete_volume" :: waited 0.027s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:44:39 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[04aacb2a-d85f-42ae-a9a5-f77ae41c416c]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:44:39 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-ea47ce0d-7680-41ab-80d1-e18677bdc580 tempest-AttachVolumeNegativeTest-382120543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-26c22efb-0997-489c-9964-5777eaea0d33 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:44:39 devstack sudo[95310]: pam_unix(sudo:session): session closed for user root Sep 22 15:44:39 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-73e5b8f8-5b28-4b15-885d-4566ffc585d9 tempest-GroupsV314Test-1152114611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-d3c39961-3794-4118-8120-caf8e5503556" returned: 0 in 0.694s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:44:39 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-73e5b8f8-5b28-4b15-885d-4566ffc585d9 tempest-GroupsV314Test-1152114611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-d3c39961-3794-4118-8120-caf8e5503556.a1975627-0914-48cb-849a-8bd68bfed202 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:44:39 devstack sudo[95319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-d3c39961-3794-4118-8120-caf8e5503556.a1975627-0914-48cb-849a-8bd68bfed202 Sep 22 15:44:39 devstack sudo[95319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:44:39 devstack sudo[95318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-26c22efb-0997-489c-9964-5777eaea0d33 Sep 22 15:44:39 devstack sudo[95318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:44:40 devstack sudo[95319]: pam_unix(sudo:session): session closed for user root Sep 22 15:44:40 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-73e5b8f8-5b28-4b15-885d-4566ffc585d9 tempest-GroupsV314Test-1152114611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-d3c39961-3794-4118-8120-caf8e5503556.a1975627-0914-48cb-849a-8bd68bfed202" returned: 0 in 0.387s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:44:40 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-73e5b8f8-5b28-4b15-885d-4566ffc585d9 tempest-GroupsV314Test-1152114611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-d3c39961-3794-4118-8120-caf8e5503556.a1975627-0914-48cb-849a-8bd68bfed202 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:44:40 devstack sudo[95318]: pam_unix(sudo:session): session closed for user root Sep 22 15:44:40 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-ea47ce0d-7680-41ab-80d1-e18677bdc580 tempest-AttachVolumeNegativeTest-382120543 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-26c22efb-0997-489c-9964-5777eaea0d33" returned: 0 in 0.417s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:44:40 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-ea47ce0d-7680-41ab-80d1-e18677bdc580 tempest-AttachVolumeNegativeTest-382120543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-26c22efb-0997-489c-9964-5777eaea0d33 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:44:40 devstack sudo[95329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-d3c39961-3794-4118-8120-caf8e5503556.a1975627-0914-48cb-849a-8bd68bfed202 Sep 22 15:44:40 devstack sudo[95329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:44:40 devstack sudo[95330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-26c22efb-0997-489c-9964-5777eaea0d33 Sep 22 15:44:40 devstack sudo[95330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:44:40 devstack cinder-volume[86212]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa860aed-ba09-4d5a-b24e-bd26b246d776 tempest-VolumesCloneNegativeTest-1740191736 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 15:44:40 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-aa860aed-ba09-4d5a-b24e-bd26b246d776 tempest-VolumesCloneNegativeTest-1740191736 None] Flow 'volume_create_manager' (78aa87ea-eafe-4c47-bcb9-9562969daacd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:44:40 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-aa860aed-ba09-4d5a-b24e-bd26b246d776 tempest-VolumesCloneNegativeTest-1740191736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a691b05-f8eb-4f37-92ad-e2858196d870) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:44:40 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-aa860aed-ba09-4d5a-b24e-bd26b246d776 tempest-VolumesCloneNegativeTest-1740191736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a691b05-f8eb-4f37-92ad-e2858196d870) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:44:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1045564133',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7c15ca9-f9de-471b-a752-e2353ac82d0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a6e160e68864aacbf59e6685d73a699',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:44:40Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:44:40Z,use_quota=True,user_id='1596b75747ab40619957b57bd1d5509d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:44:40 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-aa860aed-ba09-4d5a-b24e-bd26b246d776 tempest-VolumesCloneNegativeTest-1740191736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52faea20-6129-4259-9604-acfef856e330) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:44:40 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-aa860aed-ba09-4d5a-b24e-bd26b246d776 tempest-VolumesCloneNegativeTest-1740191736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52faea20-6129-4259-9604-acfef856e330) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:44:40 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-aa860aed-ba09-4d5a-b24e-bd26b246d776 tempest-VolumesCloneNegativeTest-1740191736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62aabf3b-df46-4def-8224-ebfb65ee6a88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:44:40 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-aa860aed-ba09-4d5a-b24e-bd26b246d776 tempest-VolumesCloneNegativeTest-1740191736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62aabf3b-df46-4def-8224-ebfb65ee6a88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b7c15ca9-f9de-471b-a752-e2353ac82d0b', 'volume_name': 'volume-b7c15ca9-f9de-471b-a752-e2353ac82d0b', 'volume_size': 2}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:44:40 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-aa860aed-ba09-4d5a-b24e-bd26b246d776 tempest-VolumesCloneNegativeTest-1740191736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32f0983d-f585-4c93-8d31-a802eafbdc1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:44:40 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-aa860aed-ba09-4d5a-b24e-bd26b246d776 tempest-VolumesCloneNegativeTest-1740191736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32f0983d-f585-4c93-8d31-a802eafbdc1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:44:40 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-aa860aed-ba09-4d5a-b24e-bd26b246d776 tempest-VolumesCloneNegativeTest-1740191736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1be23031-c9fe-4c54-854e-10706cd1b39c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:44:40 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-aa860aed-ba09-4d5a-b24e-bd26b246d776 tempest-VolumesCloneNegativeTest-1740191736 None] Volume b7c15ca9-f9de-471b-a752-e2353ac82d0b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b7c15ca9-f9de-471b-a752-e2353ac82d0b', 'volume_size': 2} Sep 22 15:44:40 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-aa860aed-ba09-4d5a-b24e-bd26b246d776 tempest-VolumesCloneNegativeTest-1740191736 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:44:40 devstack sudo[95329]: pam_unix(sudo:session): session closed for user root Sep 22 15:44:40 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-73e5b8f8-5b28-4b15-885d-4566ffc585d9 tempest-GroupsV314Test-1152114611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-d3c39961-3794-4118-8120-caf8e5503556.a1975627-0914-48cb-849a-8bd68bfed202" returned: 0 in 0.262s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:44:40 devstack sudo[95330]: pam_unix(sudo:session): session closed for user root Sep 22 15:44:40 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-73e5b8f8-5b28-4b15-885d-4566ffc585d9 tempest-GroupsV314Test-1152114611 None] Lock "cinder-quobyte-a1975627-0914-48cb-849a-8bd68bfed202" released by "_delete_snapshot" :: held 1.871s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:44:40 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-ea47ce0d-7680-41ab-80d1-e18677bdc580 tempest-AttachVolumeNegativeTest-382120543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-26c22efb-0997-489c-9964-5777eaea0d33" returned: 0 in 0.288s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:44:40 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-ea47ce0d-7680-41ab-80d1-e18677bdc580 tempest-AttachVolumeNegativeTest-382120543 None] Lock "cinder-quobyte-26c22efb-0997-489c-9964-5777eaea0d33" released by "delete_volume" :: held 0.761s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:44:40 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-73e5b8f8-5b28-4b15-885d-4566ffc585d9 tempest-GroupsV314Test-1152114611 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 15.342s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:44:40 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-541239e6-00cc-4161-bf52-80fd5186fc8f tempest-AttachVolumeTestJSON-678247873 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.935s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:44:40 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-541239e6-00cc-4161-bf52-80fd5186fc8f tempest-AttachVolumeTestJSON-678247873 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:44:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-840152810',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2267f4be-a702-4821-8a42-bb5064a7eb84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db03ba1cc4824283bbed3f55dc9e492e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:44:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:44:26Z,use_quota=True,user_id='2ed3340ecc074224bdb9447ca6deadd1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)}" {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 15:44:40 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-541239e6-00cc-4161-bf52-80fd5186fc8f tempest-AttachVolumeTestJSON-678247873 None] Creating volume 2267f4be-a702-4821-8a42-bb5064a7eb84 {{(pid=86212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 15:44:40 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-541239e6-00cc-4161-bf52-80fd5186fc8f tempest-AttachVolumeTestJSON-678247873 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:44:40 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-541239e6-00cc-4161-bf52-80fd5186fc8f tempest-AttachVolumeTestJSON-678247873 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:44:40 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-541239e6-00cc-4161-bf52-80fd5186fc8f tempest-AttachVolumeTestJSON-678247873 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:44:40 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-541239e6-00cc-4161-bf52-80fd5186fc8f tempest-AttachVolumeTestJSON-678247873 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:44:40 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-541239e6-00cc-4161-bf52-80fd5186fc8f tempest-AttachVolumeTestJSON-678247873 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:44:40 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-541239e6-00cc-4161-bf52-80fd5186fc8f tempest-AttachVolumeTestJSON-678247873 None] Selected osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 as target Quobyte volume. {{(pid=86212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 15:44:40 devstack cinder-volume[86212]: INFO cinder.volume.drivers.remotefs [None req-541239e6-00cc-4161-bf52-80fd5186fc8f tempest-AttachVolumeTestJSON-678247873 None] casted to osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 Sep 22 15:44:40 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-541239e6-00cc-4161-bf52-80fd5186fc8f tempest-AttachVolumeTestJSON-678247873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2267f4be-a702-4821-8a42-bb5064a7eb84 1073741824 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:44:40 devstack sudo[95335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2267f4be-a702-4821-8a42-bb5064a7eb84 1073741824 Sep 22 15:44:40 devstack sudo[95335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:44:40 devstack cinder-volume[86212]: DEBUG cinder.quota [None req-ea47ce0d-7680-41ab-80d1-e18677bdc580 tempest-AttachVolumeNegativeTest-382120543 None] Created reservations ['ea97e81d-34bf-41ae-b597-07563a1ee96b', '71bdf9df-01df-4678-83d2-a5676a4ee4c2', 'cdf83f21-ad6a-4348-95bd-65129e9221e8', 'f16ec179-02f5-42d4-9ba8-ef3ba7043a90'] {{(pid=86212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 15:44:40 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-73e5b8f8-5b28-4b15-885d-4566ffc585d9 tempest-GroupsV314Test-1152114611 None] Create group from source-group-0f90fbd8-e066-4221-ac3c-287577388c3b completed successfully. Sep 22 15:44:40 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-ea47ce0d-7680-41ab-80d1-e18677bdc580 tempest-AttachVolumeNegativeTest-382120543 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:44:40 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-ea47ce0d-7680-41ab-80d1-e18677bdc580 tempest-AttachVolumeNegativeTest-382120543 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:44:40 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-ea47ce0d-7680-41ab-80d1-e18677bdc580 tempest-AttachVolumeNegativeTest-382120543 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:44:40 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-ea47ce0d-7680-41ab-80d1-e18677bdc580 tempest-AttachVolumeNegativeTest-382120543 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:44:40 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-ea47ce0d-7680-41ab-80d1-e18677bdc580 tempest-AttachVolumeNegativeTest-382120543 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:44:40 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-ea47ce0d-7680-41ab-80d1-e18677bdc580 tempest-AttachVolumeNegativeTest-382120543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:44:40 devstack sudo[95337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc Sep 22 15:44:40 devstack sudo[95337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:44:40 devstack sudo[95337]: pam_unix(sudo:session): session closed for user root Sep 22 15:44:40 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-ea47ce0d-7680-41ab-80d1-e18677bdc580 tempest-AttachVolumeNegativeTest-382120543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc" returned: 0 in 0.312s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:44:40 devstack cinder-volume[86212]: DEBUG cinder.manager [None req-ea47ce0d-7680-41ab-80d1-e18677bdc580 tempest-AttachVolumeNegativeTest-382120543 None] Notifying Schedulers of capabilities ... {{(pid=86212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 15:44:40 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-ea47ce0d-7680-41ab-80d1-e18677bdc580 tempest-AttachVolumeNegativeTest-382120543 None] Deleted volume successfully. Sep 22 15:44:41 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-ea47ce0d-7680-41ab-80d1-e18677bdc580 tempest-AttachVolumeNegativeTest-382120543 None] Lock "cinder-26c22efb-0997-489c-9964-5777eaea0d33-delete_volume" released by "delete_volume" :: held 1.356s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:44:41 devstack sudo[95335]: pam_unix(sudo:session): session closed for user root Sep 22 15:44:41 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-541239e6-00cc-4161-bf52-80fd5186fc8f tempest-AttachVolumeTestJSON-678247873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2267f4be-a702-4821-8a42-bb5064a7eb84 1073741824" returned: 0 in 0.584s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:44:41 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-541239e6-00cc-4161-bf52-80fd5186fc8f tempest-AttachVolumeTestJSON-678247873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2267f4be-a702-4821-8a42-bb5064a7eb84 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:44:41 devstack sudo[95344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2267f4be-a702-4821-8a42-bb5064a7eb84 Sep 22 15:44:41 devstack sudo[95344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:44:41 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-644ee7a3-573f-40c9-a5db-552328a48bdf tempest-GroupsV314Test-1152114611 None] Acquiring lock "cinder-quobyte-65f6df4c-c7c3-469c-aaee-abfef950480e" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:44:41 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-644ee7a3-573f-40c9-a5db-552328a48bdf tempest-GroupsV314Test-1152114611 None] Lock "cinder-quobyte-65f6df4c-c7c3-469c-aaee-abfef950480e" acquired by "delete_volume" :: waited 0.035s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:44:41 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a2978f0-9638-4075-b729-8bf8b8192d60]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:44:41 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-644ee7a3-573f-40c9-a5db-552328a48bdf tempest-GroupsV314Test-1152114611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-65f6df4c-c7c3-469c-aaee-abfef950480e {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:44:41 devstack sudo[95344]: pam_unix(sudo:session): session closed for user root Sep 22 15:44:41 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-541239e6-00cc-4161-bf52-80fd5186fc8f tempest-AttachVolumeTestJSON-678247873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2267f4be-a702-4821-8a42-bb5064a7eb84" returned: 0 in 0.269s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:44:41 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-541239e6-00cc-4161-bf52-80fd5186fc8f tempest-AttachVolumeTestJSON-678247873 None] <== create_volume: return (896ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'} {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 15:44:41 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-541239e6-00cc-4161-bf52-80fd5186fc8f tempest-AttachVolumeTestJSON-678247873 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.900s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:44:41 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-aa860aed-ba09-4d5a-b24e-bd26b246d776 tempest-VolumesCloneNegativeTest-1740191736 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.032s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:44:41 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-aa860aed-ba09-4d5a-b24e-bd26b246d776 tempest-VolumesCloneNegativeTest-1740191736 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:44:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1045564133',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7c15ca9-f9de-471b-a752-e2353ac82d0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a6e160e68864aacbf59e6685d73a699',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:44:40Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:44:40Z,use_quota=True,user_id='1596b75747ab40619957b57bd1d5509d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)}" {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 15:44:41 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-aa860aed-ba09-4d5a-b24e-bd26b246d776 tempest-VolumesCloneNegativeTest-1740191736 None] Creating volume b7c15ca9-f9de-471b-a752-e2353ac82d0b {{(pid=86212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 15:44:41 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-aa860aed-ba09-4d5a-b24e-bd26b246d776 tempest-VolumesCloneNegativeTest-1740191736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:44:41 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-aa860aed-ba09-4d5a-b24e-bd26b246d776 tempest-VolumesCloneNegativeTest-1740191736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:44:41 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-aa860aed-ba09-4d5a-b24e-bd26b246d776 tempest-VolumesCloneNegativeTest-1740191736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:44:41 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-aa860aed-ba09-4d5a-b24e-bd26b246d776 tempest-VolumesCloneNegativeTest-1740191736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:44:41 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-aa860aed-ba09-4d5a-b24e-bd26b246d776 tempest-VolumesCloneNegativeTest-1740191736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:44:41 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-aa860aed-ba09-4d5a-b24e-bd26b246d776 tempest-VolumesCloneNegativeTest-1740191736 None] Selected osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 as target Quobyte volume. {{(pid=86212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 15:44:41 devstack cinder-volume[86212]: INFO cinder.volume.drivers.remotefs [None req-aa860aed-ba09-4d5a-b24e-bd26b246d776 tempest-VolumesCloneNegativeTest-1740191736 None] casted to osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 Sep 22 15:44:41 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-aa860aed-ba09-4d5a-b24e-bd26b246d776 tempest-VolumesCloneNegativeTest-1740191736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b7c15ca9-f9de-471b-a752-e2353ac82d0b 2147483648 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:44:41 devstack sudo[95346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-65f6df4c-c7c3-469c-aaee-abfef950480e Sep 22 15:44:41 devstack sudo[95346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:44:41 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-541239e6-00cc-4161-bf52-80fd5186fc8f tempest-AttachVolumeTestJSON-678247873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4248aa96-2606-4b7d-9526-10bad456cf54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2267f4be-a702-4821-8a42-bb5064a7eb84', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:44:41 devstack sudo[95348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b7c15ca9-f9de-471b-a752-e2353ac82d0b 2147483648 Sep 22 15:44:41 devstack sudo[95348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:44:41 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-541239e6-00cc-4161-bf52-80fd5186fc8f tempest-AttachVolumeTestJSON-678247873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44197bcd-ed41-4cab-9ec0-300c71c2a7c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:44:41 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-541239e6-00cc-4161-bf52-80fd5186fc8f tempest-AttachVolumeTestJSON-678247873 None] Volume volume-2267f4be-a702-4821-8a42-bb5064a7eb84 (2267f4be-a702-4821-8a42-bb5064a7eb84): created successfully Sep 22 15:44:41 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-541239e6-00cc-4161-bf52-80fd5186fc8f tempest-AttachVolumeTestJSON-678247873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44197bcd-ed41-4cab-9ec0-300c71c2a7c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:44:41 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-541239e6-00cc-4161-bf52-80fd5186fc8f tempest-AttachVolumeTestJSON-678247873 None] Flow 'volume_create_manager' (bc826a58-d488-4d47-8ccc-c98002613860) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:44:41 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-541239e6-00cc-4161-bf52-80fd5186fc8f tempest-AttachVolumeTestJSON-678247873 None] Created volume successfully. Sep 22 15:44:41 devstack sudo[95346]: pam_unix(sudo:session): session closed for user root Sep 22 15:44:41 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-644ee7a3-573f-40c9-a5db-552328a48bdf tempest-GroupsV314Test-1152114611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-65f6df4c-c7c3-469c-aaee-abfef950480e" returned: 0 in 0.417s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:44:41 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-644ee7a3-573f-40c9-a5db-552328a48bdf tempest-GroupsV314Test-1152114611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-65f6df4c-c7c3-469c-aaee-abfef950480e {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:44:41 devstack sudo[95357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-65f6df4c-c7c3-469c-aaee-abfef950480e Sep 22 15:44:41 devstack sudo[95357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:44:42 devstack sudo[95348]: pam_unix(sudo:session): session closed for user root Sep 22 15:44:42 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-aa860aed-ba09-4d5a-b24e-bd26b246d776 tempest-VolumesCloneNegativeTest-1740191736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b7c15ca9-f9de-471b-a752-e2353ac82d0b 2147483648" returned: 0 in 0.628s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:44:42 devstack sudo[95357]: pam_unix(sudo:session): session closed for user root Sep 22 15:44:42 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-644ee7a3-573f-40c9-a5db-552328a48bdf tempest-GroupsV314Test-1152114611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-65f6df4c-c7c3-469c-aaee-abfef950480e" returned: 0 in 0.341s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:44:42 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-644ee7a3-573f-40c9-a5db-552328a48bdf tempest-GroupsV314Test-1152114611 None] Lock "cinder-quobyte-65f6df4c-c7c3-469c-aaee-abfef950480e" released by "delete_volume" :: held 0.823s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:44:42 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-aa860aed-ba09-4d5a-b24e-bd26b246d776 tempest-VolumesCloneNegativeTest-1740191736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b7c15ca9-f9de-471b-a752-e2353ac82d0b {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:44:42 devstack sudo[95363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b7c15ca9-f9de-471b-a752-e2353ac82d0b Sep 22 15:44:42 devstack sudo[95363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:44:42 devstack cinder-volume[86212]: DEBUG cinder.quota [None req-644ee7a3-573f-40c9-a5db-552328a48bdf tempest-GroupsV314Test-1152114611 None] Created reservations ['d06cafd8-49a5-419b-89a7-2bda8de69c85'] {{(pid=86212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 15:44:42 devstack cinder-volume[86212]: WARNING cinder.quota [None req-644ee7a3-573f-40c9-a5db-552328a48bdf tempest-GroupsV314Test-1152114611 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1579692346 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1579692346, it is now deprecated. Please use the default quota class for default quota. Sep 22 15:44:42 devstack cinder-volume[86212]: WARNING cinder.quota [None req-644ee7a3-573f-40c9-a5db-552328a48bdf tempest-GroupsV314Test-1152114611 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1579692346 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1579692346, it is now deprecated. Please use the default quota class for default quota. Sep 22 15:44:42 devstack cinder-volume[86212]: DEBUG cinder.quota [None req-644ee7a3-573f-40c9-a5db-552328a48bdf tempest-GroupsV314Test-1152114611 None] Created reservations ['6666c69f-37b2-4452-a172-9502ef902782', '7373c7f6-24c9-45db-acf4-f6ce5e27fcdd', 'a78522f3-a46f-48d5-8dc4-6eda32183374', 'e4454fcb-c75d-4fa7-b6f1-4d62abe03a57'] {{(pid=86212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 15:44:42 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-644ee7a3-573f-40c9-a5db-552328a48bdf tempest-GroupsV314Test-1152114611 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:44:42 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-644ee7a3-573f-40c9-a5db-552328a48bdf tempest-GroupsV314Test-1152114611 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:44:42 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-644ee7a3-573f-40c9-a5db-552328a48bdf tempest-GroupsV314Test-1152114611 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:44:42 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-644ee7a3-573f-40c9-a5db-552328a48bdf tempest-GroupsV314Test-1152114611 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:44:42 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-644ee7a3-573f-40c9-a5db-552328a48bdf tempest-GroupsV314Test-1152114611 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:44:42 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-644ee7a3-573f-40c9-a5db-552328a48bdf tempest-GroupsV314Test-1152114611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:44:42 devstack sudo[95367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc Sep 22 15:44:42 devstack sudo[95367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:44:42 devstack sudo[95363]: pam_unix(sudo:session): session closed for user root Sep 22 15:44:42 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-aa860aed-ba09-4d5a-b24e-bd26b246d776 tempest-VolumesCloneNegativeTest-1740191736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b7c15ca9-f9de-471b-a752-e2353ac82d0b" returned: 0 in 0.383s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:44:42 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-aa860aed-ba09-4d5a-b24e-bd26b246d776 tempest-VolumesCloneNegativeTest-1740191736 None] <== create_volume: return (1103ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'} {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 15:44:42 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-aa860aed-ba09-4d5a-b24e-bd26b246d776 tempest-VolumesCloneNegativeTest-1740191736 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.109s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:44:42 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-aa860aed-ba09-4d5a-b24e-bd26b246d776 tempest-VolumesCloneNegativeTest-1740191736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1be23031-c9fe-4c54-854e-10706cd1b39c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b7c15ca9-f9de-471b-a752-e2353ac82d0b', 'volume_size': 2}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:44:42 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-aa860aed-ba09-4d5a-b24e-bd26b246d776 tempest-VolumesCloneNegativeTest-1740191736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c535c995-4b97-473a-b0b4-2afb57fb7113) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:44:42 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-aa860aed-ba09-4d5a-b24e-bd26b246d776 tempest-VolumesCloneNegativeTest-1740191736 None] Volume volume-b7c15ca9-f9de-471b-a752-e2353ac82d0b (b7c15ca9-f9de-471b-a752-e2353ac82d0b): created successfully Sep 22 15:44:42 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-aa860aed-ba09-4d5a-b24e-bd26b246d776 tempest-VolumesCloneNegativeTest-1740191736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c535c995-4b97-473a-b0b4-2afb57fb7113) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:44:42 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-aa860aed-ba09-4d5a-b24e-bd26b246d776 tempest-VolumesCloneNegativeTest-1740191736 None] Flow 'volume_create_manager' (78aa87ea-eafe-4c47-bcb9-9562969daacd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:44:42 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-aa860aed-ba09-4d5a-b24e-bd26b246d776 tempest-VolumesCloneNegativeTest-1740191736 None] Created volume successfully. Sep 22 15:44:42 devstack sudo[95367]: pam_unix(sudo:session): session closed for user root Sep 22 15:44:42 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-644ee7a3-573f-40c9-a5db-552328a48bdf tempest-GroupsV314Test-1152114611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc" returned: 0 in 0.356s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:44:42 devstack cinder-volume[86212]: DEBUG cinder.manager [None req-644ee7a3-573f-40c9-a5db-552328a48bdf tempest-GroupsV314Test-1152114611 None] Notifying Schedulers of capabilities ... {{(pid=86212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 15:44:42 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-644ee7a3-573f-40c9-a5db-552328a48bdf tempest-GroupsV314Test-1152114611 None] Delete group completed successfully. Sep 22 15:44:42 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [req-9e116f5e-0f3a-4fcc-86d3-f40c84b8a9d1 req-3c5d69e8-4341-4575-85a8-bd4e4c7d203a tempest-AttachVolumeTestJSON-678247873 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:44:42 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [req-9e116f5e-0f3a-4fcc-86d3-f40c84b8a9d1 req-3c5d69e8-4341-4575-85a8-bd4e4c7d203a tempest-AttachVolumeTestJSON-678247873 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:44:42 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [req-9e116f5e-0f3a-4fcc-86d3-f40c84b8a9d1 req-3c5d69e8-4341-4575-85a8-bd4e4c7d203a tempest-AttachVolumeTestJSON-678247873 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.025s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:44:43 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [req-9e116f5e-0f3a-4fcc-86d3-f40c84b8a9d1 req-3c5d69e8-4341-4575-85a8-bd4e4c7d203a tempest-AttachVolumeTestJSON-678247873 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31', 'name': 'volume-2267f4be-a702-4821-8a42-bb5064a7eb84', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ae62292b-8ad6-4607-9f88-6d2eb88769cc', 'enforce_multipath': True} {{(pid=86212) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 22 15:44:43 devstack cinder-volume[86212]: INFO cinder.volume.manager [req-9e116f5e-0f3a-4fcc-86d3-f40c84b8a9d1 req-3c5d69e8-4341-4575-85a8-bd4e4c7d203a tempest-AttachVolumeTestJSON-678247873 None] attachment_update completed successfully. Sep 22 15:44:43 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-fc32851e-e8d8-4f87-a1a1-a76a5501679b tempest-VolumesCloneNegativeTest-1740191736 None] Acquiring lock "cinder-b7c15ca9-f9de-471b-a752-e2353ac82d0b-delete_volume" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:44:43 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-fc32851e-e8d8-4f87-a1a1-a76a5501679b tempest-VolumesCloneNegativeTest-1740191736 None] Lock "cinder-b7c15ca9-f9de-471b-a752-e2353ac82d0b-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:44:43 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-fc32851e-e8d8-4f87-a1a1-a76a5501679b tempest-VolumesCloneNegativeTest-1740191736 None] Acquiring lock "cinder-quobyte-b7c15ca9-f9de-471b-a752-e2353ac82d0b" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:44:43 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-fc32851e-e8d8-4f87-a1a1-a76a5501679b tempest-VolumesCloneNegativeTest-1740191736 None] Lock "cinder-quobyte-b7c15ca9-f9de-471b-a752-e2353ac82d0b" acquired by "delete_volume" :: waited 0.021s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:44:43 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7cc36d9-abe4-49cf-af28-e40a31e0bf0a]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:44:43 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-fc32851e-e8d8-4f87-a1a1-a76a5501679b tempest-VolumesCloneNegativeTest-1740191736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b7c15ca9-f9de-471b-a752-e2353ac82d0b {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:44:43 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-1f93a35f-5c1c-4500-916b-2cec91900468 tempest-GroupsV314Test-1152114611 None] Acquiring lock "cinder-quobyte-d3c39961-3794-4118-8120-caf8e5503556" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:44:44 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-1f93a35f-5c1c-4500-916b-2cec91900468 tempest-GroupsV314Test-1152114611 None] Lock "cinder-quobyte-d3c39961-3794-4118-8120-caf8e5503556" acquired by "delete_volume" :: waited 0.034s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:44:44 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[5888acc0-8dc0-4482-9258-6ea32a1dde0b]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:44:44 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-1f93a35f-5c1c-4500-916b-2cec91900468 tempest-GroupsV314Test-1152114611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-d3c39961-3794-4118-8120-caf8e5503556 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:44:44 devstack sudo[95381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b7c15ca9-f9de-471b-a752-e2353ac82d0b Sep 22 15:44:44 devstack sudo[95381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:44:44 devstack sudo[95384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-d3c39961-3794-4118-8120-caf8e5503556 Sep 22 15:44:44 devstack sudo[95384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:44:44 devstack sudo[95381]: pam_unix(sudo:session): session closed for user root Sep 22 15:44:44 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-fc32851e-e8d8-4f87-a1a1-a76a5501679b tempest-VolumesCloneNegativeTest-1740191736 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b7c15ca9-f9de-471b-a752-e2353ac82d0b" returned: 0 in 0.569s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:44:44 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-fc32851e-e8d8-4f87-a1a1-a76a5501679b tempest-VolumesCloneNegativeTest-1740191736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b7c15ca9-f9de-471b-a752-e2353ac82d0b {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:44:44 devstack sudo[95384]: pam_unix(sudo:session): session closed for user root Sep 22 15:44:44 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-1f93a35f-5c1c-4500-916b-2cec91900468 tempest-GroupsV314Test-1152114611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-d3c39961-3794-4118-8120-caf8e5503556" returned: 0 in 0.460s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:44:44 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-1f93a35f-5c1c-4500-916b-2cec91900468 tempest-GroupsV314Test-1152114611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-d3c39961-3794-4118-8120-caf8e5503556 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:44:44 devstack sudo[95418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b7c15ca9-f9de-471b-a752-e2353ac82d0b Sep 22 15:44:44 devstack sudo[95418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:44:44 devstack sudo[95419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-d3c39961-3794-4118-8120-caf8e5503556 Sep 22 15:44:44 devstack sudo[95419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:44:44 devstack sudo[95418]: pam_unix(sudo:session): session closed for user root Sep 22 15:44:44 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-fc32851e-e8d8-4f87-a1a1-a76a5501679b tempest-VolumesCloneNegativeTest-1740191736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b7c15ca9-f9de-471b-a752-e2353ac82d0b" returned: 0 in 0.286s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:44:44 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-fc32851e-e8d8-4f87-a1a1-a76a5501679b tempest-VolumesCloneNegativeTest-1740191736 None] Lock "cinder-quobyte-b7c15ca9-f9de-471b-a752-e2353ac82d0b" released by "delete_volume" :: held 0.942s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:44:44 devstack sudo[95419]: pam_unix(sudo:session): session closed for user root Sep 22 15:44:44 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-1f93a35f-5c1c-4500-916b-2cec91900468 tempest-GroupsV314Test-1152114611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-d3c39961-3794-4118-8120-caf8e5503556" returned: 0 in 0.317s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:44:44 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-1f93a35f-5c1c-4500-916b-2cec91900468 tempest-GroupsV314Test-1152114611 None] Lock "cinder-quobyte-d3c39961-3794-4118-8120-caf8e5503556" released by "delete_volume" :: held 0.878s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:44:44 devstack cinder-volume[86212]: DEBUG cinder.quota [None req-fc32851e-e8d8-4f87-a1a1-a76a5501679b tempest-VolumesCloneNegativeTest-1740191736 None] Created reservations ['b2349e90-d1b8-4aa4-808e-2414990781bf', '3b8fd2ab-15b3-41a9-ab73-c7e4cec86950', '53ec1ac2-383a-4196-a373-919b58cb37a4', 'bef397e9-0623-472b-b046-8327c3f21dff'] {{(pid=86212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 15:44:44 devstack cinder-volume[86212]: DEBUG cinder.quota [None req-1f93a35f-5c1c-4500-916b-2cec91900468 tempest-GroupsV314Test-1152114611 None] Created reservations ['27687e9f-b7d8-4fad-a578-1cbd260a6aa1'] {{(pid=86212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 15:44:45 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-fc32851e-e8d8-4f87-a1a1-a76a5501679b tempest-VolumesCloneNegativeTest-1740191736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:44:45 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-fc32851e-e8d8-4f87-a1a1-a76a5501679b tempest-VolumesCloneNegativeTest-1740191736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:44:45 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-fc32851e-e8d8-4f87-a1a1-a76a5501679b tempest-VolumesCloneNegativeTest-1740191736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:44:45 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-fc32851e-e8d8-4f87-a1a1-a76a5501679b tempest-VolumesCloneNegativeTest-1740191736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:44:45 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-fc32851e-e8d8-4f87-a1a1-a76a5501679b tempest-VolumesCloneNegativeTest-1740191736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:44:45 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-fc32851e-e8d8-4f87-a1a1-a76a5501679b tempest-VolumesCloneNegativeTest-1740191736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:44:45 devstack sudo[95426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc Sep 22 15:44:45 devstack sudo[95426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:44:45 devstack cinder-volume[86212]: DEBUG cinder.quota [None req-1f93a35f-5c1c-4500-916b-2cec91900468 tempest-GroupsV314Test-1152114611 None] Created reservations ['2b838294-c1e1-498a-8e85-e8c68012c9d7', 'd716632e-938e-4842-997c-ef94c27508ea', 'bc950b7d-7612-4ff2-b344-a66ce62a81ba', 'a2c8fab3-69f8-45c3-9bbf-bf210c0c3d46'] {{(pid=86212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 15:44:45 devstack cinder-volume[86212]: INFO cinder.volume.manager [req-a6f43a2c-6f8c-490d-89bf-a03effc33bf5 req-1d032409-fe55-473c-a0bb-41b5c2c54944 tempest-AttachVolumeTestJSON-678247873 None] Terminate volume connection completed successfully. Sep 22 15:44:45 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [req-a6f43a2c-6f8c-490d-89bf-a03effc33bf5 req-1d032409-fe55-473c-a0bb-41b5c2c54944 tempest-AttachVolumeTestJSON-678247873 None] Deleting attachment cf3e155b-2bf1-4943-9722-fd004c02d9f7. {{(pid=86212) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 22 15:44:45 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-1f93a35f-5c1c-4500-916b-2cec91900468 tempest-GroupsV314Test-1152114611 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:44:45 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-1f93a35f-5c1c-4500-916b-2cec91900468 tempest-GroupsV314Test-1152114611 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:44:45 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-1f93a35f-5c1c-4500-916b-2cec91900468 tempest-GroupsV314Test-1152114611 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:44:45 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-1f93a35f-5c1c-4500-916b-2cec91900468 tempest-GroupsV314Test-1152114611 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:44:45 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-1f93a35f-5c1c-4500-916b-2cec91900468 tempest-GroupsV314Test-1152114611 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:44:45 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-1f93a35f-5c1c-4500-916b-2cec91900468 tempest-GroupsV314Test-1152114611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:44:45 devstack sudo[95428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc Sep 22 15:44:45 devstack sudo[95428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:44:45 devstack sudo[95426]: pam_unix(sudo:session): session closed for user root Sep 22 15:44:45 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-fc32851e-e8d8-4f87-a1a1-a76a5501679b tempest-VolumesCloneNegativeTest-1740191736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc" returned: 0 in 0.369s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:44:45 devstack cinder-volume[86212]: DEBUG cinder.manager [None req-fc32851e-e8d8-4f87-a1a1-a76a5501679b tempest-VolumesCloneNegativeTest-1740191736 None] Notifying Schedulers of capabilities ... {{(pid=86212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 15:44:45 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-fc32851e-e8d8-4f87-a1a1-a76a5501679b tempest-VolumesCloneNegativeTest-1740191736 None] Deleted volume successfully. Sep 22 15:44:45 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-fc32851e-e8d8-4f87-a1a1-a76a5501679b tempest-VolumesCloneNegativeTest-1740191736 None] Lock "cinder-b7c15ca9-f9de-471b-a752-e2353ac82d0b-delete_volume" released by "delete_volume" :: held 1.630s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:44:45 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-1f93a35f-5c1c-4500-916b-2cec91900468 tempest-GroupsV314Test-1152114611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc" returned: 0 in 0.343s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:44:45 devstack cinder-volume[86212]: DEBUG cinder.manager [None req-1f93a35f-5c1c-4500-916b-2cec91900468 tempest-GroupsV314Test-1152114611 None] Notifying Schedulers of capabilities ... {{(pid=86212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 15:44:45 devstack sudo[95428]: pam_unix(sudo:session): session closed for user root Sep 22 15:44:45 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-1f93a35f-5c1c-4500-916b-2cec91900468 tempest-GroupsV314Test-1152114611 None] Delete group completed successfully. Sep 22 15:44:46 devstack cinder-volume[86212]: INFO cinder.volume.manager [req-ffb67a7d-1211-4684-bb1a-bd6496125cca req-e59afad6-6518-41a3-be29-76670978ce21 tempest-AttachVolumeTestJSON-678247873 None] Terminate volume connection completed successfully. Sep 22 15:44:46 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [req-ffb67a7d-1211-4684-bb1a-bd6496125cca req-e59afad6-6518-41a3-be29-76670978ce21 tempest-AttachVolumeTestJSON-678247873 None] Deleting attachment ae62292b-8ad6-4607-9f88-6d2eb88769cc. {{(pid=86212) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 22 15:44:52 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-860ceac7-ae90-4bee-ae53-00dd7fef5b48 tempest-AttachVolumeTestJSON-678247873 None] Acquiring lock "cinder-2267f4be-a702-4821-8a42-bb5064a7eb84-delete_volume" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:44:52 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-860ceac7-ae90-4bee-ae53-00dd7fef5b48 tempest-AttachVolumeTestJSON-678247873 None] Lock "cinder-2267f4be-a702-4821-8a42-bb5064a7eb84-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:44:52 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-860ceac7-ae90-4bee-ae53-00dd7fef5b48 tempest-AttachVolumeTestJSON-678247873 None] Acquiring lock "cinder-quobyte-2267f4be-a702-4821-8a42-bb5064a7eb84" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:44:52 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-860ceac7-ae90-4bee-ae53-00dd7fef5b48 tempest-AttachVolumeTestJSON-678247873 None] Lock "cinder-quobyte-2267f4be-a702-4821-8a42-bb5064a7eb84" acquired by "delete_volume" :: waited 0.024s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:44:52 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[127ba9d8-e346-4ba1-a0f5-b4ea39b09aad]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:44:52 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-860ceac7-ae90-4bee-ae53-00dd7fef5b48 tempest-AttachVolumeTestJSON-678247873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2267f4be-a702-4821-8a42-bb5064a7eb84 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:44:52 devstack sudo[95466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2267f4be-a702-4821-8a42-bb5064a7eb84 Sep 22 15:44:52 devstack sudo[95466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:44:53 devstack sudo[95466]: pam_unix(sudo:session): session closed for user root Sep 22 15:44:53 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-860ceac7-ae90-4bee-ae53-00dd7fef5b48 tempest-AttachVolumeTestJSON-678247873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2267f4be-a702-4821-8a42-bb5064a7eb84" returned: 0 in 0.537s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:44:53 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-860ceac7-ae90-4bee-ae53-00dd7fef5b48 tempest-AttachVolumeTestJSON-678247873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2267f4be-a702-4821-8a42-bb5064a7eb84 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:44:53 devstack sudo[95472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2267f4be-a702-4821-8a42-bb5064a7eb84 Sep 22 15:44:53 devstack sudo[95472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:44:53 devstack cinder-volume[86212]: DEBUG cinder.volume.flows.manager.create_volume [None req-d2432aeb-d719-41f3-8b1e-ded443252c4f tempest-VolumesExtendTest-1784848575 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 15:44:53 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-d2432aeb-d719-41f3-8b1e-ded443252c4f tempest-VolumesExtendTest-1784848575 None] Flow 'volume_create_manager' (96de4317-f527-48d6-b64c-d7d3c77f7aff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:44:53 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-d2432aeb-d719-41f3-8b1e-ded443252c4f tempest-VolumesExtendTest-1784848575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62d4dff0-4fc0-4c59-85e4-77b08dd79ed5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:44:53 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-d2432aeb-d719-41f3-8b1e-ded443252c4f tempest-VolumesExtendTest-1784848575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62d4dff0-4fc0-4c59-85e4-77b08dd79ed5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:44:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1564253716',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e869d2d-8c57-4196-af61-6e274ad0b14c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7dbebcd84f404b71ba5c2d9adb96cffa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:44:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:44:53Z,use_quota=True,user_id='af04838b5640411da6aafb36a4be9127',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:44:53 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-d2432aeb-d719-41f3-8b1e-ded443252c4f tempest-VolumesExtendTest-1784848575 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abcb1695-1c2a-4a06-b32f-7bb57004c17b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:44:53 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-d2432aeb-d719-41f3-8b1e-ded443252c4f tempest-VolumesExtendTest-1784848575 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abcb1695-1c2a-4a06-b32f-7bb57004c17b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:44:53 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-d2432aeb-d719-41f3-8b1e-ded443252c4f tempest-VolumesExtendTest-1784848575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb9d0f13-6ea3-4e41-8739-02297045abab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:44:53 devstack cinder-volume[86212]: DEBUG cinder.image.glance [None req-d2432aeb-d719-41f3-8b1e-ded443252c4f tempest-VolumesExtendTest-1784848575 None] Creating Keystone auth plugin from conf {{(pid=86212) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 22 15:44:53 devstack cinder-volume[86212]: DEBUG cinder.volume.flows.manager.create_volume [req-145e13af-34e9-452a-b0a2-cbcfffe774d1 req-017dbdf4-d044-40e7-b4f9-064a1098b37b tempest-VolumesSnapshotsTestJSON-1200813888 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 15:44:53 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [req-145e13af-34e9-452a-b0a2-cbcfffe774d1 req-017dbdf4-d044-40e7-b4f9-064a1098b37b tempest-VolumesSnapshotsTestJSON-1200813888 None] Flow 'volume_create_manager' (337b83b9-d322-4a18-ba26-5d429d3d3149) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:44:53 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [req-145e13af-34e9-452a-b0a2-cbcfffe774d1 req-017dbdf4-d044-40e7-b4f9-064a1098b37b tempest-VolumesSnapshotsTestJSON-1200813888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bec0106f-9a64-453e-930a-62f7ecb7c7c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:44:53 devstack sudo[95472]: pam_unix(sudo:session): session closed for user root Sep 22 15:44:53 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-860ceac7-ae90-4bee-ae53-00dd7fef5b48 tempest-AttachVolumeTestJSON-678247873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2267f4be-a702-4821-8a42-bb5064a7eb84" returned: 0 in 0.328s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:44:53 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [req-145e13af-34e9-452a-b0a2-cbcfffe774d1 req-017dbdf4-d044-40e7-b4f9-064a1098b37b tempest-VolumesSnapshotsTestJSON-1200813888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bec0106f-9a64-453e-930a-62f7ecb7c7c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:44:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1575047691',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cdb00a10-8147-483b-8230-08a3ecdd524c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb60260c52cc47e7a9379710670bee32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:44:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:44:53Z,use_quota=True,user_id='bcb3a03c433a4b828f906f1abc7443c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:44:53 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [req-145e13af-34e9-452a-b0a2-cbcfffe774d1 req-017dbdf4-d044-40e7-b4f9-064a1098b37b tempest-VolumesSnapshotsTestJSON-1200813888 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (698d4542-b0e1-4a20-8429-390b17687f1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:44:53 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [req-145e13af-34e9-452a-b0a2-cbcfffe774d1 req-017dbdf4-d044-40e7-b4f9-064a1098b37b tempest-VolumesSnapshotsTestJSON-1200813888 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (698d4542-b0e1-4a20-8429-390b17687f1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:44:53 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [req-145e13af-34e9-452a-b0a2-cbcfffe774d1 req-017dbdf4-d044-40e7-b4f9-064a1098b37b tempest-VolumesSnapshotsTestJSON-1200813888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (758b0897-cb75-4837-a9d4-c0679897ac3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:44:53 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [req-145e13af-34e9-452a-b0a2-cbcfffe774d1 req-017dbdf4-d044-40e7-b4f9-064a1098b37b tempest-VolumesSnapshotsTestJSON-1200813888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (758b0897-cb75-4837-a9d4-c0679897ac3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cdb00a10-8147-483b-8230-08a3ecdd524c', 'volume_name': 'volume-cdb00a10-8147-483b-8230-08a3ecdd524c', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:44:53 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [req-145e13af-34e9-452a-b0a2-cbcfffe774d1 req-017dbdf4-d044-40e7-b4f9-064a1098b37b tempest-VolumesSnapshotsTestJSON-1200813888 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0c7a597-5994-44f0-9246-2db2327d5777) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:44:53 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [req-145e13af-34e9-452a-b0a2-cbcfffe774d1 req-017dbdf4-d044-40e7-b4f9-064a1098b37b tempest-VolumesSnapshotsTestJSON-1200813888 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0c7a597-5994-44f0-9246-2db2327d5777) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:44:53 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [req-145e13af-34e9-452a-b0a2-cbcfffe774d1 req-017dbdf4-d044-40e7-b4f9-064a1098b37b tempest-VolumesSnapshotsTestJSON-1200813888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80af1ac2-c6f9-4e10-a056-d5d6ebe9d6f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:44:53 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [req-145e13af-34e9-452a-b0a2-cbcfffe774d1 req-017dbdf4-d044-40e7-b4f9-064a1098b37b tempest-VolumesSnapshotsTestJSON-1200813888 None] Volume cdb00a10-8147-483b-8230-08a3ecdd524c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cdb00a10-8147-483b-8230-08a3ecdd524c', 'volume_size': 1} Sep 22 15:44:53 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [req-145e13af-34e9-452a-b0a2-cbcfffe774d1 req-017dbdf4-d044-40e7-b4f9-064a1098b37b tempest-VolumesSnapshotsTestJSON-1200813888 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:44:53 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [req-145e13af-34e9-452a-b0a2-cbcfffe774d1 req-017dbdf4-d044-40e7-b4f9-064a1098b37b tempest-VolumesSnapshotsTestJSON-1200813888 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:44:53 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [req-145e13af-34e9-452a-b0a2-cbcfffe774d1 req-017dbdf4-d044-40e7-b4f9-064a1098b37b tempest-VolumesSnapshotsTestJSON-1200813888 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:44:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1575047691',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cdb00a10-8147-483b-8230-08a3ecdd524c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb60260c52cc47e7a9379710670bee32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:44:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:44:53Z,use_quota=True,user_id='bcb3a03c433a4b828f906f1abc7443c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)}" {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 15:44:53 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [req-145e13af-34e9-452a-b0a2-cbcfffe774d1 req-017dbdf4-d044-40e7-b4f9-064a1098b37b tempest-VolumesSnapshotsTestJSON-1200813888 None] Creating volume cdb00a10-8147-483b-8230-08a3ecdd524c {{(pid=86212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 15:44:53 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [req-145e13af-34e9-452a-b0a2-cbcfffe774d1 req-017dbdf4-d044-40e7-b4f9-064a1098b37b tempest-VolumesSnapshotsTestJSON-1200813888 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:44:53 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [req-145e13af-34e9-452a-b0a2-cbcfffe774d1 req-017dbdf4-d044-40e7-b4f9-064a1098b37b tempest-VolumesSnapshotsTestJSON-1200813888 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:44:53 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [req-145e13af-34e9-452a-b0a2-cbcfffe774d1 req-017dbdf4-d044-40e7-b4f9-064a1098b37b tempest-VolumesSnapshotsTestJSON-1200813888 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:44:53 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [req-145e13af-34e9-452a-b0a2-cbcfffe774d1 req-017dbdf4-d044-40e7-b4f9-064a1098b37b tempest-VolumesSnapshotsTestJSON-1200813888 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:44:53 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [req-145e13af-34e9-452a-b0a2-cbcfffe774d1 req-017dbdf4-d044-40e7-b4f9-064a1098b37b tempest-VolumesSnapshotsTestJSON-1200813888 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:44:53 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [req-145e13af-34e9-452a-b0a2-cbcfffe774d1 req-017dbdf4-d044-40e7-b4f9-064a1098b37b tempest-VolumesSnapshotsTestJSON-1200813888 None] Selected osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 as target Quobyte volume. {{(pid=86212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 15:44:53 devstack cinder-volume[86212]: INFO cinder.volume.drivers.remotefs [req-145e13af-34e9-452a-b0a2-cbcfffe774d1 req-017dbdf4-d044-40e7-b4f9-064a1098b37b tempest-VolumesSnapshotsTestJSON-1200813888 None] casted to osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 Sep 22 15:44:53 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [req-145e13af-34e9-452a-b0a2-cbcfffe774d1 req-017dbdf4-d044-40e7-b4f9-064a1098b37b tempest-VolumesSnapshotsTestJSON-1200813888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-cdb00a10-8147-483b-8230-08a3ecdd524c 1073741824 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:44:53 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-860ceac7-ae90-4bee-ae53-00dd7fef5b48 tempest-AttachVolumeTestJSON-678247873 None] Lock "cinder-quobyte-2267f4be-a702-4821-8a42-bb5064a7eb84" released by "delete_volume" :: held 1.004s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:44:53 devstack sudo[95475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-cdb00a10-8147-483b-8230-08a3ecdd524c 1073741824 Sep 22 15:44:53 devstack sudo[95475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:44:53 devstack cinder-volume[86212]: DEBUG cinder.quota [None req-860ceac7-ae90-4bee-ae53-00dd7fef5b48 tempest-AttachVolumeTestJSON-678247873 None] Created reservations ['876b0896-6403-40a6-9d61-7818adf64fd3', '815f920e-2d64-466b-88b1-d290f99fc70b', '3cb31173-f69c-418d-bbd5-6eae7f392ca2', '3cd2cdcf-74ff-4b25-b8fc-5d36cd168575'] {{(pid=86212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 15:44:53 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-860ceac7-ae90-4bee-ae53-00dd7fef5b48 tempest-AttachVolumeTestJSON-678247873 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:44:53 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-860ceac7-ae90-4bee-ae53-00dd7fef5b48 tempest-AttachVolumeTestJSON-678247873 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:44:53 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-860ceac7-ae90-4bee-ae53-00dd7fef5b48 tempest-AttachVolumeTestJSON-678247873 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:44:53 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-860ceac7-ae90-4bee-ae53-00dd7fef5b48 tempest-AttachVolumeTestJSON-678247873 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:44:53 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-860ceac7-ae90-4bee-ae53-00dd7fef5b48 tempest-AttachVolumeTestJSON-678247873 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:44:53 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-860ceac7-ae90-4bee-ae53-00dd7fef5b48 tempest-AttachVolumeTestJSON-678247873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:44:53 devstack sudo[95477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc Sep 22 15:44:53 devstack sudo[95477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:44:53 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-d2432aeb-d719-41f3-8b1e-ded443252c4f tempest-VolumesExtendTest-1784848575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb9d0f13-6ea3-4e41-8739-02297045abab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '2e869d2d-8c57-4196-af61-6e274ad0b14c', 'volume_name': 'volume-2e869d2d-8c57-4196-af61-6e274ad0b14c', 'volume_size': 1, 'image_id': '6995c6ae-03d1-45bf-bf55-00575d1858e8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6995c6ae-03d1-45bf-bf55-00575d1858e8', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '28219d994ba546ed905a95ed90257a43', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6995c6ae-03d1-45bf-bf55-00575d1858e8', 'created_at': datetime.datetime(2026, 9, 22, 13, 30, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 13, 30, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6995c6ae-03d1-45bf-bf55-00575d1858e8/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:44:53 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-d2432aeb-d719-41f3-8b1e-ded443252c4f tempest-VolumesExtendTest-1784848575 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8136bd50-0cf4-456a-bc32-152ff1e49917) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:44:53 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-d2432aeb-d719-41f3-8b1e-ded443252c4f tempest-VolumesExtendTest-1784848575 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8136bd50-0cf4-456a-bc32-152ff1e49917) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:44:53 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-d2432aeb-d719-41f3-8b1e-ded443252c4f tempest-VolumesExtendTest-1784848575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (680bfbf9-038b-4d5e-8dfb-38e24910cadd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:44:53 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-d2432aeb-d719-41f3-8b1e-ded443252c4f tempest-VolumesExtendTest-1784848575 None] Volume 2e869d2d-8c57-4196-af61-6e274ad0b14c: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-2e869d2d-8c57-4196-af61-6e274ad0b14c', 'volume_size': 1, 'image_id': '6995c6ae-03d1-45bf-bf55-00575d1858e8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6995c6ae-03d1-45bf-bf55-00575d1858e8', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '28219d994ba546ed905a95ed90257a43', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6995c6ae-03d1-45bf-bf55-00575d1858e8', 'created_at': datetime.datetime(2026, 9, 22, 13, 30, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 13, 30, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6995c6ae-03d1-45bf-bf55-00575d1858e8/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 22 15:44:53 devstack cinder-volume[86212]: DEBUG cinder.volume.flows.manager.create_volume [None req-d2432aeb-d719-41f3-8b1e-ded443252c4f tempest-VolumesExtendTest-1784848575 None] Trying to clone 2e869d2d-8c57-4196-af61-6e274ad0b14c from image 6995c6ae-03d1-45bf-bf55-00575d1858e8 at location (None, [{'url': 'file:///opt/stack/data/glance/images/6995c6ae-03d1-45bf-bf55-00575d1858e8', 'metadata': {}}]). {{(pid=86212) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 22 15:44:53 devstack sudo[95477]: pam_unix(sudo:session): session closed for user root Sep 22 15:44:53 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-860ceac7-ae90-4bee-ae53-00dd7fef5b48 tempest-AttachVolumeTestJSON-678247873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc" returned: 0 in 0.310s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:44:53 devstack cinder-volume[86212]: DEBUG cinder.manager [None req-860ceac7-ae90-4bee-ae53-00dd7fef5b48 tempest-AttachVolumeTestJSON-678247873 None] Notifying Schedulers of capabilities ... {{(pid=86212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 15:44:53 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-860ceac7-ae90-4bee-ae53-00dd7fef5b48 tempest-AttachVolumeTestJSON-678247873 None] Deleted volume successfully. Sep 22 15:44:54 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-860ceac7-ae90-4bee-ae53-00dd7fef5b48 tempest-AttachVolumeTestJSON-678247873 None] Lock "cinder-2267f4be-a702-4821-8a42-bb5064a7eb84-delete_volume" released by "delete_volume" :: held 1.646s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:44:54 devstack sudo[95475]: pam_unix(sudo:session): session closed for user root Sep 22 15:44:54 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [req-145e13af-34e9-452a-b0a2-cbcfffe774d1 req-017dbdf4-d044-40e7-b4f9-064a1098b37b tempest-VolumesSnapshotsTestJSON-1200813888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-cdb00a10-8147-483b-8230-08a3ecdd524c 1073741824" returned: 0 in 0.601s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:44:54 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [req-145e13af-34e9-452a-b0a2-cbcfffe774d1 req-017dbdf4-d044-40e7-b4f9-064a1098b37b tempest-VolumesSnapshotsTestJSON-1200813888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-cdb00a10-8147-483b-8230-08a3ecdd524c {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:44:54 devstack sudo[95485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-cdb00a10-8147-483b-8230-08a3ecdd524c Sep 22 15:44:54 devstack sudo[95485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:44:54 devstack cinder-volume[86212]: DEBUG cinder.image.image_utils [None req-d2432aeb-d719-41f3-8b1e-ded443252c4f tempest-VolumesExtendTest-1784848575 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_6995c6ae-03d1-45bf-bf55-00575d1858e8_r_j71eq0devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86212) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 22 15:44:54 devstack cinder-volume[86212]: INFO cinder.image.image_utils [None req-d2432aeb-d719-41f3-8b1e-ded443252c4f tempest-VolumesExtendTest-1784848575 None] Image download 20.69 MB at 20.69 MB/s Sep 22 15:44:54 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[085b191b-9d79-4551-955b-9a1ba70df801]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:44:54 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-d2432aeb-d719-41f3-8b1e-ded443252c4f tempest-VolumesExtendTest-1784848575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6995c6ae-03d1-45bf-bf55-00575d1858e8_r_j71eq0devstack@QuobyteHD {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:44:54 devstack sudo[95487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6995c6ae-03d1-45bf-bf55-00575d1858e8_r_j71eq0devstack@QuobyteHD Sep 22 15:44:54 devstack sudo[95487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:44:54 devstack sudo[95485]: pam_unix(sudo:session): session closed for user root Sep 22 15:44:54 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [req-145e13af-34e9-452a-b0a2-cbcfffe774d1 req-017dbdf4-d044-40e7-b4f9-064a1098b37b tempest-VolumesSnapshotsTestJSON-1200813888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-cdb00a10-8147-483b-8230-08a3ecdd524c" returned: 0 in 0.284s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:44:54 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [req-145e13af-34e9-452a-b0a2-cbcfffe774d1 req-017dbdf4-d044-40e7-b4f9-064a1098b37b tempest-VolumesSnapshotsTestJSON-1200813888 None] <== create_volume: return (983ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'} {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 15:44:54 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [req-145e13af-34e9-452a-b0a2-cbcfffe774d1 req-017dbdf4-d044-40e7-b4f9-064a1098b37b tempest-VolumesSnapshotsTestJSON-1200813888 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.986s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:44:54 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [req-145e13af-34e9-452a-b0a2-cbcfffe774d1 req-017dbdf4-d044-40e7-b4f9-064a1098b37b tempest-VolumesSnapshotsTestJSON-1200813888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80af1ac2-c6f9-4e10-a056-d5d6ebe9d6f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cdb00a10-8147-483b-8230-08a3ecdd524c', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:44:54 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [req-145e13af-34e9-452a-b0a2-cbcfffe774d1 req-017dbdf4-d044-40e7-b4f9-064a1098b37b tempest-VolumesSnapshotsTestJSON-1200813888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a485156b-4a5d-49f0-8987-e2a0089b78eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:44:54 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [req-145e13af-34e9-452a-b0a2-cbcfffe774d1 req-017dbdf4-d044-40e7-b4f9-064a1098b37b tempest-VolumesSnapshotsTestJSON-1200813888 None] Volume volume-cdb00a10-8147-483b-8230-08a3ecdd524c (cdb00a10-8147-483b-8230-08a3ecdd524c): created successfully Sep 22 15:44:54 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [req-145e13af-34e9-452a-b0a2-cbcfffe774d1 req-017dbdf4-d044-40e7-b4f9-064a1098b37b tempest-VolumesSnapshotsTestJSON-1200813888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a485156b-4a5d-49f0-8987-e2a0089b78eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:44:54 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [req-145e13af-34e9-452a-b0a2-cbcfffe774d1 req-017dbdf4-d044-40e7-b4f9-064a1098b37b tempest-VolumesSnapshotsTestJSON-1200813888 None] Flow 'volume_create_manager' (337b83b9-d322-4a18-ba26-5d429d3d3149) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:44:54 devstack cinder-volume[86212]: INFO cinder.volume.manager [req-145e13af-34e9-452a-b0a2-cbcfffe774d1 req-017dbdf4-d044-40e7-b4f9-064a1098b37b tempest-VolumesSnapshotsTestJSON-1200813888 None] Created volume successfully. Sep 22 15:44:54 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-611194c3-47ae-4ab7-9c15-c1832565844c tempest-AttachVolumeTestJSON-678247873 None] Acquiring lock "cinder-f0b0aefc-a6a9-44ae-a223-b680aa0b7948-delete_volume" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:44:54 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-611194c3-47ae-4ab7-9c15-c1832565844c tempest-AttachVolumeTestJSON-678247873 None] Lock "cinder-f0b0aefc-a6a9-44ae-a223-b680aa0b7948-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:44:54 devstack sudo[95487]: pam_unix(sudo:session): session closed for user root Sep 22 15:44:54 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-d2432aeb-d719-41f3-8b1e-ded443252c4f tempest-VolumesExtendTest-1784848575 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6995c6ae-03d1-45bf-bf55-00575d1858e8_r_j71eq0devstack@QuobyteHD" returned: 0 in 0.379s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:44:54 devstack cinder-volume[86212]: DEBUG cinder.image.image_utils [None req-d2432aeb-d719-41f3-8b1e-ded443252c4f tempest-VolumesExtendTest-1784848575 None] Temporary image 6995c6ae-03d1-45bf-bf55-00575d1858e8 is fetched for user af04838b5640411da6aafb36a4be9127. {{(pid=86212) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 22 15:44:54 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-611194c3-47ae-4ab7-9c15-c1832565844c tempest-AttachVolumeTestJSON-678247873 None] Acquiring lock "cinder-quobyte-f0b0aefc-a6a9-44ae-a223-b680aa0b7948" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:44:54 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-611194c3-47ae-4ab7-9c15-c1832565844c tempest-AttachVolumeTestJSON-678247873 None] Lock "cinder-quobyte-f0b0aefc-a6a9-44ae-a223-b680aa0b7948" acquired by "delete_volume" :: waited 0.034s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:44:54 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[b379c351-b57e-4304-b8c1-ab76abac472f]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:44:54 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-611194c3-47ae-4ab7-9c15-c1832565844c tempest-AttachVolumeTestJSON-678247873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-f0b0aefc-a6a9-44ae-a223-b680aa0b7948 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:44:54 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[31fb7396-9cfb-4af8-bb44-6e5894f78bf7]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:44:54 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-d2432aeb-d719-41f3-8b1e-ded443252c4f tempest-VolumesExtendTest-1784848575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6995c6ae-03d1-45bf-bf55-00575d1858e8_r_j71eq0devstack@QuobyteHD {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:44:54 devstack sudo[95494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-f0b0aefc-a6a9-44ae-a223-b680aa0b7948 Sep 22 15:44:54 devstack sudo[95494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:44:54 devstack sudo[95495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6995c6ae-03d1-45bf-bf55-00575d1858e8_r_j71eq0devstack@QuobyteHD Sep 22 15:44:54 devstack sudo[95495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:44:55 devstack sudo[95495]: pam_unix(sudo:session): session closed for user root Sep 22 15:44:55 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-d2432aeb-d719-41f3-8b1e-ded443252c4f tempest-VolumesExtendTest-1784848575 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6995c6ae-03d1-45bf-bf55-00575d1858e8_r_j71eq0devstack@QuobyteHD" returned: 0 in 0.384s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:44:55 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-d2432aeb-d719-41f3-8b1e-ded443252c4f tempest-VolumesExtendTest-1784848575 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:44:55 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-d2432aeb-d719-41f3-8b1e-ded443252c4f tempest-VolumesExtendTest-1784848575 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:44:55 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-d2432aeb-d719-41f3-8b1e-ded443252c4f tempest-VolumesExtendTest-1784848575 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:44:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1564253716',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e869d2d-8c57-4196-af61-6e274ad0b14c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7dbebcd84f404b71ba5c2d9adb96cffa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:44:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:44:53Z,use_quota=True,user_id='af04838b5640411da6aafb36a4be9127',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)}" {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 15:44:55 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-d2432aeb-d719-41f3-8b1e-ded443252c4f tempest-VolumesExtendTest-1784848575 None] Creating volume 2e869d2d-8c57-4196-af61-6e274ad0b14c {{(pid=86212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 15:44:55 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-d2432aeb-d719-41f3-8b1e-ded443252c4f tempest-VolumesExtendTest-1784848575 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:44:55 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-d2432aeb-d719-41f3-8b1e-ded443252c4f tempest-VolumesExtendTest-1784848575 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:44:55 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-d2432aeb-d719-41f3-8b1e-ded443252c4f tempest-VolumesExtendTest-1784848575 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:44:55 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-d2432aeb-d719-41f3-8b1e-ded443252c4f tempest-VolumesExtendTest-1784848575 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:44:55 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-d2432aeb-d719-41f3-8b1e-ded443252c4f tempest-VolumesExtendTest-1784848575 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:44:55 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-d2432aeb-d719-41f3-8b1e-ded443252c4f tempest-VolumesExtendTest-1784848575 None] Selected osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 as target Quobyte volume. {{(pid=86212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 15:44:55 devstack cinder-volume[86212]: INFO cinder.volume.drivers.remotefs [None req-d2432aeb-d719-41f3-8b1e-ded443252c4f tempest-VolumesExtendTest-1784848575 None] casted to osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 Sep 22 15:44:55 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-d2432aeb-d719-41f3-8b1e-ded443252c4f tempest-VolumesExtendTest-1784848575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2e869d2d-8c57-4196-af61-6e274ad0b14c 1073741824 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:44:55 devstack sudo[95494]: pam_unix(sudo:session): session closed for user root Sep 22 15:44:55 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-611194c3-47ae-4ab7-9c15-c1832565844c tempest-AttachVolumeTestJSON-678247873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-f0b0aefc-a6a9-44ae-a223-b680aa0b7948" returned: 0 in 0.437s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:44:55 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-611194c3-47ae-4ab7-9c15-c1832565844c tempest-AttachVolumeTestJSON-678247873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-f0b0aefc-a6a9-44ae-a223-b680aa0b7948 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:44:55 devstack sudo[95504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2e869d2d-8c57-4196-af61-6e274ad0b14c 1073741824 Sep 22 15:44:55 devstack sudo[95504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:44:55 devstack sudo[95505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-f0b0aefc-a6a9-44ae-a223-b680aa0b7948 Sep 22 15:44:55 devstack sudo[95505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:44:55 devstack sudo[95505]: pam_unix(sudo:session): session closed for user root Sep 22 15:44:55 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-611194c3-47ae-4ab7-9c15-c1832565844c tempest-AttachVolumeTestJSON-678247873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-f0b0aefc-a6a9-44ae-a223-b680aa0b7948" returned: 0 in 0.300s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:44:55 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-611194c3-47ae-4ab7-9c15-c1832565844c tempest-AttachVolumeTestJSON-678247873 None] Lock "cinder-quobyte-f0b0aefc-a6a9-44ae-a223-b680aa0b7948" released by "delete_volume" :: held 0.794s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:44:55 devstack cinder-volume[86212]: DEBUG cinder.quota [None req-611194c3-47ae-4ab7-9c15-c1832565844c tempest-AttachVolumeTestJSON-678247873 None] Created reservations ['9038f7e0-765e-4428-bca8-35dd1afd0e3f', 'e4bdaaa3-c6fe-4079-877f-cf732c3a32f5', '8586af22-46a5-4bc0-8670-7ba633b825b5', '7a270e2e-390c-4277-bba9-18f1d5ac3371'] {{(pid=86212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 15:44:55 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-611194c3-47ae-4ab7-9c15-c1832565844c tempest-AttachVolumeTestJSON-678247873 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:44:55 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-611194c3-47ae-4ab7-9c15-c1832565844c tempest-AttachVolumeTestJSON-678247873 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:44:55 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-611194c3-47ae-4ab7-9c15-c1832565844c tempest-AttachVolumeTestJSON-678247873 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:44:55 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-611194c3-47ae-4ab7-9c15-c1832565844c tempest-AttachVolumeTestJSON-678247873 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:44:55 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-611194c3-47ae-4ab7-9c15-c1832565844c tempest-AttachVolumeTestJSON-678247873 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:44:55 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-611194c3-47ae-4ab7-9c15-c1832565844c tempest-AttachVolumeTestJSON-678247873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:44:55 devstack sudo[95504]: pam_unix(sudo:session): session closed for user root Sep 22 15:44:55 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-d2432aeb-d719-41f3-8b1e-ded443252c4f tempest-VolumesExtendTest-1784848575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2e869d2d-8c57-4196-af61-6e274ad0b14c 1073741824" returned: 0 in 0.604s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:44:55 devstack sudo[95513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc Sep 22 15:44:55 devstack sudo[95513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:44:55 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [req-e8f5c5eb-e9a1-40a8-899d-0e1958aabf46 req-d6994912-0eff-4e55-9916-0fd2f1509147 tempest-VolumesSnapshotsTestJSON-1200813888 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:44:55 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-d2432aeb-d719-41f3-8b1e-ded443252c4f tempest-VolumesExtendTest-1784848575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2e869d2d-8c57-4196-af61-6e274ad0b14c {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:44:55 devstack sudo[95515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2e869d2d-8c57-4196-af61-6e274ad0b14c Sep 22 15:44:55 devstack sudo[95515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:44:56 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-f1e68ad8-b9e2-45d3-ba61-cb46b0c5d3c8 tempest-AttachVolumeTestJSON-678247873 None] Acquiring lock "cinder-e50aa326-af76-40e8-93a1-d4e3882bdf34-delete_volume" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:44:56 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-f1e68ad8-b9e2-45d3-ba61-cb46b0c5d3c8 tempest-AttachVolumeTestJSON-678247873 None] Lock "cinder-e50aa326-af76-40e8-93a1-d4e3882bdf34-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:44:56 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-f1e68ad8-b9e2-45d3-ba61-cb46b0c5d3c8 tempest-AttachVolumeTestJSON-678247873 None] Acquiring lock "cinder-quobyte-e50aa326-af76-40e8-93a1-d4e3882bdf34" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:44:56 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-f1e68ad8-b9e2-45d3-ba61-cb46b0c5d3c8 tempest-AttachVolumeTestJSON-678247873 None] Lock "cinder-quobyte-e50aa326-af76-40e8-93a1-d4e3882bdf34" acquired by "delete_volume" :: waited 0.029s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:44:56 devstack sudo[95513]: pam_unix(sudo:session): session closed for user root Sep 22 15:44:56 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-611194c3-47ae-4ab7-9c15-c1832565844c tempest-AttachVolumeTestJSON-678247873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc" returned: 0 in 0.458s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:44:56 devstack cinder-volume[86212]: DEBUG cinder.manager [None req-611194c3-47ae-4ab7-9c15-c1832565844c tempest-AttachVolumeTestJSON-678247873 None] Notifying Schedulers of capabilities ... {{(pid=86212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 15:44:56 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-611194c3-47ae-4ab7-9c15-c1832565844c tempest-AttachVolumeTestJSON-678247873 None] Deleted volume successfully. Sep 22 15:44:56 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ddf71f1-7045-4a7b-9c0e-13b7134d1e3d]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:44:56 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-f1e68ad8-b9e2-45d3-ba61-cb46b0c5d3c8 tempest-AttachVolumeTestJSON-678247873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-e50aa326-af76-40e8-93a1-d4e3882bdf34 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:44:56 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-611194c3-47ae-4ab7-9c15-c1832565844c tempest-AttachVolumeTestJSON-678247873 None] Lock "cinder-f0b0aefc-a6a9-44ae-a223-b680aa0b7948-delete_volume" released by "delete_volume" :: held 1.618s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:44:56 devstack sudo[95515]: pam_unix(sudo:session): session closed for user root Sep 22 15:44:56 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-d2432aeb-d719-41f3-8b1e-ded443252c4f tempest-VolumesExtendTest-1784848575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2e869d2d-8c57-4196-af61-6e274ad0b14c" returned: 0 in 0.466s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:44:56 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-d2432aeb-d719-41f3-8b1e-ded443252c4f tempest-VolumesExtendTest-1784848575 None] <== create_volume: return (1144ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'} {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 15:44:56 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-d2432aeb-d719-41f3-8b1e-ded443252c4f tempest-VolumesExtendTest-1784848575 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.146s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:44:56 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [req-e8f5c5eb-e9a1-40a8-899d-0e1958aabf46 req-d6994912-0eff-4e55-9916-0fd2f1509147 tempest-VolumesSnapshotsTestJSON-1200813888 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.492s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:44:56 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [req-e8f5c5eb-e9a1-40a8-899d-0e1958aabf46 req-d6994912-0eff-4e55-9916-0fd2f1509147 tempest-VolumesSnapshotsTestJSON-1200813888 None] Creating offline snapshot 6f1f46d7-7298-4fee-870a-c5d64fd4f39f of volume cdb00a10-8147-483b-8230-08a3ecdd524c {{(pid=86212) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 22 15:44:56 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b6d8d05-d36e-4435-b9ad-ada7d79b3d9d]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:44:56 devstack sudo[95519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-e50aa326-af76-40e8-93a1-d4e3882bdf34 Sep 22 15:44:56 devstack sudo[95519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:44:56 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [req-e8f5c5eb-e9a1-40a8-899d-0e1958aabf46 req-d6994912-0eff-4e55-9916-0fd2f1509147 tempest-VolumesSnapshotsTestJSON-1200813888 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-cdb00a10-8147-483b-8230-08a3ecdd524c {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:44:56 devstack cinder-volume[86212]: DEBUG cinder.volume.volume_utils [None req-d2432aeb-d719-41f3-8b1e-ded443252c4f tempest-VolumesExtendTest-1784848575 None] Attempting download of 6995c6ae-03d1-45bf-bf55-00575d1858e8 ((None, [{'url': 'file:///opt/stack/data/glance/images/6995c6ae-03d1-45bf-bf55-00575d1858e8', 'metadata': {}}])) to volume 2e869d2d-8c57-4196-af61-6e274ad0b14c. {{(pid=86212) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 22 15:44:56 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b8a373c-5d57-4b03-8508-9e1e18b1e01c]: (4, 'raw') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:44:56 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-d2432aeb-d719-41f3-8b1e-ded443252c4f tempest-VolumesExtendTest-1784848575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6995c6ae-03d1-45bf-bf55-00575d1858e8_kd3ou38k {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:44:56 devstack sudo[95521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-cdb00a10-8147-483b-8230-08a3ecdd524c Sep 22 15:44:56 devstack sudo[95521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:44:56 devstack sudo[95522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6995c6ae-03d1-45bf-bf55-00575d1858e8_kd3ou38k Sep 22 15:44:56 devstack sudo[95522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:44:56 devstack sudo[95519]: pam_unix(sudo:session): session closed for user root Sep 22 15:44:56 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-f1e68ad8-b9e2-45d3-ba61-cb46b0c5d3c8 tempest-AttachVolumeTestJSON-678247873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-e50aa326-af76-40e8-93a1-d4e3882bdf34" returned: 0 in 0.466s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:44:56 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-f1e68ad8-b9e2-45d3-ba61-cb46b0c5d3c8 tempest-AttachVolumeTestJSON-678247873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-e50aa326-af76-40e8-93a1-d4e3882bdf34 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:44:56 devstack sudo[95529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-e50aa326-af76-40e8-93a1-d4e3882bdf34 Sep 22 15:44:56 devstack sudo[95529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:44:56 devstack sudo[95521]: pam_unix(sudo:session): session closed for user root Sep 22 15:44:56 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [req-e8f5c5eb-e9a1-40a8-899d-0e1958aabf46 req-d6994912-0eff-4e55-9916-0fd2f1509147 tempest-VolumesSnapshotsTestJSON-1200813888 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-cdb00a10-8147-483b-8230-08a3ecdd524c" returned: 0 in 0.444s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:44:56 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [req-e8f5c5eb-e9a1-40a8-899d-0e1958aabf46 req-d6994912-0eff-4e55-9916-0fd2f1509147 tempest-VolumesSnapshotsTestJSON-1200813888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-cdb00a10-8147-483b-8230-08a3ecdd524c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-cdb00a10-8147-483b-8230-08a3ecdd524c.6f1f46d7-7298-4fee-870a-c5d64fd4f39f 1G {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:44:56 devstack sudo[95534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-cdb00a10-8147-483b-8230-08a3ecdd524c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-cdb00a10-8147-483b-8230-08a3ecdd524c.6f1f46d7-7298-4fee-870a-c5d64fd4f39f 1G Sep 22 15:44:56 devstack sudo[95534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:44:56 devstack sudo[95522]: pam_unix(sudo:session): session closed for user root Sep 22 15:44:56 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-d2432aeb-d719-41f3-8b1e-ded443252c4f tempest-VolumesExtendTest-1784848575 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6995c6ae-03d1-45bf-bf55-00575d1858e8_kd3ou38k" returned: 0 in 0.439s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:44:56 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-d2432aeb-d719-41f3-8b1e-ded443252c4f tempest-VolumesExtendTest-1784848575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6995c6ae-03d1-45bf-bf55-00575d1858e8_kd3ou38k {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:44:57 devstack sudo[95529]: pam_unix(sudo:session): session closed for user root Sep 22 15:44:57 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-f1e68ad8-b9e2-45d3-ba61-cb46b0c5d3c8 tempest-AttachVolumeTestJSON-678247873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-e50aa326-af76-40e8-93a1-d4e3882bdf34" returned: 0 in 0.320s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:44:57 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-f1e68ad8-b9e2-45d3-ba61-cb46b0c5d3c8 tempest-AttachVolumeTestJSON-678247873 None] Lock "cinder-quobyte-e50aa326-af76-40e8-93a1-d4e3882bdf34" released by "delete_volume" :: held 0.868s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:44:57 devstack sudo[95538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6995c6ae-03d1-45bf-bf55-00575d1858e8_kd3ou38k Sep 22 15:44:57 devstack sudo[95538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:44:57 devstack cinder-volume[86212]: DEBUG cinder.quota [None req-f1e68ad8-b9e2-45d3-ba61-cb46b0c5d3c8 tempest-AttachVolumeTestJSON-678247873 None] Created reservations ['0ced5f7e-d6a8-4fc1-8127-6d9023e55919', '5b26c645-d636-4047-abbf-303bbe546f19', '51fdba47-3c71-4d10-8cd5-63c1d0a113ae', '18ee2105-86bc-4620-a239-38c052aa7670'] {{(pid=86212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 15:44:57 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-f1e68ad8-b9e2-45d3-ba61-cb46b0c5d3c8 tempest-AttachVolumeTestJSON-678247873 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:44:57 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-f1e68ad8-b9e2-45d3-ba61-cb46b0c5d3c8 tempest-AttachVolumeTestJSON-678247873 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:44:57 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-f1e68ad8-b9e2-45d3-ba61-cb46b0c5d3c8 tempest-AttachVolumeTestJSON-678247873 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:44:57 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-f1e68ad8-b9e2-45d3-ba61-cb46b0c5d3c8 tempest-AttachVolumeTestJSON-678247873 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:44:57 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-f1e68ad8-b9e2-45d3-ba61-cb46b0c5d3c8 tempest-AttachVolumeTestJSON-678247873 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:44:57 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-f1e68ad8-b9e2-45d3-ba61-cb46b0c5d3c8 tempest-AttachVolumeTestJSON-678247873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:44:57 devstack sudo[95545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc Sep 22 15:44:57 devstack sudo[95545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:44:57 devstack sudo[95538]: pam_unix(sudo:session): session closed for user root Sep 22 15:44:57 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-d2432aeb-d719-41f3-8b1e-ded443252c4f tempest-VolumesExtendTest-1784848575 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6995c6ae-03d1-45bf-bf55-00575d1858e8_kd3ou38k" returned: 1 in 0.518s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:44:57 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-d2432aeb-d719-41f3-8b1e-ded443252c4f tempest-VolumesExtendTest-1784848575 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6995c6ae-03d1-45bf-bf55-00575d1858e8_kd3ou38k' failed. Not Retrying. {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 22 15:44:57 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[11195350-7399-4709-bd95-5c815f1b36b8]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:44:57 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-d2432aeb-d719-41f3-8b1e-ded443252c4f tempest-VolumesExtendTest-1784848575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6995c6ae-03d1-45bf-bf55-00575d1858e8_r_j71eq0devstack@QuobyteHD {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:44:57 devstack sudo[95534]: pam_unix(sudo:session): session closed for user root Sep 22 15:44:57 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [req-e8f5c5eb-e9a1-40a8-899d-0e1958aabf46 req-d6994912-0eff-4e55-9916-0fd2f1509147 tempest-VolumesSnapshotsTestJSON-1200813888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-cdb00a10-8147-483b-8230-08a3ecdd524c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-cdb00a10-8147-483b-8230-08a3ecdd524c.6f1f46d7-7298-4fee-870a-c5d64fd4f39f 1G" returned: 0 in 0.636s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:44:57 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [req-e8f5c5eb-e9a1-40a8-899d-0e1958aabf46 req-d6994912-0eff-4e55-9916-0fd2f1509147 tempest-VolumesSnapshotsTestJSON-1200813888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cdb00a10-8147-483b-8230-08a3ecdd524c -F qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-cdb00a10-8147-483b-8230-08a3ecdd524c.6f1f46d7-7298-4fee-870a-c5d64fd4f39f {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:44:57 devstack sudo[95551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cdb00a10-8147-483b-8230-08a3ecdd524c -F qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-cdb00a10-8147-483b-8230-08a3ecdd524c.6f1f46d7-7298-4fee-870a-c5d64fd4f39f Sep 22 15:44:57 devstack sudo[95551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:44:57 devstack sudo[95545]: pam_unix(sudo:session): session closed for user root Sep 22 15:44:57 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-f1e68ad8-b9e2-45d3-ba61-cb46b0c5d3c8 tempest-AttachVolumeTestJSON-678247873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc" returned: 0 in 0.326s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:44:57 devstack cinder-volume[86212]: DEBUG cinder.manager [None req-f1e68ad8-b9e2-45d3-ba61-cb46b0c5d3c8 tempest-AttachVolumeTestJSON-678247873 None] Notifying Schedulers of capabilities ... {{(pid=86212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 15:44:57 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-f1e68ad8-b9e2-45d3-ba61-cb46b0c5d3c8 tempest-AttachVolumeTestJSON-678247873 None] Deleted volume successfully. Sep 22 15:44:57 devstack sudo[95550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6995c6ae-03d1-45bf-bf55-00575d1858e8_r_j71eq0devstack@QuobyteHD Sep 22 15:44:57 devstack sudo[95550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:44:57 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-f1e68ad8-b9e2-45d3-ba61-cb46b0c5d3c8 tempest-AttachVolumeTestJSON-678247873 None] Lock "cinder-e50aa326-af76-40e8-93a1-d4e3882bdf34-delete_volume" released by "delete_volume" :: held 1.558s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:44:57 devstack sudo[95550]: pam_unix(sudo:session): session closed for user root Sep 22 15:44:57 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-d2432aeb-d719-41f3-8b1e-ded443252c4f tempest-VolumesExtendTest-1784848575 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6995c6ae-03d1-45bf-bf55-00575d1858e8_r_j71eq0devstack@QuobyteHD" returned: 0 in 0.412s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:44:57 devstack cinder-volume[86212]: DEBUG cinder.image.image_utils [None req-d2432aeb-d719-41f3-8b1e-ded443252c4f tempest-VolumesExtendTest-1784848575 None] 6995c6ae-03d1-45bf-bf55-00575d1858e8 was qcow2, converting to qcow2 {{(pid=86212) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 22 15:44:57 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-d2432aeb-d719-41f3-8b1e-ded443252c4f tempest-VolumesExtendTest-1784848575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6995c6ae-03d1-45bf-bf55-00575d1858e8_r_j71eq0devstack@QuobyteHD /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2e869d2d-8c57-4196-af61-6e274ad0b14c {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:44:57 devstack sudo[95561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6995c6ae-03d1-45bf-bf55-00575d1858e8_r_j71eq0devstack@QuobyteHD /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2e869d2d-8c57-4196-af61-6e274ad0b14c Sep 22 15:44:57 devstack sudo[95561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:44:57 devstack sudo[95551]: pam_unix(sudo:session): session closed for user root Sep 22 15:44:57 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [req-e8f5c5eb-e9a1-40a8-899d-0e1958aabf46 req-d6994912-0eff-4e55-9916-0fd2f1509147 tempest-VolumesSnapshotsTestJSON-1200813888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cdb00a10-8147-483b-8230-08a3ecdd524c -F qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-cdb00a10-8147-483b-8230-08a3ecdd524c.6f1f46d7-7298-4fee-870a-c5d64fd4f39f" returned: 0 in 0.482s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:44:57 devstack cinder-volume[86212]: WARNING cinder.volume.drivers.remotefs [req-e8f5c5eb-e9a1-40a8-899d-0e1958aabf46 req-d6994912-0eff-4e55-9916-0fd2f1509147 tempest-VolumesSnapshotsTestJSON-1200813888 None] /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-cdb00a10-8147-483b-8230-08a3ecdd524c.6f1f46d7-7298-4fee-870a-c5d64fd4f39f is being set with open permissions: ugo+rw Sep 22 15:44:57 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [req-e8f5c5eb-e9a1-40a8-899d-0e1958aabf46 req-d6994912-0eff-4e55-9916-0fd2f1509147 tempest-VolumesSnapshotsTestJSON-1200813888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-cdb00a10-8147-483b-8230-08a3ecdd524c.6f1f46d7-7298-4fee-870a-c5d64fd4f39f {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:44:57 devstack sudo[95564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-cdb00a10-8147-483b-8230-08a3ecdd524c.6f1f46d7-7298-4fee-870a-c5d64fd4f39f Sep 22 15:44:57 devstack sudo[95564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:44:58 devstack sudo[95564]: pam_unix(sudo:session): session closed for user root Sep 22 15:44:58 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [req-e8f5c5eb-e9a1-40a8-899d-0e1958aabf46 req-d6994912-0eff-4e55-9916-0fd2f1509147 tempest-VolumesSnapshotsTestJSON-1200813888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-cdb00a10-8147-483b-8230-08a3ecdd524c.6f1f46d7-7298-4fee-870a-c5d64fd4f39f" returned: 0 in 0.319s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:44:58 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [req-e8f5c5eb-e9a1-40a8-899d-0e1958aabf46 req-d6994912-0eff-4e55-9916-0fd2f1509147 tempest-VolumesSnapshotsTestJSON-1200813888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-cdb00a10-8147-483b-8230-08a3ecdd524c.info {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:44:58 devstack sudo[95571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-cdb00a10-8147-483b-8230-08a3ecdd524c.info Sep 22 15:44:58 devstack sudo[95571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:44:58 devstack sudo[95571]: pam_unix(sudo:session): session closed for user root Sep 22 15:44:58 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [req-e8f5c5eb-e9a1-40a8-899d-0e1958aabf46 req-d6994912-0eff-4e55-9916-0fd2f1509147 tempest-VolumesSnapshotsTestJSON-1200813888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-cdb00a10-8147-483b-8230-08a3ecdd524c.info" returned: 0 in 0.370s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:44:58 devstack cinder-volume[86212]: WARNING cinder.volume.drivers.remotefs [req-e8f5c5eb-e9a1-40a8-899d-0e1958aabf46 req-d6994912-0eff-4e55-9916-0fd2f1509147 tempest-VolumesSnapshotsTestJSON-1200813888 None] /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-cdb00a10-8147-483b-8230-08a3ecdd524c.info is being set with open permissions: ugo+rw Sep 22 15:44:58 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [req-e8f5c5eb-e9a1-40a8-899d-0e1958aabf46 req-d6994912-0eff-4e55-9916-0fd2f1509147 tempest-VolumesSnapshotsTestJSON-1200813888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-cdb00a10-8147-483b-8230-08a3ecdd524c.info {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:44:58 devstack sudo[95575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-cdb00a10-8147-483b-8230-08a3ecdd524c.info Sep 22 15:44:58 devstack sudo[95575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:44:59 devstack sudo[95575]: pam_unix(sudo:session): session closed for user root Sep 22 15:44:59 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [req-e8f5c5eb-e9a1-40a8-899d-0e1958aabf46 req-d6994912-0eff-4e55-9916-0fd2f1509147 tempest-VolumesSnapshotsTestJSON-1200813888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-cdb00a10-8147-483b-8230-08a3ecdd524c.info" returned: 0 in 0.302s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:44:59 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [req-e8f5c5eb-e9a1-40a8-899d-0e1958aabf46 req-d6994912-0eff-4e55-9916-0fd2f1509147 tempest-VolumesSnapshotsTestJSON-1200813888 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.717s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:44:59 devstack cinder-volume[86212]: INFO cinder.volume.manager [req-e8f5c5eb-e9a1-40a8-899d-0e1958aabf46 req-d6994912-0eff-4e55-9916-0fd2f1509147 tempest-VolumesSnapshotsTestJSON-1200813888 None] Create snapshot completed successfully Sep 22 15:44:59 devstack cinder-volume[86212]: DEBUG cinder.coordination [req-0cdb67b4-ac5a-4f6f-8d6d-a68694ddb9dc req-55aa1df2-069a-41d2-b6ef-2f1d83a0227c tempest-VolumesSnapshotsTestJSON-1200813888 None] Acquiring lock "cinder-6f1f46d7-7298-4fee-870a-c5d64fd4f39f-delete_snapshot" by "delete_snapshot" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:44:59 devstack cinder-volume[86212]: DEBUG cinder.coordination [req-0cdb67b4-ac5a-4f6f-8d6d-a68694ddb9dc req-55aa1df2-069a-41d2-b6ef-2f1d83a0227c tempest-VolumesSnapshotsTestJSON-1200813888 None] Lock "cinder-6f1f46d7-7298-4fee-870a-c5d64fd4f39f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:44:59 devstack cinder-volume[86212]: DEBUG cinder.coordination [req-0cdb67b4-ac5a-4f6f-8d6d-a68694ddb9dc req-55aa1df2-069a-41d2-b6ef-2f1d83a0227c tempest-VolumesSnapshotsTestJSON-1200813888 None] Acquiring lock "cinder-quobyte-cdb00a10-8147-483b-8230-08a3ecdd524c" by "delete_snapshot" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:44:59 devstack cinder-volume[86212]: DEBUG cinder.coordination [req-0cdb67b4-ac5a-4f6f-8d6d-a68694ddb9dc req-55aa1df2-069a-41d2-b6ef-2f1d83a0227c tempest-VolumesSnapshotsTestJSON-1200813888 None] Lock "cinder-quobyte-cdb00a10-8147-483b-8230-08a3ecdd524c" acquired by "delete_snapshot" :: waited 0.035s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:44:59 devstack cinder-volume[86212]: DEBUG cinder.coordination [req-0cdb67b4-ac5a-4f6f-8d6d-a68694ddb9dc req-55aa1df2-069a-41d2-b6ef-2f1d83a0227c tempest-VolumesSnapshotsTestJSON-1200813888 None] Acquiring lock "cinder-quobyte-6f1f46d7-7298-4fee-870a-c5d64fd4f39f" by "_delete_snapshot" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:44:59 devstack cinder-volume[86212]: DEBUG cinder.coordination [req-0cdb67b4-ac5a-4f6f-8d6d-a68694ddb9dc req-55aa1df2-069a-41d2-b6ef-2f1d83a0227c tempest-VolumesSnapshotsTestJSON-1200813888 None] Lock "cinder-quobyte-6f1f46d7-7298-4fee-870a-c5d64fd4f39f" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:44:59 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [req-0cdb67b4-ac5a-4f6f-8d6d-a68694ddb9dc req-55aa1df2-069a-41d2-b6ef-2f1d83a0227c tempest-VolumesSnapshotsTestJSON-1200813888 None] Deleting offline snapshot 6f1f46d7-7298-4fee-870a-c5d64fd4f39f of volume cdb00a10-8147-483b-8230-08a3ecdd524c {{(pid=86212) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 22 15:44:59 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [req-0cdb67b4-ac5a-4f6f-8d6d-a68694ddb9dc req-55aa1df2-069a-41d2-b6ef-2f1d83a0227c tempest-VolumesSnapshotsTestJSON-1200813888 None] snapshot_file for this snap is: volume-cdb00a10-8147-483b-8230-08a3ecdd524c.6f1f46d7-7298-4fee-870a-c5d64fd4f39f {{(pid=86212) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 22 15:44:59 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[efbd214f-3685-4764-9c09-25c4586fe50a]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:44:59 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [req-0cdb67b4-ac5a-4f6f-8d6d-a68694ddb9dc req-55aa1df2-069a-41d2-b6ef-2f1d83a0227c tempest-VolumesSnapshotsTestJSON-1200813888 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-cdb00a10-8147-483b-8230-08a3ecdd524c.6f1f46d7-7298-4fee-870a-c5d64fd4f39f {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:44:59 devstack sudo[95579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-cdb00a10-8147-483b-8230-08a3ecdd524c.6f1f46d7-7298-4fee-870a-c5d64fd4f39f Sep 22 15:44:59 devstack sudo[95579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:45:00 devstack sudo[95579]: pam_unix(sudo:session): session closed for user root Sep 22 15:45:00 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [req-0cdb67b4-ac5a-4f6f-8d6d-a68694ddb9dc req-55aa1df2-069a-41d2-b6ef-2f1d83a0227c tempest-VolumesSnapshotsTestJSON-1200813888 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-cdb00a10-8147-483b-8230-08a3ecdd524c.6f1f46d7-7298-4fee-870a-c5d64fd4f39f" returned: 0 in 0.525s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:45:00 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [req-0cdb67b4-ac5a-4f6f-8d6d-a68694ddb9dc req-55aa1df2-069a-41d2-b6ef-2f1d83a0227c tempest-VolumesSnapshotsTestJSON-1200813888 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cdb00a10-8147-483b-8230-08a3ecdd524c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86212) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 22 15:45:00 devstack sudo[95561]: pam_unix(sudo:session): session closed for user root Sep 22 15:45:00 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-d2432aeb-d719-41f3-8b1e-ded443252c4f tempest-VolumesExtendTest-1784848575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6995c6ae-03d1-45bf-bf55-00575d1858e8_r_j71eq0devstack@QuobyteHD /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2e869d2d-8c57-4196-af61-6e274ad0b14c" returned: 0 in 2.489s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:45:00 devstack cinder-volume[86212]: DEBUG cinder.image.image_utils [None req-d2432aeb-d719-41f3-8b1e-ded443252c4f tempest-VolumesExtendTest-1784848575 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_6995c6ae-03d1-45bf-bf55-00575d1858e8_r_j71eq0devstack@QuobyteHD, size 112.00 MB, duration 2.49 sec, destination /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2e869d2d-8c57-4196-af61-6e274ad0b14c {{(pid=86212) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 22 15:45:00 devstack cinder-volume[86212]: INFO cinder.image.image_utils [None req-d2432aeb-d719-41f3-8b1e-ded443252c4f tempest-VolumesExtendTest-1784848575 None] Converted 112.00 MB image at 44.98 MB/s Sep 22 15:45:00 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-d2432aeb-d719-41f3-8b1e-ded443252c4f tempest-VolumesExtendTest-1784848575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2e869d2d-8c57-4196-af61-6e274ad0b14c 1G {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:45:00 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f66c255-7063-41a3-bf97-33e7c21c9fd2]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:45:00 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [req-0cdb67b4-ac5a-4f6f-8d6d-a68694ddb9dc req-55aa1df2-069a-41d2-b6ef-2f1d83a0227c tempest-VolumesSnapshotsTestJSON-1200813888 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-cdb00a10-8147-483b-8230-08a3ecdd524c {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:45:00 devstack sudo[95586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2e869d2d-8c57-4196-af61-6e274ad0b14c 1G Sep 22 15:45:00 devstack sudo[95586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:45:00 devstack sudo[95587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-cdb00a10-8147-483b-8230-08a3ecdd524c Sep 22 15:45:00 devstack sudo[95587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:45:00 devstack sudo[95586]: pam_unix(sudo:session): session closed for user root Sep 22 15:45:00 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-d2432aeb-d719-41f3-8b1e-ded443252c4f tempest-VolumesExtendTest-1784848575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2e869d2d-8c57-4196-af61-6e274ad0b14c 1G" returned: 0 in 0.462s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:45:00 devstack cinder-volume[86212]: DEBUG cinder.volume.volume_utils [None req-d2432aeb-d719-41f3-8b1e-ded443252c4f tempest-VolumesExtendTest-1784848575 None] Downloaded image 6995c6ae-03d1-45bf-bf55-00575d1858e8 ((None, [{'url': 'file:///opt/stack/data/glance/images/6995c6ae-03d1-45bf-bf55-00575d1858e8', 'metadata': {}}])) to volume 2e869d2d-8c57-4196-af61-6e274ad0b14c successfully. {{(pid=86212) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 22 15:45:00 devstack cinder-volume[86212]: DEBUG cinder.image.image_utils [None req-d2432aeb-d719-41f3-8b1e-ded443252c4f tempest-VolumesExtendTest-1784848575 None] Temporary image 6995c6ae-03d1-45bf-bf55-00575d1858e8 for user af04838b5640411da6aafb36a4be9127 is deleted. {{(pid=86212) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 22 15:45:00 devstack cinder-volume[86212]: DEBUG cinder.volume.volume_utils [None req-d2432aeb-d719-41f3-8b1e-ded443252c4f tempest-VolumesExtendTest-1784848575 None] Marking volume 2e869d2d-8c57-4196-af61-6e274ad0b14c as bootable. {{(pid=86212) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 22 15:45:00 devstack cinder-volume[86212]: DEBUG cinder.volume.flows.manager.create_volume [None req-d2432aeb-d719-41f3-8b1e-ded443252c4f tempest-VolumesExtendTest-1784848575 None] Copying metadata from image 6995c6ae-03d1-45bf-bf55-00575d1858e8 to 2e869d2d-8c57-4196-af61-6e274ad0b14c. {{(pid=86212) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 22 15:45:00 devstack cinder-volume[86212]: DEBUG cinder.volume.flows.manager.create_volume [None req-d2432aeb-d719-41f3-8b1e-ded443252c4f tempest-VolumesExtendTest-1784848575 None] Creating volume glance metadata for volume 2e869d2d-8c57-4196-af61-6e274ad0b14c backed by image 6995c6ae-03d1-45bf-bf55-00575d1858e8 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '6995c6ae-03d1-45bf-bf55-00575d1858e8', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86212) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 22 15:45:00 devstack sudo[95587]: pam_unix(sudo:session): session closed for user root Sep 22 15:45:00 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [req-0cdb67b4-ac5a-4f6f-8d6d-a68694ddb9dc req-55aa1df2-069a-41d2-b6ef-2f1d83a0227c tempest-VolumesSnapshotsTestJSON-1200813888 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-cdb00a10-8147-483b-8230-08a3ecdd524c" returned: 0 in 0.498s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:45:00 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [req-0cdb67b4-ac5a-4f6f-8d6d-a68694ddb9dc req-55aa1df2-069a-41d2-b6ef-2f1d83a0227c tempest-VolumesSnapshotsTestJSON-1200813888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-cdb00a10-8147-483b-8230-08a3ecdd524c.6f1f46d7-7298-4fee-870a-c5d64fd4f39f {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:45:00 devstack sudo[95597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-cdb00a10-8147-483b-8230-08a3ecdd524c.6f1f46d7-7298-4fee-870a-c5d64fd4f39f Sep 22 15:45:00 devstack sudo[95597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:45:00 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-d2432aeb-d719-41f3-8b1e-ded443252c4f tempest-VolumesExtendTest-1784848575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (680bfbf9-038b-4d5e-8dfb-38e24910cadd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e869d2d-8c57-4196-af61-6e274ad0b14c', 'volume_size': 1, 'image_id': '6995c6ae-03d1-45bf-bf55-00575d1858e8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6995c6ae-03d1-45bf-bf55-00575d1858e8', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '28219d994ba546ed905a95ed90257a43', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6995c6ae-03d1-45bf-bf55-00575d1858e8', 'created_at': datetime.datetime(2026, 9, 22, 13, 30, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 13, 30, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6995c6ae-03d1-45bf-bf55-00575d1858e8/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:45:01 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-d2432aeb-d719-41f3-8b1e-ded443252c4f tempest-VolumesExtendTest-1784848575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53a93a8d-450c-4920-bf83-9597fe05424d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:45:01 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-d2432aeb-d719-41f3-8b1e-ded443252c4f tempest-VolumesExtendTest-1784848575 None] Volume volume-2e869d2d-8c57-4196-af61-6e274ad0b14c (2e869d2d-8c57-4196-af61-6e274ad0b14c): created successfully Sep 22 15:45:01 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-d2432aeb-d719-41f3-8b1e-ded443252c4f tempest-VolumesExtendTest-1784848575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53a93a8d-450c-4920-bf83-9597fe05424d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:45:01 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-d2432aeb-d719-41f3-8b1e-ded443252c4f tempest-VolumesExtendTest-1784848575 None] Flow 'volume_create_manager' (96de4317-f527-48d6-b64c-d7d3c77f7aff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:45:01 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-d2432aeb-d719-41f3-8b1e-ded443252c4f tempest-VolumesExtendTest-1784848575 None] Created volume successfully. Sep 22 15:45:01 devstack sudo[95597]: pam_unix(sudo:session): session closed for user root Sep 22 15:45:01 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [req-0cdb67b4-ac5a-4f6f-8d6d-a68694ddb9dc req-55aa1df2-069a-41d2-b6ef-2f1d83a0227c tempest-VolumesSnapshotsTestJSON-1200813888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-cdb00a10-8147-483b-8230-08a3ecdd524c.6f1f46d7-7298-4fee-870a-c5d64fd4f39f" returned: 0 in 0.439s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:45:01 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [req-0cdb67b4-ac5a-4f6f-8d6d-a68694ddb9dc req-55aa1df2-069a-41d2-b6ef-2f1d83a0227c tempest-VolumesSnapshotsTestJSON-1200813888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-cdb00a10-8147-483b-8230-08a3ecdd524c.6f1f46d7-7298-4fee-870a-c5d64fd4f39f {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:45:01 devstack sudo[95606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-cdb00a10-8147-483b-8230-08a3ecdd524c.6f1f46d7-7298-4fee-870a-c5d64fd4f39f Sep 22 15:45:01 devstack sudo[95606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:45:01 devstack sudo[95606]: pam_unix(sudo:session): session closed for user root Sep 22 15:45:01 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [req-0cdb67b4-ac5a-4f6f-8d6d-a68694ddb9dc req-55aa1df2-069a-41d2-b6ef-2f1d83a0227c tempest-VolumesSnapshotsTestJSON-1200813888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-cdb00a10-8147-483b-8230-08a3ecdd524c.6f1f46d7-7298-4fee-870a-c5d64fd4f39f" returned: 0 in 0.275s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:45:01 devstack cinder-volume[86212]: DEBUG cinder.coordination [req-0cdb67b4-ac5a-4f6f-8d6d-a68694ddb9dc req-55aa1df2-069a-41d2-b6ef-2f1d83a0227c tempest-VolumesSnapshotsTestJSON-1200813888 None] Lock "cinder-quobyte-6f1f46d7-7298-4fee-870a-c5d64fd4f39f" released by "_delete_snapshot" :: held 1.900s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:45:01 devstack cinder-volume[86212]: DEBUG cinder.coordination [req-0cdb67b4-ac5a-4f6f-8d6d-a68694ddb9dc req-55aa1df2-069a-41d2-b6ef-2f1d83a0227c tempest-VolumesSnapshotsTestJSON-1200813888 None] Lock "cinder-quobyte-cdb00a10-8147-483b-8230-08a3ecdd524c" released by "delete_snapshot" :: held 1.938s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:45:01 devstack cinder-volume[86212]: DEBUG cinder.quota [req-0cdb67b4-ac5a-4f6f-8d6d-a68694ddb9dc req-55aa1df2-069a-41d2-b6ef-2f1d83a0227c tempest-VolumesSnapshotsTestJSON-1200813888 None] Created reservations ['218b9e1e-f695-421a-8da4-2733a4a5f621', '80ec5c73-b4bc-4dbb-a647-d27fcd2fc8ef', '01f37ec4-ce6e-41b6-8e73-41b62c9cfd10', '63c428e4-fb20-4d39-8098-188b6610d047'] {{(pid=86212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 15:45:01 devstack cinder-volume[86212]: INFO cinder.volume.manager [req-0cdb67b4-ac5a-4f6f-8d6d-a68694ddb9dc req-55aa1df2-069a-41d2-b6ef-2f1d83a0227c tempest-VolumesSnapshotsTestJSON-1200813888 None] Delete snapshot completed successfully. Sep 22 15:45:01 devstack cinder-volume[86212]: DEBUG cinder.coordination [req-0cdb67b4-ac5a-4f6f-8d6d-a68694ddb9dc req-55aa1df2-069a-41d2-b6ef-2f1d83a0227c tempest-VolumesSnapshotsTestJSON-1200813888 None] Lock "cinder-6f1f46d7-7298-4fee-870a-c5d64fd4f39f-delete_snapshot" released by "delete_snapshot" :: held 2.118s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:45:01 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-5ac1985c-b973-47da-a492-7362b0c1fcd1 tempest-VolumesExtendTest-1784848575 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:45:01 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-5ac1985c-b973-47da-a492-7362b0c1fcd1 tempest-VolumesExtendTest-1784848575 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:45:01 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b99ce52-708d-47cf-8eb3-689745f1a3a1]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:45:01 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-5ac1985c-b973-47da-a492-7362b0c1fcd1 tempest-VolumesExtendTest-1784848575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2e869d2d-8c57-4196-af61-6e274ad0b14c {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:45:01 devstack cinder-volume[86212]: DEBUG cinder.coordination [req-43b9adaf-f88e-4900-b08e-fbe74294cd02 req-326e1f8a-67dc-40b7-92e4-a81463e72699 tempest-VolumesSnapshotsTestJSON-1200813888 None] Acquiring lock "cinder-cdb00a10-8147-483b-8230-08a3ecdd524c-delete_volume" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:45:01 devstack sudo[95609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2e869d2d-8c57-4196-af61-6e274ad0b14c Sep 22 15:45:01 devstack sudo[95609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:45:01 devstack cinder-volume[86212]: DEBUG cinder.coordination [req-43b9adaf-f88e-4900-b08e-fbe74294cd02 req-326e1f8a-67dc-40b7-92e4-a81463e72699 tempest-VolumesSnapshotsTestJSON-1200813888 None] Lock "cinder-cdb00a10-8147-483b-8230-08a3ecdd524c-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:45:02 devstack cinder-volume[86212]: DEBUG cinder.coordination [req-43b9adaf-f88e-4900-b08e-fbe74294cd02 req-326e1f8a-67dc-40b7-92e4-a81463e72699 tempest-VolumesSnapshotsTestJSON-1200813888 None] Acquiring lock "cinder-quobyte-cdb00a10-8147-483b-8230-08a3ecdd524c" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:45:02 devstack cinder-volume[86212]: DEBUG cinder.coordination [req-43b9adaf-f88e-4900-b08e-fbe74294cd02 req-326e1f8a-67dc-40b7-92e4-a81463e72699 tempest-VolumesSnapshotsTestJSON-1200813888 None] Lock "cinder-quobyte-cdb00a10-8147-483b-8230-08a3ecdd524c" acquired by "delete_volume" :: waited 0.027s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:45:02 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fca9af7-3b6e-47bb-ba08-c0c9216481a5]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:45:02 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [req-43b9adaf-f88e-4900-b08e-fbe74294cd02 req-326e1f8a-67dc-40b7-92e4-a81463e72699 tempest-VolumesSnapshotsTestJSON-1200813888 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-cdb00a10-8147-483b-8230-08a3ecdd524c {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:45:02 devstack sudo[95611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-cdb00a10-8147-483b-8230-08a3ecdd524c Sep 22 15:45:02 devstack sudo[95611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:45:02 devstack sudo[95609]: pam_unix(sudo:session): session closed for user root Sep 22 15:45:02 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-5ac1985c-b973-47da-a492-7362b0c1fcd1 tempest-VolumesExtendTest-1784848575 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2e869d2d-8c57-4196-af61-6e274ad0b14c" returned: 0 in 0.575s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:45:02 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-5ac1985c-b973-47da-a492-7362b0c1fcd1 tempest-VolumesExtendTest-1784848575 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2e869d2d-8c57-4196-af61-6e274ad0b14c 2G {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:45:02 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-5ac1985c-b973-47da-a492-7362b0c1fcd1 tempest-VolumesExtendTest-1784848575 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2e869d2d-8c57-4196-af61-6e274ad0b14c 2G" returned: 0 in 0.136s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:45:02 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-5ac1985c-b973-47da-a492-7362b0c1fcd1 tempest-VolumesExtendTest-1784848575 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.745s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:45:02 devstack sudo[95611]: pam_unix(sudo:session): session closed for user root Sep 22 15:45:02 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-5ac1985c-b973-47da-a492-7362b0c1fcd1 tempest-VolumesExtendTest-1784848575 None] Extend volume completed successfully. Sep 22 15:45:02 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [req-43b9adaf-f88e-4900-b08e-fbe74294cd02 req-326e1f8a-67dc-40b7-92e4-a81463e72699 tempest-VolumesSnapshotsTestJSON-1200813888 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-cdb00a10-8147-483b-8230-08a3ecdd524c" returned: 0 in 0.501s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:45:02 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [req-43b9adaf-f88e-4900-b08e-fbe74294cd02 req-326e1f8a-67dc-40b7-92e4-a81463e72699 tempest-VolumesSnapshotsTestJSON-1200813888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-cdb00a10-8147-483b-8230-08a3ecdd524c {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:45:02 devstack sudo[95623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-cdb00a10-8147-483b-8230-08a3ecdd524c Sep 22 15:45:02 devstack sudo[95623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:45:02 devstack sudo[95623]: pam_unix(sudo:session): session closed for user root Sep 22 15:45:02 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [req-43b9adaf-f88e-4900-b08e-fbe74294cd02 req-326e1f8a-67dc-40b7-92e4-a81463e72699 tempest-VolumesSnapshotsTestJSON-1200813888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-cdb00a10-8147-483b-8230-08a3ecdd524c" returned: 0 in 0.285s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:45:02 devstack cinder-volume[86212]: DEBUG cinder.coordination [req-43b9adaf-f88e-4900-b08e-fbe74294cd02 req-326e1f8a-67dc-40b7-92e4-a81463e72699 tempest-VolumesSnapshotsTestJSON-1200813888 None] Lock "cinder-quobyte-cdb00a10-8147-483b-8230-08a3ecdd524c" released by "delete_volume" :: held 0.888s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:45:03 devstack cinder-volume[86212]: DEBUG cinder.quota [req-43b9adaf-f88e-4900-b08e-fbe74294cd02 req-326e1f8a-67dc-40b7-92e4-a81463e72699 tempest-VolumesSnapshotsTestJSON-1200813888 None] Created reservations ['a431f5bf-1163-4fbf-a4be-ef0d38c941a4', '180f0dcc-e11c-49be-8216-1be605d98443', 'ac63fce7-900e-41d0-beff-509965b8193e', '06fb1580-aaf6-4f2b-b3cb-4e9d42a18c67'] {{(pid=86212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 15:45:03 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [req-43b9adaf-f88e-4900-b08e-fbe74294cd02 req-326e1f8a-67dc-40b7-92e4-a81463e72699 tempest-VolumesSnapshotsTestJSON-1200813888 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:45:03 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [req-43b9adaf-f88e-4900-b08e-fbe74294cd02 req-326e1f8a-67dc-40b7-92e4-a81463e72699 tempest-VolumesSnapshotsTestJSON-1200813888 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:45:03 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [req-43b9adaf-f88e-4900-b08e-fbe74294cd02 req-326e1f8a-67dc-40b7-92e4-a81463e72699 tempest-VolumesSnapshotsTestJSON-1200813888 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:45:03 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [req-43b9adaf-f88e-4900-b08e-fbe74294cd02 req-326e1f8a-67dc-40b7-92e4-a81463e72699 tempest-VolumesSnapshotsTestJSON-1200813888 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:45:03 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [req-43b9adaf-f88e-4900-b08e-fbe74294cd02 req-326e1f8a-67dc-40b7-92e4-a81463e72699 tempest-VolumesSnapshotsTestJSON-1200813888 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:45:03 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [req-43b9adaf-f88e-4900-b08e-fbe74294cd02 req-326e1f8a-67dc-40b7-92e4-a81463e72699 tempest-VolumesSnapshotsTestJSON-1200813888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:45:03 devstack sudo[95626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc Sep 22 15:45:03 devstack sudo[95626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:45:03 devstack sudo[95626]: pam_unix(sudo:session): session closed for user root Sep 22 15:45:03 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [req-43b9adaf-f88e-4900-b08e-fbe74294cd02 req-326e1f8a-67dc-40b7-92e4-a81463e72699 tempest-VolumesSnapshotsTestJSON-1200813888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc" returned: 0 in 0.389s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:45:03 devstack cinder-volume[86212]: DEBUG cinder.manager [req-43b9adaf-f88e-4900-b08e-fbe74294cd02 req-326e1f8a-67dc-40b7-92e4-a81463e72699 tempest-VolumesSnapshotsTestJSON-1200813888 None] Notifying Schedulers of capabilities ... {{(pid=86212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 15:45:03 devstack cinder-volume[86212]: INFO cinder.volume.manager [req-43b9adaf-f88e-4900-b08e-fbe74294cd02 req-326e1f8a-67dc-40b7-92e4-a81463e72699 tempest-VolumesSnapshotsTestJSON-1200813888 None] Deleted volume successfully. Sep 22 15:45:03 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-cf488d61-2071-430a-9dee-a8a310e4d9d5 tempest-VolumesExtendTest-1784848575 None] Acquiring lock "cinder-2e869d2d-8c57-4196-af61-6e274ad0b14c-delete_volume" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:45:03 devstack cinder-volume[86212]: DEBUG cinder.coordination [req-43b9adaf-f88e-4900-b08e-fbe74294cd02 req-326e1f8a-67dc-40b7-92e4-a81463e72699 tempest-VolumesSnapshotsTestJSON-1200813888 None] Lock "cinder-cdb00a10-8147-483b-8230-08a3ecdd524c-delete_volume" released by "delete_volume" :: held 1.628s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:45:03 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-cf488d61-2071-430a-9dee-a8a310e4d9d5 tempest-VolumesExtendTest-1784848575 None] Lock "cinder-2e869d2d-8c57-4196-af61-6e274ad0b14c-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:45:03 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-cf488d61-2071-430a-9dee-a8a310e4d9d5 tempest-VolumesExtendTest-1784848575 None] Acquiring lock "cinder-quobyte-2e869d2d-8c57-4196-af61-6e274ad0b14c" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:45:03 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-cf488d61-2071-430a-9dee-a8a310e4d9d5 tempest-VolumesExtendTest-1784848575 None] Lock "cinder-quobyte-2e869d2d-8c57-4196-af61-6e274ad0b14c" acquired by "delete_volume" :: waited 0.020s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:45:03 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[70e0ee11-0b42-4817-8d07-d60898667ae8]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:45:03 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-cf488d61-2071-430a-9dee-a8a310e4d9d5 tempest-VolumesExtendTest-1784848575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2e869d2d-8c57-4196-af61-6e274ad0b14c {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:45:03 devstack sudo[95630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2e869d2d-8c57-4196-af61-6e274ad0b14c Sep 22 15:45:03 devstack sudo[95630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:45:04 devstack sudo[95630]: pam_unix(sudo:session): session closed for user root Sep 22 15:45:04 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-cf488d61-2071-430a-9dee-a8a310e4d9d5 tempest-VolumesExtendTest-1784848575 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2e869d2d-8c57-4196-af61-6e274ad0b14c" returned: 0 in 0.403s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:45:04 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-cf488d61-2071-430a-9dee-a8a310e4d9d5 tempest-VolumesExtendTest-1784848575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2e869d2d-8c57-4196-af61-6e274ad0b14c {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:45:04 devstack sudo[95636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2e869d2d-8c57-4196-af61-6e274ad0b14c Sep 22 15:45:04 devstack sudo[95636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:45:04 devstack sudo[95636]: pam_unix(sudo:session): session closed for user root Sep 22 15:45:04 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-cf488d61-2071-430a-9dee-a8a310e4d9d5 tempest-VolumesExtendTest-1784848575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2e869d2d-8c57-4196-af61-6e274ad0b14c" returned: 0 in 0.303s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:45:04 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-cf488d61-2071-430a-9dee-a8a310e4d9d5 tempest-VolumesExtendTest-1784848575 None] Lock "cinder-quobyte-2e869d2d-8c57-4196-af61-6e274ad0b14c" released by "delete_volume" :: held 0.761s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:45:04 devstack cinder-volume[86212]: DEBUG cinder.quota [None req-cf488d61-2071-430a-9dee-a8a310e4d9d5 tempest-VolumesExtendTest-1784848575 None] Created reservations ['685587a2-f91e-49f5-bf31-d4c69c69dcb7', '2d02c496-b315-4672-a0b3-d6702c84b37d', 'c8a1a4fb-a19b-41d5-9790-e526fd7490f5', '2679152d-91d6-40e5-9388-a6fffb9f179f'] {{(pid=86212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 15:45:04 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-cf488d61-2071-430a-9dee-a8a310e4d9d5 tempest-VolumesExtendTest-1784848575 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:45:04 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-cf488d61-2071-430a-9dee-a8a310e4d9d5 tempest-VolumesExtendTest-1784848575 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:45:04 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-cf488d61-2071-430a-9dee-a8a310e4d9d5 tempest-VolumesExtendTest-1784848575 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:45:04 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-cf488d61-2071-430a-9dee-a8a310e4d9d5 tempest-VolumesExtendTest-1784848575 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:45:04 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-cf488d61-2071-430a-9dee-a8a310e4d9d5 tempest-VolumesExtendTest-1784848575 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:45:04 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-cf488d61-2071-430a-9dee-a8a310e4d9d5 tempest-VolumesExtendTest-1784848575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:45:04 devstack sudo[95639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc Sep 22 15:45:04 devstack sudo[95639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:45:05 devstack sudo[95639]: pam_unix(sudo:session): session closed for user root Sep 22 15:45:05 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-cf488d61-2071-430a-9dee-a8a310e4d9d5 tempest-VolumesExtendTest-1784848575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc" returned: 0 in 0.317s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:45:05 devstack cinder-volume[86212]: DEBUG cinder.manager [None req-cf488d61-2071-430a-9dee-a8a310e4d9d5 tempest-VolumesExtendTest-1784848575 None] Notifying Schedulers of capabilities ... {{(pid=86212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 15:45:05 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-cf488d61-2071-430a-9dee-a8a310e4d9d5 tempest-VolumesExtendTest-1784848575 None] Deleted volume successfully. Sep 22 15:45:05 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-cf488d61-2071-430a-9dee-a8a310e4d9d5 tempest-VolumesExtendTest-1784848575 None] Lock "cinder-2e869d2d-8c57-4196-af61-6e274ad0b14c-delete_volume" released by "delete_volume" :: held 1.596s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:45:05 devstack cinder-volume[86212]: DEBUG cinder.volume.flows.manager.create_volume [None req-a351ad6f-1a82-4c36-8261-a3cf894c4e45 tempest-VolumesExtendTest-1784848575 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 15:45:05 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-a351ad6f-1a82-4c36-8261-a3cf894c4e45 tempest-VolumesExtendTest-1784848575 None] Flow 'volume_create_manager' (071df20f-7b91-4994-9922-bf1d5a74c1ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:45:05 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-a351ad6f-1a82-4c36-8261-a3cf894c4e45 tempest-VolumesExtendTest-1784848575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40abf7e6-8cb0-4dd6-b3ee-277528101894) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:45:05 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-a351ad6f-1a82-4c36-8261-a3cf894c4e45 tempest-VolumesExtendTest-1784848575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40abf7e6-8cb0-4dd6-b3ee-277528101894) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:45:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-259809090',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92984af5-5b36-4e35-8cc0-bb64566df74d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7dbebcd84f404b71ba5c2d9adb96cffa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:45:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:45:05Z,use_quota=True,user_id='af04838b5640411da6aafb36a4be9127',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:45:05 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-a351ad6f-1a82-4c36-8261-a3cf894c4e45 tempest-VolumesExtendTest-1784848575 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e211000-ed0f-47db-a9af-be3bef8ea763) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:45:05 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-a351ad6f-1a82-4c36-8261-a3cf894c4e45 tempest-VolumesExtendTest-1784848575 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e211000-ed0f-47db-a9af-be3bef8ea763) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:45:05 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-a351ad6f-1a82-4c36-8261-a3cf894c4e45 tempest-VolumesExtendTest-1784848575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad6109d2-22d2-4d2b-bc3e-d10aff00a59b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:45:05 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-a351ad6f-1a82-4c36-8261-a3cf894c4e45 tempest-VolumesExtendTest-1784848575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad6109d2-22d2-4d2b-bc3e-d10aff00a59b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '92984af5-5b36-4e35-8cc0-bb64566df74d', 'volume_name': 'volume-92984af5-5b36-4e35-8cc0-bb64566df74d', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:45:05 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-a351ad6f-1a82-4c36-8261-a3cf894c4e45 tempest-VolumesExtendTest-1784848575 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23314015-cb78-40e2-acb9-3d5bb7532b2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:45:05 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-a351ad6f-1a82-4c36-8261-a3cf894c4e45 tempest-VolumesExtendTest-1784848575 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23314015-cb78-40e2-acb9-3d5bb7532b2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:45:05 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-a351ad6f-1a82-4c36-8261-a3cf894c4e45 tempest-VolumesExtendTest-1784848575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45dd0cab-ed3a-4f20-be2c-339b66477630) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:45:05 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-a351ad6f-1a82-4c36-8261-a3cf894c4e45 tempest-VolumesExtendTest-1784848575 None] Volume 92984af5-5b36-4e35-8cc0-bb64566df74d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-92984af5-5b36-4e35-8cc0-bb64566df74d', 'volume_size': 1} Sep 22 15:45:05 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-a351ad6f-1a82-4c36-8261-a3cf894c4e45 tempest-VolumesExtendTest-1784848575 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:45:05 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-a351ad6f-1a82-4c36-8261-a3cf894c4e45 tempest-VolumesExtendTest-1784848575 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:45:05 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-a351ad6f-1a82-4c36-8261-a3cf894c4e45 tempest-VolumesExtendTest-1784848575 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:45:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-259809090',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92984af5-5b36-4e35-8cc0-bb64566df74d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7dbebcd84f404b71ba5c2d9adb96cffa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:45:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:45:05Z,use_quota=True,user_id='af04838b5640411da6aafb36a4be9127',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)}" {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 15:45:05 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-a351ad6f-1a82-4c36-8261-a3cf894c4e45 tempest-VolumesExtendTest-1784848575 None] Creating volume 92984af5-5b36-4e35-8cc0-bb64566df74d {{(pid=86212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 15:45:05 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-a351ad6f-1a82-4c36-8261-a3cf894c4e45 tempest-VolumesExtendTest-1784848575 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:45:05 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-a351ad6f-1a82-4c36-8261-a3cf894c4e45 tempest-VolumesExtendTest-1784848575 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:45:05 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-a351ad6f-1a82-4c36-8261-a3cf894c4e45 tempest-VolumesExtendTest-1784848575 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:45:05 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-a351ad6f-1a82-4c36-8261-a3cf894c4e45 tempest-VolumesExtendTest-1784848575 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:45:05 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-a351ad6f-1a82-4c36-8261-a3cf894c4e45 tempest-VolumesExtendTest-1784848575 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:45:05 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-a351ad6f-1a82-4c36-8261-a3cf894c4e45 tempest-VolumesExtendTest-1784848575 None] Selected osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 as target Quobyte volume. {{(pid=86212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 15:45:05 devstack cinder-volume[86212]: INFO cinder.volume.drivers.remotefs [None req-a351ad6f-1a82-4c36-8261-a3cf894c4e45 tempest-VolumesExtendTest-1784848575 None] casted to osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 Sep 22 15:45:05 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-a351ad6f-1a82-4c36-8261-a3cf894c4e45 tempest-VolumesExtendTest-1784848575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-92984af5-5b36-4e35-8cc0-bb64566df74d 1073741824 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:45:05 devstack sudo[95642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-92984af5-5b36-4e35-8cc0-bb64566df74d 1073741824 Sep 22 15:45:05 devstack sudo[95642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:45:05 devstack sudo[95642]: pam_unix(sudo:session): session closed for user root Sep 22 15:45:05 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-a351ad6f-1a82-4c36-8261-a3cf894c4e45 tempest-VolumesExtendTest-1784848575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-92984af5-5b36-4e35-8cc0-bb64566df74d 1073741824" returned: 0 in 0.546s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:45:05 devstack cinder-volume[86212]: DEBUG dbcounter [-] [86212] Writing DB stats cinder:UPDATE=147,cinder:SELECT=136,cinder:INSERT=39,cinder:DELETE=9 {{(pid=86212) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 22 15:45:05 devstack cinder-volume[86212]: DEBUG dbcounter [-] [86212] Writing DB stats cinder:SELECT=122,cinder:UPDATE=137,cinder:DELETE=9,cinder:INSERT=38 {{(pid=86212) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 22 15:45:06 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-a351ad6f-1a82-4c36-8261-a3cf894c4e45 tempest-VolumesExtendTest-1784848575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-92984af5-5b36-4e35-8cc0-bb64566df74d {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:45:06 devstack sudo[95648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-92984af5-5b36-4e35-8cc0-bb64566df74d Sep 22 15:45:06 devstack sudo[95648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:45:06 devstack sudo[95648]: pam_unix(sudo:session): session closed for user root Sep 22 15:45:06 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-a351ad6f-1a82-4c36-8261-a3cf894c4e45 tempest-VolumesExtendTest-1784848575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-92984af5-5b36-4e35-8cc0-bb64566df74d" returned: 0 in 0.351s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:45:06 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-a351ad6f-1a82-4c36-8261-a3cf894c4e45 tempest-VolumesExtendTest-1784848575 None] <== create_volume: return (963ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'} {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 15:45:06 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-a351ad6f-1a82-4c36-8261-a3cf894c4e45 tempest-VolumesExtendTest-1784848575 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.966s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:45:06 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-a351ad6f-1a82-4c36-8261-a3cf894c4e45 tempest-VolumesExtendTest-1784848575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45dd0cab-ed3a-4f20-be2c-339b66477630) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-92984af5-5b36-4e35-8cc0-bb64566df74d', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:45:06 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-a351ad6f-1a82-4c36-8261-a3cf894c4e45 tempest-VolumesExtendTest-1784848575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c5fc979-83be-446d-9f7d-311d36269d5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:45:06 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-a351ad6f-1a82-4c36-8261-a3cf894c4e45 tempest-VolumesExtendTest-1784848575 None] Volume volume-92984af5-5b36-4e35-8cc0-bb64566df74d (92984af5-5b36-4e35-8cc0-bb64566df74d): created successfully Sep 22 15:45:06 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-a351ad6f-1a82-4c36-8261-a3cf894c4e45 tempest-VolumesExtendTest-1784848575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c5fc979-83be-446d-9f7d-311d36269d5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:45:06 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-a351ad6f-1a82-4c36-8261-a3cf894c4e45 tempest-VolumesExtendTest-1784848575 None] Flow 'volume_create_manager' (071df20f-7b91-4994-9922-bf1d5a74c1ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:45:06 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-a351ad6f-1a82-4c36-8261-a3cf894c4e45 tempest-VolumesExtendTest-1784848575 None] Created volume successfully. Sep 22 15:45:07 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-0c5e13d9-b1ce-4fc2-848c-7ef4d3276602 tempest-VolumesExtendTest-1784848575 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:45:07 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-0c5e13d9-b1ce-4fc2-848c-7ef4d3276602 tempest-VolumesExtendTest-1784848575 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:45:07 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-0c5e13d9-b1ce-4fc2-848c-7ef4d3276602 tempest-VolumesExtendTest-1784848575 None] Creating offline snapshot 3b32adcf-3b64-4fbe-8248-2c90126525ec of volume 92984af5-5b36-4e35-8cc0-bb64566df74d {{(pid=86212) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 22 15:45:07 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f2c64d9-395c-45b4-9e53-f178f7f38d7e]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:45:07 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-0c5e13d9-b1ce-4fc2-848c-7ef4d3276602 tempest-VolumesExtendTest-1784848575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-92984af5-5b36-4e35-8cc0-bb64566df74d {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:45:07 devstack sudo[95652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-92984af5-5b36-4e35-8cc0-bb64566df74d Sep 22 15:45:07 devstack sudo[95652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:45:08 devstack sudo[95652]: pam_unix(sudo:session): session closed for user root Sep 22 15:45:08 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-0c5e13d9-b1ce-4fc2-848c-7ef4d3276602 tempest-VolumesExtendTest-1784848575 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-92984af5-5b36-4e35-8cc0-bb64566df74d" returned: 0 in 0.411s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:45:08 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-0c5e13d9-b1ce-4fc2-848c-7ef4d3276602 tempest-VolumesExtendTest-1784848575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-92984af5-5b36-4e35-8cc0-bb64566df74d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-92984af5-5b36-4e35-8cc0-bb64566df74d.3b32adcf-3b64-4fbe-8248-2c90126525ec 1G {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:45:08 devstack sudo[95657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-92984af5-5b36-4e35-8cc0-bb64566df74d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-92984af5-5b36-4e35-8cc0-bb64566df74d.3b32adcf-3b64-4fbe-8248-2c90126525ec 1G Sep 22 15:45:08 devstack sudo[95657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:45:08 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-877a43ba-681b-406e-b295-79f98340460a tempest-BackendsCapabilitiesAdminTestsJSON-1711542727 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.568157196045, 'free_capacity_gb': 1775.568157196045, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86212) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 22 15:45:08 devstack sudo[95657]: pam_unix(sudo:session): session closed for user root Sep 22 15:45:08 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-0c5e13d9-b1ce-4fc2-848c-7ef4d3276602 tempest-VolumesExtendTest-1784848575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-92984af5-5b36-4e35-8cc0-bb64566df74d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-92984af5-5b36-4e35-8cc0-bb64566df74d.3b32adcf-3b64-4fbe-8248-2c90126525ec 1G" returned: 0 in 0.554s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:45:08 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-0c5e13d9-b1ce-4fc2-848c-7ef4d3276602 tempest-VolumesExtendTest-1784848575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-92984af5-5b36-4e35-8cc0-bb64566df74d -F qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-92984af5-5b36-4e35-8cc0-bb64566df74d.3b32adcf-3b64-4fbe-8248-2c90126525ec {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:45:08 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-4c974e5e-f025-4a4d-8cf9-5c36bca66615 tempest-BackendsCapabilitiesAdminTestsJSON-1711542727 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.568157196045, 'free_capacity_gb': 1775.568157196045, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86212) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 22 15:45:08 devstack sudo[95663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-92984af5-5b36-4e35-8cc0-bb64566df74d -F qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-92984af5-5b36-4e35-8cc0-bb64566df74d.3b32adcf-3b64-4fbe-8248-2c90126525ec Sep 22 15:45:08 devstack sudo[95663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:45:09 devstack sudo[95663]: pam_unix(sudo:session): session closed for user root Sep 22 15:45:09 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-0c5e13d9-b1ce-4fc2-848c-7ef4d3276602 tempest-VolumesExtendTest-1784848575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-92984af5-5b36-4e35-8cc0-bb64566df74d -F qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-92984af5-5b36-4e35-8cc0-bb64566df74d.3b32adcf-3b64-4fbe-8248-2c90126525ec" returned: 0 in 0.349s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:45:09 devstack cinder-volume[86212]: WARNING cinder.volume.drivers.remotefs [None req-0c5e13d9-b1ce-4fc2-848c-7ef4d3276602 tempest-VolumesExtendTest-1784848575 None] /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-92984af5-5b36-4e35-8cc0-bb64566df74d.3b32adcf-3b64-4fbe-8248-2c90126525ec is being set with open permissions: ugo+rw Sep 22 15:45:09 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-0c5e13d9-b1ce-4fc2-848c-7ef4d3276602 tempest-VolumesExtendTest-1784848575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-92984af5-5b36-4e35-8cc0-bb64566df74d.3b32adcf-3b64-4fbe-8248-2c90126525ec {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:45:09 devstack sudo[95668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-92984af5-5b36-4e35-8cc0-bb64566df74d.3b32adcf-3b64-4fbe-8248-2c90126525ec Sep 22 15:45:09 devstack sudo[95668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:45:09 devstack sudo[95668]: pam_unix(sudo:session): session closed for user root Sep 22 15:45:09 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-0c5e13d9-b1ce-4fc2-848c-7ef4d3276602 tempest-VolumesExtendTest-1784848575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-92984af5-5b36-4e35-8cc0-bb64566df74d.3b32adcf-3b64-4fbe-8248-2c90126525ec" returned: 0 in 0.352s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:45:09 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-0c5e13d9-b1ce-4fc2-848c-7ef4d3276602 tempest-VolumesExtendTest-1784848575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-92984af5-5b36-4e35-8cc0-bb64566df74d.info {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:45:09 devstack sudo[95671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-92984af5-5b36-4e35-8cc0-bb64566df74d.info Sep 22 15:45:09 devstack sudo[95671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:45:09 devstack cinder-volume[86212]: DEBUG cinder.volume.flows.manager.create_volume [req-e29972e3-a404-4e56-94a4-f0c045a8565d req-d604f30d-d1cc-4d86-a2a2-7e66ccc602da tempest-VolumesGetTestJSON-1919352166 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 15:45:09 devstack sudo[95671]: pam_unix(sudo:session): session closed for user root Sep 22 15:45:09 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [req-e29972e3-a404-4e56-94a4-f0c045a8565d req-d604f30d-d1cc-4d86-a2a2-7e66ccc602da tempest-VolumesGetTestJSON-1919352166 None] Flow 'volume_create_manager' (6013ff26-a641-45a4-a02e-ab2e41d15124) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:45:09 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [req-e29972e3-a404-4e56-94a4-f0c045a8565d req-d604f30d-d1cc-4d86-a2a2-7e66ccc602da tempest-VolumesGetTestJSON-1919352166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07d392b4-8fd6-4622-ade0-b151d91fa21f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:45:09 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-0c5e13d9-b1ce-4fc2-848c-7ef4d3276602 tempest-VolumesExtendTest-1784848575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-92984af5-5b36-4e35-8cc0-bb64566df74d.info" returned: 0 in 0.447s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:45:09 devstack cinder-volume[86212]: WARNING cinder.volume.drivers.remotefs [None req-0c5e13d9-b1ce-4fc2-848c-7ef4d3276602 tempest-VolumesExtendTest-1784848575 None] /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-92984af5-5b36-4e35-8cc0-bb64566df74d.info is being set with open permissions: ugo+rw Sep 22 15:45:09 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-0c5e13d9-b1ce-4fc2-848c-7ef4d3276602 tempest-VolumesExtendTest-1784848575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-92984af5-5b36-4e35-8cc0-bb64566df74d.info {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:45:10 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [req-e29972e3-a404-4e56-94a4-f0c045a8565d req-d604f30d-d1cc-4d86-a2a2-7e66ccc602da tempest-VolumesGetTestJSON-1919352166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07d392b4-8fd6-4622-ade0-b151d91fa21f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:45:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1558008401',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18c238e1-e2ba-465f-bc8e-bd779d5392c0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e6f20c38acb94aa8a982a832b0dcfef2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:45:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:45:10Z,use_quota=True,user_id='66205027b9184836b0de4231bfacd0f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:45:10 devstack sudo[95674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-92984af5-5b36-4e35-8cc0-bb64566df74d.info Sep 22 15:45:10 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [req-e29972e3-a404-4e56-94a4-f0c045a8565d req-d604f30d-d1cc-4d86-a2a2-7e66ccc602da tempest-VolumesGetTestJSON-1919352166 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (337e4041-9a96-4c6a-92de-5a66545b9fd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:45:10 devstack sudo[95674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:45:10 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [req-e29972e3-a404-4e56-94a4-f0c045a8565d req-d604f30d-d1cc-4d86-a2a2-7e66ccc602da tempest-VolumesGetTestJSON-1919352166 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (337e4041-9a96-4c6a-92de-5a66545b9fd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:45:10 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [req-e29972e3-a404-4e56-94a4-f0c045a8565d req-d604f30d-d1cc-4d86-a2a2-7e66ccc602da tempest-VolumesGetTestJSON-1919352166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31b9d215-dfbb-4eba-bcee-721d43ef570f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:45:10 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [req-e29972e3-a404-4e56-94a4-f0c045a8565d req-d604f30d-d1cc-4d86-a2a2-7e66ccc602da tempest-VolumesGetTestJSON-1919352166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31b9d215-dfbb-4eba-bcee-721d43ef570f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '18c238e1-e2ba-465f-bc8e-bd779d5392c0', 'volume_name': 'volume-18c238e1-e2ba-465f-bc8e-bd779d5392c0', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:45:10 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [req-e29972e3-a404-4e56-94a4-f0c045a8565d req-d604f30d-d1cc-4d86-a2a2-7e66ccc602da tempest-VolumesGetTestJSON-1919352166 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4607aac8-2eec-469b-b12e-247ab6a70c09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:45:10 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [req-e29972e3-a404-4e56-94a4-f0c045a8565d req-d604f30d-d1cc-4d86-a2a2-7e66ccc602da tempest-VolumesGetTestJSON-1919352166 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4607aac8-2eec-469b-b12e-247ab6a70c09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:45:10 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [req-e29972e3-a404-4e56-94a4-f0c045a8565d req-d604f30d-d1cc-4d86-a2a2-7e66ccc602da tempest-VolumesGetTestJSON-1919352166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1036b67e-b5a1-4568-84ef-a549bb9eff72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:45:10 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [req-e29972e3-a404-4e56-94a4-f0c045a8565d req-d604f30d-d1cc-4d86-a2a2-7e66ccc602da tempest-VolumesGetTestJSON-1919352166 None] Volume 18c238e1-e2ba-465f-bc8e-bd779d5392c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-18c238e1-e2ba-465f-bc8e-bd779d5392c0', 'volume_size': 1} Sep 22 15:45:10 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [req-e29972e3-a404-4e56-94a4-f0c045a8565d req-d604f30d-d1cc-4d86-a2a2-7e66ccc602da tempest-VolumesGetTestJSON-1919352166 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:45:10 devstack sudo[95674]: pam_unix(sudo:session): session closed for user root Sep 22 15:45:10 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-0c5e13d9-b1ce-4fc2-848c-7ef4d3276602 tempest-VolumesExtendTest-1784848575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-92984af5-5b36-4e35-8cc0-bb64566df74d.info" returned: 0 in 0.280s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:45:10 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-0c5e13d9-b1ce-4fc2-848c-7ef4d3276602 tempest-VolumesExtendTest-1784848575 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.537s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:45:10 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [req-e29972e3-a404-4e56-94a4-f0c045a8565d req-d604f30d-d1cc-4d86-a2a2-7e66ccc602da tempest-VolumesGetTestJSON-1919352166 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.226s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:45:10 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [req-e29972e3-a404-4e56-94a4-f0c045a8565d req-d604f30d-d1cc-4d86-a2a2-7e66ccc602da tempest-VolumesGetTestJSON-1919352166 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:45:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1558008401',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18c238e1-e2ba-465f-bc8e-bd779d5392c0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e6f20c38acb94aa8a982a832b0dcfef2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:45:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:45:10Z,use_quota=True,user_id='66205027b9184836b0de4231bfacd0f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)}" {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 15:45:10 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [req-e29972e3-a404-4e56-94a4-f0c045a8565d req-d604f30d-d1cc-4d86-a2a2-7e66ccc602da tempest-VolumesGetTestJSON-1919352166 None] Creating volume 18c238e1-e2ba-465f-bc8e-bd779d5392c0 {{(pid=86212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 15:45:10 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [req-e29972e3-a404-4e56-94a4-f0c045a8565d req-d604f30d-d1cc-4d86-a2a2-7e66ccc602da tempest-VolumesGetTestJSON-1919352166 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:45:10 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [req-e29972e3-a404-4e56-94a4-f0c045a8565d req-d604f30d-d1cc-4d86-a2a2-7e66ccc602da tempest-VolumesGetTestJSON-1919352166 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:45:10 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [req-e29972e3-a404-4e56-94a4-f0c045a8565d req-d604f30d-d1cc-4d86-a2a2-7e66ccc602da tempest-VolumesGetTestJSON-1919352166 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:45:10 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [req-e29972e3-a404-4e56-94a4-f0c045a8565d req-d604f30d-d1cc-4d86-a2a2-7e66ccc602da tempest-VolumesGetTestJSON-1919352166 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:45:10 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [req-e29972e3-a404-4e56-94a4-f0c045a8565d req-d604f30d-d1cc-4d86-a2a2-7e66ccc602da tempest-VolumesGetTestJSON-1919352166 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:45:10 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [req-e29972e3-a404-4e56-94a4-f0c045a8565d req-d604f30d-d1cc-4d86-a2a2-7e66ccc602da tempest-VolumesGetTestJSON-1919352166 None] Selected osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 as target Quobyte volume. {{(pid=86212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 15:45:10 devstack cinder-volume[86212]: INFO cinder.volume.drivers.remotefs [req-e29972e3-a404-4e56-94a4-f0c045a8565d req-d604f30d-d1cc-4d86-a2a2-7e66ccc602da tempest-VolumesGetTestJSON-1919352166 None] casted to osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 Sep 22 15:45:10 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [req-e29972e3-a404-4e56-94a4-f0c045a8565d req-d604f30d-d1cc-4d86-a2a2-7e66ccc602da tempest-VolumesGetTestJSON-1919352166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-18c238e1-e2ba-465f-bc8e-bd779d5392c0 1073741824 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:45:10 devstack sudo[95677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-18c238e1-e2ba-465f-bc8e-bd779d5392c0 1073741824 Sep 22 15:45:10 devstack sudo[95677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:45:10 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-0c5e13d9-b1ce-4fc2-848c-7ef4d3276602 tempest-VolumesExtendTest-1784848575 None] Create snapshot completed successfully Sep 22 15:45:10 devstack sudo[95677]: pam_unix(sudo:session): session closed for user root Sep 22 15:45:10 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [req-e29972e3-a404-4e56-94a4-f0c045a8565d req-d604f30d-d1cc-4d86-a2a2-7e66ccc602da tempest-VolumesGetTestJSON-1919352166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-18c238e1-e2ba-465f-bc8e-bd779d5392c0 1073741824" returned: 0 in 0.556s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:45:10 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [req-e29972e3-a404-4e56-94a4-f0c045a8565d req-d604f30d-d1cc-4d86-a2a2-7e66ccc602da tempest-VolumesGetTestJSON-1919352166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-18c238e1-e2ba-465f-bc8e-bd779d5392c0 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:45:10 devstack sudo[95683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-18c238e1-e2ba-465f-bc8e-bd779d5392c0 Sep 22 15:45:10 devstack sudo[95683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:45:11 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-53d80f11-28db-49ea-a0cf-e3df68c24afb tempest-VolumesExtendTest-1784848575 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:45:11 devstack sudo[95683]: pam_unix(sudo:session): session closed for user root Sep 22 15:45:11 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [req-e29972e3-a404-4e56-94a4-f0c045a8565d req-d604f30d-d1cc-4d86-a2a2-7e66ccc602da tempest-VolumesGetTestJSON-1919352166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-18c238e1-e2ba-465f-bc8e-bd779d5392c0" returned: 0 in 0.279s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:45:11 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [req-e29972e3-a404-4e56-94a4-f0c045a8565d req-d604f30d-d1cc-4d86-a2a2-7e66ccc602da tempest-VolumesGetTestJSON-1919352166 None] <== create_volume: return (892ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'} {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 15:45:11 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [req-e29972e3-a404-4e56-94a4-f0c045a8565d req-d604f30d-d1cc-4d86-a2a2-7e66ccc602da tempest-VolumesGetTestJSON-1919352166 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.895s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:45:11 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-53d80f11-28db-49ea-a0cf-e3df68c24afb tempest-VolumesExtendTest-1784848575 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.072s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:45:11 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [req-e29972e3-a404-4e56-94a4-f0c045a8565d req-d604f30d-d1cc-4d86-a2a2-7e66ccc602da tempest-VolumesGetTestJSON-1919352166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1036b67e-b5a1-4568-84ef-a549bb9eff72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-18c238e1-e2ba-465f-bc8e-bd779d5392c0', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:45:11 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [req-e29972e3-a404-4e56-94a4-f0c045a8565d req-d604f30d-d1cc-4d86-a2a2-7e66ccc602da tempest-VolumesGetTestJSON-1919352166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd35d1b9-b9a7-4df1-b87a-42202795bd0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:45:11 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[125f49ba-2f86-4c59-85a7-945c47dd8e83]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:45:11 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-53d80f11-28db-49ea-a0cf-e3df68c24afb tempest-VolumesExtendTest-1784848575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-92984af5-5b36-4e35-8cc0-bb64566df74d {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:45:11 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [req-e29972e3-a404-4e56-94a4-f0c045a8565d req-d604f30d-d1cc-4d86-a2a2-7e66ccc602da tempest-VolumesGetTestJSON-1919352166 None] Volume volume-18c238e1-e2ba-465f-bc8e-bd779d5392c0 (18c238e1-e2ba-465f-bc8e-bd779d5392c0): created successfully Sep 22 15:45:11 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [req-e29972e3-a404-4e56-94a4-f0c045a8565d req-d604f30d-d1cc-4d86-a2a2-7e66ccc602da tempest-VolumesGetTestJSON-1919352166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd35d1b9-b9a7-4df1-b87a-42202795bd0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:45:11 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [req-e29972e3-a404-4e56-94a4-f0c045a8565d req-d604f30d-d1cc-4d86-a2a2-7e66ccc602da tempest-VolumesGetTestJSON-1919352166 None] Flow 'volume_create_manager' (6013ff26-a641-45a4-a02e-ab2e41d15124) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:45:11 devstack cinder-volume[86212]: INFO cinder.volume.manager [req-e29972e3-a404-4e56-94a4-f0c045a8565d req-d604f30d-d1cc-4d86-a2a2-7e66ccc602da tempest-VolumesGetTestJSON-1919352166 None] Created volume successfully. Sep 22 15:45:11 devstack sudo[95686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-92984af5-5b36-4e35-8cc0-bb64566df74d Sep 22 15:45:11 devstack sudo[95686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:45:11 devstack sudo[95686]: pam_unix(sudo:session): session closed for user root Sep 22 15:45:11 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-53d80f11-28db-49ea-a0cf-e3df68c24afb tempest-VolumesExtendTest-1784848575 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-92984af5-5b36-4e35-8cc0-bb64566df74d" returned: 0 in 0.430s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:45:11 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-53d80f11-28db-49ea-a0cf-e3df68c24afb tempest-VolumesExtendTest-1784848575 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-92984af5-5b36-4e35-8cc0-bb64566df74d.3b32adcf-3b64-4fbe-8248-2c90126525ec 2G {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:45:11 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-53d80f11-28db-49ea-a0cf-e3df68c24afb tempest-VolumesExtendTest-1784848575 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-92984af5-5b36-4e35-8cc0-bb64566df74d.3b32adcf-3b64-4fbe-8248-2c90126525ec 2G" returned: 0 in 0.222s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:45:11 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-53d80f11-28db-49ea-a0cf-e3df68c24afb tempest-VolumesExtendTest-1784848575 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.750s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:45:11 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-53d80f11-28db-49ea-a0cf-e3df68c24afb tempest-VolumesExtendTest-1784848575 None] Extend volume completed successfully. Sep 22 15:45:12 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-91f58aa2-4f6f-44ab-b41e-b1a3648ff63f tempest-VolumesExtendTest-1784848575 None] Acquiring lock "cinder-3b32adcf-3b64-4fbe-8248-2c90126525ec-delete_snapshot" by "delete_snapshot" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:45:12 devstack cinder-volume[86212]: DEBUG cinder.coordination [req-7e7557e0-72b7-457f-aafb-226d79854b6f req-976085fa-981e-4f16-a3ea-e09a5e0d55a3 tempest-VolumesGetTestJSON-1919352166 None] Acquiring lock "cinder-18c238e1-e2ba-465f-bc8e-bd779d5392c0-delete_volume" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:45:12 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-91f58aa2-4f6f-44ab-b41e-b1a3648ff63f tempest-VolumesExtendTest-1784848575 None] Lock "cinder-3b32adcf-3b64-4fbe-8248-2c90126525ec-delete_snapshot" acquired by "delete_snapshot" :: waited 0.077s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:45:12 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-91f58aa2-4f6f-44ab-b41e-b1a3648ff63f tempest-VolumesExtendTest-1784848575 None] Acquiring lock "cinder-quobyte-92984af5-5b36-4e35-8cc0-bb64566df74d" by "delete_snapshot" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:45:12 devstack cinder-volume[86212]: DEBUG cinder.coordination [req-7e7557e0-72b7-457f-aafb-226d79854b6f req-976085fa-981e-4f16-a3ea-e09a5e0d55a3 tempest-VolumesGetTestJSON-1919352166 None] Lock "cinder-18c238e1-e2ba-465f-bc8e-bd779d5392c0-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:45:12 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-91f58aa2-4f6f-44ab-b41e-b1a3648ff63f tempest-VolumesExtendTest-1784848575 None] Lock "cinder-quobyte-92984af5-5b36-4e35-8cc0-bb64566df74d" acquired by "delete_snapshot" :: waited 0.051s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:45:12 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-91f58aa2-4f6f-44ab-b41e-b1a3648ff63f tempest-VolumesExtendTest-1784848575 None] Acquiring lock "cinder-quobyte-3b32adcf-3b64-4fbe-8248-2c90126525ec" by "_delete_snapshot" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:45:12 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-91f58aa2-4f6f-44ab-b41e-b1a3648ff63f tempest-VolumesExtendTest-1784848575 None] Lock "cinder-quobyte-3b32adcf-3b64-4fbe-8248-2c90126525ec" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:45:12 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-91f58aa2-4f6f-44ab-b41e-b1a3648ff63f tempest-VolumesExtendTest-1784848575 None] Deleting offline snapshot 3b32adcf-3b64-4fbe-8248-2c90126525ec of volume 92984af5-5b36-4e35-8cc0-bb64566df74d {{(pid=86212) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 22 15:45:12 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-91f58aa2-4f6f-44ab-b41e-b1a3648ff63f tempest-VolumesExtendTest-1784848575 None] snapshot_file for this snap is: volume-92984af5-5b36-4e35-8cc0-bb64566df74d.3b32adcf-3b64-4fbe-8248-2c90126525ec {{(pid=86212) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 22 15:45:12 devstack cinder-volume[86212]: DEBUG cinder.coordination [req-7e7557e0-72b7-457f-aafb-226d79854b6f req-976085fa-981e-4f16-a3ea-e09a5e0d55a3 tempest-VolumesGetTestJSON-1919352166 None] Acquiring lock "cinder-quobyte-18c238e1-e2ba-465f-bc8e-bd779d5392c0" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:45:12 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[a924609a-5033-4558-880f-2177a6a68e84]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:45:12 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-91f58aa2-4f6f-44ab-b41e-b1a3648ff63f tempest-VolumesExtendTest-1784848575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-92984af5-5b36-4e35-8cc0-bb64566df74d.3b32adcf-3b64-4fbe-8248-2c90126525ec {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:45:12 devstack cinder-volume[86212]: DEBUG cinder.coordination [req-7e7557e0-72b7-457f-aafb-226d79854b6f req-976085fa-981e-4f16-a3ea-e09a5e0d55a3 tempest-VolumesGetTestJSON-1919352166 None] Lock "cinder-quobyte-18c238e1-e2ba-465f-bc8e-bd779d5392c0" acquired by "delete_volume" :: waited 0.035s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:45:12 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[24e071db-2710-411e-a0d5-7cb4c85983b7]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:45:12 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [req-7e7557e0-72b7-457f-aafb-226d79854b6f req-976085fa-981e-4f16-a3ea-e09a5e0d55a3 tempest-VolumesGetTestJSON-1919352166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-18c238e1-e2ba-465f-bc8e-bd779d5392c0 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:45:12 devstack sudo[95694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-92984af5-5b36-4e35-8cc0-bb64566df74d.3b32adcf-3b64-4fbe-8248-2c90126525ec Sep 22 15:45:12 devstack sudo[95694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:45:12 devstack sudo[95695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-18c238e1-e2ba-465f-bc8e-bd779d5392c0 Sep 22 15:45:12 devstack sudo[95695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:45:13 devstack sudo[95694]: pam_unix(sudo:session): session closed for user root Sep 22 15:45:13 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-91f58aa2-4f6f-44ab-b41e-b1a3648ff63f tempest-VolumesExtendTest-1784848575 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-92984af5-5b36-4e35-8cc0-bb64566df74d.3b32adcf-3b64-4fbe-8248-2c90126525ec" returned: 0 in 0.496s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:45:13 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-91f58aa2-4f6f-44ab-b41e-b1a3648ff63f tempest-VolumesExtendTest-1784848575 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-92984af5-5b36-4e35-8cc0-bb64566df74d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86212) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 22 15:45:13 devstack sudo[95695]: pam_unix(sudo:session): session closed for user root Sep 22 15:45:13 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [req-7e7557e0-72b7-457f-aafb-226d79854b6f req-976085fa-981e-4f16-a3ea-e09a5e0d55a3 tempest-VolumesGetTestJSON-1919352166 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-18c238e1-e2ba-465f-bc8e-bd779d5392c0" returned: 0 in 0.480s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:45:13 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [req-7e7557e0-72b7-457f-aafb-226d79854b6f req-976085fa-981e-4f16-a3ea-e09a5e0d55a3 tempest-VolumesGetTestJSON-1919352166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-18c238e1-e2ba-465f-bc8e-bd779d5392c0 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:45:13 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[c723d1f9-3161-49a2-99de-0f9b923e6075]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:45:13 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-91f58aa2-4f6f-44ab-b41e-b1a3648ff63f tempest-VolumesExtendTest-1784848575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-92984af5-5b36-4e35-8cc0-bb64566df74d {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:45:13 devstack sudo[95704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-18c238e1-e2ba-465f-bc8e-bd779d5392c0 Sep 22 15:45:13 devstack sudo[95704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:45:13 devstack sudo[95705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-92984af5-5b36-4e35-8cc0-bb64566df74d Sep 22 15:45:13 devstack sudo[95705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:45:13 devstack sudo[95704]: pam_unix(sudo:session): session closed for user root Sep 22 15:45:13 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [req-7e7557e0-72b7-457f-aafb-226d79854b6f req-976085fa-981e-4f16-a3ea-e09a5e0d55a3 tempest-VolumesGetTestJSON-1919352166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-18c238e1-e2ba-465f-bc8e-bd779d5392c0" returned: 0 in 0.338s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:45:13 devstack cinder-volume[86212]: DEBUG cinder.coordination [req-7e7557e0-72b7-457f-aafb-226d79854b6f req-976085fa-981e-4f16-a3ea-e09a5e0d55a3 tempest-VolumesGetTestJSON-1919352166 None] Lock "cinder-quobyte-18c238e1-e2ba-465f-bc8e-bd779d5392c0" released by "delete_volume" :: held 0.895s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:45:13 devstack cinder-volume[86212]: DEBUG cinder.quota [req-7e7557e0-72b7-457f-aafb-226d79854b6f req-976085fa-981e-4f16-a3ea-e09a5e0d55a3 tempest-VolumesGetTestJSON-1919352166 None] Created reservations ['34d85c50-f326-44cc-b1b1-fc17ee973438', 'edd993b2-a7d4-4535-9560-b42f8a09fbd5', '522af8b5-fc82-4314-afe9-9909c2b98afa', '36f46388-bdb9-48c2-a2de-12225fe76785'] {{(pid=86212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 15:45:13 devstack sudo[95705]: pam_unix(sudo:session): session closed for user root Sep 22 15:45:13 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-91f58aa2-4f6f-44ab-b41e-b1a3648ff63f tempest-VolumesExtendTest-1784848575 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-92984af5-5b36-4e35-8cc0-bb64566df74d" returned: 0 in 0.484s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:45:13 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-91f58aa2-4f6f-44ab-b41e-b1a3648ff63f tempest-VolumesExtendTest-1784848575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-92984af5-5b36-4e35-8cc0-bb64566df74d.3b32adcf-3b64-4fbe-8248-2c90126525ec {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:45:13 devstack sudo[95713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-92984af5-5b36-4e35-8cc0-bb64566df74d.3b32adcf-3b64-4fbe-8248-2c90126525ec Sep 22 15:45:13 devstack sudo[95713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:45:13 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [req-7e7557e0-72b7-457f-aafb-226d79854b6f req-976085fa-981e-4f16-a3ea-e09a5e0d55a3 tempest-VolumesGetTestJSON-1919352166 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:45:13 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [req-7e7557e0-72b7-457f-aafb-226d79854b6f req-976085fa-981e-4f16-a3ea-e09a5e0d55a3 tempest-VolumesGetTestJSON-1919352166 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:45:13 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [req-7e7557e0-72b7-457f-aafb-226d79854b6f req-976085fa-981e-4f16-a3ea-e09a5e0d55a3 tempest-VolumesGetTestJSON-1919352166 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:45:13 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [req-7e7557e0-72b7-457f-aafb-226d79854b6f req-976085fa-981e-4f16-a3ea-e09a5e0d55a3 tempest-VolumesGetTestJSON-1919352166 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:45:13 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [req-7e7557e0-72b7-457f-aafb-226d79854b6f req-976085fa-981e-4f16-a3ea-e09a5e0d55a3 tempest-VolumesGetTestJSON-1919352166 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:45:13 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [req-7e7557e0-72b7-457f-aafb-226d79854b6f req-976085fa-981e-4f16-a3ea-e09a5e0d55a3 tempest-VolumesGetTestJSON-1919352166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:45:13 devstack sudo[95715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc Sep 22 15:45:13 devstack sudo[95715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:45:14 devstack sudo[95715]: pam_unix(sudo:session): session closed for user root Sep 22 15:45:14 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [req-7e7557e0-72b7-457f-aafb-226d79854b6f req-976085fa-981e-4f16-a3ea-e09a5e0d55a3 tempest-VolumesGetTestJSON-1919352166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc" returned: 0 in 0.312s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:45:14 devstack cinder-volume[86212]: DEBUG cinder.manager [req-7e7557e0-72b7-457f-aafb-226d79854b6f req-976085fa-981e-4f16-a3ea-e09a5e0d55a3 tempest-VolumesGetTestJSON-1919352166 None] Notifying Schedulers of capabilities ... {{(pid=86212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 15:45:14 devstack cinder-volume[86212]: INFO cinder.volume.manager [req-7e7557e0-72b7-457f-aafb-226d79854b6f req-976085fa-981e-4f16-a3ea-e09a5e0d55a3 tempest-VolumesGetTestJSON-1919352166 None] Deleted volume successfully. Sep 22 15:45:14 devstack cinder-volume[86212]: DEBUG cinder.coordination [req-7e7557e0-72b7-457f-aafb-226d79854b6f req-976085fa-981e-4f16-a3ea-e09a5e0d55a3 tempest-VolumesGetTestJSON-1919352166 None] Lock "cinder-18c238e1-e2ba-465f-bc8e-bd779d5392c0-delete_volume" released by "delete_volume" :: held 1.608s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:45:14 devstack sudo[95713]: pam_unix(sudo:session): session closed for user root Sep 22 15:45:14 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-91f58aa2-4f6f-44ab-b41e-b1a3648ff63f tempest-VolumesExtendTest-1784848575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-92984af5-5b36-4e35-8cc0-bb64566df74d.3b32adcf-3b64-4fbe-8248-2c90126525ec" returned: 0 in 0.448s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:45:14 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-91f58aa2-4f6f-44ab-b41e-b1a3648ff63f tempest-VolumesExtendTest-1784848575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-92984af5-5b36-4e35-8cc0-bb64566df74d.3b32adcf-3b64-4fbe-8248-2c90126525ec {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:45:14 devstack sudo[95722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-92984af5-5b36-4e35-8cc0-bb64566df74d.3b32adcf-3b64-4fbe-8248-2c90126525ec Sep 22 15:45:14 devstack sudo[95722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:45:14 devstack sudo[95722]: pam_unix(sudo:session): session closed for user root Sep 22 15:45:14 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-91f58aa2-4f6f-44ab-b41e-b1a3648ff63f tempest-VolumesExtendTest-1784848575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-92984af5-5b36-4e35-8cc0-bb64566df74d.3b32adcf-3b64-4fbe-8248-2c90126525ec" returned: 0 in 0.281s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:45:14 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-91f58aa2-4f6f-44ab-b41e-b1a3648ff63f tempest-VolumesExtendTest-1784848575 None] Lock "cinder-quobyte-3b32adcf-3b64-4fbe-8248-2c90126525ec" released by "_delete_snapshot" :: held 1.896s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:45:14 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-91f58aa2-4f6f-44ab-b41e-b1a3648ff63f tempest-VolumesExtendTest-1784848575 None] Lock "cinder-quobyte-92984af5-5b36-4e35-8cc0-bb64566df74d" released by "delete_snapshot" :: held 1.948s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:45:14 devstack cinder-volume[86212]: DEBUG cinder.quota [None req-91f58aa2-4f6f-44ab-b41e-b1a3648ff63f tempest-VolumesExtendTest-1784848575 None] Created reservations ['4f3ea50a-7231-4fd2-bbad-469bb1f2b07d', '09d71b47-d32c-41e0-8a24-5c6adbd7cf9f', 'de6c114e-9eed-4e00-9c08-50bf62316bfb', 'e5e3a88b-d6e3-42a2-b1d4-217f504250fb'] {{(pid=86212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 15:45:14 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-91f58aa2-4f6f-44ab-b41e-b1a3648ff63f tempest-VolumesExtendTest-1784848575 None] Delete snapshot completed successfully. Sep 22 15:45:14 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-91f58aa2-4f6f-44ab-b41e-b1a3648ff63f tempest-VolumesExtendTest-1784848575 None] Lock "cinder-3b32adcf-3b64-4fbe-8248-2c90126525ec-delete_snapshot" released by "delete_snapshot" :: held 2.157s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:45:15 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-b0cc79e1-f6ea-4184-a230-9de5ddcc50f6 tempest-VolumesExtendTest-1784848575 None] Acquiring lock "cinder-92984af5-5b36-4e35-8cc0-bb64566df74d-delete_volume" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:45:15 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-b0cc79e1-f6ea-4184-a230-9de5ddcc50f6 tempest-VolumesExtendTest-1784848575 None] Lock "cinder-92984af5-5b36-4e35-8cc0-bb64566df74d-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:45:15 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-b0cc79e1-f6ea-4184-a230-9de5ddcc50f6 tempest-VolumesExtendTest-1784848575 None] Acquiring lock "cinder-quobyte-92984af5-5b36-4e35-8cc0-bb64566df74d" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:45:15 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-b0cc79e1-f6ea-4184-a230-9de5ddcc50f6 tempest-VolumesExtendTest-1784848575 None] Lock "cinder-quobyte-92984af5-5b36-4e35-8cc0-bb64566df74d" acquired by "delete_volume" :: waited 0.024s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:45:16 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[f255f833-3f17-458a-94cd-f0af1a0777c7]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:45:16 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-b0cc79e1-f6ea-4184-a230-9de5ddcc50f6 tempest-VolumesExtendTest-1784848575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-92984af5-5b36-4e35-8cc0-bb64566df74d {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:45:16 devstack sudo[95725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-92984af5-5b36-4e35-8cc0-bb64566df74d Sep 22 15:45:16 devstack sudo[95725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:45:16 devstack sudo[95725]: pam_unix(sudo:session): session closed for user root Sep 22 15:45:16 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-b0cc79e1-f6ea-4184-a230-9de5ddcc50f6 tempest-VolumesExtendTest-1784848575 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-92984af5-5b36-4e35-8cc0-bb64566df74d" returned: 0 in 0.474s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:45:16 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-b0cc79e1-f6ea-4184-a230-9de5ddcc50f6 tempest-VolumesExtendTest-1784848575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-92984af5-5b36-4e35-8cc0-bb64566df74d {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:45:16 devstack sudo[95730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-92984af5-5b36-4e35-8cc0-bb64566df74d Sep 22 15:45:16 devstack sudo[95730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:45:16 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-35f714e3-c7ce-4312-90e2-bf7131f970ee tempest-GroupSnapshotsTest-1556879145 None] Group tempest-GroupSnapshotsTest-Group-1457469777: creating Sep 22 15:45:16 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-35f714e3-c7ce-4312-90e2-bf7131f970ee tempest-GroupSnapshotsTest-1556879145 None] Group tempest-GroupSnapshotsTest-Group-1457469777: created successfully Sep 22 15:45:16 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-35f714e3-c7ce-4312-90e2-bf7131f970ee tempest-GroupSnapshotsTest-1556879145 None] Create group completed successfully. Sep 22 15:45:16 devstack sudo[95730]: pam_unix(sudo:session): session closed for user root Sep 22 15:45:16 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-b0cc79e1-f6ea-4184-a230-9de5ddcc50f6 tempest-VolumesExtendTest-1784848575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-92984af5-5b36-4e35-8cc0-bb64566df74d" returned: 0 in 0.399s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:45:16 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-b0cc79e1-f6ea-4184-a230-9de5ddcc50f6 tempest-VolumesExtendTest-1784848575 None] Lock "cinder-quobyte-92984af5-5b36-4e35-8cc0-bb64566df74d" released by "delete_volume" :: held 0.986s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:45:16 devstack cinder-volume[86212]: DEBUG cinder.quota [None req-b0cc79e1-f6ea-4184-a230-9de5ddcc50f6 tempest-VolumesExtendTest-1784848575 None] Created reservations ['c7f1cd8a-d26f-493d-a3b1-c9c354766273', '44c528bf-c1ad-4a51-a020-809dcd743615', '5ba4aea9-894c-4c5a-800a-676378227f98', 'd1c03332-601e-4f00-a8c4-3d9d44bb9a66'] {{(pid=86212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 15:45:17 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-b0cc79e1-f6ea-4184-a230-9de5ddcc50f6 tempest-VolumesExtendTest-1784848575 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:45:17 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-b0cc79e1-f6ea-4184-a230-9de5ddcc50f6 tempest-VolumesExtendTest-1784848575 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:45:17 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-b0cc79e1-f6ea-4184-a230-9de5ddcc50f6 tempest-VolumesExtendTest-1784848575 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:45:17 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-b0cc79e1-f6ea-4184-a230-9de5ddcc50f6 tempest-VolumesExtendTest-1784848575 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:45:17 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-b0cc79e1-f6ea-4184-a230-9de5ddcc50f6 tempest-VolumesExtendTest-1784848575 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:45:17 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-b0cc79e1-f6ea-4184-a230-9de5ddcc50f6 tempest-VolumesExtendTest-1784848575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:45:17 devstack sudo[95733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc Sep 22 15:45:17 devstack sudo[95733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:45:17 devstack sudo[95733]: pam_unix(sudo:session): session closed for user root Sep 22 15:45:17 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-b0cc79e1-f6ea-4184-a230-9de5ddcc50f6 tempest-VolumesExtendTest-1784848575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc" returned: 0 in 0.272s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:45:17 devstack cinder-volume[86212]: DEBUG cinder.manager [None req-b0cc79e1-f6ea-4184-a230-9de5ddcc50f6 tempest-VolumesExtendTest-1784848575 None] Notifying Schedulers of capabilities ... {{(pid=86212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 15:45:17 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-b0cc79e1-f6ea-4184-a230-9de5ddcc50f6 tempest-VolumesExtendTest-1784848575 None] Deleted volume successfully. Sep 22 15:45:17 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-b0cc79e1-f6ea-4184-a230-9de5ddcc50f6 tempest-VolumesExtendTest-1784848575 None] Lock "cinder-92984af5-5b36-4e35-8cc0-bb64566df74d-delete_volume" released by "delete_volume" :: held 1.527s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:45:18 devstack cinder-volume[86212]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa7cfab1-1be2-49f9-94c4-619f277a0cab tempest-GroupSnapshotsTest-1556879145 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 15:45:18 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-fa7cfab1-1be2-49f9-94c4-619f277a0cab tempest-GroupSnapshotsTest-1556879145 None] Flow 'volume_create_manager' (af604265-a4c0-4b81-a41e-bc6221d87129) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:45:18 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-fa7cfab1-1be2-49f9-94c4-619f277a0cab tempest-GroupSnapshotsTest-1556879145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d262132f-a18c-4312-bbdb-2d48bcd82991) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:45:18 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-fa7cfab1-1be2-49f9-94c4-619f277a0cab tempest-GroupSnapshotsTest-1556879145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d262132f-a18c-4312-bbdb-2d48bcd82991) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:45:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1110890715',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c49e723b-dccc-4b9c-b268-bcbe4a38ebaf,host='devstack@QuobyteHD#QuobyteHD',id=bee4048f-1513-4df1-9a52-9fb5eb25918d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='302ce9fa5101463680fb8113ccce1f48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:45:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:45:18Z,use_quota=True,user_id='f8650ad05c3d4df895b954f3cea76df3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5770adbf-112b-4dad-875e-df88947d6801),volume_type_id=5770adbf-112b-4dad-875e-df88947d6801)' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:45:18 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-fa7cfab1-1be2-49f9-94c4-619f277a0cab tempest-GroupSnapshotsTest-1556879145 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30eaf1f5-1d5f-44c9-bebb-084945d02527) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:45:18 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-fa7cfab1-1be2-49f9-94c4-619f277a0cab tempest-GroupSnapshotsTest-1556879145 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30eaf1f5-1d5f-44c9-bebb-084945d02527) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:45:18 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-fa7cfab1-1be2-49f9-94c4-619f277a0cab tempest-GroupSnapshotsTest-1556879145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (711ffb87-c600-4771-92d5-32d5e509079f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:45:18 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-fa7cfab1-1be2-49f9-94c4-619f277a0cab tempest-GroupSnapshotsTest-1556879145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (711ffb87-c600-4771-92d5-32d5e509079f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bee4048f-1513-4df1-9a52-9fb5eb25918d', 'volume_name': 'volume-bee4048f-1513-4df1-9a52-9fb5eb25918d', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:45:18 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-fa7cfab1-1be2-49f9-94c4-619f277a0cab tempest-GroupSnapshotsTest-1556879145 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (807efa7a-2366-4d8d-809b-6487a09b6adc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:45:18 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-fa7cfab1-1be2-49f9-94c4-619f277a0cab tempest-GroupSnapshotsTest-1556879145 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (807efa7a-2366-4d8d-809b-6487a09b6adc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:45:18 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-fa7cfab1-1be2-49f9-94c4-619f277a0cab tempest-GroupSnapshotsTest-1556879145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f30ba9ad-bb89-4c74-a49c-2258a0053654) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:45:18 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-fa7cfab1-1be2-49f9-94c4-619f277a0cab tempest-GroupSnapshotsTest-1556879145 None] Volume bee4048f-1513-4df1-9a52-9fb5eb25918d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bee4048f-1513-4df1-9a52-9fb5eb25918d', 'volume_size': 1} Sep 22 15:45:18 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-fa7cfab1-1be2-49f9-94c4-619f277a0cab tempest-GroupSnapshotsTest-1556879145 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:45:18 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-fa7cfab1-1be2-49f9-94c4-619f277a0cab tempest-GroupSnapshotsTest-1556879145 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:45:18 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-fa7cfab1-1be2-49f9-94c4-619f277a0cab tempest-GroupSnapshotsTest-1556879145 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=c49e723b-dccc-4b9c-b268-bcbe4a38ebaf,created_at=2026-09-22T13:45:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1110890715',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c49e723b-dccc-4b9c-b268-bcbe4a38ebaf,host='devstack@QuobyteHD#QuobyteHD',id=bee4048f-1513-4df1-9a52-9fb5eb25918d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='302ce9fa5101463680fb8113ccce1f48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:45:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:45:18Z,use_quota=True,user_id='f8650ad05c3d4df895b954f3cea76df3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5770adbf-112b-4dad-875e-df88947d6801),volume_type_id=5770adbf-112b-4dad-875e-df88947d6801)}" {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 15:45:18 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-fa7cfab1-1be2-49f9-94c4-619f277a0cab tempest-GroupSnapshotsTest-1556879145 None] Creating volume bee4048f-1513-4df1-9a52-9fb5eb25918d {{(pid=86212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 15:45:18 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-fa7cfab1-1be2-49f9-94c4-619f277a0cab tempest-GroupSnapshotsTest-1556879145 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:45:18 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-fa7cfab1-1be2-49f9-94c4-619f277a0cab tempest-GroupSnapshotsTest-1556879145 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:45:18 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-fa7cfab1-1be2-49f9-94c4-619f277a0cab tempest-GroupSnapshotsTest-1556879145 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:45:18 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-fa7cfab1-1be2-49f9-94c4-619f277a0cab tempest-GroupSnapshotsTest-1556879145 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:45:18 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-fa7cfab1-1be2-49f9-94c4-619f277a0cab tempest-GroupSnapshotsTest-1556879145 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:45:18 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-fa7cfab1-1be2-49f9-94c4-619f277a0cab tempest-GroupSnapshotsTest-1556879145 None] Selected osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 as target Quobyte volume. {{(pid=86212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 15:45:18 devstack cinder-volume[86212]: INFO cinder.volume.drivers.remotefs [None req-fa7cfab1-1be2-49f9-94c4-619f277a0cab tempest-GroupSnapshotsTest-1556879145 None] casted to osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 Sep 22 15:45:18 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-fa7cfab1-1be2-49f9-94c4-619f277a0cab tempest-GroupSnapshotsTest-1556879145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-bee4048f-1513-4df1-9a52-9fb5eb25918d 1073741824 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:45:18 devstack sudo[95737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-bee4048f-1513-4df1-9a52-9fb5eb25918d 1073741824 Sep 22 15:45:18 devstack sudo[95737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:45:19 devstack sudo[95737]: pam_unix(sudo:session): session closed for user root Sep 22 15:45:19 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-fa7cfab1-1be2-49f9-94c4-619f277a0cab tempest-GroupSnapshotsTest-1556879145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-bee4048f-1513-4df1-9a52-9fb5eb25918d 1073741824" returned: 0 in 0.521s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:45:19 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-fa7cfab1-1be2-49f9-94c4-619f277a0cab tempest-GroupSnapshotsTest-1556879145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-bee4048f-1513-4df1-9a52-9fb5eb25918d {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:45:19 devstack sudo[95743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-bee4048f-1513-4df1-9a52-9fb5eb25918d Sep 22 15:45:19 devstack sudo[95743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:45:19 devstack sudo[95743]: pam_unix(sudo:session): session closed for user root Sep 22 15:45:19 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-fa7cfab1-1be2-49f9-94c4-619f277a0cab tempest-GroupSnapshotsTest-1556879145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-bee4048f-1513-4df1-9a52-9fb5eb25918d" returned: 0 in 0.312s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:45:19 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-fa7cfab1-1be2-49f9-94c4-619f277a0cab tempest-GroupSnapshotsTest-1556879145 None] <== create_volume: return (891ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'} {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 15:45:19 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-fa7cfab1-1be2-49f9-94c4-619f277a0cab tempest-GroupSnapshotsTest-1556879145 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.894s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:45:19 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-fa7cfab1-1be2-49f9-94c4-619f277a0cab tempest-GroupSnapshotsTest-1556879145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f30ba9ad-bb89-4c74-a49c-2258a0053654) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bee4048f-1513-4df1-9a52-9fb5eb25918d', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:45:19 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-fa7cfab1-1be2-49f9-94c4-619f277a0cab tempest-GroupSnapshotsTest-1556879145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ba21640-d856-4852-ada2-09a0203eedc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:45:19 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-fa7cfab1-1be2-49f9-94c4-619f277a0cab tempest-GroupSnapshotsTest-1556879145 None] Volume volume-bee4048f-1513-4df1-9a52-9fb5eb25918d (bee4048f-1513-4df1-9a52-9fb5eb25918d): created successfully Sep 22 15:45:19 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-fa7cfab1-1be2-49f9-94c4-619f277a0cab tempest-GroupSnapshotsTest-1556879145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ba21640-d856-4852-ada2-09a0203eedc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:45:19 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-fa7cfab1-1be2-49f9-94c4-619f277a0cab tempest-GroupSnapshotsTest-1556879145 None] Flow 'volume_create_manager' (af604265-a4c0-4b81-a41e-bc6221d87129) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:45:19 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-fa7cfab1-1be2-49f9-94c4-619f277a0cab tempest-GroupSnapshotsTest-1556879145 None] Created volume successfully. Sep 22 15:45:20 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-9cc1a422-2048-4df5-b3c1-9abaf4fafa9e tempest-GroupSnapshotsTest-1556879145 None] GroupSnapshot 8c7ecdc0-b1b5-4e64-8542-8c9384fed354: creating. Sep 22 15:45:20 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-9cc1a422-2048-4df5-b3c1-9abaf4fafa9e tempest-GroupSnapshotsTest-1556879145 None] Group snapshot 8c7ecdc0-b1b5-4e64-8542-8c9384fed354: creating. {{(pid=86212) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 22 15:45:20 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-9cc1a422-2048-4df5-b3c1-9abaf4fafa9e tempest-GroupSnapshotsTest-1556879145 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:45:20 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-9cc1a422-2048-4df5-b3c1-9abaf4fafa9e tempest-GroupSnapshotsTest-1556879145 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:45:20 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-9cc1a422-2048-4df5-b3c1-9abaf4fafa9e tempest-GroupSnapshotsTest-1556879145 None] Creating offline snapshot bfd18d29-3f4f-4b31-adbc-bea6e8472aae of volume bee4048f-1513-4df1-9a52-9fb5eb25918d {{(pid=86212) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 22 15:45:20 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[33016281-d0f2-411d-b2be-14f9ea1996e5]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:45:20 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-9cc1a422-2048-4df5-b3c1-9abaf4fafa9e tempest-GroupSnapshotsTest-1556879145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-bee4048f-1513-4df1-9a52-9fb5eb25918d {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:45:20 devstack sudo[95746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-bee4048f-1513-4df1-9a52-9fb5eb25918d Sep 22 15:45:20 devstack sudo[95746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:45:20 devstack sudo[95746]: pam_unix(sudo:session): session closed for user root Sep 22 15:45:20 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-9cc1a422-2048-4df5-b3c1-9abaf4fafa9e tempest-GroupSnapshotsTest-1556879145 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-bee4048f-1513-4df1-9a52-9fb5eb25918d" returned: 0 in 0.526s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:45:20 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-9cc1a422-2048-4df5-b3c1-9abaf4fafa9e tempest-GroupSnapshotsTest-1556879145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-bee4048f-1513-4df1-9a52-9fb5eb25918d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-bee4048f-1513-4df1-9a52-9fb5eb25918d.bfd18d29-3f4f-4b31-adbc-bea6e8472aae 1G {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:45:20 devstack sudo[95751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-bee4048f-1513-4df1-9a52-9fb5eb25918d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-bee4048f-1513-4df1-9a52-9fb5eb25918d.bfd18d29-3f4f-4b31-adbc-bea6e8472aae 1G Sep 22 15:45:20 devstack cinder-volume[86212]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa4b6f72-bffa-4e6a-98cc-a27cfed31220 tempest-VolumesTestJSON-265954310 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 15:45:20 devstack sudo[95751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:45:20 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-aa4b6f72-bffa-4e6a-98cc-a27cfed31220 tempest-VolumesTestJSON-265954310 None] Flow 'volume_create_manager' (a661c6cd-f0c4-45c4-891e-61ef81108e27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:45:20 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-aa4b6f72-bffa-4e6a-98cc-a27cfed31220 tempest-VolumesTestJSON-265954310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1100e15e-e6e3-4415-b97d-cb628eba8b34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:45:20 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-aa4b6f72-bffa-4e6a-98cc-a27cfed31220 tempest-VolumesTestJSON-265954310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1100e15e-e6e3-4415-b97d-cb628eba8b34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:45:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2120469680',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3da36e20-ef6f-469d-b489-10abecba2fe1,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9046cfc5568c4655bed3294b24b483f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:45:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:45:21Z,use_quota=True,user_id='54a85f80aae8477f85ef87756e75ecb4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:45:20 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-aa4b6f72-bffa-4e6a-98cc-a27cfed31220 tempest-VolumesTestJSON-265954310 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19b474dd-ecef-4e8a-8d7e-ceeb3e9e9ffc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:45:21 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-aa4b6f72-bffa-4e6a-98cc-a27cfed31220 tempest-VolumesTestJSON-265954310 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19b474dd-ecef-4e8a-8d7e-ceeb3e9e9ffc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:45:21 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-aa4b6f72-bffa-4e6a-98cc-a27cfed31220 tempest-VolumesTestJSON-265954310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a582e2f-7f69-4391-b173-af6456d90c4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:45:21 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-aa4b6f72-bffa-4e6a-98cc-a27cfed31220 tempest-VolumesTestJSON-265954310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a582e2f-7f69-4391-b173-af6456d90c4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3da36e20-ef6f-469d-b489-10abecba2fe1', 'volume_name': 'volume-3da36e20-ef6f-469d-b489-10abecba2fe1', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:45:21 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-aa4b6f72-bffa-4e6a-98cc-a27cfed31220 tempest-VolumesTestJSON-265954310 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae34afeb-f165-430b-ac9e-9621e97e64b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:45:21 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-aa4b6f72-bffa-4e6a-98cc-a27cfed31220 tempest-VolumesTestJSON-265954310 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae34afeb-f165-430b-ac9e-9621e97e64b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:45:21 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-aa4b6f72-bffa-4e6a-98cc-a27cfed31220 tempest-VolumesTestJSON-265954310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2149fa7c-e388-4e9f-ac0a-a087bc83d174) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:45:21 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-aa4b6f72-bffa-4e6a-98cc-a27cfed31220 tempest-VolumesTestJSON-265954310 None] Volume 3da36e20-ef6f-469d-b489-10abecba2fe1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3da36e20-ef6f-469d-b489-10abecba2fe1', 'volume_size': 1} Sep 22 15:45:21 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-aa4b6f72-bffa-4e6a-98cc-a27cfed31220 tempest-VolumesTestJSON-265954310 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:45:21 devstack sudo[95751]: pam_unix(sudo:session): session closed for user root Sep 22 15:45:21 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-9cc1a422-2048-4df5-b3c1-9abaf4fafa9e tempest-GroupSnapshotsTest-1556879145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-bee4048f-1513-4df1-9a52-9fb5eb25918d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-bee4048f-1513-4df1-9a52-9fb5eb25918d.bfd18d29-3f4f-4b31-adbc-bea6e8472aae 1G" returned: 0 in 0.504s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:45:21 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-9cc1a422-2048-4df5-b3c1-9abaf4fafa9e tempest-GroupSnapshotsTest-1556879145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bee4048f-1513-4df1-9a52-9fb5eb25918d -F qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-bee4048f-1513-4df1-9a52-9fb5eb25918d.bfd18d29-3f4f-4b31-adbc-bea6e8472aae {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:45:21 devstack sudo[95757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bee4048f-1513-4df1-9a52-9fb5eb25918d -F qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-bee4048f-1513-4df1-9a52-9fb5eb25918d.bfd18d29-3f4f-4b31-adbc-bea6e8472aae Sep 22 15:45:21 devstack sudo[95757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:45:21 devstack cinder-volume[86212]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4320678-1b7d-4be2-9f1a-413bb1fdd13e tempest-VolumeRetypeWithoutMigrationTest-288079674 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 15:45:21 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-d4320678-1b7d-4be2-9f1a-413bb1fdd13e tempest-VolumeRetypeWithoutMigrationTest-288079674 None] Flow 'volume_create_manager' (ede6ca2e-048b-4266-84c6-99b74f2dfbc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:45:21 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-d4320678-1b7d-4be2-9f1a-413bb1fdd13e tempest-VolumeRetypeWithoutMigrationTest-288079674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eec68ac1-d2c5-4f84-8c1e-e7a2a20ee339) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:45:21 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-d4320678-1b7d-4be2-9f1a-413bb1fdd13e tempest-VolumeRetypeWithoutMigrationTest-288079674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eec68ac1-d2c5-4f84-8c1e-e7a2a20ee339) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:45:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-2122396351',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c947011-8d53-45ab-8347-db10ce012f31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86b66f753aa848b281589e5a440ca6a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:45:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:45:22Z,use_quota=True,user_id='040d1713da4948298a57903bfc2faa8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(798ab2d2-8641-4bc3-bd96-a2aef16d0681),volume_type_id=798ab2d2-8641-4bc3-bd96-a2aef16d0681)' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:45:21 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-d4320678-1b7d-4be2-9f1a-413bb1fdd13e tempest-VolumeRetypeWithoutMigrationTest-288079674 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4898f97-597f-447d-a949-f272bc00b397) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:45:21 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-d4320678-1b7d-4be2-9f1a-413bb1fdd13e tempest-VolumeRetypeWithoutMigrationTest-288079674 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4898f97-597f-447d-a949-f272bc00b397) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:45:21 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-d4320678-1b7d-4be2-9f1a-413bb1fdd13e tempest-VolumeRetypeWithoutMigrationTest-288079674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3c3dfec-32eb-482d-8dbd-6fe1169ae312) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:45:21 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-d4320678-1b7d-4be2-9f1a-413bb1fdd13e tempest-VolumeRetypeWithoutMigrationTest-288079674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3c3dfec-32eb-482d-8dbd-6fe1169ae312) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c947011-8d53-45ab-8347-db10ce012f31', 'volume_name': 'volume-9c947011-8d53-45ab-8347-db10ce012f31', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:45:21 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-d4320678-1b7d-4be2-9f1a-413bb1fdd13e tempest-VolumeRetypeWithoutMigrationTest-288079674 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a274429-9af2-444d-bac0-97cf30fe55d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:45:21 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-d4320678-1b7d-4be2-9f1a-413bb1fdd13e tempest-VolumeRetypeWithoutMigrationTest-288079674 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a274429-9af2-444d-bac0-97cf30fe55d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:45:21 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-d4320678-1b7d-4be2-9f1a-413bb1fdd13e tempest-VolumeRetypeWithoutMigrationTest-288079674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (745f2606-a979-4ab0-af7c-b74bf741dd33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:45:21 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-d4320678-1b7d-4be2-9f1a-413bb1fdd13e tempest-VolumeRetypeWithoutMigrationTest-288079674 None] Volume 9c947011-8d53-45ab-8347-db10ce012f31: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c947011-8d53-45ab-8347-db10ce012f31', 'volume_size': 1} Sep 22 15:45:21 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-d4320678-1b7d-4be2-9f1a-413bb1fdd13e tempest-VolumeRetypeWithoutMigrationTest-288079674 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:45:21 devstack sudo[95757]: pam_unix(sudo:session): session closed for user root Sep 22 15:45:21 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-9cc1a422-2048-4df5-b3c1-9abaf4fafa9e tempest-GroupSnapshotsTest-1556879145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bee4048f-1513-4df1-9a52-9fb5eb25918d -F qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-bee4048f-1513-4df1-9a52-9fb5eb25918d.bfd18d29-3f4f-4b31-adbc-bea6e8472aae" returned: 0 in 0.361s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:45:21 devstack cinder-volume[86212]: WARNING cinder.volume.drivers.remotefs [None req-9cc1a422-2048-4df5-b3c1-9abaf4fafa9e tempest-GroupSnapshotsTest-1556879145 None] /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-bee4048f-1513-4df1-9a52-9fb5eb25918d.bfd18d29-3f4f-4b31-adbc-bea6e8472aae is being set with open permissions: ugo+rw: NotImplementedError Sep 22 15:45:21 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-9cc1a422-2048-4df5-b3c1-9abaf4fafa9e tempest-GroupSnapshotsTest-1556879145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-bee4048f-1513-4df1-9a52-9fb5eb25918d.bfd18d29-3f4f-4b31-adbc-bea6e8472aae {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:45:21 devstack sudo[95762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-bee4048f-1513-4df1-9a52-9fb5eb25918d.bfd18d29-3f4f-4b31-adbc-bea6e8472aae Sep 22 15:45:21 devstack sudo[95762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:45:22 devstack sudo[95762]: pam_unix(sudo:session): session closed for user root Sep 22 15:45:22 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-9cc1a422-2048-4df5-b3c1-9abaf4fafa9e tempest-GroupSnapshotsTest-1556879145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-bee4048f-1513-4df1-9a52-9fb5eb25918d.bfd18d29-3f4f-4b31-adbc-bea6e8472aae" returned: 0 in 0.258s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:45:22 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-9cc1a422-2048-4df5-b3c1-9abaf4fafa9e tempest-GroupSnapshotsTest-1556879145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-bee4048f-1513-4df1-9a52-9fb5eb25918d.info {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:45:22 devstack sudo[95765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-bee4048f-1513-4df1-9a52-9fb5eb25918d.info Sep 22 15:45:22 devstack sudo[95765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:45:22 devstack sudo[95765]: pam_unix(sudo:session): session closed for user root Sep 22 15:45:22 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-9cc1a422-2048-4df5-b3c1-9abaf4fafa9e tempest-GroupSnapshotsTest-1556879145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-bee4048f-1513-4df1-9a52-9fb5eb25918d.info" returned: 0 in 0.251s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:45:22 devstack cinder-volume[86212]: WARNING cinder.volume.drivers.remotefs [None req-9cc1a422-2048-4df5-b3c1-9abaf4fafa9e tempest-GroupSnapshotsTest-1556879145 None] /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-bee4048f-1513-4df1-9a52-9fb5eb25918d.info is being set with open permissions: ugo+rw: NotImplementedError Sep 22 15:45:22 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-9cc1a422-2048-4df5-b3c1-9abaf4fafa9e tempest-GroupSnapshotsTest-1556879145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-bee4048f-1513-4df1-9a52-9fb5eb25918d.info {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:45:22 devstack sudo[95768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-bee4048f-1513-4df1-9a52-9fb5eb25918d.info Sep 22 15:45:22 devstack sudo[95768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:45:22 devstack sudo[95768]: pam_unix(sudo:session): session closed for user root Sep 22 15:45:22 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-9cc1a422-2048-4df5-b3c1-9abaf4fafa9e tempest-GroupSnapshotsTest-1556879145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-bee4048f-1513-4df1-9a52-9fb5eb25918d.info" returned: 0 in 0.275s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:45:22 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-9cc1a422-2048-4df5-b3c1-9abaf4fafa9e tempest-GroupSnapshotsTest-1556879145 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.306s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:45:22 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-aa4b6f72-bffa-4e6a-98cc-a27cfed31220 tempest-VolumesTestJSON-265954310 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.574s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:45:22 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-aa4b6f72-bffa-4e6a-98cc-a27cfed31220 tempest-VolumesTestJSON-265954310 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:45:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2120469680',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3da36e20-ef6f-469d-b489-10abecba2fe1,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9046cfc5568c4655bed3294b24b483f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:45:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:45:21Z,use_quota=True,user_id='54a85f80aae8477f85ef87756e75ecb4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)}" {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 15:45:22 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-aa4b6f72-bffa-4e6a-98cc-a27cfed31220 tempest-VolumesTestJSON-265954310 None] Creating volume 3da36e20-ef6f-469d-b489-10abecba2fe1 {{(pid=86212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 15:45:22 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-aa4b6f72-bffa-4e6a-98cc-a27cfed31220 tempest-VolumesTestJSON-265954310 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:45:22 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-aa4b6f72-bffa-4e6a-98cc-a27cfed31220 tempest-VolumesTestJSON-265954310 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:45:22 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-aa4b6f72-bffa-4e6a-98cc-a27cfed31220 tempest-VolumesTestJSON-265954310 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:45:22 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-aa4b6f72-bffa-4e6a-98cc-a27cfed31220 tempest-VolumesTestJSON-265954310 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:45:22 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-aa4b6f72-bffa-4e6a-98cc-a27cfed31220 tempest-VolumesTestJSON-265954310 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:45:22 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-aa4b6f72-bffa-4e6a-98cc-a27cfed31220 tempest-VolumesTestJSON-265954310 None] Selected osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 as target Quobyte volume. {{(pid=86212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 15:45:22 devstack cinder-volume[86212]: INFO cinder.volume.drivers.remotefs [None req-aa4b6f72-bffa-4e6a-98cc-a27cfed31220 tempest-VolumesTestJSON-265954310 None] casted to osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 Sep 22 15:45:22 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-aa4b6f72-bffa-4e6a-98cc-a27cfed31220 tempest-VolumesTestJSON-265954310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-3da36e20-ef6f-469d-b489-10abecba2fe1 1073741824 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:45:22 devstack sudo[95772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-3da36e20-ef6f-469d-b489-10abecba2fe1 1073741824 Sep 22 15:45:22 devstack sudo[95772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:45:22 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-9cc1a422-2048-4df5-b3c1-9abaf4fafa9e tempest-GroupSnapshotsTest-1556879145 None] group_snapshot 8c7ecdc0-b1b5-4e64-8542-8c9384fed354: created successfully Sep 22 15:45:22 devstack cinder-volume[86212]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3b4c755-ff3f-462c-8653-9db006d469fb tempest-VolumesGetTest-2122974047 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 15:45:22 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-a3b4c755-ff3f-462c-8653-9db006d469fb tempest-VolumesGetTest-2122974047 None] Flow 'volume_create_manager' (e6b43f1e-60ce-4dba-ac3d-a001fe195a73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:45:22 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-a3b4c755-ff3f-462c-8653-9db006d469fb tempest-VolumesGetTest-2122974047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44b71977-980d-4f5e-a93f-4d05c0d722e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:45:22 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-a3b4c755-ff3f-462c-8653-9db006d469fb tempest-VolumesGetTest-2122974047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44b71977-980d-4f5e-a93f-4d05c0d722e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:45:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1618533591',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a76322ba-08e1-4e26-93b9-c2066bb5e30b,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='4ab605a12e704f698a0a4b7beeffe43f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:45:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:45:23Z,use_quota=True,user_id='a0b6cabdecf14f80b25b912b51474b36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:45:22 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-a3b4c755-ff3f-462c-8653-9db006d469fb tempest-VolumesGetTest-2122974047 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e33a67dc-5c0e-4c0b-8e08-93658a3ac43a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:45:22 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-a3b4c755-ff3f-462c-8653-9db006d469fb tempest-VolumesGetTest-2122974047 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e33a67dc-5c0e-4c0b-8e08-93658a3ac43a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:45:22 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-a3b4c755-ff3f-462c-8653-9db006d469fb tempest-VolumesGetTest-2122974047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5514e112-e9d9-4a63-ac88-eaac2ea2e8a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:45:22 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-a3b4c755-ff3f-462c-8653-9db006d469fb tempest-VolumesGetTest-2122974047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5514e112-e9d9-4a63-ac88-eaac2ea2e8a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a76322ba-08e1-4e26-93b9-c2066bb5e30b', 'volume_name': 'volume-a76322ba-08e1-4e26-93b9-c2066bb5e30b', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:45:22 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-a3b4c755-ff3f-462c-8653-9db006d469fb tempest-VolumesGetTest-2122974047 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc585dcd-c002-4025-90b0-4ad7fbcc65a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:45:22 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-a3b4c755-ff3f-462c-8653-9db006d469fb tempest-VolumesGetTest-2122974047 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc585dcd-c002-4025-90b0-4ad7fbcc65a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:45:22 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-a3b4c755-ff3f-462c-8653-9db006d469fb tempest-VolumesGetTest-2122974047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (834441c9-046f-436d-af7b-afe270d495ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:45:22 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-a3b4c755-ff3f-462c-8653-9db006d469fb tempest-VolumesGetTest-2122974047 None] Volume a76322ba-08e1-4e26-93b9-c2066bb5e30b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a76322ba-08e1-4e26-93b9-c2066bb5e30b', 'volume_size': 1} Sep 22 15:45:22 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-a3b4c755-ff3f-462c-8653-9db006d469fb tempest-VolumesGetTest-2122974047 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:45:23 devstack sudo[95772]: pam_unix(sudo:session): session closed for user root Sep 22 15:45:23 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-aa4b6f72-bffa-4e6a-98cc-a27cfed31220 tempest-VolumesTestJSON-265954310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-3da36e20-ef6f-469d-b489-10abecba2fe1 1073741824" returned: 0 in 0.437s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:45:23 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-aa4b6f72-bffa-4e6a-98cc-a27cfed31220 tempest-VolumesTestJSON-265954310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-3da36e20-ef6f-469d-b489-10abecba2fe1 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:45:23 devstack sudo[95778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-3da36e20-ef6f-469d-b489-10abecba2fe1 Sep 22 15:45:23 devstack sudo[95778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:45:23 devstack sudo[95778]: pam_unix(sudo:session): session closed for user root Sep 22 15:45:23 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-aa4b6f72-bffa-4e6a-98cc-a27cfed31220 tempest-VolumesTestJSON-265954310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-3da36e20-ef6f-469d-b489-10abecba2fe1" returned: 0 in 0.236s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:45:23 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-aa4b6f72-bffa-4e6a-98cc-a27cfed31220 tempest-VolumesTestJSON-265954310 None] <== create_volume: return (717ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'} {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 15:45:23 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-aa4b6f72-bffa-4e6a-98cc-a27cfed31220 tempest-VolumesTestJSON-265954310 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.720s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:45:23 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-d4320678-1b7d-4be2-9f1a-413bb1fdd13e tempest-VolumeRetypeWithoutMigrationTest-288079674 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.621s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:45:23 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-d4320678-1b7d-4be2-9f1a-413bb1fdd13e tempest-VolumeRetypeWithoutMigrationTest-288079674 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:45:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-2122396351',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c947011-8d53-45ab-8347-db10ce012f31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86b66f753aa848b281589e5a440ca6a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:45:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:45:22Z,use_quota=True,user_id='040d1713da4948298a57903bfc2faa8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(798ab2d2-8641-4bc3-bd96-a2aef16d0681),volume_type_id=798ab2d2-8641-4bc3-bd96-a2aef16d0681)}" {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 15:45:23 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-d4320678-1b7d-4be2-9f1a-413bb1fdd13e tempest-VolumeRetypeWithoutMigrationTest-288079674 None] Creating volume 9c947011-8d53-45ab-8347-db10ce012f31 {{(pid=86212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 15:45:23 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-d4320678-1b7d-4be2-9f1a-413bb1fdd13e tempest-VolumeRetypeWithoutMigrationTest-288079674 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:45:23 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-d4320678-1b7d-4be2-9f1a-413bb1fdd13e tempest-VolumeRetypeWithoutMigrationTest-288079674 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:45:23 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-d4320678-1b7d-4be2-9f1a-413bb1fdd13e tempest-VolumeRetypeWithoutMigrationTest-288079674 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:45:23 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-d4320678-1b7d-4be2-9f1a-413bb1fdd13e tempest-VolumeRetypeWithoutMigrationTest-288079674 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:45:23 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-d4320678-1b7d-4be2-9f1a-413bb1fdd13e tempest-VolumeRetypeWithoutMigrationTest-288079674 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:45:23 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-d4320678-1b7d-4be2-9f1a-413bb1fdd13e tempest-VolumeRetypeWithoutMigrationTest-288079674 None] Selected osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 as target Quobyte volume. {{(pid=86212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 15:45:23 devstack cinder-volume[86212]: INFO cinder.volume.drivers.remotefs [None req-d4320678-1b7d-4be2-9f1a-413bb1fdd13e tempest-VolumeRetypeWithoutMigrationTest-288079674 None] casted to osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 Sep 22 15:45:23 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-d4320678-1b7d-4be2-9f1a-413bb1fdd13e tempest-VolumeRetypeWithoutMigrationTest-288079674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-9c947011-8d53-45ab-8347-db10ce012f31 1073741824 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:45:23 devstack sudo[95781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-9c947011-8d53-45ab-8347-db10ce012f31 1073741824 Sep 22 15:45:23 devstack sudo[95781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:45:23 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-aa4b6f72-bffa-4e6a-98cc-a27cfed31220 tempest-VolumesTestJSON-265954310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2149fa7c-e388-4e9f-ac0a-a087bc83d174) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3da36e20-ef6f-469d-b489-10abecba2fe1', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:45:23 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-aa4b6f72-bffa-4e6a-98cc-a27cfed31220 tempest-VolumesTestJSON-265954310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2bc305a7-c7ae-4dc7-b94d-a0b0d5ecae88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:45:23 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-aa4b6f72-bffa-4e6a-98cc-a27cfed31220 tempest-VolumesTestJSON-265954310 None] Volume volume-3da36e20-ef6f-469d-b489-10abecba2fe1 (3da36e20-ef6f-469d-b489-10abecba2fe1): created successfully Sep 22 15:45:23 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-aa4b6f72-bffa-4e6a-98cc-a27cfed31220 tempest-VolumesTestJSON-265954310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2bc305a7-c7ae-4dc7-b94d-a0b0d5ecae88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:45:23 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-aa4b6f72-bffa-4e6a-98cc-a27cfed31220 tempest-VolumesTestJSON-265954310 None] Flow 'volume_create_manager' (a661c6cd-f0c4-45c4-891e-61ef81108e27) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:45:23 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-aa4b6f72-bffa-4e6a-98cc-a27cfed31220 tempest-VolumesTestJSON-265954310 None] Created volume successfully. Sep 22 15:45:23 devstack sudo[95781]: pam_unix(sudo:session): session closed for user root Sep 22 15:45:23 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-d4320678-1b7d-4be2-9f1a-413bb1fdd13e tempest-VolumeRetypeWithoutMigrationTest-288079674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-9c947011-8d53-45ab-8347-db10ce012f31 1073741824" returned: 0 in 0.513s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:45:23 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-d4320678-1b7d-4be2-9f1a-413bb1fdd13e tempest-VolumeRetypeWithoutMigrationTest-288079674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-9c947011-8d53-45ab-8347-db10ce012f31 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:45:23 devstack sudo[95787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-9c947011-8d53-45ab-8347-db10ce012f31 Sep 22 15:45:23 devstack sudo[95787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:45:24 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-12a85683-440a-4c48-829f-b7f9a4819feb tempest-GroupSnapshotsTest-1556879145 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:45:24 devstack sudo[95787]: pam_unix(sudo:session): session closed for user root Sep 22 15:45:24 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-d4320678-1b7d-4be2-9f1a-413bb1fdd13e tempest-VolumeRetypeWithoutMigrationTest-288079674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-9c947011-8d53-45ab-8347-db10ce012f31" returned: 0 in 0.300s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:45:24 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-d4320678-1b7d-4be2-9f1a-413bb1fdd13e tempest-VolumeRetypeWithoutMigrationTest-288079674 None] <== create_volume: return (855ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'} {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 15:45:24 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-d4320678-1b7d-4be2-9f1a-413bb1fdd13e tempest-VolumeRetypeWithoutMigrationTest-288079674 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.858s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:45:24 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-a3b4c755-ff3f-462c-8653-9db006d469fb tempest-VolumesGetTest-2122974047 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.324s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:45:24 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-a3b4c755-ff3f-462c-8653-9db006d469fb tempest-VolumesGetTest-2122974047 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:45:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1618533591',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a76322ba-08e1-4e26-93b9-c2066bb5e30b,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='4ab605a12e704f698a0a4b7beeffe43f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:45:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:45:23Z,use_quota=True,user_id='a0b6cabdecf14f80b25b912b51474b36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)}" {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 15:45:24 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-a3b4c755-ff3f-462c-8653-9db006d469fb tempest-VolumesGetTest-2122974047 None] Creating volume a76322ba-08e1-4e26-93b9-c2066bb5e30b {{(pid=86212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 15:45:24 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-a3b4c755-ff3f-462c-8653-9db006d469fb tempest-VolumesGetTest-2122974047 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:45:24 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-a3b4c755-ff3f-462c-8653-9db006d469fb tempest-VolumesGetTest-2122974047 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:45:24 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-a3b4c755-ff3f-462c-8653-9db006d469fb tempest-VolumesGetTest-2122974047 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:45:24 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-a3b4c755-ff3f-462c-8653-9db006d469fb tempest-VolumesGetTest-2122974047 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:45:24 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-a3b4c755-ff3f-462c-8653-9db006d469fb tempest-VolumesGetTest-2122974047 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:45:24 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-a3b4c755-ff3f-462c-8653-9db006d469fb tempest-VolumesGetTest-2122974047 None] Selected osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 as target Quobyte volume. {{(pid=86212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 15:45:24 devstack cinder-volume[86212]: INFO cinder.volume.drivers.remotefs [None req-a3b4c755-ff3f-462c-8653-9db006d469fb tempest-VolumesGetTest-2122974047 None] casted to osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 Sep 22 15:45:24 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-a3b4c755-ff3f-462c-8653-9db006d469fb tempest-VolumesGetTest-2122974047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a76322ba-08e1-4e26-93b9-c2066bb5e30b 1073741824 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:45:24 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-d4320678-1b7d-4be2-9f1a-413bb1fdd13e tempest-VolumeRetypeWithoutMigrationTest-288079674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (745f2606-a979-4ab0-af7c-b74bf741dd33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c947011-8d53-45ab-8347-db10ce012f31', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:45:24 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-d4320678-1b7d-4be2-9f1a-413bb1fdd13e tempest-VolumeRetypeWithoutMigrationTest-288079674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37dad6fb-1639-4fb3-a43a-b8ffe444f19b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:45:24 devstack sudo[95790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a76322ba-08e1-4e26-93b9-c2066bb5e30b 1073741824 Sep 22 15:45:24 devstack sudo[95790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:45:24 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-d4320678-1b7d-4be2-9f1a-413bb1fdd13e tempest-VolumeRetypeWithoutMigrationTest-288079674 None] Volume volume-9c947011-8d53-45ab-8347-db10ce012f31 (9c947011-8d53-45ab-8347-db10ce012f31): created successfully Sep 22 15:45:24 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-d4320678-1b7d-4be2-9f1a-413bb1fdd13e tempest-VolumeRetypeWithoutMigrationTest-288079674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37dad6fb-1639-4fb3-a43a-b8ffe444f19b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:45:24 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-d4320678-1b7d-4be2-9f1a-413bb1fdd13e tempest-VolumeRetypeWithoutMigrationTest-288079674 None] Flow 'volume_create_manager' (ede6ca2e-048b-4266-84c6-99b74f2dfbc1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:45:24 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-d4320678-1b7d-4be2-9f1a-413bb1fdd13e tempest-VolumeRetypeWithoutMigrationTest-288079674 None] Created volume successfully. Sep 22 15:45:24 devstack cinder-volume[86212]: DEBUG cinder.volume.flows.manager.create_volume [None req-031fe822-caee-4e0b-9a76-bc8c20d78130 tempest-VolumesTestJSON-265954310 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 15:45:24 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-031fe822-caee-4e0b-9a76-bc8c20d78130 tempest-VolumesTestJSON-265954310 None] Flow 'volume_create_manager' (02625858-9a18-461b-b5a1-4c1bb8b269bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:45:24 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-031fe822-caee-4e0b-9a76-bc8c20d78130 tempest-VolumesTestJSON-265954310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acd86b94-b53f-4575-8aaa-4a14945db87b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:45:24 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-031fe822-caee-4e0b-9a76-bc8c20d78130 tempest-VolumesTestJSON-265954310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acd86b94-b53f-4575-8aaa-4a14945db87b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:45:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-515511490',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2dbd691f-9670-4765-92a5-6ad9b21945b2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9046cfc5568c4655bed3294b24b483f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:45:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:45:25Z,use_quota=True,user_id='54a85f80aae8477f85ef87756e75ecb4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:45:24 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-031fe822-caee-4e0b-9a76-bc8c20d78130 tempest-VolumesTestJSON-265954310 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (403f2ad8-a5c1-4283-bcab-fbc9e54f9adb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:45:24 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-031fe822-caee-4e0b-9a76-bc8c20d78130 tempest-VolumesTestJSON-265954310 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (403f2ad8-a5c1-4283-bcab-fbc9e54f9adb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:45:24 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-031fe822-caee-4e0b-9a76-bc8c20d78130 tempest-VolumesTestJSON-265954310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86ade798-10e0-458c-8c6d-0d9f7acfce98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:45:24 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-031fe822-caee-4e0b-9a76-bc8c20d78130 tempest-VolumesTestJSON-265954310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86ade798-10e0-458c-8c6d-0d9f7acfce98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2dbd691f-9670-4765-92a5-6ad9b21945b2', 'volume_name': 'volume-2dbd691f-9670-4765-92a5-6ad9b21945b2', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:45:24 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-031fe822-caee-4e0b-9a76-bc8c20d78130 tempest-VolumesTestJSON-265954310 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44c0634e-6e4e-4475-bcd5-4b148959115b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:45:24 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-031fe822-caee-4e0b-9a76-bc8c20d78130 tempest-VolumesTestJSON-265954310 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44c0634e-6e4e-4475-bcd5-4b148959115b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:45:24 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-031fe822-caee-4e0b-9a76-bc8c20d78130 tempest-VolumesTestJSON-265954310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c881269-476b-47f4-aa5c-fccfde8e57c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:45:24 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-031fe822-caee-4e0b-9a76-bc8c20d78130 tempest-VolumesTestJSON-265954310 None] Volume 2dbd691f-9670-4765-92a5-6ad9b21945b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2dbd691f-9670-4765-92a5-6ad9b21945b2', 'volume_size': 1} Sep 22 15:45:24 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-031fe822-caee-4e0b-9a76-bc8c20d78130 tempest-VolumesTestJSON-265954310 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:45:24 devstack sudo[95790]: pam_unix(sudo:session): session closed for user root Sep 22 15:45:24 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-a3b4c755-ff3f-462c-8653-9db006d469fb tempest-VolumesGetTest-2122974047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a76322ba-08e1-4e26-93b9-c2066bb5e30b 1073741824" returned: 0 in 0.568s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:45:24 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-a3b4c755-ff3f-462c-8653-9db006d469fb tempest-VolumesGetTest-2122974047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a76322ba-08e1-4e26-93b9-c2066bb5e30b {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:45:24 devstack sudo[95796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a76322ba-08e1-4e26-93b9-c2066bb5e30b Sep 22 15:45:24 devstack sudo[95796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:45:25 devstack sudo[95796]: pam_unix(sudo:session): session closed for user root Sep 22 15:45:25 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-a3b4c755-ff3f-462c-8653-9db006d469fb tempest-VolumesGetTest-2122974047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a76322ba-08e1-4e26-93b9-c2066bb5e30b" returned: 0 in 0.270s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:45:25 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-a3b4c755-ff3f-462c-8653-9db006d469fb tempest-VolumesGetTest-2122974047 None] <== create_volume: return (882ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'} {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 15:45:25 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-a3b4c755-ff3f-462c-8653-9db006d469fb tempest-VolumesGetTest-2122974047 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.884s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:45:25 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-12a85683-440a-4c48-829f-b7f9a4819feb tempest-GroupSnapshotsTest-1556879145 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.905s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:45:25 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-12a85683-440a-4c48-829f-b7f9a4819feb tempest-GroupSnapshotsTest-1556879145 None] Acquiring lock "cinder-quobyte-bfd18d29-3f4f-4b31-adbc-bea6e8472aae-5133ea6e-8fdb-4407-8dcf-b95a5f7bf37e" by "_create_volume_from_snapshot" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:45:25 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-a3b4c755-ff3f-462c-8653-9db006d469fb tempest-VolumesGetTest-2122974047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (834441c9-046f-436d-af7b-afe270d495ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a76322ba-08e1-4e26-93b9-c2066bb5e30b', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:45:25 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-a3b4c755-ff3f-462c-8653-9db006d469fb tempest-VolumesGetTest-2122974047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56a8ffa2-8dd9-42e5-a626-9ec7d1070b39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:45:25 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-12a85683-440a-4c48-829f-b7f9a4819feb tempest-GroupSnapshotsTest-1556879145 None] Lock "cinder-quobyte-bfd18d29-3f4f-4b31-adbc-bea6e8472aae-5133ea6e-8fdb-4407-8dcf-b95a5f7bf37e" acquired by "_create_volume_from_snapshot" :: waited 0.028s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:45:25 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-12a85683-440a-4c48-829f-b7f9a4819feb tempest-GroupSnapshotsTest-1556879145 None] Creating volume 5133ea6e-8fdb-4407-8dcf-b95a5f7bf37e from snapshot bfd18d29-3f4f-4b31-adbc-bea6e8472aae {{(pid=86212) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 22 15:45:25 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-12a85683-440a-4c48-829f-b7f9a4819feb tempest-GroupSnapshotsTest-1556879145 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:45:25 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-12a85683-440a-4c48-829f-b7f9a4819feb tempest-GroupSnapshotsTest-1556879145 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:45:25 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-12a85683-440a-4c48-829f-b7f9a4819feb tempest-GroupSnapshotsTest-1556879145 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:45:25 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-12a85683-440a-4c48-829f-b7f9a4819feb tempest-GroupSnapshotsTest-1556879145 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:45:25 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-12a85683-440a-4c48-829f-b7f9a4819feb tempest-GroupSnapshotsTest-1556879145 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:45:25 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-12a85683-440a-4c48-829f-b7f9a4819feb tempest-GroupSnapshotsTest-1556879145 None] Selected osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 as target Quobyte volume. {{(pid=86212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 15:45:25 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-12a85683-440a-4c48-829f-b7f9a4819feb tempest-GroupSnapshotsTest-1556879145 None] Acquiring lock "cinder-quobyte-5133ea6e-8fdb-4407-8dcf-b95a5f7bf37e" by "_copy_volume_from_snapshot" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:45:25 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-a3b4c755-ff3f-462c-8653-9db006d469fb tempest-VolumesGetTest-2122974047 None] Volume volume-a76322ba-08e1-4e26-93b9-c2066bb5e30b (a76322ba-08e1-4e26-93b9-c2066bb5e30b): created successfully Sep 22 15:45:25 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-a3b4c755-ff3f-462c-8653-9db006d469fb tempest-VolumesGetTest-2122974047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56a8ffa2-8dd9-42e5-a626-9ec7d1070b39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:45:25 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-a3b4c755-ff3f-462c-8653-9db006d469fb tempest-VolumesGetTest-2122974047 None] Flow 'volume_create_manager' (e6b43f1e-60ce-4dba-ac3d-a001fe195a73) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:45:25 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-12a85683-440a-4c48-829f-b7f9a4819feb tempest-GroupSnapshotsTest-1556879145 None] Lock "cinder-quobyte-5133ea6e-8fdb-4407-8dcf-b95a5f7bf37e" acquired by "_copy_volume_from_snapshot" :: waited 0.032s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:45:25 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-12a85683-440a-4c48-829f-b7f9a4819feb tempest-GroupSnapshotsTest-1556879145 None] snapshot: bfd18d29-3f4f-4b31-adbc-bea6e8472aae, volume: 5133ea6e-8fdb-4407-8dcf-b95a5f7bf37e, {{(pid=86212) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 22 15:45:25 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-12a85683-440a-4c48-829f-b7f9a4819feb tempest-GroupSnapshotsTest-1556879145 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:45:25 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-12a85683-440a-4c48-829f-b7f9a4819feb tempest-GroupSnapshotsTest-1556879145 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:45:25 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-12a85683-440a-4c48-829f-b7f9a4819feb tempest-GroupSnapshotsTest-1556879145 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:45:25 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-12a85683-440a-4c48-829f-b7f9a4819feb tempest-GroupSnapshotsTest-1556879145 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:45:25 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-12a85683-440a-4c48-829f-b7f9a4819feb tempest-GroupSnapshotsTest-1556879145 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:45:25 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-a3b4c755-ff3f-462c-8653-9db006d469fb tempest-VolumesGetTest-2122974047 None] Created volume successfully. Sep 22 15:45:25 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe0547d4-8a88-4cf7-9128-1e749ca09d63]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:45:25 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-12a85683-440a-4c48-829f-b7f9a4819feb tempest-GroupSnapshotsTest-1556879145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-bee4048f-1513-4df1-9a52-9fb5eb25918d.bfd18d29-3f4f-4b31-adbc-bea6e8472aae {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:45:25 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-74c90265-bbb6-4f28-9c1b-95f61cab9b9a tempest-VolumeRetypeWithoutMigrationTest-288079674 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:45:25 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-74c90265-bbb6-4f28-9c1b-95f61cab9b9a tempest-VolumeRetypeWithoutMigrationTest-288079674 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:45:25 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-74c90265-bbb6-4f28-9c1b-95f61cab9b9a tempest-VolumeRetypeWithoutMigrationTest-288079674 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:45:25 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-74c90265-bbb6-4f28-9c1b-95f61cab9b9a tempest-VolumeRetypeWithoutMigrationTest-288079674 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:45:25 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-74c90265-bbb6-4f28-9c1b-95f61cab9b9a tempest-VolumeRetypeWithoutMigrationTest-288079674 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:45:25 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-74c90265-bbb6-4f28-9c1b-95f61cab9b9a tempest-VolumeRetypeWithoutMigrationTest-288079674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:45:25 devstack sudo[95802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc Sep 22 15:45:25 devstack sudo[95802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:45:25 devstack sudo[95801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-bee4048f-1513-4df1-9a52-9fb5eb25918d.bfd18d29-3f4f-4b31-adbc-bea6e8472aae Sep 22 15:45:25 devstack sudo[95801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:45:25 devstack sudo[95802]: pam_unix(sudo:session): session closed for user root Sep 22 15:45:25 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-74c90265-bbb6-4f28-9c1b-95f61cab9b9a tempest-VolumeRetypeWithoutMigrationTest-288079674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc" returned: 0 in 0.258s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:45:25 devstack cinder-volume[86212]: DEBUG cinder.manager [None req-74c90265-bbb6-4f28-9c1b-95f61cab9b9a tempest-VolumeRetypeWithoutMigrationTest-288079674 None] Notifying Schedulers of capabilities ... {{(pid=86212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 15:45:25 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-74c90265-bbb6-4f28-9c1b-95f61cab9b9a tempest-VolumeRetypeWithoutMigrationTest-288079674 None] Retype volume completed successfully. Sep 22 15:45:25 devstack sudo[95801]: pam_unix(sudo:session): session closed for user root Sep 22 15:45:25 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-12a85683-440a-4c48-829f-b7f9a4819feb tempest-GroupSnapshotsTest-1556879145 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-bee4048f-1513-4df1-9a52-9fb5eb25918d.bfd18d29-3f4f-4b31-adbc-bea6e8472aae" returned: 0 in 0.404s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:45:25 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-12a85683-440a-4c48-829f-b7f9a4819feb tempest-GroupSnapshotsTest-1556879145 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bee4048f-1513-4df1-9a52-9fb5eb25918d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86212) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 22 15:45:25 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b22ed63-20ae-41ac-9f59-e83e84c663c5]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:45:25 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-12a85683-440a-4c48-829f-b7f9a4819feb tempest-GroupSnapshotsTest-1556879145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-bee4048f-1513-4df1-9a52-9fb5eb25918d {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:45:25 devstack sudo[95809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-bee4048f-1513-4df1-9a52-9fb5eb25918d Sep 22 15:45:25 devstack sudo[95809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:45:26 devstack sudo[95809]: pam_unix(sudo:session): session closed for user root Sep 22 15:45:26 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-12a85683-440a-4c48-829f-b7f9a4819feb tempest-GroupSnapshotsTest-1556879145 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-bee4048f-1513-4df1-9a52-9fb5eb25918d" returned: 0 in 0.369s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:45:26 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-12a85683-440a-4c48-829f-b7f9a4819feb tempest-GroupSnapshotsTest-1556879145 None] will copy from snapshot at /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-bee4048f-1513-4df1-9a52-9fb5eb25918d {{(pid=86212) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 22 15:45:26 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-12a85683-440a-4c48-829f-b7f9a4819feb tempest-GroupSnapshotsTest-1556879145 None] Creating direct copy from snapshot {{(pid=86212) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 22 15:45:26 devstack cinder-volume[86212]: DEBUG cinder.utils [None req-12a85683-440a-4c48-829f-b7f9a4819feb tempest-GroupSnapshotsTest-1556879145 None] Path /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-5133ea6e-8fdb-4407-8dcf-b95a5f7bf37e not found in is_blk_device check {{(pid=86212) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 22 15:45:26 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-12a85683-440a-4c48-829f-b7f9a4819feb tempest-GroupSnapshotsTest-1556879145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-bee4048f-1513-4df1-9a52-9fb5eb25918d /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-5133ea6e-8fdb-4407-8dcf-b95a5f7bf37e {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:45:26 devstack sudo[95815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-bee4048f-1513-4df1-9a52-9fb5eb25918d /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-5133ea6e-8fdb-4407-8dcf-b95a5f7bf37e Sep 22 15:45:26 devstack sudo[95815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:45:26 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-940359f3-e069-460e-a31e-260823e6cc38 tempest-VolumeRetypeWithoutMigrationTest-288079674 None] Acquiring lock "cinder-9c947011-8d53-45ab-8347-db10ce012f31-delete_volume" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:45:26 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-940359f3-e069-460e-a31e-260823e6cc38 tempest-VolumeRetypeWithoutMigrationTest-288079674 None] Lock "cinder-9c947011-8d53-45ab-8347-db10ce012f31-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:45:26 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-940359f3-e069-460e-a31e-260823e6cc38 tempest-VolumeRetypeWithoutMigrationTest-288079674 None] Acquiring lock "cinder-quobyte-9c947011-8d53-45ab-8347-db10ce012f31" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:45:26 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-940359f3-e069-460e-a31e-260823e6cc38 tempest-VolumeRetypeWithoutMigrationTest-288079674 None] Lock "cinder-quobyte-9c947011-8d53-45ab-8347-db10ce012f31" acquired by "delete_volume" :: waited 0.037s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:45:26 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd0c6d3a-ec29-47be-b3d0-fcbb5a0aa940]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:45:26 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-940359f3-e069-460e-a31e-260823e6cc38 tempest-VolumeRetypeWithoutMigrationTest-288079674 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-9c947011-8d53-45ab-8347-db10ce012f31 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:45:26 devstack cinder-volume[86212]: DEBUG cinder.volume.flows.manager.create_volume [None req-e139b881-8a27-4b5d-b8ff-1c1f93632cb2 tempest-VolumesGetTest-2122974047 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 15:45:26 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-e139b881-8a27-4b5d-b8ff-1c1f93632cb2 tempest-VolumesGetTest-2122974047 None] Flow 'volume_create_manager' (ed8b19d1-0674-401f-8b60-5d3c4c9bcad0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:45:26 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-e139b881-8a27-4b5d-b8ff-1c1f93632cb2 tempest-VolumesGetTest-2122974047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f4adc2d-38b8-4a27-9d6c-ee540858e98a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:45:26 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-e139b881-8a27-4b5d-b8ff-1c1f93632cb2 tempest-VolumesGetTest-2122974047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f4adc2d-38b8-4a27-9d6c-ee540858e98a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:45:26Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-468733270',display_name='tempest-VolumesGetTest-Volume-2093930580',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99249bb0-e426-4f29-80e8-8963352cd5e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ab605a12e704f698a0a4b7beeffe43f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:45:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:45:27Z,use_quota=True,user_id='a0b6cabdecf14f80b25b912b51474b36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:45:27 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-e139b881-8a27-4b5d-b8ff-1c1f93632cb2 tempest-VolumesGetTest-2122974047 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a626c4a7-7d7a-4100-869b-18c47c3cf260) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:45:27 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-e139b881-8a27-4b5d-b8ff-1c1f93632cb2 tempest-VolumesGetTest-2122974047 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a626c4a7-7d7a-4100-869b-18c47c3cf260) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:45:27 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-e139b881-8a27-4b5d-b8ff-1c1f93632cb2 tempest-VolumesGetTest-2122974047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b6bdd89-ea70-4292-8491-22addba9756c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:45:27 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-e139b881-8a27-4b5d-b8ff-1c1f93632cb2 tempest-VolumesGetTest-2122974047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b6bdd89-ea70-4292-8491-22addba9756c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '99249bb0-e426-4f29-80e8-8963352cd5e5', 'volume_name': 'volume-99249bb0-e426-4f29-80e8-8963352cd5e5', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:45:27 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-e139b881-8a27-4b5d-b8ff-1c1f93632cb2 tempest-VolumesGetTest-2122974047 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f67dea34-f1f9-4571-ba15-a09fa3b54944) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:45:27 devstack sudo[95827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-9c947011-8d53-45ab-8347-db10ce012f31 Sep 22 15:45:27 devstack sudo[95827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:45:27 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-e139b881-8a27-4b5d-b8ff-1c1f93632cb2 tempest-VolumesGetTest-2122974047 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f67dea34-f1f9-4571-ba15-a09fa3b54944) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:45:27 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-e139b881-8a27-4b5d-b8ff-1c1f93632cb2 tempest-VolumesGetTest-2122974047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0a0d244-2f6e-45a4-87f2-f7a229a182da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:45:27 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-e139b881-8a27-4b5d-b8ff-1c1f93632cb2 tempest-VolumesGetTest-2122974047 None] Volume 99249bb0-e426-4f29-80e8-8963352cd5e5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-99249bb0-e426-4f29-80e8-8963352cd5e5', 'volume_size': 1} Sep 22 15:45:27 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-e139b881-8a27-4b5d-b8ff-1c1f93632cb2 tempest-VolumesGetTest-2122974047 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:45:27 devstack sudo[95827]: pam_unix(sudo:session): session closed for user root Sep 22 15:45:27 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-940359f3-e069-460e-a31e-260823e6cc38 tempest-VolumeRetypeWithoutMigrationTest-288079674 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-9c947011-8d53-45ab-8347-db10ce012f31" returned: 0 in 0.839s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:45:27 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-940359f3-e069-460e-a31e-260823e6cc38 tempest-VolumeRetypeWithoutMigrationTest-288079674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-9c947011-8d53-45ab-8347-db10ce012f31 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:45:27 devstack sudo[95834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-9c947011-8d53-45ab-8347-db10ce012f31 Sep 22 15:45:27 devstack sudo[95834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:45:28 devstack sudo[95834]: pam_unix(sudo:session): session closed for user root Sep 22 15:45:28 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-940359f3-e069-460e-a31e-260823e6cc38 tempest-VolumeRetypeWithoutMigrationTest-288079674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-9c947011-8d53-45ab-8347-db10ce012f31" returned: 0 in 0.557s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:45:28 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-940359f3-e069-460e-a31e-260823e6cc38 tempest-VolumeRetypeWithoutMigrationTest-288079674 None] Lock "cinder-quobyte-9c947011-8d53-45ab-8347-db10ce012f31" released by "delete_volume" :: held 1.523s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:45:28 devstack cinder-volume[86212]: WARNING cinder.quota [None req-940359f3-e069-460e-a31e-260823e6cc38 tempest-VolumeRetypeWithoutMigrationTest-288079674 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 22 15:45:28 devstack cinder-volume[86212]: WARNING cinder.quota [None req-940359f3-e069-460e-a31e-260823e6cc38 tempest-VolumeRetypeWithoutMigrationTest-288079674 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 22 15:45:28 devstack cinder-volume[86212]: DEBUG cinder.quota [None req-940359f3-e069-460e-a31e-260823e6cc38 tempest-VolumeRetypeWithoutMigrationTest-288079674 None] Created reservations ['63789635-1c0c-421b-a6d4-e2a187bd24f7', '3e68ad5b-8eb4-444b-9b02-f18e6cc66639', 'f1cd1fc4-8bcc-4292-a2a7-146e6df79a5b', 'f92bf4a2-c338-49fd-8946-bc36c7bcd9ac'] {{(pid=86212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 15:45:28 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-940359f3-e069-460e-a31e-260823e6cc38 tempest-VolumeRetypeWithoutMigrationTest-288079674 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:45:28 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-940359f3-e069-460e-a31e-260823e6cc38 tempest-VolumeRetypeWithoutMigrationTest-288079674 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:45:28 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-940359f3-e069-460e-a31e-260823e6cc38 tempest-VolumeRetypeWithoutMigrationTest-288079674 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:45:28 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-940359f3-e069-460e-a31e-260823e6cc38 tempest-VolumeRetypeWithoutMigrationTest-288079674 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:45:28 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-940359f3-e069-460e-a31e-260823e6cc38 tempest-VolumeRetypeWithoutMigrationTest-288079674 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:45:28 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-940359f3-e069-460e-a31e-260823e6cc38 tempest-VolumeRetypeWithoutMigrationTest-288079674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:45:28 devstack sudo[95837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc Sep 22 15:45:28 devstack sudo[95837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:45:28 devstack sudo[95837]: pam_unix(sudo:session): session closed for user root Sep 22 15:45:28 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-940359f3-e069-460e-a31e-260823e6cc38 tempest-VolumeRetypeWithoutMigrationTest-288079674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc" returned: 0 in 0.412s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:45:28 devstack cinder-volume[86212]: DEBUG cinder.manager [None req-940359f3-e069-460e-a31e-260823e6cc38 tempest-VolumeRetypeWithoutMigrationTest-288079674 None] Notifying Schedulers of capabilities ... {{(pid=86212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 15:45:28 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-940359f3-e069-460e-a31e-260823e6cc38 tempest-VolumeRetypeWithoutMigrationTest-288079674 None] Deleted volume successfully. Sep 22 15:45:28 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-940359f3-e069-460e-a31e-260823e6cc38 tempest-VolumeRetypeWithoutMigrationTest-288079674 None] Lock "cinder-9c947011-8d53-45ab-8347-db10ce012f31-delete_volume" released by "delete_volume" :: held 2.271s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:45:33 devstack sudo[95815]: pam_unix(sudo:session): session closed for user root Sep 22 15:45:33 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-12a85683-440a-4c48-829f-b7f9a4819feb tempest-GroupSnapshotsTest-1556879145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-bee4048f-1513-4df1-9a52-9fb5eb25918d /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-5133ea6e-8fdb-4407-8dcf-b95a5f7bf37e" returned: 0 in 7.565s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:45:33 devstack cinder-volume[86212]: DEBUG cinder.image.image_utils [None req-12a85683-440a-4c48-829f-b7f9a4819feb tempest-GroupSnapshotsTest-1556879145 None] Image conversion details: src /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-bee4048f-1513-4df1-9a52-9fb5eb25918d, size 1024.00 MB, duration 7.57 sec, destination /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-5133ea6e-8fdb-4407-8dcf-b95a5f7bf37e {{(pid=86212) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 22 15:45:33 devstack cinder-volume[86212]: INFO cinder.image.image_utils [None req-12a85683-440a-4c48-829f-b7f9a4819feb tempest-GroupSnapshotsTest-1556879145 None] Converted 1024.00 MB image at 135.34 MB/s Sep 22 15:45:33 devstack cinder-volume[86212]: WARNING cinder.volume.drivers.remotefs [None req-12a85683-440a-4c48-829f-b7f9a4819feb tempest-GroupSnapshotsTest-1556879145 None] /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-5133ea6e-8fdb-4407-8dcf-b95a5f7bf37e is being set with open permissions: ugo+rw: NotImplementedError Sep 22 15:45:33 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-12a85683-440a-4c48-829f-b7f9a4819feb tempest-GroupSnapshotsTest-1556879145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-5133ea6e-8fdb-4407-8dcf-b95a5f7bf37e {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:45:33 devstack sudo[95842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-5133ea6e-8fdb-4407-8dcf-b95a5f7bf37e Sep 22 15:45:33 devstack sudo[95842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:45:33 devstack sudo[95842]: pam_unix(sudo:session): session closed for user root Sep 22 15:45:33 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-12a85683-440a-4c48-829f-b7f9a4819feb tempest-GroupSnapshotsTest-1556879145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-5133ea6e-8fdb-4407-8dcf-b95a5f7bf37e" returned: 0 in 0.242s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:45:33 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-12a85683-440a-4c48-829f-b7f9a4819feb tempest-GroupSnapshotsTest-1556879145 None] Lock "cinder-quobyte-5133ea6e-8fdb-4407-8dcf-b95a5f7bf37e" released by "_copy_volume_from_snapshot" :: held 8.677s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:45:33 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-12a85683-440a-4c48-829f-b7f9a4819feb tempest-GroupSnapshotsTest-1556879145 None] Lock "cinder-quobyte-bfd18d29-3f4f-4b31-adbc-bea6e8472aae-5133ea6e-8fdb-4407-8dcf-b95a5f7bf37e" released by "_create_volume_from_snapshot" :: held 8.762s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:45:33 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-12a85683-440a-4c48-829f-b7f9a4819feb tempest-GroupSnapshotsTest-1556879145 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.792s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:45:33 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-031fe822-caee-4e0b-9a76-bc8c20d78130 tempest-VolumesTestJSON-265954310 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.145s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:45:33 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-031fe822-caee-4e0b-9a76-bc8c20d78130 tempest-VolumesTestJSON-265954310 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:45:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-515511490',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2dbd691f-9670-4765-92a5-6ad9b21945b2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9046cfc5568c4655bed3294b24b483f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:45:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:45:25Z,use_quota=True,user_id='54a85f80aae8477f85ef87756e75ecb4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)}" {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 15:45:33 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-031fe822-caee-4e0b-9a76-bc8c20d78130 tempest-VolumesTestJSON-265954310 None] Creating volume 2dbd691f-9670-4765-92a5-6ad9b21945b2 {{(pid=86212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 15:45:33 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-031fe822-caee-4e0b-9a76-bc8c20d78130 tempest-VolumesTestJSON-265954310 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:45:33 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-031fe822-caee-4e0b-9a76-bc8c20d78130 tempest-VolumesTestJSON-265954310 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:45:33 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-031fe822-caee-4e0b-9a76-bc8c20d78130 tempest-VolumesTestJSON-265954310 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:45:33 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-031fe822-caee-4e0b-9a76-bc8c20d78130 tempest-VolumesTestJSON-265954310 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:45:33 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-031fe822-caee-4e0b-9a76-bc8c20d78130 tempest-VolumesTestJSON-265954310 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:45:33 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-031fe822-caee-4e0b-9a76-bc8c20d78130 tempest-VolumesTestJSON-265954310 None] Selected osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 as target Quobyte volume. {{(pid=86212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 15:45:33 devstack cinder-volume[86212]: INFO cinder.volume.drivers.remotefs [None req-031fe822-caee-4e0b-9a76-bc8c20d78130 tempest-VolumesTestJSON-265954310 None] casted to osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 Sep 22 15:45:33 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-031fe822-caee-4e0b-9a76-bc8c20d78130 tempest-VolumesTestJSON-265954310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2dbd691f-9670-4765-92a5-6ad9b21945b2 1073741824 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:45:33 devstack sudo[95845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2dbd691f-9670-4765-92a5-6ad9b21945b2 1073741824 Sep 22 15:45:33 devstack sudo[95845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:45:34 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-12a85683-440a-4c48-829f-b7f9a4819feb tempest-GroupSnapshotsTest-1556879145 None] Create group from source-snapshot-8c7ecdc0-b1b5-4e64-8542-8c9384fed354 completed successfully. Sep 22 15:45:34 devstack sudo[95845]: pam_unix(sudo:session): session closed for user root Sep 22 15:45:34 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-031fe822-caee-4e0b-9a76-bc8c20d78130 tempest-VolumesTestJSON-265954310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2dbd691f-9670-4765-92a5-6ad9b21945b2 1073741824" returned: 0 in 0.468s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:45:34 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-031fe822-caee-4e0b-9a76-bc8c20d78130 tempest-VolumesTestJSON-265954310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2dbd691f-9670-4765-92a5-6ad9b21945b2 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:45:34 devstack sudo[95851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2dbd691f-9670-4765-92a5-6ad9b21945b2 Sep 22 15:45:34 devstack sudo[95851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:45:34 devstack sudo[95851]: pam_unix(sudo:session): session closed for user root Sep 22 15:45:34 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-031fe822-caee-4e0b-9a76-bc8c20d78130 tempest-VolumesTestJSON-265954310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2dbd691f-9670-4765-92a5-6ad9b21945b2" returned: 0 in 0.261s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:45:34 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-031fe822-caee-4e0b-9a76-bc8c20d78130 tempest-VolumesTestJSON-265954310 None] <== create_volume: return (774ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'} {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 15:45:34 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-031fe822-caee-4e0b-9a76-bc8c20d78130 tempest-VolumesTestJSON-265954310 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.777s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:45:34 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-e139b881-8a27-4b5d-b8ff-1c1f93632cb2 tempest-VolumesGetTest-2122974047 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.595s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:45:34 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-e139b881-8a27-4b5d-b8ff-1c1f93632cb2 tempest-VolumesGetTest-2122974047 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:45:26Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-468733270',display_name='tempest-VolumesGetTest-Volume-2093930580',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99249bb0-e426-4f29-80e8-8963352cd5e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ab605a12e704f698a0a4b7beeffe43f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:45:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:45:27Z,use_quota=True,user_id='a0b6cabdecf14f80b25b912b51474b36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)}" {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 15:45:34 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-e139b881-8a27-4b5d-b8ff-1c1f93632cb2 tempest-VolumesGetTest-2122974047 None] Creating volume 99249bb0-e426-4f29-80e8-8963352cd5e5 {{(pid=86212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 15:45:34 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-e139b881-8a27-4b5d-b8ff-1c1f93632cb2 tempest-VolumesGetTest-2122974047 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:45:34 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-e139b881-8a27-4b5d-b8ff-1c1f93632cb2 tempest-VolumesGetTest-2122974047 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:45:34 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-e139b881-8a27-4b5d-b8ff-1c1f93632cb2 tempest-VolumesGetTest-2122974047 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:45:34 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-e139b881-8a27-4b5d-b8ff-1c1f93632cb2 tempest-VolumesGetTest-2122974047 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:45:34 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-e139b881-8a27-4b5d-b8ff-1c1f93632cb2 tempest-VolumesGetTest-2122974047 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:45:34 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-e139b881-8a27-4b5d-b8ff-1c1f93632cb2 tempest-VolumesGetTest-2122974047 None] Selected osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 as target Quobyte volume. {{(pid=86212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 15:45:34 devstack cinder-volume[86212]: INFO cinder.volume.drivers.remotefs [None req-e139b881-8a27-4b5d-b8ff-1c1f93632cb2 tempest-VolumesGetTest-2122974047 None] casted to osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 Sep 22 15:45:34 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-e139b881-8a27-4b5d-b8ff-1c1f93632cb2 tempest-VolumesGetTest-2122974047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-99249bb0-e426-4f29-80e8-8963352cd5e5 1073741824 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:45:34 devstack sudo[95854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-99249bb0-e426-4f29-80e8-8963352cd5e5 1073741824 Sep 22 15:45:34 devstack sudo[95854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:45:34 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-031fe822-caee-4e0b-9a76-bc8c20d78130 tempest-VolumesTestJSON-265954310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c881269-476b-47f4-aa5c-fccfde8e57c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2dbd691f-9670-4765-92a5-6ad9b21945b2', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:45:34 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-031fe822-caee-4e0b-9a76-bc8c20d78130 tempest-VolumesTestJSON-265954310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5d44496-78d5-43f8-8ae6-887a3a6a41c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:45:34 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-031fe822-caee-4e0b-9a76-bc8c20d78130 tempest-VolumesTestJSON-265954310 None] Volume volume-2dbd691f-9670-4765-92a5-6ad9b21945b2 (2dbd691f-9670-4765-92a5-6ad9b21945b2): created successfully Sep 22 15:45:34 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-031fe822-caee-4e0b-9a76-bc8c20d78130 tempest-VolumesTestJSON-265954310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5d44496-78d5-43f8-8ae6-887a3a6a41c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:45:34 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-031fe822-caee-4e0b-9a76-bc8c20d78130 tempest-VolumesTestJSON-265954310 None] Flow 'volume_create_manager' (02625858-9a18-461b-b5a1-4c1bb8b269bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:45:34 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-031fe822-caee-4e0b-9a76-bc8c20d78130 tempest-VolumesTestJSON-265954310 None] Created volume successfully. Sep 22 15:45:35 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-c5f92811-acd7-49b2-aa7a-8c810c6b5237 tempest-GroupSnapshotsTest-1556879145 None] Acquiring lock "cinder-quobyte-5133ea6e-8fdb-4407-8dcf-b95a5f7bf37e" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:45:35 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-c5f92811-acd7-49b2-aa7a-8c810c6b5237 tempest-GroupSnapshotsTest-1556879145 None] Lock "cinder-quobyte-5133ea6e-8fdb-4407-8dcf-b95a5f7bf37e" acquired by "delete_volume" :: waited 0.021s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:45:35 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[e97a3a96-0443-4fe0-8454-2d765af4de22]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:45:35 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-c5f92811-acd7-49b2-aa7a-8c810c6b5237 tempest-GroupSnapshotsTest-1556879145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-5133ea6e-8fdb-4407-8dcf-b95a5f7bf37e {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:45:35 devstack sudo[95854]: pam_unix(sudo:session): session closed for user root Sep 22 15:45:35 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-e139b881-8a27-4b5d-b8ff-1c1f93632cb2 tempest-VolumesGetTest-2122974047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-99249bb0-e426-4f29-80e8-8963352cd5e5 1073741824" returned: 0 in 0.539s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:45:35 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-e139b881-8a27-4b5d-b8ff-1c1f93632cb2 tempest-VolumesGetTest-2122974047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-99249bb0-e426-4f29-80e8-8963352cd5e5 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:45:35 devstack sudo[95861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-99249bb0-e426-4f29-80e8-8963352cd5e5 Sep 22 15:45:35 devstack sudo[95861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:45:35 devstack sudo[95860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-5133ea6e-8fdb-4407-8dcf-b95a5f7bf37e Sep 22 15:45:35 devstack sudo[95860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:45:35 devstack sudo[95861]: pam_unix(sudo:session): session closed for user root Sep 22 15:45:35 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-e139b881-8a27-4b5d-b8ff-1c1f93632cb2 tempest-VolumesGetTest-2122974047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-99249bb0-e426-4f29-80e8-8963352cd5e5" returned: 0 in 0.314s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:45:35 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-e139b881-8a27-4b5d-b8ff-1c1f93632cb2 tempest-VolumesGetTest-2122974047 None] <== create_volume: return (926ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'} {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 15:45:35 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-e139b881-8a27-4b5d-b8ff-1c1f93632cb2 tempest-VolumesGetTest-2122974047 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.931s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:45:35 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-e139b881-8a27-4b5d-b8ff-1c1f93632cb2 tempest-VolumesGetTest-2122974047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0a0d244-2f6e-45a4-87f2-f7a229a182da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-99249bb0-e426-4f29-80e8-8963352cd5e5', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:45:35 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-e139b881-8a27-4b5d-b8ff-1c1f93632cb2 tempest-VolumesGetTest-2122974047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bdc931c0-c063-47f1-9c0e-b45af111ccc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:45:35 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-e139b881-8a27-4b5d-b8ff-1c1f93632cb2 tempest-VolumesGetTest-2122974047 None] Volume volume-99249bb0-e426-4f29-80e8-8963352cd5e5 (99249bb0-e426-4f29-80e8-8963352cd5e5): created successfully Sep 22 15:45:35 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-e139b881-8a27-4b5d-b8ff-1c1f93632cb2 tempest-VolumesGetTest-2122974047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bdc931c0-c063-47f1-9c0e-b45af111ccc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:45:35 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-e139b881-8a27-4b5d-b8ff-1c1f93632cb2 tempest-VolumesGetTest-2122974047 None] Flow 'volume_create_manager' (ed8b19d1-0674-401f-8b60-5d3c4c9bcad0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:45:35 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-e139b881-8a27-4b5d-b8ff-1c1f93632cb2 tempest-VolumesGetTest-2122974047 None] Created volume successfully. Sep 22 15:45:35 devstack sudo[95860]: pam_unix(sudo:session): session closed for user root Sep 22 15:45:35 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-c5f92811-acd7-49b2-aa7a-8c810c6b5237 tempest-GroupSnapshotsTest-1556879145 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-5133ea6e-8fdb-4407-8dcf-b95a5f7bf37e" returned: 0 in 0.533s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:45:35 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-c5f92811-acd7-49b2-aa7a-8c810c6b5237 tempest-GroupSnapshotsTest-1556879145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-5133ea6e-8fdb-4407-8dcf-b95a5f7bf37e {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:45:35 devstack sudo[95902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-5133ea6e-8fdb-4407-8dcf-b95a5f7bf37e Sep 22 15:45:35 devstack sudo[95902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:45:36 devstack sudo[95902]: pam_unix(sudo:session): session closed for user root Sep 22 15:45:36 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-c5f92811-acd7-49b2-aa7a-8c810c6b5237 tempest-GroupSnapshotsTest-1556879145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-5133ea6e-8fdb-4407-8dcf-b95a5f7bf37e" returned: 0 in 0.338s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:45:36 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-c5f92811-acd7-49b2-aa7a-8c810c6b5237 tempest-GroupSnapshotsTest-1556879145 None] Lock "cinder-quobyte-5133ea6e-8fdb-4407-8dcf-b95a5f7bf37e" released by "delete_volume" :: held 0.938s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:45:36 devstack cinder-volume[86212]: DEBUG cinder.quota [None req-c5f92811-acd7-49b2-aa7a-8c810c6b5237 tempest-GroupSnapshotsTest-1556879145 None] Created reservations ['02763df2-6512-4ca4-b24f-fc505dfb632c'] {{(pid=86212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 15:45:36 devstack cinder-volume[86212]: WARNING cinder.quota [None req-c5f92811-acd7-49b2-aa7a-8c810c6b5237 tempest-GroupSnapshotsTest-1556879145 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-462490672 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-462490672, it is now deprecated. Please use the default quota class for default quota. Sep 22 15:45:36 devstack cinder-volume[86212]: WARNING cinder.quota [None req-c5f92811-acd7-49b2-aa7a-8c810c6b5237 tempest-GroupSnapshotsTest-1556879145 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-462490672 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-462490672, it is now deprecated. Please use the default quota class for default quota. Sep 22 15:45:36 devstack cinder-volume[86212]: DEBUG cinder.quota [None req-c5f92811-acd7-49b2-aa7a-8c810c6b5237 tempest-GroupSnapshotsTest-1556879145 None] Created reservations ['025e97cb-fd80-4afc-8811-abed8717fe83', '3ae02edf-7c4d-4900-a8ed-23189ae86a3b', '09eed094-4fbe-4ca2-9ed9-33df509d1562', 'ed38577f-d87a-41a1-89fb-4fe3612c6cbb'] {{(pid=86212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 15:45:36 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-c5f92811-acd7-49b2-aa7a-8c810c6b5237 tempest-GroupSnapshotsTest-1556879145 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:45:36 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-c5f92811-acd7-49b2-aa7a-8c810c6b5237 tempest-GroupSnapshotsTest-1556879145 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:45:36 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-c5f92811-acd7-49b2-aa7a-8c810c6b5237 tempest-GroupSnapshotsTest-1556879145 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:45:36 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-c5f92811-acd7-49b2-aa7a-8c810c6b5237 tempest-GroupSnapshotsTest-1556879145 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:45:36 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-c5f92811-acd7-49b2-aa7a-8c810c6b5237 tempest-GroupSnapshotsTest-1556879145 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:45:36 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-c5f92811-acd7-49b2-aa7a-8c810c6b5237 tempest-GroupSnapshotsTest-1556879145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:45:36 devstack sudo[95909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc Sep 22 15:45:36 devstack sudo[95909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:45:36 devstack cinder-volume[86212]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c7da2a2-6852-4d0c-bc13-412fec62886a tempest-VolumesTestJSON-265954310 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 15:45:36 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-6c7da2a2-6852-4d0c-bc13-412fec62886a tempest-VolumesTestJSON-265954310 None] Flow 'volume_create_manager' (8d8e730f-e7e2-456c-b0c7-046308fa7b02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:45:36 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-6c7da2a2-6852-4d0c-bc13-412fec62886a tempest-VolumesTestJSON-265954310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d811b0d9-83f3-47c9-8fa1-88bc4dde06d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:45:36 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-6c7da2a2-6852-4d0c-bc13-412fec62886a tempest-VolumesTestJSON-265954310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d811b0d9-83f3-47c9-8fa1-88bc4dde06d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:45:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-510959584',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b1e068a-86a7-4d4c-be1c-b8c0a74d2be3,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9046cfc5568c4655bed3294b24b483f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:45:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:45:36Z,use_quota=True,user_id='54a85f80aae8477f85ef87756e75ecb4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:45:36 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-6c7da2a2-6852-4d0c-bc13-412fec62886a tempest-VolumesTestJSON-265954310 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64936b13-65ca-4bc4-be9b-cd6966d641cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:45:36 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-6c7da2a2-6852-4d0c-bc13-412fec62886a tempest-VolumesTestJSON-265954310 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64936b13-65ca-4bc4-be9b-cd6966d641cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:45:36 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-6c7da2a2-6852-4d0c-bc13-412fec62886a tempest-VolumesTestJSON-265954310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce35299c-2a5d-49a7-a7bb-9d054e68a20e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:45:36 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-6c7da2a2-6852-4d0c-bc13-412fec62886a tempest-VolumesTestJSON-265954310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce35299c-2a5d-49a7-a7bb-9d054e68a20e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b1e068a-86a7-4d4c-be1c-b8c0a74d2be3', 'volume_name': 'volume-6b1e068a-86a7-4d4c-be1c-b8c0a74d2be3', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:45:36 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-6c7da2a2-6852-4d0c-bc13-412fec62886a tempest-VolumesTestJSON-265954310 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e736d5e3-44c0-4c26-9e67-e1f5d9563b3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:45:36 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-6c7da2a2-6852-4d0c-bc13-412fec62886a tempest-VolumesTestJSON-265954310 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e736d5e3-44c0-4c26-9e67-e1f5d9563b3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:45:36 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-6c7da2a2-6852-4d0c-bc13-412fec62886a tempest-VolumesTestJSON-265954310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4b11739-b783-41a6-be6e-31edcc29666d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:45:36 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-6c7da2a2-6852-4d0c-bc13-412fec62886a tempest-VolumesTestJSON-265954310 None] Volume 6b1e068a-86a7-4d4c-be1c-b8c0a74d2be3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b1e068a-86a7-4d4c-be1c-b8c0a74d2be3', 'volume_size': 1} Sep 22 15:45:36 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-6c7da2a2-6852-4d0c-bc13-412fec62886a tempest-VolumesTestJSON-265954310 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:45:36 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-6c7da2a2-6852-4d0c-bc13-412fec62886a tempest-VolumesTestJSON-265954310 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:45:36 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-6c7da2a2-6852-4d0c-bc13-412fec62886a tempest-VolumesTestJSON-265954310 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:45:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-510959584',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b1e068a-86a7-4d4c-be1c-b8c0a74d2be3,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9046cfc5568c4655bed3294b24b483f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:45:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:45:36Z,use_quota=True,user_id='54a85f80aae8477f85ef87756e75ecb4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)}" {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 15:45:36 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-6c7da2a2-6852-4d0c-bc13-412fec62886a tempest-VolumesTestJSON-265954310 None] Creating volume 6b1e068a-86a7-4d4c-be1c-b8c0a74d2be3 {{(pid=86212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 15:45:36 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-6c7da2a2-6852-4d0c-bc13-412fec62886a tempest-VolumesTestJSON-265954310 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:45:36 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-6c7da2a2-6852-4d0c-bc13-412fec62886a tempest-VolumesTestJSON-265954310 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:45:36 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-6c7da2a2-6852-4d0c-bc13-412fec62886a tempest-VolumesTestJSON-265954310 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:45:36 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-6c7da2a2-6852-4d0c-bc13-412fec62886a tempest-VolumesTestJSON-265954310 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:45:36 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-6c7da2a2-6852-4d0c-bc13-412fec62886a tempest-VolumesTestJSON-265954310 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:45:36 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-6c7da2a2-6852-4d0c-bc13-412fec62886a tempest-VolumesTestJSON-265954310 None] Selected osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 as target Quobyte volume. {{(pid=86212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 15:45:36 devstack cinder-volume[86212]: INFO cinder.volume.drivers.remotefs [None req-6c7da2a2-6852-4d0c-bc13-412fec62886a tempest-VolumesTestJSON-265954310 None] casted to osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 Sep 22 15:45:36 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-6c7da2a2-6852-4d0c-bc13-412fec62886a tempest-VolumesTestJSON-265954310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-6b1e068a-86a7-4d4c-be1c-b8c0a74d2be3 1073741824 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:45:36 devstack sudo[95911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-6b1e068a-86a7-4d4c-be1c-b8c0a74d2be3 1073741824 Sep 22 15:45:36 devstack sudo[95911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:45:36 devstack sudo[95909]: pam_unix(sudo:session): session closed for user root Sep 22 15:45:36 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-c5f92811-acd7-49b2-aa7a-8c810c6b5237 tempest-GroupSnapshotsTest-1556879145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc" returned: 0 in 0.290s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:45:36 devstack cinder-volume[86212]: DEBUG cinder.manager [None req-c5f92811-acd7-49b2-aa7a-8c810c6b5237 tempest-GroupSnapshotsTest-1556879145 None] Notifying Schedulers of capabilities ... {{(pid=86212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 15:45:36 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-c5f92811-acd7-49b2-aa7a-8c810c6b5237 tempest-GroupSnapshotsTest-1556879145 None] Delete group completed successfully. Sep 22 15:45:37 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-c7e87c6f-fcc6-4d75-851c-f3999459f410 tempest-VolumesGetTest-2122974047 None] Acquiring lock "cinder-99249bb0-e426-4f29-80e8-8963352cd5e5-delete_volume" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:45:37 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-c7e87c6f-fcc6-4d75-851c-f3999459f410 tempest-VolumesGetTest-2122974047 None] Lock "cinder-99249bb0-e426-4f29-80e8-8963352cd5e5-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:45:37 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-c7e87c6f-fcc6-4d75-851c-f3999459f410 tempest-VolumesGetTest-2122974047 None] Acquiring lock "cinder-quobyte-99249bb0-e426-4f29-80e8-8963352cd5e5" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:45:37 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-c7e87c6f-fcc6-4d75-851c-f3999459f410 tempest-VolumesGetTest-2122974047 None] Lock "cinder-quobyte-99249bb0-e426-4f29-80e8-8963352cd5e5" acquired by "delete_volume" :: waited 0.017s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:45:37 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[49541462-02a0-4f5c-a68b-51d373f02b09]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:45:37 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-c7e87c6f-fcc6-4d75-851c-f3999459f410 tempest-VolumesGetTest-2122974047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-99249bb0-e426-4f29-80e8-8963352cd5e5 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:45:37 devstack sudo[95911]: pam_unix(sudo:session): session closed for user root Sep 22 15:45:37 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-6c7da2a2-6852-4d0c-bc13-412fec62886a tempest-VolumesTestJSON-265954310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-6b1e068a-86a7-4d4c-be1c-b8c0a74d2be3 1073741824" returned: 0 in 0.549s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:45:37 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-6c7da2a2-6852-4d0c-bc13-412fec62886a tempest-VolumesTestJSON-265954310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-6b1e068a-86a7-4d4c-be1c-b8c0a74d2be3 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:45:37 devstack sudo[95917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-99249bb0-e426-4f29-80e8-8963352cd5e5 Sep 22 15:45:37 devstack sudo[95917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:45:37 devstack sudo[95918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-6b1e068a-86a7-4d4c-be1c-b8c0a74d2be3 Sep 22 15:45:37 devstack sudo[95918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:45:37 devstack sudo[95918]: pam_unix(sudo:session): session closed for user root Sep 22 15:45:37 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-6c7da2a2-6852-4d0c-bc13-412fec62886a tempest-VolumesTestJSON-265954310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-6b1e068a-86a7-4d4c-be1c-b8c0a74d2be3" returned: 0 in 0.311s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:45:37 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-6c7da2a2-6852-4d0c-bc13-412fec62886a tempest-VolumesTestJSON-265954310 None] <== create_volume: return (908ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'} {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 15:45:37 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-6c7da2a2-6852-4d0c-bc13-412fec62886a tempest-VolumesTestJSON-265954310 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.912s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:45:37 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-6c7da2a2-6852-4d0c-bc13-412fec62886a tempest-VolumesTestJSON-265954310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4b11739-b783-41a6-be6e-31edcc29666d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b1e068a-86a7-4d4c-be1c-b8c0a74d2be3', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:45:37 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-6c7da2a2-6852-4d0c-bc13-412fec62886a tempest-VolumesTestJSON-265954310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6adce788-1dd7-41c2-8d1e-b5a483ef08fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:45:37 devstack sudo[95917]: pam_unix(sudo:session): session closed for user root Sep 22 15:45:37 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-c7e87c6f-fcc6-4d75-851c-f3999459f410 tempest-VolumesGetTest-2122974047 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-99249bb0-e426-4f29-80e8-8963352cd5e5" returned: 0 in 0.483s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:45:37 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-c7e87c6f-fcc6-4d75-851c-f3999459f410 tempest-VolumesGetTest-2122974047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-99249bb0-e426-4f29-80e8-8963352cd5e5 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:45:37 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-6c7da2a2-6852-4d0c-bc13-412fec62886a tempest-VolumesTestJSON-265954310 None] Volume volume-6b1e068a-86a7-4d4c-be1c-b8c0a74d2be3 (6b1e068a-86a7-4d4c-be1c-b8c0a74d2be3): created successfully Sep 22 15:45:37 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-6c7da2a2-6852-4d0c-bc13-412fec62886a tempest-VolumesTestJSON-265954310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6adce788-1dd7-41c2-8d1e-b5a483ef08fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:45:37 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-6c7da2a2-6852-4d0c-bc13-412fec62886a tempest-VolumesTestJSON-265954310 None] Flow 'volume_create_manager' (8d8e730f-e7e2-456c-b0c7-046308fa7b02) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:45:37 devstack sudo[95926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-99249bb0-e426-4f29-80e8-8963352cd5e5 Sep 22 15:45:37 devstack sudo[95926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:45:37 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-261ce427-faa1-4cd7-b9b7-1714346a0eea tempest-GroupSnapshotsTest-1556879145 None] group_snapshot 8c7ecdc0-b1b5-4e64-8542-8c9384fed354: deleting Sep 22 15:45:37 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-6c7da2a2-6852-4d0c-bc13-412fec62886a tempest-VolumesTestJSON-265954310 None] Created volume successfully. Sep 22 15:45:37 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-261ce427-faa1-4cd7-b9b7-1714346a0eea tempest-GroupSnapshotsTest-1556879145 None] group_snapshot 8c7ecdc0-b1b5-4e64-8542-8c9384fed354: deleting {{(pid=86212) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 22 15:45:37 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-261ce427-faa1-4cd7-b9b7-1714346a0eea tempest-GroupSnapshotsTest-1556879145 None] Acquiring lock "cinder-quobyte-bee4048f-1513-4df1-9a52-9fb5eb25918d" by "delete_snapshot" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:45:37 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-261ce427-faa1-4cd7-b9b7-1714346a0eea tempest-GroupSnapshotsTest-1556879145 None] Lock "cinder-quobyte-bee4048f-1513-4df1-9a52-9fb5eb25918d" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:45:37 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-261ce427-faa1-4cd7-b9b7-1714346a0eea tempest-GroupSnapshotsTest-1556879145 None] Acquiring lock "cinder-quobyte-bfd18d29-3f4f-4b31-adbc-bea6e8472aae" by "_delete_snapshot" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:45:37 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-261ce427-faa1-4cd7-b9b7-1714346a0eea tempest-GroupSnapshotsTest-1556879145 None] Lock "cinder-quobyte-bfd18d29-3f4f-4b31-adbc-bea6e8472aae" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:45:37 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-261ce427-faa1-4cd7-b9b7-1714346a0eea tempest-GroupSnapshotsTest-1556879145 None] Deleting offline snapshot bfd18d29-3f4f-4b31-adbc-bea6e8472aae of volume bee4048f-1513-4df1-9a52-9fb5eb25918d {{(pid=86212) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 22 15:45:37 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-261ce427-faa1-4cd7-b9b7-1714346a0eea tempest-GroupSnapshotsTest-1556879145 None] snapshot_file for this snap is: volume-bee4048f-1513-4df1-9a52-9fb5eb25918d.bfd18d29-3f4f-4b31-adbc-bea6e8472aae {{(pid=86212) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 22 15:45:37 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[4830e2ce-bcc5-424b-93ad-ab607fb9a6c0]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:45:37 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-261ce427-faa1-4cd7-b9b7-1714346a0eea tempest-GroupSnapshotsTest-1556879145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-bee4048f-1513-4df1-9a52-9fb5eb25918d.bfd18d29-3f4f-4b31-adbc-bea6e8472aae {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:45:37 devstack sudo[95926]: pam_unix(sudo:session): session closed for user root Sep 22 15:45:37 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-c7e87c6f-fcc6-4d75-851c-f3999459f410 tempest-VolumesGetTest-2122974047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-99249bb0-e426-4f29-80e8-8963352cd5e5" returned: 0 in 0.325s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:45:37 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-c7e87c6f-fcc6-4d75-851c-f3999459f410 tempest-VolumesGetTest-2122974047 None] Lock "cinder-quobyte-99249bb0-e426-4f29-80e8-8963352cd5e5" released by "delete_volume" :: held 0.856s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:45:37 devstack sudo[95928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-bee4048f-1513-4df1-9a52-9fb5eb25918d.bfd18d29-3f4f-4b31-adbc-bea6e8472aae Sep 22 15:45:37 devstack sudo[95928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:45:38 devstack cinder-volume[86212]: DEBUG cinder.quota [None req-c7e87c6f-fcc6-4d75-851c-f3999459f410 tempest-VolumesGetTest-2122974047 None] Created reservations ['d8454179-6762-47b6-b4d3-bc6d5af5a7a5', 'f3d90e9c-25d6-435a-b697-ae85e733e6d2', '0e4332cd-67bb-4879-bc48-1658ec9a4226', '63dcc9f9-2d1d-4578-ad8f-6b8c827501a1'] {{(pid=86212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 15:45:38 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-c7e87c6f-fcc6-4d75-851c-f3999459f410 tempest-VolumesGetTest-2122974047 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:45:38 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-c7e87c6f-fcc6-4d75-851c-f3999459f410 tempest-VolumesGetTest-2122974047 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:45:38 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-c7e87c6f-fcc6-4d75-851c-f3999459f410 tempest-VolumesGetTest-2122974047 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:45:38 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-c7e87c6f-fcc6-4d75-851c-f3999459f410 tempest-VolumesGetTest-2122974047 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:45:38 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-c7e87c6f-fcc6-4d75-851c-f3999459f410 tempest-VolumesGetTest-2122974047 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:45:38 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-c7e87c6f-fcc6-4d75-851c-f3999459f410 tempest-VolumesGetTest-2122974047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:45:38 devstack sudo[95931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc Sep 22 15:45:38 devstack sudo[95931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:45:38 devstack sudo[95928]: pam_unix(sudo:session): session closed for user root Sep 22 15:45:38 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-261ce427-faa1-4cd7-b9b7-1714346a0eea tempest-GroupSnapshotsTest-1556879145 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-bee4048f-1513-4df1-9a52-9fb5eb25918d.bfd18d29-3f4f-4b31-adbc-bea6e8472aae" returned: 0 in 0.452s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:45:38 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-261ce427-faa1-4cd7-b9b7-1714346a0eea tempest-GroupSnapshotsTest-1556879145 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bee4048f-1513-4df1-9a52-9fb5eb25918d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86212) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 22 15:45:38 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-222b2c9b-e1a3-4e46-8a32-35349c52287d tempest-VolumesGetTest-2122974047 None] Acquiring lock "cinder-a76322ba-08e1-4e26-93b9-c2066bb5e30b-delete_volume" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:45:38 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c4d8dbc-013c-47b4-9ed6-fe55e8ce3f2a]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:45:38 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-261ce427-faa1-4cd7-b9b7-1714346a0eea tempest-GroupSnapshotsTest-1556879145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-bee4048f-1513-4df1-9a52-9fb5eb25918d {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:45:38 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-222b2c9b-e1a3-4e46-8a32-35349c52287d tempest-VolumesGetTest-2122974047 None] Lock "cinder-a76322ba-08e1-4e26-93b9-c2066bb5e30b-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:45:38 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-222b2c9b-e1a3-4e46-8a32-35349c52287d tempest-VolumesGetTest-2122974047 None] Acquiring lock "cinder-quobyte-a76322ba-08e1-4e26-93b9-c2066bb5e30b" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:45:38 devstack sudo[95931]: pam_unix(sudo:session): session closed for user root Sep 22 15:45:38 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-222b2c9b-e1a3-4e46-8a32-35349c52287d tempest-VolumesGetTest-2122974047 None] Lock "cinder-quobyte-a76322ba-08e1-4e26-93b9-c2066bb5e30b" acquired by "delete_volume" :: waited 0.020s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:45:38 devstack cinder-volume[86212]: DEBUG oslo_service.periodic_task [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86212) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 22 15:45:38 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:45:38 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:45:38 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:45:38 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:45:38 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:45:38 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:45:38 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[06480465-2b7e-4488-aeae-2c35b8237ef4]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:45:38 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-222b2c9b-e1a3-4e46-8a32-35349c52287d tempest-VolumesGetTest-2122974047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a76322ba-08e1-4e26-93b9-c2066bb5e30b {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:45:38 devstack sudo[95936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-bee4048f-1513-4df1-9a52-9fb5eb25918d Sep 22 15:45:38 devstack sudo[95936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:45:38 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-c7e87c6f-fcc6-4d75-851c-f3999459f410 tempest-VolumesGetTest-2122974047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc" returned: 0 in 0.396s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:45:38 devstack sudo[95938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc Sep 22 15:45:38 devstack sudo[95938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:45:38 devstack cinder-volume[86212]: DEBUG cinder.manager [None req-c7e87c6f-fcc6-4d75-851c-f3999459f410 tempest-VolumesGetTest-2122974047 None] Notifying Schedulers of capabilities ... {{(pid=86212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 15:45:38 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-c7e87c6f-fcc6-4d75-851c-f3999459f410 tempest-VolumesGetTest-2122974047 None] Deleted volume successfully. Sep 22 15:45:38 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-c7e87c6f-fcc6-4d75-851c-f3999459f410 tempest-VolumesGetTest-2122974047 None] Lock "cinder-99249bb0-e426-4f29-80e8-8963352cd5e5-delete_volume" released by "delete_volume" :: held 1.507s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:45:38 devstack sudo[95940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a76322ba-08e1-4e26-93b9-c2066bb5e30b Sep 22 15:45:38 devstack sudo[95940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:45:38 devstack sudo[95938]: pam_unix(sudo:session): session closed for user root Sep 22 15:45:38 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc" returned: 0 in 0.429s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:45:38 devstack cinder-volume[86212]: DEBUG cinder.manager [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] Notifying Schedulers of capabilities ... {{(pid=86212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 15:45:38 devstack cinder-volume[86212]: DEBUG oslo_service.periodic_task [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] Running periodic task VolumeManager._thread_info {{(pid=86212) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 22 15:45:38 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] thread count: 28 {{(pid=86212) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 22 15:45:38 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] thread info: [<_MainThread(MainThread, started 136163191222400)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86212) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 22 15:45:39 devstack sudo[95940]: pam_unix(sudo:session): session closed for user root Sep 22 15:45:39 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-222b2c9b-e1a3-4e46-8a32-35349c52287d tempest-VolumesGetTest-2122974047 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a76322ba-08e1-4e26-93b9-c2066bb5e30b" returned: 0 in 0.637s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:45:39 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-222b2c9b-e1a3-4e46-8a32-35349c52287d tempest-VolumesGetTest-2122974047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a76322ba-08e1-4e26-93b9-c2066bb5e30b {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:45:39 devstack sudo[95936]: pam_unix(sudo:session): session closed for user root Sep 22 15:45:39 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-261ce427-faa1-4cd7-b9b7-1714346a0eea tempest-GroupSnapshotsTest-1556879145 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-bee4048f-1513-4df1-9a52-9fb5eb25918d" returned: 0 in 0.805s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:45:39 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-261ce427-faa1-4cd7-b9b7-1714346a0eea tempest-GroupSnapshotsTest-1556879145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-bee4048f-1513-4df1-9a52-9fb5eb25918d.bfd18d29-3f4f-4b31-adbc-bea6e8472aae {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:45:39 devstack sudo[95952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a76322ba-08e1-4e26-93b9-c2066bb5e30b Sep 22 15:45:39 devstack sudo[95952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:45:39 devstack sudo[95953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-bee4048f-1513-4df1-9a52-9fb5eb25918d.bfd18d29-3f4f-4b31-adbc-bea6e8472aae Sep 22 15:45:39 devstack sudo[95953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:45:39 devstack sudo[95952]: pam_unix(sudo:session): session closed for user root Sep 22 15:45:39 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-222b2c9b-e1a3-4e46-8a32-35349c52287d tempest-VolumesGetTest-2122974047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a76322ba-08e1-4e26-93b9-c2066bb5e30b" returned: 0 in 0.311s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:45:39 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-222b2c9b-e1a3-4e46-8a32-35349c52287d tempest-VolumesGetTest-2122974047 None] Lock "cinder-quobyte-a76322ba-08e1-4e26-93b9-c2066bb5e30b" released by "delete_volume" :: held 1.019s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:45:39 devstack cinder-volume[86212]: DEBUG cinder.quota [None req-222b2c9b-e1a3-4e46-8a32-35349c52287d tempest-VolumesGetTest-2122974047 None] Created reservations ['e2f5c614-b512-4e8e-b5cf-44f536c23e25', 'ee8ce4e7-e852-4850-9485-5be27690723b', '7a7fc7f8-ce5a-4011-9e0f-27d897efa9d0', '77b59c19-3739-44a4-8299-e3b464012f52'] {{(pid=86212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 15:45:39 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-222b2c9b-e1a3-4e46-8a32-35349c52287d tempest-VolumesGetTest-2122974047 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:45:39 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-222b2c9b-e1a3-4e46-8a32-35349c52287d tempest-VolumesGetTest-2122974047 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:45:39 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-222b2c9b-e1a3-4e46-8a32-35349c52287d tempest-VolumesGetTest-2122974047 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:45:39 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-222b2c9b-e1a3-4e46-8a32-35349c52287d tempest-VolumesGetTest-2122974047 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:45:39 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-222b2c9b-e1a3-4e46-8a32-35349c52287d tempest-VolumesGetTest-2122974047 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:45:39 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-222b2c9b-e1a3-4e46-8a32-35349c52287d tempest-VolumesGetTest-2122974047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:45:39 devstack sudo[95953]: pam_unix(sudo:session): session closed for user root Sep 22 15:45:39 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-261ce427-faa1-4cd7-b9b7-1714346a0eea tempest-GroupSnapshotsTest-1556879145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-bee4048f-1513-4df1-9a52-9fb5eb25918d.bfd18d29-3f4f-4b31-adbc-bea6e8472aae" returned: 0 in 0.532s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:45:39 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-261ce427-faa1-4cd7-b9b7-1714346a0eea tempest-GroupSnapshotsTest-1556879145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-bee4048f-1513-4df1-9a52-9fb5eb25918d.bfd18d29-3f4f-4b31-adbc-bea6e8472aae {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:45:39 devstack sudo[95960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc Sep 22 15:45:39 devstack sudo[95960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:45:39 devstack sudo[95962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-bee4048f-1513-4df1-9a52-9fb5eb25918d.bfd18d29-3f4f-4b31-adbc-bea6e8472aae Sep 22 15:45:39 devstack sudo[95962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:45:39 devstack sudo[95960]: pam_unix(sudo:session): session closed for user root Sep 22 15:45:39 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-222b2c9b-e1a3-4e46-8a32-35349c52287d tempest-VolumesGetTest-2122974047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc" returned: 0 in 0.303s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:45:39 devstack cinder-volume[86212]: DEBUG cinder.manager [None req-222b2c9b-e1a3-4e46-8a32-35349c52287d tempest-VolumesGetTest-2122974047 None] Notifying Schedulers of capabilities ... {{(pid=86212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 15:45:39 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-222b2c9b-e1a3-4e46-8a32-35349c52287d tempest-VolumesGetTest-2122974047 None] Deleted volume successfully. Sep 22 15:45:39 devstack sudo[95962]: pam_unix(sudo:session): session closed for user root Sep 22 15:45:39 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-261ce427-faa1-4cd7-b9b7-1714346a0eea tempest-GroupSnapshotsTest-1556879145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-bee4048f-1513-4df1-9a52-9fb5eb25918d.bfd18d29-3f4f-4b31-adbc-bea6e8472aae" returned: 0 in 0.302s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:45:40 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-222b2c9b-e1a3-4e46-8a32-35349c52287d tempest-VolumesGetTest-2122974047 None] Lock "cinder-a76322ba-08e1-4e26-93b9-c2066bb5e30b-delete_volume" released by "delete_volume" :: held 1.662s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:45:40 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-181315d7-380e-4109-9ab7-7c196e1fbccb tempest-VolumesTestJSON-265954310 None] Acquiring lock "cinder-6b1e068a-86a7-4d4c-be1c-b8c0a74d2be3-delete_volume" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:45:40 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-261ce427-faa1-4cd7-b9b7-1714346a0eea tempest-GroupSnapshotsTest-1556879145 None] Lock "cinder-quobyte-bfd18d29-3f4f-4b31-adbc-bea6e8472aae" released by "_delete_snapshot" :: held 2.272s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:45:40 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-181315d7-380e-4109-9ab7-7c196e1fbccb tempest-VolumesTestJSON-265954310 None] Lock "cinder-6b1e068a-86a7-4d4c-be1c-b8c0a74d2be3-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:45:40 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-261ce427-faa1-4cd7-b9b7-1714346a0eea tempest-GroupSnapshotsTest-1556879145 None] Lock "cinder-quobyte-bee4048f-1513-4df1-9a52-9fb5eb25918d" released by "delete_snapshot" :: held 2.315s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:45:40 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-181315d7-380e-4109-9ab7-7c196e1fbccb tempest-VolumesTestJSON-265954310 None] Acquiring lock "cinder-quobyte-6b1e068a-86a7-4d4c-be1c-b8c0a74d2be3" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:45:40 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-181315d7-380e-4109-9ab7-7c196e1fbccb tempest-VolumesTestJSON-265954310 None] Lock "cinder-quobyte-6b1e068a-86a7-4d4c-be1c-b8c0a74d2be3" acquired by "delete_volume" :: waited 0.024s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:45:40 devstack cinder-volume[86212]: WARNING cinder.quota [None req-261ce427-faa1-4cd7-b9b7-1714346a0eea tempest-GroupSnapshotsTest-1556879145 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-462490672 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-462490672, it is now deprecated. Please use the default quota class for default quota. Sep 22 15:45:40 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d187276-1557-407e-a667-7fe69d14a533]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:45:40 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-181315d7-380e-4109-9ab7-7c196e1fbccb tempest-VolumesTestJSON-265954310 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-6b1e068a-86a7-4d4c-be1c-b8c0a74d2be3 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:45:40 devstack cinder-volume[86212]: DEBUG cinder.quota [None req-261ce427-faa1-4cd7-b9b7-1714346a0eea tempest-GroupSnapshotsTest-1556879145 None] Created reservations ['8ad23583-1ef7-410b-a4e4-8a54a5579f6d', 'f3e0c04c-2ed1-48c4-82e6-b7182455bb08', '2de6106a-846a-4510-85a6-ac7f957f189e', '1060e650-0261-489f-906e-ad7769da39f1'] {{(pid=86212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 15:45:40 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-261ce427-faa1-4cd7-b9b7-1714346a0eea tempest-GroupSnapshotsTest-1556879145 None] group_snapshot 8c7ecdc0-b1b5-4e64-8542-8c9384fed354: deleted successfully Sep 22 15:45:40 devstack sudo[95966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-6b1e068a-86a7-4d4c-be1c-b8c0a74d2be3 Sep 22 15:45:40 devstack sudo[95966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:45:40 devstack sudo[95966]: pam_unix(sudo:session): session closed for user root Sep 22 15:45:40 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-181315d7-380e-4109-9ab7-7c196e1fbccb tempest-VolumesTestJSON-265954310 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-6b1e068a-86a7-4d4c-be1c-b8c0a74d2be3" returned: 0 in 0.411s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:45:40 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-181315d7-380e-4109-9ab7-7c196e1fbccb tempest-VolumesTestJSON-265954310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-6b1e068a-86a7-4d4c-be1c-b8c0a74d2be3 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:45:40 devstack sudo[95971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-6b1e068a-86a7-4d4c-be1c-b8c0a74d2be3 Sep 22 15:45:40 devstack sudo[95971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:45:40 devstack sudo[95971]: pam_unix(sudo:session): session closed for user root Sep 22 15:45:40 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-181315d7-380e-4109-9ab7-7c196e1fbccb tempest-VolumesTestJSON-265954310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-6b1e068a-86a7-4d4c-be1c-b8c0a74d2be3" returned: 0 in 0.308s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:45:40 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-181315d7-380e-4109-9ab7-7c196e1fbccb tempest-VolumesTestJSON-265954310 None] Lock "cinder-quobyte-6b1e068a-86a7-4d4c-be1c-b8c0a74d2be3" released by "delete_volume" :: held 0.778s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:45:41 devstack cinder-volume[86212]: DEBUG cinder.quota [None req-181315d7-380e-4109-9ab7-7c196e1fbccb tempest-VolumesTestJSON-265954310 None] Created reservations ['05786a44-a08d-44b5-9016-ebb7c0b46eda', 'c9d3a754-2df4-4845-a2a2-530e5cf0a630', '91161ef7-697c-40c6-bbb4-6fd76fcea4d1', '3cb356a0-f552-4f09-abb6-92d24d87b5f6'] {{(pid=86212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 15:45:41 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-181315d7-380e-4109-9ab7-7c196e1fbccb tempest-VolumesTestJSON-265954310 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:45:41 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-181315d7-380e-4109-9ab7-7c196e1fbccb tempest-VolumesTestJSON-265954310 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:45:41 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-181315d7-380e-4109-9ab7-7c196e1fbccb tempest-VolumesTestJSON-265954310 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:45:41 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-181315d7-380e-4109-9ab7-7c196e1fbccb tempest-VolumesTestJSON-265954310 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:45:41 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-181315d7-380e-4109-9ab7-7c196e1fbccb tempest-VolumesTestJSON-265954310 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:45:41 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-181315d7-380e-4109-9ab7-7c196e1fbccb tempest-VolumesTestJSON-265954310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:45:41 devstack sudo[95974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc Sep 22 15:45:41 devstack sudo[95974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:45:41 devstack cinder-volume[86212]: DEBUG cinder.volume.flows.manager.create_volume [None req-a24c6837-2c9d-4c2a-a02a-7d2520175411 tempest-VolumesGetTest-2122974047 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 15:45:41 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-a24c6837-2c9d-4c2a-a02a-7d2520175411 tempest-VolumesGetTest-2122974047 None] Flow 'volume_create_manager' (b1a194e0-993d-48f1-80b4-f5f8039d7c36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:45:41 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-a24c6837-2c9d-4c2a-a02a-7d2520175411 tempest-VolumesGetTest-2122974047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b0e0c81-dd83-4d50-be7d-efc25e496763) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:45:41 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-02c6166b-5cc8-42fa-8a5c-6dbc712fc09f tempest-VolumesTestJSON-265954310 None] Acquiring lock "cinder-2dbd691f-9670-4765-92a5-6ad9b21945b2-delete_volume" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:45:41 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-a24c6837-2c9d-4c2a-a02a-7d2520175411 tempest-VolumesGetTest-2122974047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b0e0c81-dd83-4d50-be7d-efc25e496763) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:45:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2109327466',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c456c31-edfa-482a-a7b4-ac99ef32fc71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ab605a12e704f698a0a4b7beeffe43f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:45:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:45:41Z,use_quota=True,user_id='a0b6cabdecf14f80b25b912b51474b36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:45:41 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-a24c6837-2c9d-4c2a-a02a-7d2520175411 tempest-VolumesGetTest-2122974047 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef6c0139-06f2-4510-bfd1-e216b45d09bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:45:41 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-a24c6837-2c9d-4c2a-a02a-7d2520175411 tempest-VolumesGetTest-2122974047 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef6c0139-06f2-4510-bfd1-e216b45d09bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:45:41 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-a24c6837-2c9d-4c2a-a02a-7d2520175411 tempest-VolumesGetTest-2122974047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (773f1088-e9f7-4625-9652-fa54b0f94801) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:45:41 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-a24c6837-2c9d-4c2a-a02a-7d2520175411 tempest-VolumesGetTest-2122974047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (773f1088-e9f7-4625-9652-fa54b0f94801) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2c456c31-edfa-482a-a7b4-ac99ef32fc71', 'volume_name': 'volume-2c456c31-edfa-482a-a7b4-ac99ef32fc71', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:45:41 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-a24c6837-2c9d-4c2a-a02a-7d2520175411 tempest-VolumesGetTest-2122974047 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ee06306-5504-4297-a7ae-d5356a1f0c55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:45:41 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-a24c6837-2c9d-4c2a-a02a-7d2520175411 tempest-VolumesGetTest-2122974047 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ee06306-5504-4297-a7ae-d5356a1f0c55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:45:41 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-a24c6837-2c9d-4c2a-a02a-7d2520175411 tempest-VolumesGetTest-2122974047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98fc3e39-082d-47d3-aca3-d06b47323b7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:45:41 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-a24c6837-2c9d-4c2a-a02a-7d2520175411 tempest-VolumesGetTest-2122974047 None] Volume 2c456c31-edfa-482a-a7b4-ac99ef32fc71: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2c456c31-edfa-482a-a7b4-ac99ef32fc71', 'volume_size': 1} Sep 22 15:45:41 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-a24c6837-2c9d-4c2a-a02a-7d2520175411 tempest-VolumesGetTest-2122974047 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:45:41 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-a24c6837-2c9d-4c2a-a02a-7d2520175411 tempest-VolumesGetTest-2122974047 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:45:41 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-a24c6837-2c9d-4c2a-a02a-7d2520175411 tempest-VolumesGetTest-2122974047 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:45:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2109327466',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c456c31-edfa-482a-a7b4-ac99ef32fc71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ab605a12e704f698a0a4b7beeffe43f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:45:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:45:41Z,use_quota=True,user_id='a0b6cabdecf14f80b25b912b51474b36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)}" {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 15:45:41 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-a24c6837-2c9d-4c2a-a02a-7d2520175411 tempest-VolumesGetTest-2122974047 None] Creating volume 2c456c31-edfa-482a-a7b4-ac99ef32fc71 {{(pid=86212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 15:45:41 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-a24c6837-2c9d-4c2a-a02a-7d2520175411 tempest-VolumesGetTest-2122974047 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:45:41 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-a24c6837-2c9d-4c2a-a02a-7d2520175411 tempest-VolumesGetTest-2122974047 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:45:41 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-a24c6837-2c9d-4c2a-a02a-7d2520175411 tempest-VolumesGetTest-2122974047 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:45:41 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-a24c6837-2c9d-4c2a-a02a-7d2520175411 tempest-VolumesGetTest-2122974047 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:45:41 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-a24c6837-2c9d-4c2a-a02a-7d2520175411 tempest-VolumesGetTest-2122974047 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:45:41 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-a24c6837-2c9d-4c2a-a02a-7d2520175411 tempest-VolumesGetTest-2122974047 None] Selected osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 as target Quobyte volume. {{(pid=86212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 15:45:41 devstack cinder-volume[86212]: INFO cinder.volume.drivers.remotefs [None req-a24c6837-2c9d-4c2a-a02a-7d2520175411 tempest-VolumesGetTest-2122974047 None] casted to osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 Sep 22 15:45:41 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-a24c6837-2c9d-4c2a-a02a-7d2520175411 tempest-VolumesGetTest-2122974047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2c456c31-edfa-482a-a7b4-ac99ef32fc71 1073741824 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:45:41 devstack sudo[95976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2c456c31-edfa-482a-a7b4-ac99ef32fc71 1073741824 Sep 22 15:45:41 devstack sudo[95976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:45:41 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-02c6166b-5cc8-42fa-8a5c-6dbc712fc09f tempest-VolumesTestJSON-265954310 None] Lock "cinder-2dbd691f-9670-4765-92a5-6ad9b21945b2-delete_volume" acquired by "delete_volume" :: waited 0.154s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:45:41 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-02c6166b-5cc8-42fa-8a5c-6dbc712fc09f tempest-VolumesTestJSON-265954310 None] Acquiring lock "cinder-quobyte-2dbd691f-9670-4765-92a5-6ad9b21945b2" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:45:41 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-02c6166b-5cc8-42fa-8a5c-6dbc712fc09f tempest-VolumesTestJSON-265954310 None] Lock "cinder-quobyte-2dbd691f-9670-4765-92a5-6ad9b21945b2" acquired by "delete_volume" :: waited 0.047s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:45:41 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-75c2533b-d82b-4a62-9fb1-4a4196a380b2 tempest-GroupSnapshotsTest-1556879145 None] Acquiring lock "cinder-quobyte-bee4048f-1513-4df1-9a52-9fb5eb25918d" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:45:41 devstack sudo[95974]: pam_unix(sudo:session): session closed for user root Sep 22 15:45:41 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[4143ce97-3fc0-4e43-9a1f-48839039d3f2]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:45:41 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-02c6166b-5cc8-42fa-8a5c-6dbc712fc09f tempest-VolumesTestJSON-265954310 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2dbd691f-9670-4765-92a5-6ad9b21945b2 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:45:41 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-75c2533b-d82b-4a62-9fb1-4a4196a380b2 tempest-GroupSnapshotsTest-1556879145 None] Lock "cinder-quobyte-bee4048f-1513-4df1-9a52-9fb5eb25918d" acquired by "delete_volume" :: waited 0.058s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:45:41 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-181315d7-380e-4109-9ab7-7c196e1fbccb tempest-VolumesTestJSON-265954310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc" returned: 0 in 0.515s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:45:41 devstack cinder-volume[86212]: DEBUG cinder.manager [None req-181315d7-380e-4109-9ab7-7c196e1fbccb tempest-VolumesTestJSON-265954310 None] Notifying Schedulers of capabilities ... {{(pid=86212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 15:45:41 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-181315d7-380e-4109-9ab7-7c196e1fbccb tempest-VolumesTestJSON-265954310 None] Deleted volume successfully. Sep 22 15:45:41 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[47c8e42d-e1e4-42f8-af8a-a37dfff82c31]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:45:41 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-75c2533b-d82b-4a62-9fb1-4a4196a380b2 tempest-GroupSnapshotsTest-1556879145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-bee4048f-1513-4df1-9a52-9fb5eb25918d {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:45:41 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-181315d7-380e-4109-9ab7-7c196e1fbccb tempest-VolumesTestJSON-265954310 None] Lock "cinder-6b1e068a-86a7-4d4c-be1c-b8c0a74d2be3-delete_volume" released by "delete_volume" :: held 1.635s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:45:41 devstack sudo[95979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2dbd691f-9670-4765-92a5-6ad9b21945b2 Sep 22 15:45:41 devstack sudo[95979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:45:41 devstack sudo[95982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-bee4048f-1513-4df1-9a52-9fb5eb25918d Sep 22 15:45:41 devstack sudo[95982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:45:41 devstack sudo[95976]: pam_unix(sudo:session): session closed for user root Sep 22 15:45:41 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-a24c6837-2c9d-4c2a-a02a-7d2520175411 tempest-VolumesGetTest-2122974047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2c456c31-edfa-482a-a7b4-ac99ef32fc71 1073741824" returned: 0 in 0.609s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:45:42 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-a24c6837-2c9d-4c2a-a02a-7d2520175411 tempest-VolumesGetTest-2122974047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2c456c31-edfa-482a-a7b4-ac99ef32fc71 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:45:42 devstack sudo[95990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2c456c31-edfa-482a-a7b4-ac99ef32fc71 Sep 22 15:45:42 devstack sudo[95990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:45:42 devstack sudo[95982]: pam_unix(sudo:session): session closed for user root Sep 22 15:45:42 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-75c2533b-d82b-4a62-9fb1-4a4196a380b2 tempest-GroupSnapshotsTest-1556879145 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-bee4048f-1513-4df1-9a52-9fb5eb25918d" returned: 0 in 0.428s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:45:42 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-75c2533b-d82b-4a62-9fb1-4a4196a380b2 tempest-GroupSnapshotsTest-1556879145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-bee4048f-1513-4df1-9a52-9fb5eb25918d {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:45:42 devstack sudo[95979]: pam_unix(sudo:session): session closed for user root Sep 22 15:45:42 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-02c6166b-5cc8-42fa-8a5c-6dbc712fc09f tempest-VolumesTestJSON-265954310 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2dbd691f-9670-4765-92a5-6ad9b21945b2" returned: 0 in 0.558s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:45:42 devstack sudo[95996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-bee4048f-1513-4df1-9a52-9fb5eb25918d Sep 22 15:45:42 devstack sudo[95996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:45:42 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-02c6166b-5cc8-42fa-8a5c-6dbc712fc09f tempest-VolumesTestJSON-265954310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2dbd691f-9670-4765-92a5-6ad9b21945b2 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:45:42 devstack sudo[95998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2dbd691f-9670-4765-92a5-6ad9b21945b2 Sep 22 15:45:42 devstack sudo[95998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:45:42 devstack sudo[95990]: pam_unix(sudo:session): session closed for user root Sep 22 15:45:42 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-a24c6837-2c9d-4c2a-a02a-7d2520175411 tempest-VolumesGetTest-2122974047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2c456c31-edfa-482a-a7b4-ac99ef32fc71" returned: 0 in 0.314s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:45:42 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-a24c6837-2c9d-4c2a-a02a-7d2520175411 tempest-VolumesGetTest-2122974047 None] <== create_volume: return (987ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'} {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 15:45:42 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-a24c6837-2c9d-4c2a-a02a-7d2520175411 tempest-VolumesGetTest-2122974047 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.991s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:45:42 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-a24c6837-2c9d-4c2a-a02a-7d2520175411 tempest-VolumesGetTest-2122974047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98fc3e39-082d-47d3-aca3-d06b47323b7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2c456c31-edfa-482a-a7b4-ac99ef32fc71', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:45:42 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-a24c6837-2c9d-4c2a-a02a-7d2520175411 tempest-VolumesGetTest-2122974047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ee1f25a-e058-418d-ab31-a3b867437680) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:45:42 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-a24c6837-2c9d-4c2a-a02a-7d2520175411 tempest-VolumesGetTest-2122974047 None] Volume volume-2c456c31-edfa-482a-a7b4-ac99ef32fc71 (2c456c31-edfa-482a-a7b4-ac99ef32fc71): created successfully Sep 22 15:45:42 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-a24c6837-2c9d-4c2a-a02a-7d2520175411 tempest-VolumesGetTest-2122974047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ee1f25a-e058-418d-ab31-a3b867437680) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:45:42 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-a24c6837-2c9d-4c2a-a02a-7d2520175411 tempest-VolumesGetTest-2122974047 None] Flow 'volume_create_manager' (b1a194e0-993d-48f1-80b4-f5f8039d7c36) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:45:42 devstack sudo[95996]: pam_unix(sudo:session): session closed for user root Sep 22 15:45:42 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-a24c6837-2c9d-4c2a-a02a-7d2520175411 tempest-VolumesGetTest-2122974047 None] Created volume successfully. Sep 22 15:45:42 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-75c2533b-d82b-4a62-9fb1-4a4196a380b2 tempest-GroupSnapshotsTest-1556879145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-bee4048f-1513-4df1-9a52-9fb5eb25918d" returned: 0 in 0.312s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:45:42 devstack sudo[95998]: pam_unix(sudo:session): session closed for user root Sep 22 15:45:42 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-75c2533b-d82b-4a62-9fb1-4a4196a380b2 tempest-GroupSnapshotsTest-1556879145 None] Lock "cinder-quobyte-bee4048f-1513-4df1-9a52-9fb5eb25918d" released by "delete_volume" :: held 0.845s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:45:42 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-02c6166b-5cc8-42fa-8a5c-6dbc712fc09f tempest-VolumesTestJSON-265954310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2dbd691f-9670-4765-92a5-6ad9b21945b2" returned: 0 in 0.309s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:45:42 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-02c6166b-5cc8-42fa-8a5c-6dbc712fc09f tempest-VolumesTestJSON-265954310 None] Lock "cinder-quobyte-2dbd691f-9670-4765-92a5-6ad9b21945b2" released by "delete_volume" :: held 0.974s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:45:42 devstack cinder-volume[86212]: DEBUG cinder.quota [None req-75c2533b-d82b-4a62-9fb1-4a4196a380b2 tempest-GroupSnapshotsTest-1556879145 None] Created reservations ['44bebb3d-6364-4d00-860c-30b47fc48d0e'] {{(pid=86212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 15:45:42 devstack cinder-volume[86212]: DEBUG cinder.quota [None req-02c6166b-5cc8-42fa-8a5c-6dbc712fc09f tempest-VolumesTestJSON-265954310 None] Created reservations ['ea84a7c7-54a5-44b7-93a3-73914cefe9ca', '46d44b88-22b7-4a16-8565-a689aa6f22e9', '49931b72-b0b6-4aad-86fc-24bb7c7f7504', '883466c5-d8ab-4280-a4b4-38e3e7ef5a4e'] {{(pid=86212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 15:45:42 devstack cinder-volume[86212]: WARNING cinder.db.api [None req-75c2533b-d82b-4a62-9fb1-4a4196a380b2 tempest-GroupSnapshotsTest-1556879145 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-462490672'] Sep 22 15:45:42 devstack cinder-volume[86212]: DEBUG cinder.quota [None req-75c2533b-d82b-4a62-9fb1-4a4196a380b2 tempest-GroupSnapshotsTest-1556879145 None] Created reservations ['abb6fc88-fa68-43b2-b5c0-78e893372dd5', 'f7918631-6711-47b2-b46f-81e43c26ba7e', 'f532674d-060a-40ca-8705-46ea0c87242f', '1c902500-74a6-4fad-9043-6b60bcb80471'] {{(pid=86212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 15:45:42 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-02c6166b-5cc8-42fa-8a5c-6dbc712fc09f tempest-VolumesTestJSON-265954310 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:45:42 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-02c6166b-5cc8-42fa-8a5c-6dbc712fc09f tempest-VolumesTestJSON-265954310 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:45:42 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-02c6166b-5cc8-42fa-8a5c-6dbc712fc09f tempest-VolumesTestJSON-265954310 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:45:42 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-02c6166b-5cc8-42fa-8a5c-6dbc712fc09f tempest-VolumesTestJSON-265954310 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:45:42 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-02c6166b-5cc8-42fa-8a5c-6dbc712fc09f tempest-VolumesTestJSON-265954310 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:45:42 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-02c6166b-5cc8-42fa-8a5c-6dbc712fc09f tempest-VolumesTestJSON-265954310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:45:42 devstack sudo[96003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc Sep 22 15:45:42 devstack sudo[96003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:45:42 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-75c2533b-d82b-4a62-9fb1-4a4196a380b2 tempest-GroupSnapshotsTest-1556879145 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:45:42 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-75c2533b-d82b-4a62-9fb1-4a4196a380b2 tempest-GroupSnapshotsTest-1556879145 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:45:42 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-75c2533b-d82b-4a62-9fb1-4a4196a380b2 tempest-GroupSnapshotsTest-1556879145 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:45:42 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-75c2533b-d82b-4a62-9fb1-4a4196a380b2 tempest-GroupSnapshotsTest-1556879145 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:45:42 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-75c2533b-d82b-4a62-9fb1-4a4196a380b2 tempest-GroupSnapshotsTest-1556879145 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:45:42 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-75c2533b-d82b-4a62-9fb1-4a4196a380b2 tempest-GroupSnapshotsTest-1556879145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:45:42 devstack sudo[96005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc Sep 22 15:45:42 devstack sudo[96005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:45:42 devstack sudo[96003]: pam_unix(sudo:session): session closed for user root Sep 22 15:45:42 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-02c6166b-5cc8-42fa-8a5c-6dbc712fc09f tempest-VolumesTestJSON-265954310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc" returned: 0 in 0.297s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:45:42 devstack cinder-volume[86212]: DEBUG cinder.manager [None req-02c6166b-5cc8-42fa-8a5c-6dbc712fc09f tempest-VolumesTestJSON-265954310 None] Notifying Schedulers of capabilities ... {{(pid=86212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 15:45:42 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-02c6166b-5cc8-42fa-8a5c-6dbc712fc09f tempest-VolumesTestJSON-265954310 None] Deleted volume successfully. Sep 22 15:45:42 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-02c6166b-5cc8-42fa-8a5c-6dbc712fc09f tempest-VolumesTestJSON-265954310 None] Lock "cinder-2dbd691f-9670-4765-92a5-6ad9b21945b2-delete_volume" released by "delete_volume" :: held 1.590s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:45:43 devstack sudo[96005]: pam_unix(sudo:session): session closed for user root Sep 22 15:45:43 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-75c2533b-d82b-4a62-9fb1-4a4196a380b2 tempest-GroupSnapshotsTest-1556879145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc" returned: 0 in 0.284s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:45:43 devstack cinder-volume[86212]: DEBUG cinder.manager [None req-75c2533b-d82b-4a62-9fb1-4a4196a380b2 tempest-GroupSnapshotsTest-1556879145 None] Notifying Schedulers of capabilities ... {{(pid=86212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 15:45:43 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-75c2533b-d82b-4a62-9fb1-4a4196a380b2 tempest-GroupSnapshotsTest-1556879145 None] Delete group completed successfully. Sep 22 15:45:43 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-389a0535-408b-47c4-8ddd-78aa5fa1828b tempest-GroupSnapshotsTest-1556879145 None] Group tempest-GroupSnapshotsTest-Group-1208904311: creating Sep 22 15:45:43 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-389a0535-408b-47c4-8ddd-78aa5fa1828b tempest-GroupSnapshotsTest-1556879145 None] Group tempest-GroupSnapshotsTest-Group-1208904311: created successfully Sep 22 15:45:43 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-389a0535-408b-47c4-8ddd-78aa5fa1828b tempest-GroupSnapshotsTest-1556879145 None] Create group completed successfully. Sep 22 15:45:43 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-ba4301aa-94bf-4183-906d-aee480b48f7e tempest-VolumesTestJSON-265954310 None] Acquiring lock "cinder-3da36e20-ef6f-469d-b489-10abecba2fe1-delete_volume" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:45:43 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-ba4301aa-94bf-4183-906d-aee480b48f7e tempest-VolumesTestJSON-265954310 None] Lock "cinder-3da36e20-ef6f-469d-b489-10abecba2fe1-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:45:43 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-ba4301aa-94bf-4183-906d-aee480b48f7e tempest-VolumesTestJSON-265954310 None] Acquiring lock "cinder-quobyte-3da36e20-ef6f-469d-b489-10abecba2fe1" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:45:43 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-ba4301aa-94bf-4183-906d-aee480b48f7e tempest-VolumesTestJSON-265954310 None] Lock "cinder-quobyte-3da36e20-ef6f-469d-b489-10abecba2fe1" acquired by "delete_volume" :: waited 0.024s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:45:43 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[48ffcf91-c8cb-474e-aef5-3ab7ef407c78]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:45:43 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-ba4301aa-94bf-4183-906d-aee480b48f7e tempest-VolumesTestJSON-265954310 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-3da36e20-ef6f-469d-b489-10abecba2fe1 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:45:43 devstack sudo[96009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-3da36e20-ef6f-469d-b489-10abecba2fe1 Sep 22 15:45:43 devstack sudo[96009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:45:43 devstack cinder-volume[86212]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3a6368b-53bb-4acb-aa84-92b5121ffa1f tempest-VolumesGetTest-2122974047 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 15:45:43 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-f3a6368b-53bb-4acb-aa84-92b5121ffa1f tempest-VolumesGetTest-2122974047 None] Flow 'volume_create_manager' (5f123db7-69e9-4a45-b8db-ad2c3108f9c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:45:43 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-f3a6368b-53bb-4acb-aa84-92b5121ffa1f tempest-VolumesGetTest-2122974047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d620fd1-23f7-42bd-8d0a-1b72cc404875) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:45:43 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-f3a6368b-53bb-4acb-aa84-92b5121ffa1f tempest-VolumesGetTest-2122974047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d620fd1-23f7-42bd-8d0a-1b72cc404875) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:45:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-82065082',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f2a7d78-aed3-4a49-95f6-095183ed063b,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='4ab605a12e704f698a0a4b7beeffe43f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:45:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=2c456c31-edfa-482a-a7b4-ac99ef32fc71,status='creating',terminated_at=None,updated_at=2026-09-22T13:45:44Z,use_quota=True,user_id='a0b6cabdecf14f80b25b912b51474b36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:45:43 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-f3a6368b-53bb-4acb-aa84-92b5121ffa1f tempest-VolumesGetTest-2122974047 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d28119f5-65e6-47d3-a480-c54e12b59bb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:45:43 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-f3a6368b-53bb-4acb-aa84-92b5121ffa1f tempest-VolumesGetTest-2122974047 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d28119f5-65e6-47d3-a480-c54e12b59bb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:45:44 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-f3a6368b-53bb-4acb-aa84-92b5121ffa1f tempest-VolumesGetTest-2122974047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2973bdb-40cf-4cd4-8e3f-ad008bb9412f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:45:44 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-f3a6368b-53bb-4acb-aa84-92b5121ffa1f tempest-VolumesGetTest-2122974047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2973bdb-40cf-4cd4-8e3f-ad008bb9412f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '0f2a7d78-aed3-4a49-95f6-095183ed063b', 'volume_name': 'volume-0f2a7d78-aed3-4a49-95f6-095183ed063b', 'volume_size': 1, 'source_volid': '2c456c31-edfa-482a-a7b4-ac99ef32fc71', 'source_volstatus': 'available'}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:45:44 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-f3a6368b-53bb-4acb-aa84-92b5121ffa1f tempest-VolumesGetTest-2122974047 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eaa59eee-7e73-498e-932e-cb917ccd5856) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:45:44 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-f3a6368b-53bb-4acb-aa84-92b5121ffa1f tempest-VolumesGetTest-2122974047 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eaa59eee-7e73-498e-932e-cb917ccd5856) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:45:44 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-f3a6368b-53bb-4acb-aa84-92b5121ffa1f tempest-VolumesGetTest-2122974047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b65a22e3-8181-4f43-aec5-01a966a1b35d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:45:44 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-f3a6368b-53bb-4acb-aa84-92b5121ffa1f tempest-VolumesGetTest-2122974047 None] Volume 0f2a7d78-aed3-4a49-95f6-095183ed063b: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-0f2a7d78-aed3-4a49-95f6-095183ed063b', 'volume_size': 1, 'source_volid': '2c456c31-edfa-482a-a7b4-ac99ef32fc71', 'source_volstatus': 'available'} Sep 22 15:45:44 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-f3a6368b-53bb-4acb-aa84-92b5121ffa1f tempest-VolumesGetTest-2122974047 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:45:44 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-f3a6368b-53bb-4acb-aa84-92b5121ffa1f tempest-VolumesGetTest-2122974047 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:45:44 devstack cinder-volume[86212]: INFO cinder.volume.drivers.remotefs [None req-f3a6368b-53bb-4acb-aa84-92b5121ffa1f tempest-VolumesGetTest-2122974047 None] Cloning volume 2c456c31-edfa-482a-a7b4-ac99ef32fc71 to volume 0f2a7d78-aed3-4a49-95f6-095183ed063b Sep 22 15:45:44 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-f3a6368b-53bb-4acb-aa84-92b5121ffa1f tempest-VolumesGetTest-2122974047 None] Creating offline snapshot 0e97f512-96e9-422b-b2c2-8fb3d637678f of volume 2c456c31-edfa-482a-a7b4-ac99ef32fc71 {{(pid=86212) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 22 15:45:44 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6ba68a0-7a8a-4e73-bfc9-bc098d664bdf]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:45:44 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-f3a6368b-53bb-4acb-aa84-92b5121ffa1f tempest-VolumesGetTest-2122974047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2c456c31-edfa-482a-a7b4-ac99ef32fc71 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:45:44 devstack sudo[96009]: pam_unix(sudo:session): session closed for user root Sep 22 15:45:44 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-ba4301aa-94bf-4183-906d-aee480b48f7e tempest-VolumesTestJSON-265954310 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-3da36e20-ef6f-469d-b489-10abecba2fe1" returned: 0 in 0.388s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:45:44 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-ba4301aa-94bf-4183-906d-aee480b48f7e tempest-VolumesTestJSON-265954310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-3da36e20-ef6f-469d-b489-10abecba2fe1 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:45:44 devstack sudo[96015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-3da36e20-ef6f-469d-b489-10abecba2fe1 Sep 22 15:45:44 devstack sudo[96015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:45:44 devstack sudo[96014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2c456c31-edfa-482a-a7b4-ac99ef32fc71 Sep 22 15:45:44 devstack sudo[96014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:45:44 devstack sudo[96015]: pam_unix(sudo:session): session closed for user root Sep 22 15:45:44 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-ba4301aa-94bf-4183-906d-aee480b48f7e tempest-VolumesTestJSON-265954310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-3da36e20-ef6f-469d-b489-10abecba2fe1" returned: 0 in 0.259s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:45:44 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-ba4301aa-94bf-4183-906d-aee480b48f7e tempest-VolumesTestJSON-265954310 None] Lock "cinder-quobyte-3da36e20-ef6f-469d-b489-10abecba2fe1" released by "delete_volume" :: held 0.704s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:45:44 devstack cinder-volume[86212]: DEBUG cinder.quota [None req-ba4301aa-94bf-4183-906d-aee480b48f7e tempest-VolumesTestJSON-265954310 None] Created reservations ['5bc58bbb-890d-49b4-8f0f-6bfc5d0b454b', '3d21ab7b-1075-43e5-8665-e3408c3974f7', 'a30eb0bd-fa25-42ad-8b7d-51cb925b5260', '0df4ff8a-9cee-4eec-82dd-17f9208a4efc'] {{(pid=86212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 15:45:44 devstack sudo[96014]: pam_unix(sudo:session): session closed for user root Sep 22 15:45:44 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-f3a6368b-53bb-4acb-aa84-92b5121ffa1f tempest-VolumesGetTest-2122974047 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2c456c31-edfa-482a-a7b4-ac99ef32fc71" returned: 0 in 0.432s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:45:44 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-f3a6368b-53bb-4acb-aa84-92b5121ffa1f tempest-VolumesGetTest-2122974047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2c456c31-edfa-482a-a7b4-ac99ef32fc71,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2c456c31-edfa-482a-a7b4-ac99ef32fc71.0e97f512-96e9-422b-b2c2-8fb3d637678f 1G {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:45:44 devstack sudo[96022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2c456c31-edfa-482a-a7b4-ac99ef32fc71,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2c456c31-edfa-482a-a7b4-ac99ef32fc71.0e97f512-96e9-422b-b2c2-8fb3d637678f 1G Sep 22 15:45:44 devstack sudo[96022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:45:44 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-ba4301aa-94bf-4183-906d-aee480b48f7e tempest-VolumesTestJSON-265954310 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:45:44 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-ba4301aa-94bf-4183-906d-aee480b48f7e tempest-VolumesTestJSON-265954310 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:45:44 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-ba4301aa-94bf-4183-906d-aee480b48f7e tempest-VolumesTestJSON-265954310 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:45:44 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-ba4301aa-94bf-4183-906d-aee480b48f7e tempest-VolumesTestJSON-265954310 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:45:44 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-ba4301aa-94bf-4183-906d-aee480b48f7e tempest-VolumesTestJSON-265954310 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:45:44 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-ba4301aa-94bf-4183-906d-aee480b48f7e tempest-VolumesTestJSON-265954310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:45:44 devstack sudo[96024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc Sep 22 15:45:44 devstack sudo[96024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:45:45 devstack sudo[96024]: pam_unix(sudo:session): session closed for user root Sep 22 15:45:45 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-ba4301aa-94bf-4183-906d-aee480b48f7e tempest-VolumesTestJSON-265954310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc" returned: 0 in 0.490s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:45:45 devstack cinder-volume[86212]: DEBUG cinder.manager [None req-ba4301aa-94bf-4183-906d-aee480b48f7e tempest-VolumesTestJSON-265954310 None] Notifying Schedulers of capabilities ... {{(pid=86212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 15:45:45 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-ba4301aa-94bf-4183-906d-aee480b48f7e tempest-VolumesTestJSON-265954310 None] Deleted volume successfully. Sep 22 15:45:45 devstack cinder-volume[86212]: DEBUG cinder.volume.flows.manager.create_volume [None req-391e2ef0-e718-46a0-aca9-ca569f47b26c tempest-GroupSnapshotsTest-1556879145 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 15:45:45 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-391e2ef0-e718-46a0-aca9-ca569f47b26c tempest-GroupSnapshotsTest-1556879145 None] Flow 'volume_create_manager' (36d1f051-5398-460b-abb3-b739910ceaeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:45:45 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-391e2ef0-e718-46a0-aca9-ca569f47b26c tempest-GroupSnapshotsTest-1556879145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c021300-da58-4bcb-a3c8-e2dba9f0d6eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:45:45 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-ba4301aa-94bf-4183-906d-aee480b48f7e tempest-VolumesTestJSON-265954310 None] Lock "cinder-3da36e20-ef6f-469d-b489-10abecba2fe1-delete_volume" released by "delete_volume" :: held 1.585s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:45:45 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-391e2ef0-e718-46a0-aca9-ca569f47b26c tempest-GroupSnapshotsTest-1556879145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c021300-da58-4bcb-a3c8-e2dba9f0d6eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:45:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-236625161',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d3b9e0e1-a1c7-4e9a-aa8f-39740199141e,host='devstack@QuobyteHD#QuobyteHD',id=36fece85-c391-4b3d-8484-d33f1e020467,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='302ce9fa5101463680fb8113ccce1f48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:45:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:45:45Z,use_quota=True,user_id='f8650ad05c3d4df895b954f3cea76df3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b741e725-403a-47c3-8c35-f80b30e26a62),volume_type_id=b741e725-403a-47c3-8c35-f80b30e26a62)' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:45:45 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-391e2ef0-e718-46a0-aca9-ca569f47b26c tempest-GroupSnapshotsTest-1556879145 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (660456ad-47d2-4280-a2a1-0eaab8829eb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:45:45 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-391e2ef0-e718-46a0-aca9-ca569f47b26c tempest-GroupSnapshotsTest-1556879145 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (660456ad-47d2-4280-a2a1-0eaab8829eb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:45:45 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-391e2ef0-e718-46a0-aca9-ca569f47b26c tempest-GroupSnapshotsTest-1556879145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (002525c5-ff83-4ade-9a61-2f32701f5ac0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:45:45 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-391e2ef0-e718-46a0-aca9-ca569f47b26c tempest-GroupSnapshotsTest-1556879145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (002525c5-ff83-4ade-9a61-2f32701f5ac0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '36fece85-c391-4b3d-8484-d33f1e020467', 'volume_name': 'volume-36fece85-c391-4b3d-8484-d33f1e020467', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:45:45 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-391e2ef0-e718-46a0-aca9-ca569f47b26c tempest-GroupSnapshotsTest-1556879145 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f2a2ed8-433c-412e-a391-43549a589dc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:45:45 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-391e2ef0-e718-46a0-aca9-ca569f47b26c tempest-GroupSnapshotsTest-1556879145 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f2a2ed8-433c-412e-a391-43549a589dc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:45:45 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-391e2ef0-e718-46a0-aca9-ca569f47b26c tempest-GroupSnapshotsTest-1556879145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4409ddb-0cd9-4265-8c44-1ff246e61f11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:45:45 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-391e2ef0-e718-46a0-aca9-ca569f47b26c tempest-GroupSnapshotsTest-1556879145 None] Volume 36fece85-c391-4b3d-8484-d33f1e020467: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-36fece85-c391-4b3d-8484-d33f1e020467', 'volume_size': 1} Sep 22 15:45:45 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-391e2ef0-e718-46a0-aca9-ca569f47b26c tempest-GroupSnapshotsTest-1556879145 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:45:45 devstack sudo[96022]: pam_unix(sudo:session): session closed for user root Sep 22 15:45:45 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-f3a6368b-53bb-4acb-aa84-92b5121ffa1f tempest-VolumesGetTest-2122974047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2c456c31-edfa-482a-a7b4-ac99ef32fc71,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2c456c31-edfa-482a-a7b4-ac99ef32fc71.0e97f512-96e9-422b-b2c2-8fb3d637678f 1G" returned: 0 in 0.764s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:45:45 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-f3a6368b-53bb-4acb-aa84-92b5121ffa1f tempest-VolumesGetTest-2122974047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2c456c31-edfa-482a-a7b4-ac99ef32fc71 -F qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2c456c31-edfa-482a-a7b4-ac99ef32fc71.0e97f512-96e9-422b-b2c2-8fb3d637678f {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:45:45 devstack sudo[96030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2c456c31-edfa-482a-a7b4-ac99ef32fc71 -F qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2c456c31-edfa-482a-a7b4-ac99ef32fc71.0e97f512-96e9-422b-b2c2-8fb3d637678f Sep 22 15:45:45 devstack sudo[96030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:45:45 devstack sudo[96030]: pam_unix(sudo:session): session closed for user root Sep 22 15:45:45 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-f3a6368b-53bb-4acb-aa84-92b5121ffa1f tempest-VolumesGetTest-2122974047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2c456c31-edfa-482a-a7b4-ac99ef32fc71 -F qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2c456c31-edfa-482a-a7b4-ac99ef32fc71.0e97f512-96e9-422b-b2c2-8fb3d637678f" returned: 0 in 0.347s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:45:45 devstack cinder-volume[86212]: WARNING cinder.volume.drivers.remotefs [None req-f3a6368b-53bb-4acb-aa84-92b5121ffa1f tempest-VolumesGetTest-2122974047 None] /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2c456c31-edfa-482a-a7b4-ac99ef32fc71.0e97f512-96e9-422b-b2c2-8fb3d637678f is being set with open permissions: ugo+rw Sep 22 15:45:45 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-f3a6368b-53bb-4acb-aa84-92b5121ffa1f tempest-VolumesGetTest-2122974047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2c456c31-edfa-482a-a7b4-ac99ef32fc71.0e97f512-96e9-422b-b2c2-8fb3d637678f {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:45:45 devstack sudo[96035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2c456c31-edfa-482a-a7b4-ac99ef32fc71.0e97f512-96e9-422b-b2c2-8fb3d637678f Sep 22 15:45:45 devstack sudo[96035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:45:45 devstack sudo[96035]: pam_unix(sudo:session): session closed for user root Sep 22 15:45:45 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-f3a6368b-53bb-4acb-aa84-92b5121ffa1f tempest-VolumesGetTest-2122974047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2c456c31-edfa-482a-a7b4-ac99ef32fc71.0e97f512-96e9-422b-b2c2-8fb3d637678f" returned: 0 in 0.262s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:45:45 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-f3a6368b-53bb-4acb-aa84-92b5121ffa1f tempest-VolumesGetTest-2122974047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2c456c31-edfa-482a-a7b4-ac99ef32fc71.info {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:45:45 devstack sudo[96038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2c456c31-edfa-482a-a7b4-ac99ef32fc71.info Sep 22 15:45:45 devstack sudo[96038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:45:46 devstack sudo[96038]: pam_unix(sudo:session): session closed for user root Sep 22 15:45:46 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-f3a6368b-53bb-4acb-aa84-92b5121ffa1f tempest-VolumesGetTest-2122974047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2c456c31-edfa-482a-a7b4-ac99ef32fc71.info" returned: 0 in 0.299s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:45:46 devstack cinder-volume[86212]: WARNING cinder.volume.drivers.remotefs [None req-f3a6368b-53bb-4acb-aa84-92b5121ffa1f tempest-VolumesGetTest-2122974047 None] /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2c456c31-edfa-482a-a7b4-ac99ef32fc71.info is being set with open permissions: ugo+rw Sep 22 15:45:46 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-f3a6368b-53bb-4acb-aa84-92b5121ffa1f tempest-VolumesGetTest-2122974047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2c456c31-edfa-482a-a7b4-ac99ef32fc71.info {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:45:46 devstack sudo[96041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2c456c31-edfa-482a-a7b4-ac99ef32fc71.info Sep 22 15:45:46 devstack sudo[96041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:45:46 devstack sudo[96041]: pam_unix(sudo:session): session closed for user root Sep 22 15:45:46 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-f3a6368b-53bb-4acb-aa84-92b5121ffa1f tempest-VolumesGetTest-2122974047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2c456c31-edfa-482a-a7b4-ac99ef32fc71.info" returned: 0 in 0.289s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:45:46 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-f3a6368b-53bb-4acb-aa84-92b5121ffa1f tempest-VolumesGetTest-2122974047 None] Acquiring lock "cinder-quobyte-0f2a7d78-aed3-4a49-95f6-095183ed063b" by "_copy_volume_from_snapshot" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:45:46 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-f3a6368b-53bb-4acb-aa84-92b5121ffa1f tempest-VolumesGetTest-2122974047 None] Lock "cinder-quobyte-0f2a7d78-aed3-4a49-95f6-095183ed063b" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:45:46 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-f3a6368b-53bb-4acb-aa84-92b5121ffa1f tempest-VolumesGetTest-2122974047 None] snapshot: 0e97f512-96e9-422b-b2c2-8fb3d637678f, volume: 0f2a7d78-aed3-4a49-95f6-095183ed063b, {{(pid=86212) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 22 15:45:46 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-f3a6368b-53bb-4acb-aa84-92b5121ffa1f tempest-VolumesGetTest-2122974047 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:45:46 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-f3a6368b-53bb-4acb-aa84-92b5121ffa1f tempest-VolumesGetTest-2122974047 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:45:46 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-f3a6368b-53bb-4acb-aa84-92b5121ffa1f tempest-VolumesGetTest-2122974047 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:45:46 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-f3a6368b-53bb-4acb-aa84-92b5121ffa1f tempest-VolumesGetTest-2122974047 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:45:46 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-f3a6368b-53bb-4acb-aa84-92b5121ffa1f tempest-VolumesGetTest-2122974047 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:45:46 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fc6d8ff-24e5-46b7-8fd3-2ea528986127]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:45:46 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-f3a6368b-53bb-4acb-aa84-92b5121ffa1f tempest-VolumesGetTest-2122974047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2c456c31-edfa-482a-a7b4-ac99ef32fc71.0e97f512-96e9-422b-b2c2-8fb3d637678f {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:45:46 devstack sudo[96044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2c456c31-edfa-482a-a7b4-ac99ef32fc71.0e97f512-96e9-422b-b2c2-8fb3d637678f Sep 22 15:45:46 devstack sudo[96044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:45:47 devstack sudo[96044]: pam_unix(sudo:session): session closed for user root Sep 22 15:45:47 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-f3a6368b-53bb-4acb-aa84-92b5121ffa1f tempest-VolumesGetTest-2122974047 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2c456c31-edfa-482a-a7b4-ac99ef32fc71.0e97f512-96e9-422b-b2c2-8fb3d637678f" returned: 0 in 0.447s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:45:47 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-f3a6368b-53bb-4acb-aa84-92b5121ffa1f tempest-VolumesGetTest-2122974047 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2c456c31-edfa-482a-a7b4-ac99ef32fc71(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86212) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 22 15:45:47 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7e207d6-0ee3-419d-bc34-d516b34dc2ab]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:45:47 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-f3a6368b-53bb-4acb-aa84-92b5121ffa1f tempest-VolumesGetTest-2122974047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2c456c31-edfa-482a-a7b4-ac99ef32fc71 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:45:47 devstack sudo[96050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2c456c31-edfa-482a-a7b4-ac99ef32fc71 Sep 22 15:45:47 devstack sudo[96050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:45:47 devstack sudo[96050]: pam_unix(sudo:session): session closed for user root Sep 22 15:45:47 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-f3a6368b-53bb-4acb-aa84-92b5121ffa1f tempest-VolumesGetTest-2122974047 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2c456c31-edfa-482a-a7b4-ac99ef32fc71" returned: 0 in 0.427s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:45:47 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-f3a6368b-53bb-4acb-aa84-92b5121ffa1f tempest-VolumesGetTest-2122974047 None] will copy from snapshot at /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2c456c31-edfa-482a-a7b4-ac99ef32fc71 {{(pid=86212) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 22 15:45:47 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-f3a6368b-53bb-4acb-aa84-92b5121ffa1f tempest-VolumesGetTest-2122974047 None] Creating direct copy from snapshot {{(pid=86212) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 22 15:45:47 devstack cinder-volume[86212]: DEBUG cinder.utils [None req-f3a6368b-53bb-4acb-aa84-92b5121ffa1f tempest-VolumesGetTest-2122974047 None] Path /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-0f2a7d78-aed3-4a49-95f6-095183ed063b not found in is_blk_device check {{(pid=86212) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 22 15:45:47 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-f3a6368b-53bb-4acb-aa84-92b5121ffa1f tempest-VolumesGetTest-2122974047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2c456c31-edfa-482a-a7b4-ac99ef32fc71 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-0f2a7d78-aed3-4a49-95f6-095183ed063b {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:45:47 devstack sudo[96056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2c456c31-edfa-482a-a7b4-ac99ef32fc71 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-0f2a7d78-aed3-4a49-95f6-095183ed063b Sep 22 15:45:47 devstack sudo[96056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:45:55 devstack cinder-volume[86212]: DEBUG cinder.volume.flows.manager.create_volume [None req-ccf53723-4013-41a1-977e-27450f1f3f1c tempest-VolumesImageMetadata-353019529 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 15:45:55 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-ccf53723-4013-41a1-977e-27450f1f3f1c tempest-VolumesImageMetadata-353019529 None] Flow 'volume_create_manager' (62c13fb7-da34-457b-a3dc-b9bcb0d344a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:45:55 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-ccf53723-4013-41a1-977e-27450f1f3f1c tempest-VolumesImageMetadata-353019529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21a0af1a-6af3-4761-8b5e-ce0becac244d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:45:55 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-ccf53723-4013-41a1-977e-27450f1f3f1c tempest-VolumesImageMetadata-353019529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21a0af1a-6af3-4761-8b5e-ce0becac244d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:45:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1265523531',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57f012ca-59f4-4bb3-b899-a5d7744f2e3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d0457d8271640edaf577fe8a41b3cf7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:45:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:45:56Z,use_quota=True,user_id='799759e868094ea0b9dd27e5692ccba0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:45:55 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-ccf53723-4013-41a1-977e-27450f1f3f1c tempest-VolumesImageMetadata-353019529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (572bab48-768d-43a7-9df4-5699352f3e36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:45:55 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-ccf53723-4013-41a1-977e-27450f1f3f1c tempest-VolumesImageMetadata-353019529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (572bab48-768d-43a7-9df4-5699352f3e36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:45:55 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-ccf53723-4013-41a1-977e-27450f1f3f1c tempest-VolumesImageMetadata-353019529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f33a501-09ee-47eb-99f0-c246a22f6ab1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:45:55 devstack cinder-volume[86212]: DEBUG cinder.image.glance [None req-ccf53723-4013-41a1-977e-27450f1f3f1c tempest-VolumesImageMetadata-353019529 None] Creating Keystone auth plugin from conf {{(pid=86212) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 22 15:45:55 devstack sudo[96056]: pam_unix(sudo:session): session closed for user root Sep 22 15:45:56 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-f3a6368b-53bb-4acb-aa84-92b5121ffa1f tempest-VolumesGetTest-2122974047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2c456c31-edfa-482a-a7b4-ac99ef32fc71 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-0f2a7d78-aed3-4a49-95f6-095183ed063b" returned: 0 in 8.446s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:45:56 devstack cinder-volume[86212]: DEBUG cinder.image.image_utils [None req-f3a6368b-53bb-4acb-aa84-92b5121ffa1f tempest-VolumesGetTest-2122974047 None] Image conversion details: src /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2c456c31-edfa-482a-a7b4-ac99ef32fc71, size 1024.00 MB, duration 8.45 sec, destination /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-0f2a7d78-aed3-4a49-95f6-095183ed063b {{(pid=86212) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 22 15:45:56 devstack cinder-volume[86212]: INFO cinder.image.image_utils [None req-f3a6368b-53bb-4acb-aa84-92b5121ffa1f tempest-VolumesGetTest-2122974047 None] Converted 1024.00 MB image at 121.21 MB/s Sep 22 15:45:56 devstack cinder-volume[86212]: WARNING cinder.volume.drivers.remotefs [None req-f3a6368b-53bb-4acb-aa84-92b5121ffa1f tempest-VolumesGetTest-2122974047 None] /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-0f2a7d78-aed3-4a49-95f6-095183ed063b is being set with open permissions: ugo+rw Sep 22 15:45:56 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-f3a6368b-53bb-4acb-aa84-92b5121ffa1f tempest-VolumesGetTest-2122974047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-0f2a7d78-aed3-4a49-95f6-095183ed063b {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:45:56 devstack sudo[96076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-0f2a7d78-aed3-4a49-95f6-095183ed063b Sep 22 15:45:56 devstack sudo[96076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:45:56 devstack sudo[96076]: pam_unix(sudo:session): session closed for user root Sep 22 15:45:56 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-f3a6368b-53bb-4acb-aa84-92b5121ffa1f tempest-VolumesGetTest-2122974047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-0f2a7d78-aed3-4a49-95f6-095183ed063b" returned: 0 in 0.268s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:45:56 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-f3a6368b-53bb-4acb-aa84-92b5121ffa1f tempest-VolumesGetTest-2122974047 None] Lock "cinder-quobyte-0f2a7d78-aed3-4a49-95f6-095183ed063b" released by "_copy_volume_from_snapshot" :: held 9.701s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:45:56 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-f3a6368b-53bb-4acb-aa84-92b5121ffa1f tempest-VolumesGetTest-2122974047 None] Acquiring lock "cinder-quobyte-0e97f512-96e9-422b-b2c2-8fb3d637678f" by "_delete_snapshot" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:45:56 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-f3a6368b-53bb-4acb-aa84-92b5121ffa1f tempest-VolumesGetTest-2122974047 None] Lock "cinder-quobyte-0e97f512-96e9-422b-b2c2-8fb3d637678f" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:45:56 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-f3a6368b-53bb-4acb-aa84-92b5121ffa1f tempest-VolumesGetTest-2122974047 None] Deleting offline snapshot 0e97f512-96e9-422b-b2c2-8fb3d637678f of volume 2c456c31-edfa-482a-a7b4-ac99ef32fc71 {{(pid=86212) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 22 15:45:56 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-f3a6368b-53bb-4acb-aa84-92b5121ffa1f tempest-VolumesGetTest-2122974047 None] snapshot_file for this snap is: volume-2c456c31-edfa-482a-a7b4-ac99ef32fc71.0e97f512-96e9-422b-b2c2-8fb3d637678f {{(pid=86212) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 22 15:45:56 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[176dacb3-b33c-44d3-8f5e-18414bf3a683]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:45:56 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-f3a6368b-53bb-4acb-aa84-92b5121ffa1f tempest-VolumesGetTest-2122974047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2c456c31-edfa-482a-a7b4-ac99ef32fc71.0e97f512-96e9-422b-b2c2-8fb3d637678f {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:45:56 devstack sudo[96079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2c456c31-edfa-482a-a7b4-ac99ef32fc71.0e97f512-96e9-422b-b2c2-8fb3d637678f Sep 22 15:45:56 devstack sudo[96079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:45:56 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-ccf53723-4013-41a1-977e-27450f1f3f1c tempest-VolumesImageMetadata-353019529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f33a501-09ee-47eb-99f0-c246a22f6ab1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '57f012ca-59f4-4bb3-b899-a5d7744f2e3e', 'volume_name': 'volume-57f012ca-59f4-4bb3-b899-a5d7744f2e3e', 'volume_size': 1, 'image_id': '6995c6ae-03d1-45bf-bf55-00575d1858e8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6995c6ae-03d1-45bf-bf55-00575d1858e8', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '28219d994ba546ed905a95ed90257a43', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6995c6ae-03d1-45bf-bf55-00575d1858e8', 'created_at': datetime.datetime(2026, 9, 22, 13, 30, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 13, 30, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6995c6ae-03d1-45bf-bf55-00575d1858e8/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:45:56 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-ccf53723-4013-41a1-977e-27450f1f3f1c tempest-VolumesImageMetadata-353019529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b9b83c4-8650-4bca-9e00-a061ec8ae827) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:45:56 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-ccf53723-4013-41a1-977e-27450f1f3f1c tempest-VolumesImageMetadata-353019529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b9b83c4-8650-4bca-9e00-a061ec8ae827) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:45:56 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-ccf53723-4013-41a1-977e-27450f1f3f1c tempest-VolumesImageMetadata-353019529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e4a0dfc-754d-4049-93e8-3204b92e0a41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:45:56 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-ccf53723-4013-41a1-977e-27450f1f3f1c tempest-VolumesImageMetadata-353019529 None] Volume 57f012ca-59f4-4bb3-b899-a5d7744f2e3e: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-57f012ca-59f4-4bb3-b899-a5d7744f2e3e', 'volume_size': 1, 'image_id': '6995c6ae-03d1-45bf-bf55-00575d1858e8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6995c6ae-03d1-45bf-bf55-00575d1858e8', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '28219d994ba546ed905a95ed90257a43', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6995c6ae-03d1-45bf-bf55-00575d1858e8', 'created_at': datetime.datetime(2026, 9, 22, 13, 30, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 13, 30, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6995c6ae-03d1-45bf-bf55-00575d1858e8/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 22 15:45:56 devstack cinder-volume[86212]: DEBUG cinder.volume.flows.manager.create_volume [None req-ccf53723-4013-41a1-977e-27450f1f3f1c tempest-VolumesImageMetadata-353019529 None] Trying to clone 57f012ca-59f4-4bb3-b899-a5d7744f2e3e from image 6995c6ae-03d1-45bf-bf55-00575d1858e8 at location (None, [{'url': 'file:///opt/stack/data/glance/images/6995c6ae-03d1-45bf-bf55-00575d1858e8', 'metadata': {}}]). {{(pid=86212) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 22 15:45:56 devstack sudo[96079]: pam_unix(sudo:session): session closed for user root Sep 22 15:45:56 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-f3a6368b-53bb-4acb-aa84-92b5121ffa1f tempest-VolumesGetTest-2122974047 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2c456c31-edfa-482a-a7b4-ac99ef32fc71.0e97f512-96e9-422b-b2c2-8fb3d637678f" returned: 0 in 0.474s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:45:56 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-f3a6368b-53bb-4acb-aa84-92b5121ffa1f tempest-VolumesGetTest-2122974047 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2c456c31-edfa-482a-a7b4-ac99ef32fc71(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86212) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 22 15:45:56 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[1773cb9b-70c3-4985-bea8-2ca961d29dc8]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:45:56 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-f3a6368b-53bb-4acb-aa84-92b5121ffa1f tempest-VolumesGetTest-2122974047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2c456c31-edfa-482a-a7b4-ac99ef32fc71 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:45:56 devstack cinder-volume[86212]: DEBUG cinder.image.image_utils [None req-ccf53723-4013-41a1-977e-27450f1f3f1c tempest-VolumesImageMetadata-353019529 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_6995c6ae-03d1-45bf-bf55-00575d1858e8_ikr_bypndevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86212) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 22 15:45:56 devstack cinder-volume[86212]: INFO cinder.image.image_utils [None req-ccf53723-4013-41a1-977e-27450f1f3f1c tempest-VolumesImageMetadata-353019529 None] Image download 20.69 MB at 20.69 MB/s Sep 22 15:45:57 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[8958f52b-47df-4160-9d8a-56f08d919cbf]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:45:57 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-ccf53723-4013-41a1-977e-27450f1f3f1c tempest-VolumesImageMetadata-353019529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6995c6ae-03d1-45bf-bf55-00575d1858e8_ikr_bypndevstack@QuobyteHD {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:45:57 devstack sudo[96086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2c456c31-edfa-482a-a7b4-ac99ef32fc71 Sep 22 15:45:57 devstack sudo[96086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:45:57 devstack sudo[96087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6995c6ae-03d1-45bf-bf55-00575d1858e8_ikr_bypndevstack@QuobyteHD Sep 22 15:45:57 devstack sudo[96087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:45:57 devstack sudo[96087]: pam_unix(sudo:session): session closed for user root Sep 22 15:45:57 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-ccf53723-4013-41a1-977e-27450f1f3f1c tempest-VolumesImageMetadata-353019529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6995c6ae-03d1-45bf-bf55-00575d1858e8_ikr_bypndevstack@QuobyteHD" returned: 0 in 0.341s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:45:57 devstack cinder-volume[86212]: DEBUG cinder.image.image_utils [None req-ccf53723-4013-41a1-977e-27450f1f3f1c tempest-VolumesImageMetadata-353019529 None] Temporary image 6995c6ae-03d1-45bf-bf55-00575d1858e8 is fetched for user 799759e868094ea0b9dd27e5692ccba0. {{(pid=86212) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 22 15:45:57 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe5ee706-05d5-421c-af75-3203e2db6151]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:45:57 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-ccf53723-4013-41a1-977e-27450f1f3f1c tempest-VolumesImageMetadata-353019529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6995c6ae-03d1-45bf-bf55-00575d1858e8_ikr_bypndevstack@QuobyteHD {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:45:57 devstack sudo[96086]: pam_unix(sudo:session): session closed for user root Sep 22 15:45:57 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-f3a6368b-53bb-4acb-aa84-92b5121ffa1f tempest-VolumesGetTest-2122974047 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2c456c31-edfa-482a-a7b4-ac99ef32fc71" returned: 0 in 0.577s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:45:57 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-f3a6368b-53bb-4acb-aa84-92b5121ffa1f tempest-VolumesGetTest-2122974047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2c456c31-edfa-482a-a7b4-ac99ef32fc71.0e97f512-96e9-422b-b2c2-8fb3d637678f {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:45:57 devstack sudo[96098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2c456c31-edfa-482a-a7b4-ac99ef32fc71.0e97f512-96e9-422b-b2c2-8fb3d637678f Sep 22 15:45:57 devstack sudo[96098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:45:57 devstack sudo[96097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6995c6ae-03d1-45bf-bf55-00575d1858e8_ikr_bypndevstack@QuobyteHD Sep 22 15:45:57 devstack sudo[96097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:45:57 devstack sudo[96097]: pam_unix(sudo:session): session closed for user root Sep 22 15:45:57 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-ccf53723-4013-41a1-977e-27450f1f3f1c tempest-VolumesImageMetadata-353019529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6995c6ae-03d1-45bf-bf55-00575d1858e8_ikr_bypndevstack@QuobyteHD" returned: 0 in 0.386s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:45:57 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-ccf53723-4013-41a1-977e-27450f1f3f1c tempest-VolumesImageMetadata-353019529 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:45:57 devstack sudo[96098]: pam_unix(sudo:session): session closed for user root Sep 22 15:45:57 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-f3a6368b-53bb-4acb-aa84-92b5121ffa1f tempest-VolumesGetTest-2122974047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2c456c31-edfa-482a-a7b4-ac99ef32fc71.0e97f512-96e9-422b-b2c2-8fb3d637678f" returned: 0 in 0.384s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:45:57 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-f3a6368b-53bb-4acb-aa84-92b5121ffa1f tempest-VolumesGetTest-2122974047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2c456c31-edfa-482a-a7b4-ac99ef32fc71.0e97f512-96e9-422b-b2c2-8fb3d637678f {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:45:57 devstack sudo[96109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2c456c31-edfa-482a-a7b4-ac99ef32fc71.0e97f512-96e9-422b-b2c2-8fb3d637678f Sep 22 15:45:57 devstack sudo[96109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:45:58 devstack sudo[96109]: pam_unix(sudo:session): session closed for user root Sep 22 15:45:58 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-f3a6368b-53bb-4acb-aa84-92b5121ffa1f tempest-VolumesGetTest-2122974047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2c456c31-edfa-482a-a7b4-ac99ef32fc71.0e97f512-96e9-422b-b2c2-8fb3d637678f" returned: 0 in 0.263s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:45:58 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-f3a6368b-53bb-4acb-aa84-92b5121ffa1f tempest-VolumesGetTest-2122974047 None] Lock "cinder-quobyte-0e97f512-96e9-422b-b2c2-8fb3d637678f" released by "_delete_snapshot" :: held 1.852s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:45:58 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-f3a6368b-53bb-4acb-aa84-92b5121ffa1f tempest-VolumesGetTest-2122974047 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 14.174s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:45:58 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-391e2ef0-e718-46a0-aca9-ca569f47b26c tempest-GroupSnapshotsTest-1556879145 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.924s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:45:58 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-391e2ef0-e718-46a0-aca9-ca569f47b26c tempest-GroupSnapshotsTest-1556879145 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=d3b9e0e1-a1c7-4e9a-aa8f-39740199141e,created_at=2026-09-22T13:45:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-236625161',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d3b9e0e1-a1c7-4e9a-aa8f-39740199141e,host='devstack@QuobyteHD#QuobyteHD',id=36fece85-c391-4b3d-8484-d33f1e020467,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='302ce9fa5101463680fb8113ccce1f48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:45:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:45:45Z,use_quota=True,user_id='f8650ad05c3d4df895b954f3cea76df3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b741e725-403a-47c3-8c35-f80b30e26a62),volume_type_id=b741e725-403a-47c3-8c35-f80b30e26a62)}" {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 15:45:58 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-391e2ef0-e718-46a0-aca9-ca569f47b26c tempest-GroupSnapshotsTest-1556879145 None] Creating volume 36fece85-c391-4b3d-8484-d33f1e020467 {{(pid=86212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 15:45:58 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-391e2ef0-e718-46a0-aca9-ca569f47b26c tempest-GroupSnapshotsTest-1556879145 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:45:58 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-391e2ef0-e718-46a0-aca9-ca569f47b26c tempest-GroupSnapshotsTest-1556879145 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:45:58 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-391e2ef0-e718-46a0-aca9-ca569f47b26c tempest-GroupSnapshotsTest-1556879145 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:45:58 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-391e2ef0-e718-46a0-aca9-ca569f47b26c tempest-GroupSnapshotsTest-1556879145 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:45:58 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-391e2ef0-e718-46a0-aca9-ca569f47b26c tempest-GroupSnapshotsTest-1556879145 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:45:58 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-391e2ef0-e718-46a0-aca9-ca569f47b26c tempest-GroupSnapshotsTest-1556879145 None] Selected osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 as target Quobyte volume. {{(pid=86212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 15:45:58 devstack cinder-volume[86212]: INFO cinder.volume.drivers.remotefs [None req-391e2ef0-e718-46a0-aca9-ca569f47b26c tempest-GroupSnapshotsTest-1556879145 None] casted to osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 Sep 22 15:45:58 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-391e2ef0-e718-46a0-aca9-ca569f47b26c tempest-GroupSnapshotsTest-1556879145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-36fece85-c391-4b3d-8484-d33f1e020467 1073741824 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:45:58 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-f3a6368b-53bb-4acb-aa84-92b5121ffa1f tempest-VolumesGetTest-2122974047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b65a22e3-8181-4f43-aec5-01a966a1b35d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0f2a7d78-aed3-4a49-95f6-095183ed063b', 'volume_size': 1, 'source_volid': '2c456c31-edfa-482a-a7b4-ac99ef32fc71', 'source_volstatus': 'available'}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:45:58 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-f3a6368b-53bb-4acb-aa84-92b5121ffa1f tempest-VolumesGetTest-2122974047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6efe0410-97ae-4404-810d-1a0934ce8e28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:45:58 devstack sudo[96112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-36fece85-c391-4b3d-8484-d33f1e020467 1073741824 Sep 22 15:45:58 devstack sudo[96112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:45:58 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-f3a6368b-53bb-4acb-aa84-92b5121ffa1f tempest-VolumesGetTest-2122974047 None] Volume volume-0f2a7d78-aed3-4a49-95f6-095183ed063b (0f2a7d78-aed3-4a49-95f6-095183ed063b): created successfully Sep 22 15:45:58 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-f3a6368b-53bb-4acb-aa84-92b5121ffa1f tempest-VolumesGetTest-2122974047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6efe0410-97ae-4404-810d-1a0934ce8e28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:45:58 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-f3a6368b-53bb-4acb-aa84-92b5121ffa1f tempest-VolumesGetTest-2122974047 None] Flow 'volume_create_manager' (5f123db7-69e9-4a45-b8db-ad2c3108f9c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:45:58 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-f3a6368b-53bb-4acb-aa84-92b5121ffa1f tempest-VolumesGetTest-2122974047 None] Created volume successfully. Sep 22 15:45:58 devstack sudo[96112]: pam_unix(sudo:session): session closed for user root Sep 22 15:45:58 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-391e2ef0-e718-46a0-aca9-ca569f47b26c tempest-GroupSnapshotsTest-1556879145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-36fece85-c391-4b3d-8484-d33f1e020467 1073741824" returned: 0 in 0.494s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:45:58 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-391e2ef0-e718-46a0-aca9-ca569f47b26c tempest-GroupSnapshotsTest-1556879145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-36fece85-c391-4b3d-8484-d33f1e020467 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:45:58 devstack sudo[96119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-36fece85-c391-4b3d-8484-d33f1e020467 Sep 22 15:45:58 devstack sudo[96119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:45:59 devstack sudo[96119]: pam_unix(sudo:session): session closed for user root Sep 22 15:45:59 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-391e2ef0-e718-46a0-aca9-ca569f47b26c tempest-GroupSnapshotsTest-1556879145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-36fece85-c391-4b3d-8484-d33f1e020467" returned: 0 in 0.273s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:45:59 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-391e2ef0-e718-46a0-aca9-ca569f47b26c tempest-GroupSnapshotsTest-1556879145 None] <== create_volume: return (806ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'} {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 15:45:59 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-391e2ef0-e718-46a0-aca9-ca569f47b26c tempest-GroupSnapshotsTest-1556879145 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.809s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:45:59 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-ccf53723-4013-41a1-977e-27450f1f3f1c tempest-VolumesImageMetadata-353019529 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.186s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:45:59 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-ccf53723-4013-41a1-977e-27450f1f3f1c tempest-VolumesImageMetadata-353019529 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:45:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1265523531',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57f012ca-59f4-4bb3-b899-a5d7744f2e3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d0457d8271640edaf577fe8a41b3cf7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:45:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:45:56Z,use_quota=True,user_id='799759e868094ea0b9dd27e5692ccba0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)}" {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 15:45:59 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-ccf53723-4013-41a1-977e-27450f1f3f1c tempest-VolumesImageMetadata-353019529 None] Creating volume 57f012ca-59f4-4bb3-b899-a5d7744f2e3e {{(pid=86212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 15:45:59 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-ccf53723-4013-41a1-977e-27450f1f3f1c tempest-VolumesImageMetadata-353019529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:45:59 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-ccf53723-4013-41a1-977e-27450f1f3f1c tempest-VolumesImageMetadata-353019529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:45:59 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-ccf53723-4013-41a1-977e-27450f1f3f1c tempest-VolumesImageMetadata-353019529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:45:59 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-ccf53723-4013-41a1-977e-27450f1f3f1c tempest-VolumesImageMetadata-353019529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:45:59 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-ccf53723-4013-41a1-977e-27450f1f3f1c tempest-VolumesImageMetadata-353019529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:45:59 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-ccf53723-4013-41a1-977e-27450f1f3f1c tempest-VolumesImageMetadata-353019529 None] Selected osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 as target Quobyte volume. {{(pid=86212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 15:45:59 devstack cinder-volume[86212]: INFO cinder.volume.drivers.remotefs [None req-ccf53723-4013-41a1-977e-27450f1f3f1c tempest-VolumesImageMetadata-353019529 None] casted to osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 Sep 22 15:45:59 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-ccf53723-4013-41a1-977e-27450f1f3f1c tempest-VolumesImageMetadata-353019529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-57f012ca-59f4-4bb3-b899-a5d7744f2e3e 1073741824 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:45:59 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-391e2ef0-e718-46a0-aca9-ca569f47b26c tempest-GroupSnapshotsTest-1556879145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4409ddb-0cd9-4265-8c44-1ff246e61f11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36fece85-c391-4b3d-8484-d33f1e020467', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:45:59 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-391e2ef0-e718-46a0-aca9-ca569f47b26c tempest-GroupSnapshotsTest-1556879145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2e483f3-68e3-4aee-8f54-327c2dfdeb29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:45:59 devstack sudo[96122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-57f012ca-59f4-4bb3-b899-a5d7744f2e3e 1073741824 Sep 22 15:45:59 devstack sudo[96122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:45:59 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-391e2ef0-e718-46a0-aca9-ca569f47b26c tempest-GroupSnapshotsTest-1556879145 None] Volume volume-36fece85-c391-4b3d-8484-d33f1e020467 (36fece85-c391-4b3d-8484-d33f1e020467): created successfully Sep 22 15:45:59 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-391e2ef0-e718-46a0-aca9-ca569f47b26c tempest-GroupSnapshotsTest-1556879145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2e483f3-68e3-4aee-8f54-327c2dfdeb29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:45:59 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-391e2ef0-e718-46a0-aca9-ca569f47b26c tempest-GroupSnapshotsTest-1556879145 None] Flow 'volume_create_manager' (36d1f051-5398-460b-abb3-b739910ceaeb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:45:59 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-391e2ef0-e718-46a0-aca9-ca569f47b26c tempest-GroupSnapshotsTest-1556879145 None] Created volume successfully. Sep 22 15:45:59 devstack sudo[96122]: pam_unix(sudo:session): session closed for user root Sep 22 15:45:59 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-ccf53723-4013-41a1-977e-27450f1f3f1c tempest-VolumesImageMetadata-353019529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-57f012ca-59f4-4bb3-b899-a5d7744f2e3e 1073741824" returned: 0 in 0.527s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:45:59 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-ccf53723-4013-41a1-977e-27450f1f3f1c tempest-VolumesImageMetadata-353019529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-57f012ca-59f4-4bb3-b899-a5d7744f2e3e {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:45:59 devstack sudo[96128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-57f012ca-59f4-4bb3-b899-a5d7744f2e3e Sep 22 15:45:59 devstack sudo[96128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:45:59 devstack sudo[96128]: pam_unix(sudo:session): session closed for user root Sep 22 15:45:59 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-ccf53723-4013-41a1-977e-27450f1f3f1c tempest-VolumesImageMetadata-353019529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-57f012ca-59f4-4bb3-b899-a5d7744f2e3e" returned: 0 in 0.287s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:45:59 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-ccf53723-4013-41a1-977e-27450f1f3f1c tempest-VolumesImageMetadata-353019529 None] <== create_volume: return (860ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'} {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 15:45:59 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-ccf53723-4013-41a1-977e-27450f1f3f1c tempest-VolumesImageMetadata-353019529 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.864s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:45:59 devstack cinder-volume[86212]: DEBUG cinder.volume.volume_utils [None req-ccf53723-4013-41a1-977e-27450f1f3f1c tempest-VolumesImageMetadata-353019529 None] Attempting download of 6995c6ae-03d1-45bf-bf55-00575d1858e8 ((None, [{'url': 'file:///opt/stack/data/glance/images/6995c6ae-03d1-45bf-bf55-00575d1858e8', 'metadata': {}}])) to volume 57f012ca-59f4-4bb3-b899-a5d7744f2e3e. {{(pid=86212) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 22 15:45:59 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[67b4910a-d7cb-4372-a5a9-fdc2b6403b07]: (4, 'raw') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:45:59 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-ccf53723-4013-41a1-977e-27450f1f3f1c tempest-VolumesImageMetadata-353019529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6995c6ae-03d1-45bf-bf55-00575d1858e8_n1v2pft7 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:46:00 devstack cinder-volume[86212]: DEBUG cinder.volume.flows.manager.create_volume [None req-cfcff321-143a-46ad-badb-0e23f4fc0b37 tempest-VolumesGetTest-2122974047 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 15:46:00 devstack sudo[96131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6995c6ae-03d1-45bf-bf55-00575d1858e8_n1v2pft7 Sep 22 15:46:00 devstack sudo[96131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:46:00 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-cfcff321-143a-46ad-badb-0e23f4fc0b37 tempest-VolumesGetTest-2122974047 None] Flow 'volume_create_manager' (b8c7b970-56a4-46a9-9116-0b42ca17ec1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:46:00 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-cfcff321-143a-46ad-badb-0e23f4fc0b37 tempest-VolumesGetTest-2122974047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d48ce50-5703-4cf9-9205-fb7f3877c490) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:46:00 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-cfcff321-143a-46ad-badb-0e23f4fc0b37 tempest-VolumesGetTest-2122974047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d48ce50-5703-4cf9-9205-fb7f3877c490) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:46:00Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1632307362',display_name='tempest-VolumesGetTest-Volume-1380697409',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69a3a56a-9384-4059-9dad-685cdd0afdc5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ab605a12e704f698a0a4b7beeffe43f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:46:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:46:00Z,use_quota=True,user_id='a0b6cabdecf14f80b25b912b51474b36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:46:00 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-cfcff321-143a-46ad-badb-0e23f4fc0b37 tempest-VolumesGetTest-2122974047 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76d5f07e-7342-49d8-9806-197d39fb16d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:46:00 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-cfcff321-143a-46ad-badb-0e23f4fc0b37 tempest-VolumesGetTest-2122974047 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76d5f07e-7342-49d8-9806-197d39fb16d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:46:00 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-cfcff321-143a-46ad-badb-0e23f4fc0b37 tempest-VolumesGetTest-2122974047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb320dc6-a041-4bbb-ac4b-f2165f7f0822) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:46:00 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-cfcff321-143a-46ad-badb-0e23f4fc0b37 tempest-VolumesGetTest-2122974047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb320dc6-a041-4bbb-ac4b-f2165f7f0822) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '69a3a56a-9384-4059-9dad-685cdd0afdc5', 'volume_name': 'volume-69a3a56a-9384-4059-9dad-685cdd0afdc5', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:46:00 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-cfcff321-143a-46ad-badb-0e23f4fc0b37 tempest-VolumesGetTest-2122974047 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d65b243-8246-434e-bd42-89c27a21d22b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:46:00 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-cfcff321-143a-46ad-badb-0e23f4fc0b37 tempest-VolumesGetTest-2122974047 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d65b243-8246-434e-bd42-89c27a21d22b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:46:00 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-cfcff321-143a-46ad-badb-0e23f4fc0b37 tempest-VolumesGetTest-2122974047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a85c006d-5363-4b95-86cd-d7985aed07cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:46:00 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-cfcff321-143a-46ad-badb-0e23f4fc0b37 tempest-VolumesGetTest-2122974047 None] Volume 69a3a56a-9384-4059-9dad-685cdd0afdc5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-69a3a56a-9384-4059-9dad-685cdd0afdc5', 'volume_size': 1} Sep 22 15:46:00 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-cfcff321-143a-46ad-badb-0e23f4fc0b37 tempest-VolumesGetTest-2122974047 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:46:00 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-cfcff321-143a-46ad-badb-0e23f4fc0b37 tempest-VolumesGetTest-2122974047 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:46:00 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-cfcff321-143a-46ad-badb-0e23f4fc0b37 tempest-VolumesGetTest-2122974047 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:46:00Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1632307362',display_name='tempest-VolumesGetTest-Volume-1380697409',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69a3a56a-9384-4059-9dad-685cdd0afdc5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ab605a12e704f698a0a4b7beeffe43f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:46:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:46:00Z,use_quota=True,user_id='a0b6cabdecf14f80b25b912b51474b36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)}" {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 15:46:00 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-cfcff321-143a-46ad-badb-0e23f4fc0b37 tempest-VolumesGetTest-2122974047 None] Creating volume 69a3a56a-9384-4059-9dad-685cdd0afdc5 {{(pid=86212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 15:46:00 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-cfcff321-143a-46ad-badb-0e23f4fc0b37 tempest-VolumesGetTest-2122974047 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:46:00 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-cfcff321-143a-46ad-badb-0e23f4fc0b37 tempest-VolumesGetTest-2122974047 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:46:00 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-cfcff321-143a-46ad-badb-0e23f4fc0b37 tempest-VolumesGetTest-2122974047 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:46:00 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-cfcff321-143a-46ad-badb-0e23f4fc0b37 tempest-VolumesGetTest-2122974047 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:46:00 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-cfcff321-143a-46ad-badb-0e23f4fc0b37 tempest-VolumesGetTest-2122974047 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:46:00 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-cfcff321-143a-46ad-badb-0e23f4fc0b37 tempest-VolumesGetTest-2122974047 None] Selected osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 as target Quobyte volume. {{(pid=86212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 15:46:00 devstack cinder-volume[86212]: INFO cinder.volume.drivers.remotefs [None req-cfcff321-143a-46ad-badb-0e23f4fc0b37 tempest-VolumesGetTest-2122974047 None] casted to osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 Sep 22 15:46:00 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-cfcff321-143a-46ad-badb-0e23f4fc0b37 tempest-VolumesGetTest-2122974047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-69a3a56a-9384-4059-9dad-685cdd0afdc5 1073741824 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:46:00 devstack sudo[96133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-69a3a56a-9384-4059-9dad-685cdd0afdc5 1073741824 Sep 22 15:46:00 devstack sudo[96133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:46:00 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-b22f2451-d8c3-4e26-bc69-d61a41c36070 tempest-GroupsV320Test-830839110 None] Group tempest-GroupsV320Test-Group-417858846: creating Sep 22 15:46:00 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-b22f2451-d8c3-4e26-bc69-d61a41c36070 tempest-GroupsV320Test-830839110 None] Group tempest-GroupsV320Test-Group-417858846: created successfully Sep 22 15:46:00 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-b22f2451-d8c3-4e26-bc69-d61a41c36070 tempest-GroupsV320Test-830839110 None] Create group completed successfully. Sep 22 15:46:00 devstack sudo[96131]: pam_unix(sudo:session): session closed for user root Sep 22 15:46:00 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-ccf53723-4013-41a1-977e-27450f1f3f1c tempest-VolumesImageMetadata-353019529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6995c6ae-03d1-45bf-bf55-00575d1858e8_n1v2pft7" returned: 0 in 0.396s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:46:00 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-ccf53723-4013-41a1-977e-27450f1f3f1c tempest-VolumesImageMetadata-353019529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6995c6ae-03d1-45bf-bf55-00575d1858e8_n1v2pft7 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:46:00 devstack sudo[96137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6995c6ae-03d1-45bf-bf55-00575d1858e8_n1v2pft7 Sep 22 15:46:00 devstack sudo[96137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:46:00 devstack sudo[96133]: pam_unix(sudo:session): session closed for user root Sep 22 15:46:00 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-cfcff321-143a-46ad-badb-0e23f4fc0b37 tempest-VolumesGetTest-2122974047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-69a3a56a-9384-4059-9dad-685cdd0afdc5 1073741824" returned: 0 in 0.544s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:46:00 devstack sudo[96137]: pam_unix(sudo:session): session closed for user root Sep 22 15:46:00 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-ccf53723-4013-41a1-977e-27450f1f3f1c tempest-VolumesImageMetadata-353019529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6995c6ae-03d1-45bf-bf55-00575d1858e8_n1v2pft7" returned: 1 in 0.395s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:46:00 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-ccf53723-4013-41a1-977e-27450f1f3f1c tempest-VolumesImageMetadata-353019529 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6995c6ae-03d1-45bf-bf55-00575d1858e8_n1v2pft7' failed. Not Retrying. {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 22 15:46:00 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[17da278a-032a-4b9e-9ecb-f9dcc8e5522b]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:46:00 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-ccf53723-4013-41a1-977e-27450f1f3f1c tempest-VolumesImageMetadata-353019529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6995c6ae-03d1-45bf-bf55-00575d1858e8_ikr_bypndevstack@QuobyteHD {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:46:00 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-cfcff321-143a-46ad-badb-0e23f4fc0b37 tempest-VolumesGetTest-2122974047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-69a3a56a-9384-4059-9dad-685cdd0afdc5 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:46:00 devstack sudo[96145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-69a3a56a-9384-4059-9dad-685cdd0afdc5 Sep 22 15:46:00 devstack sudo[96145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:46:00 devstack sudo[96144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6995c6ae-03d1-45bf-bf55-00575d1858e8_ikr_bypndevstack@QuobyteHD Sep 22 15:46:00 devstack sudo[96144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:46:00 devstack cinder-volume[86212]: DEBUG cinder.volume.flows.manager.create_volume [None req-49dbef62-f9b4-46b3-ba13-bada9c848e4a tempest-GroupSnapshotsTest-1556879145 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 15:46:00 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-49dbef62-f9b4-46b3-ba13-bada9c848e4a tempest-GroupSnapshotsTest-1556879145 None] Flow 'volume_create_manager' (e544d7a8-9d22-44ac-91bd-b4e67b3ec2b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:46:00 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-49dbef62-f9b4-46b3-ba13-bada9c848e4a tempest-GroupSnapshotsTest-1556879145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f6fcb45-d1c2-400c-951d-b21d3ee803b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:46:00 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-49dbef62-f9b4-46b3-ba13-bada9c848e4a tempest-GroupSnapshotsTest-1556879145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f6fcb45-d1c2-400c-951d-b21d3ee803b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:46:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-281286717',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d3b9e0e1-a1c7-4e9a-aa8f-39740199141e,host='devstack@QuobyteHD#QuobyteHD',id=b7c86c5e-e22e-4540-afa6-42b8e3340286,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='302ce9fa5101463680fb8113ccce1f48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:46:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:46:01Z,use_quota=True,user_id='f8650ad05c3d4df895b954f3cea76df3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b741e725-403a-47c3-8c35-f80b30e26a62),volume_type_id=b741e725-403a-47c3-8c35-f80b30e26a62)' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:46:01 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-49dbef62-f9b4-46b3-ba13-bada9c848e4a tempest-GroupSnapshotsTest-1556879145 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6fc3b9a-0afc-4cb0-bc2a-183b59350c19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:46:01 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-49dbef62-f9b4-46b3-ba13-bada9c848e4a tempest-GroupSnapshotsTest-1556879145 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6fc3b9a-0afc-4cb0-bc2a-183b59350c19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:46:01 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-49dbef62-f9b4-46b3-ba13-bada9c848e4a tempest-GroupSnapshotsTest-1556879145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5de09893-fcb2-484f-93f9-aba751b3cd39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:46:01 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-49dbef62-f9b4-46b3-ba13-bada9c848e4a tempest-GroupSnapshotsTest-1556879145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5de09893-fcb2-484f-93f9-aba751b3cd39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b7c86c5e-e22e-4540-afa6-42b8e3340286', 'volume_name': 'volume-b7c86c5e-e22e-4540-afa6-42b8e3340286', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:46:01 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-49dbef62-f9b4-46b3-ba13-bada9c848e4a tempest-GroupSnapshotsTest-1556879145 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7894680d-618a-4681-a70c-f237533e51bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:46:01 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-49dbef62-f9b4-46b3-ba13-bada9c848e4a tempest-GroupSnapshotsTest-1556879145 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7894680d-618a-4681-a70c-f237533e51bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:46:01 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-49dbef62-f9b4-46b3-ba13-bada9c848e4a tempest-GroupSnapshotsTest-1556879145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c7c5d77-52a0-4d74-b540-f98d9ac4e88e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:46:01 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-49dbef62-f9b4-46b3-ba13-bada9c848e4a tempest-GroupSnapshotsTest-1556879145 None] Volume b7c86c5e-e22e-4540-afa6-42b8e3340286: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b7c86c5e-e22e-4540-afa6-42b8e3340286', 'volume_size': 1} Sep 22 15:46:01 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-49dbef62-f9b4-46b3-ba13-bada9c848e4a tempest-GroupSnapshotsTest-1556879145 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:46:01 devstack sudo[96145]: pam_unix(sudo:session): session closed for user root Sep 22 15:46:01 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-cfcff321-143a-46ad-badb-0e23f4fc0b37 tempest-VolumesGetTest-2122974047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-69a3a56a-9384-4059-9dad-685cdd0afdc5" returned: 0 in 0.270s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:46:01 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-cfcff321-143a-46ad-badb-0e23f4fc0b37 tempest-VolumesGetTest-2122974047 None] <== create_volume: return (896ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'} {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 15:46:01 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-cfcff321-143a-46ad-badb-0e23f4fc0b37 tempest-VolumesGetTest-2122974047 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.899s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:46:01 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-49dbef62-f9b4-46b3-ba13-bada9c848e4a tempest-GroupSnapshotsTest-1556879145 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.067s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:46:01 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-49dbef62-f9b4-46b3-ba13-bada9c848e4a tempest-GroupSnapshotsTest-1556879145 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=d3b9e0e1-a1c7-4e9a-aa8f-39740199141e,created_at=2026-09-22T13:46:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-281286717',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d3b9e0e1-a1c7-4e9a-aa8f-39740199141e,host='devstack@QuobyteHD#QuobyteHD',id=b7c86c5e-e22e-4540-afa6-42b8e3340286,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='302ce9fa5101463680fb8113ccce1f48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:46:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:46:01Z,use_quota=True,user_id='f8650ad05c3d4df895b954f3cea76df3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b741e725-403a-47c3-8c35-f80b30e26a62),volume_type_id=b741e725-403a-47c3-8c35-f80b30e26a62)}" {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 15:46:01 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-49dbef62-f9b4-46b3-ba13-bada9c848e4a tempest-GroupSnapshotsTest-1556879145 None] Creating volume b7c86c5e-e22e-4540-afa6-42b8e3340286 {{(pid=86212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 15:46:01 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-49dbef62-f9b4-46b3-ba13-bada9c848e4a tempest-GroupSnapshotsTest-1556879145 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:46:01 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-49dbef62-f9b4-46b3-ba13-bada9c848e4a tempest-GroupSnapshotsTest-1556879145 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:46:01 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-49dbef62-f9b4-46b3-ba13-bada9c848e4a tempest-GroupSnapshotsTest-1556879145 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:46:01 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-49dbef62-f9b4-46b3-ba13-bada9c848e4a tempest-GroupSnapshotsTest-1556879145 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:46:01 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-49dbef62-f9b4-46b3-ba13-bada9c848e4a tempest-GroupSnapshotsTest-1556879145 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:46:01 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-49dbef62-f9b4-46b3-ba13-bada9c848e4a tempest-GroupSnapshotsTest-1556879145 None] Selected osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 as target Quobyte volume. {{(pid=86212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 15:46:01 devstack cinder-volume[86212]: INFO cinder.volume.drivers.remotefs [None req-49dbef62-f9b4-46b3-ba13-bada9c848e4a tempest-GroupSnapshotsTest-1556879145 None] casted to osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 Sep 22 15:46:01 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-49dbef62-f9b4-46b3-ba13-bada9c848e4a tempest-GroupSnapshotsTest-1556879145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b7c86c5e-e22e-4540-afa6-42b8e3340286 1073741824 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:46:01 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-cfcff321-143a-46ad-badb-0e23f4fc0b37 tempest-VolumesGetTest-2122974047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a85c006d-5363-4b95-86cd-d7985aed07cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69a3a56a-9384-4059-9dad-685cdd0afdc5', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:46:01 devstack sudo[96153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b7c86c5e-e22e-4540-afa6-42b8e3340286 1073741824 Sep 22 15:46:01 devstack sudo[96144]: pam_unix(sudo:session): session closed for user root Sep 22 15:46:01 devstack sudo[96153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:46:01 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-cfcff321-143a-46ad-badb-0e23f4fc0b37 tempest-VolumesGetTest-2122974047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4e561e6-2cf7-46ad-b5d6-2e2e4fb5884d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:46:01 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-ccf53723-4013-41a1-977e-27450f1f3f1c tempest-VolumesImageMetadata-353019529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6995c6ae-03d1-45bf-bf55-00575d1858e8_ikr_bypndevstack@QuobyteHD" returned: 0 in 0.372s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:46:01 devstack cinder-volume[86212]: DEBUG cinder.image.image_utils [None req-ccf53723-4013-41a1-977e-27450f1f3f1c tempest-VolumesImageMetadata-353019529 None] 6995c6ae-03d1-45bf-bf55-00575d1858e8 was qcow2, converting to qcow2 {{(pid=86212) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 22 15:46:01 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-ccf53723-4013-41a1-977e-27450f1f3f1c tempest-VolumesImageMetadata-353019529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6995c6ae-03d1-45bf-bf55-00575d1858e8_ikr_bypndevstack@QuobyteHD /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-57f012ca-59f4-4bb3-b899-a5d7744f2e3e {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:46:01 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-cfcff321-143a-46ad-badb-0e23f4fc0b37 tempest-VolumesGetTest-2122974047 None] Volume volume-69a3a56a-9384-4059-9dad-685cdd0afdc5 (69a3a56a-9384-4059-9dad-685cdd0afdc5): created successfully Sep 22 15:46:01 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-cfcff321-143a-46ad-badb-0e23f4fc0b37 tempest-VolumesGetTest-2122974047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4e561e6-2cf7-46ad-b5d6-2e2e4fb5884d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:46:01 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-cfcff321-143a-46ad-badb-0e23f4fc0b37 tempest-VolumesGetTest-2122974047 None] Flow 'volume_create_manager' (b8c7b970-56a4-46a9-9116-0b42ca17ec1b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:46:01 devstack sudo[96155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6995c6ae-03d1-45bf-bf55-00575d1858e8_ikr_bypndevstack@QuobyteHD /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-57f012ca-59f4-4bb3-b899-a5d7744f2e3e Sep 22 15:46:01 devstack sudo[96155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:46:01 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-cfcff321-143a-46ad-badb-0e23f4fc0b37 tempest-VolumesGetTest-2122974047 None] Created volume successfully. Sep 22 15:46:01 devstack sudo[96153]: pam_unix(sudo:session): session closed for user root Sep 22 15:46:01 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-49dbef62-f9b4-46b3-ba13-bada9c848e4a tempest-GroupSnapshotsTest-1556879145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b7c86c5e-e22e-4540-afa6-42b8e3340286 1073741824" returned: 0 in 0.492s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:46:01 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-49dbef62-f9b4-46b3-ba13-bada9c848e4a tempest-GroupSnapshotsTest-1556879145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b7c86c5e-e22e-4540-afa6-42b8e3340286 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:46:01 devstack sudo[96166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b7c86c5e-e22e-4540-afa6-42b8e3340286 Sep 22 15:46:01 devstack sudo[96166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:46:01 devstack cinder-volume[86212]: DEBUG cinder.quota [None req-ed52cd24-6ea5-4db4-8120-acd03f1d7620 tempest-GroupsV320Test-830839110 None] Created reservations ['a2512461-b142-4248-8139-cef6273dfb11'] {{(pid=86212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 15:46:01 devstack sudo[96166]: pam_unix(sudo:session): session closed for user root Sep 22 15:46:01 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-ed52cd24-6ea5-4db4-8120-acd03f1d7620 tempest-GroupsV320Test-830839110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:46:01 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-ed52cd24-6ea5-4db4-8120-acd03f1d7620 tempest-GroupsV320Test-830839110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:46:01 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-ed52cd24-6ea5-4db4-8120-acd03f1d7620 tempest-GroupsV320Test-830839110 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:46:01 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-ed52cd24-6ea5-4db4-8120-acd03f1d7620 tempest-GroupsV320Test-830839110 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:46:01 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-ed52cd24-6ea5-4db4-8120-acd03f1d7620 tempest-GroupsV320Test-830839110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:46:01 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-ed52cd24-6ea5-4db4-8120-acd03f1d7620 tempest-GroupsV320Test-830839110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:46:01 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-49dbef62-f9b4-46b3-ba13-bada9c848e4a tempest-GroupSnapshotsTest-1556879145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b7c86c5e-e22e-4540-afa6-42b8e3340286" returned: 0 in 0.317s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:46:01 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-49dbef62-f9b4-46b3-ba13-bada9c848e4a tempest-GroupSnapshotsTest-1556879145 None] <== create_volume: return (868ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'} {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 15:46:01 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-49dbef62-f9b4-46b3-ba13-bada9c848e4a tempest-GroupSnapshotsTest-1556879145 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.871s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:46:01 devstack sudo[96169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc Sep 22 15:46:01 devstack sudo[96169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:46:02 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-49dbef62-f9b4-46b3-ba13-bada9c848e4a tempest-GroupSnapshotsTest-1556879145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c7c5d77-52a0-4d74-b540-f98d9ac4e88e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b7c86c5e-e22e-4540-afa6-42b8e3340286', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:46:02 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-49dbef62-f9b4-46b3-ba13-bada9c848e4a tempest-GroupSnapshotsTest-1556879145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd764d34-99eb-41d1-a6a6-b8d18ce67757) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:46:02 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-49dbef62-f9b4-46b3-ba13-bada9c848e4a tempest-GroupSnapshotsTest-1556879145 None] Volume volume-b7c86c5e-e22e-4540-afa6-42b8e3340286 (b7c86c5e-e22e-4540-afa6-42b8e3340286): created successfully Sep 22 15:46:02 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-49dbef62-f9b4-46b3-ba13-bada9c848e4a tempest-GroupSnapshotsTest-1556879145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd764d34-99eb-41d1-a6a6-b8d18ce67757) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:46:02 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-49dbef62-f9b4-46b3-ba13-bada9c848e4a tempest-GroupSnapshotsTest-1556879145 None] Flow 'volume_create_manager' (e544d7a8-9d22-44ac-91bd-b4e67b3ec2b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:46:02 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-49dbef62-f9b4-46b3-ba13-bada9c848e4a tempest-GroupSnapshotsTest-1556879145 None] Created volume successfully. Sep 22 15:46:02 devstack sudo[96169]: pam_unix(sudo:session): session closed for user root Sep 22 15:46:02 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-ed52cd24-6ea5-4db4-8120-acd03f1d7620 tempest-GroupsV320Test-830839110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc" returned: 0 in 0.303s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:46:02 devstack cinder-volume[86212]: DEBUG cinder.manager [None req-ed52cd24-6ea5-4db4-8120-acd03f1d7620 tempest-GroupsV320Test-830839110 None] Notifying Schedulers of capabilities ... {{(pid=86212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 15:46:02 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-ed52cd24-6ea5-4db4-8120-acd03f1d7620 tempest-GroupsV320Test-830839110 None] Delete group completed successfully. Sep 22 15:46:02 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-6a1345af-0bcc-4f29-9b13-1132d4e76d14 tempest-VolumesGetTest-2122974047 None] Acquiring lock "cinder-69a3a56a-9384-4059-9dad-685cdd0afdc5-delete_volume" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:46:02 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-6a1345af-0bcc-4f29-9b13-1132d4e76d14 tempest-VolumesGetTest-2122974047 None] Lock "cinder-69a3a56a-9384-4059-9dad-685cdd0afdc5-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:46:02 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-6a1345af-0bcc-4f29-9b13-1132d4e76d14 tempest-VolumesGetTest-2122974047 None] Acquiring lock "cinder-quobyte-69a3a56a-9384-4059-9dad-685cdd0afdc5" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:46:02 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-6a1345af-0bcc-4f29-9b13-1132d4e76d14 tempest-VolumesGetTest-2122974047 None] Lock "cinder-quobyte-69a3a56a-9384-4059-9dad-685cdd0afdc5" acquired by "delete_volume" :: waited 0.018s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:46:02 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5c42507-6bd8-44a7-95fa-c47ef6131a82]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:46:02 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-6a1345af-0bcc-4f29-9b13-1132d4e76d14 tempest-VolumesGetTest-2122974047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-69a3a56a-9384-4059-9dad-685cdd0afdc5 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:46:02 devstack sudo[96173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-69a3a56a-9384-4059-9dad-685cdd0afdc5 Sep 22 15:46:02 devstack sudo[96173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:46:02 devstack sudo[96173]: pam_unix(sudo:session): session closed for user root Sep 22 15:46:02 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-6a1345af-0bcc-4f29-9b13-1132d4e76d14 tempest-VolumesGetTest-2122974047 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-69a3a56a-9384-4059-9dad-685cdd0afdc5" returned: 0 in 0.366s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:46:02 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-6a1345af-0bcc-4f29-9b13-1132d4e76d14 tempest-VolumesGetTest-2122974047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-69a3a56a-9384-4059-9dad-685cdd0afdc5 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:46:02 devstack sudo[96178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-69a3a56a-9384-4059-9dad-685cdd0afdc5 Sep 22 15:46:02 devstack sudo[96178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:46:03 devstack sudo[96178]: pam_unix(sudo:session): session closed for user root Sep 22 15:46:03 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-6a1345af-0bcc-4f29-9b13-1132d4e76d14 tempest-VolumesGetTest-2122974047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-69a3a56a-9384-4059-9dad-685cdd0afdc5" returned: 0 in 0.293s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:46:03 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-6a1345af-0bcc-4f29-9b13-1132d4e76d14 tempest-VolumesGetTest-2122974047 None] Lock "cinder-quobyte-69a3a56a-9384-4059-9dad-685cdd0afdc5" released by "delete_volume" :: held 0.707s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:46:03 devstack cinder-volume[86212]: DEBUG cinder.quota [None req-6a1345af-0bcc-4f29-9b13-1132d4e76d14 tempest-VolumesGetTest-2122974047 None] Created reservations ['e71040c1-ce81-4fbf-8079-1287eff030db', '177f949e-71e9-4392-80e9-5c6da088cd8a', 'a9f036cc-fa4a-44a1-9c4b-560ee66c1fb9', '9a9612b2-16a6-4ce6-a491-06b64671d915'] {{(pid=86212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 15:46:03 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-6a1345af-0bcc-4f29-9b13-1132d4e76d14 tempest-VolumesGetTest-2122974047 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:46:03 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-6a1345af-0bcc-4f29-9b13-1132d4e76d14 tempest-VolumesGetTest-2122974047 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:46:03 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-6a1345af-0bcc-4f29-9b13-1132d4e76d14 tempest-VolumesGetTest-2122974047 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:46:03 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-6a1345af-0bcc-4f29-9b13-1132d4e76d14 tempest-VolumesGetTest-2122974047 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:46:03 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-6a1345af-0bcc-4f29-9b13-1132d4e76d14 tempest-VolumesGetTest-2122974047 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:46:03 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-6a1345af-0bcc-4f29-9b13-1132d4e76d14 tempest-VolumesGetTest-2122974047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:46:03 devstack sudo[96181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc Sep 22 15:46:03 devstack sudo[96181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:46:03 devstack sudo[96155]: pam_unix(sudo:session): session closed for user root Sep 22 15:46:03 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-ccf53723-4013-41a1-977e-27450f1f3f1c tempest-VolumesImageMetadata-353019529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6995c6ae-03d1-45bf-bf55-00575d1858e8_ikr_bypndevstack@QuobyteHD /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-57f012ca-59f4-4bb3-b899-a5d7744f2e3e" returned: 0 in 2.171s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:46:03 devstack cinder-volume[86212]: DEBUG cinder.image.image_utils [None req-ccf53723-4013-41a1-977e-27450f1f3f1c tempest-VolumesImageMetadata-353019529 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_6995c6ae-03d1-45bf-bf55-00575d1858e8_ikr_bypndevstack@QuobyteHD, size 112.00 MB, duration 2.17 sec, destination /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-57f012ca-59f4-4bb3-b899-a5d7744f2e3e {{(pid=86212) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 22 15:46:03 devstack cinder-volume[86212]: INFO cinder.image.image_utils [None req-ccf53723-4013-41a1-977e-27450f1f3f1c tempest-VolumesImageMetadata-353019529 None] Converted 112.00 MB image at 51.55 MB/s Sep 22 15:46:03 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-ccf53723-4013-41a1-977e-27450f1f3f1c tempest-VolumesImageMetadata-353019529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-57f012ca-59f4-4bb3-b899-a5d7744f2e3e 1G {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:46:03 devstack sudo[96183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-57f012ca-59f4-4bb3-b899-a5d7744f2e3e 1G Sep 22 15:46:03 devstack sudo[96183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:46:03 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-020c7400-bd94-49c9-bcfb-2454a75c640f tempest-VolumesGetTest-2122974047 None] Acquiring lock "cinder-0f2a7d78-aed3-4a49-95f6-095183ed063b-delete_volume" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:46:03 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-4d01cc4b-f7d4-4985-a4e8-b3decdb1d7dd tempest-GroupSnapshotsTest-1556879145 None] Update group completed successfully. Sep 22 15:46:03 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-020c7400-bd94-49c9-bcfb-2454a75c640f tempest-VolumesGetTest-2122974047 None] Lock "cinder-0f2a7d78-aed3-4a49-95f6-095183ed063b-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:46:03 devstack sudo[96181]: pam_unix(sudo:session): session closed for user root Sep 22 15:46:03 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-6a1345af-0bcc-4f29-9b13-1132d4e76d14 tempest-VolumesGetTest-2122974047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc" returned: 0 in 0.425s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:46:03 devstack cinder-volume[86212]: DEBUG cinder.manager [None req-6a1345af-0bcc-4f29-9b13-1132d4e76d14 tempest-VolumesGetTest-2122974047 None] Notifying Schedulers of capabilities ... {{(pid=86212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 15:46:03 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-6a1345af-0bcc-4f29-9b13-1132d4e76d14 tempest-VolumesGetTest-2122974047 None] Deleted volume successfully. Sep 22 15:46:03 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-6a1345af-0bcc-4f29-9b13-1132d4e76d14 tempest-VolumesGetTest-2122974047 None] Lock "cinder-69a3a56a-9384-4059-9dad-685cdd0afdc5-delete_volume" released by "delete_volume" :: held 1.420s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:46:03 devstack sudo[96183]: pam_unix(sudo:session): session closed for user root Sep 22 15:46:03 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-ccf53723-4013-41a1-977e-27450f1f3f1c tempest-VolumesImageMetadata-353019529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-57f012ca-59f4-4bb3-b899-a5d7744f2e3e 1G" returned: 0 in 0.447s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:46:03 devstack cinder-volume[86212]: DEBUG cinder.volume.volume_utils [None req-ccf53723-4013-41a1-977e-27450f1f3f1c tempest-VolumesImageMetadata-353019529 None] Downloaded image 6995c6ae-03d1-45bf-bf55-00575d1858e8 ((None, [{'url': 'file:///opt/stack/data/glance/images/6995c6ae-03d1-45bf-bf55-00575d1858e8', 'metadata': {}}])) to volume 57f012ca-59f4-4bb3-b899-a5d7744f2e3e successfully. {{(pid=86212) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 22 15:46:03 devstack cinder-volume[86212]: DEBUG cinder.image.image_utils [None req-ccf53723-4013-41a1-977e-27450f1f3f1c tempest-VolumesImageMetadata-353019529 None] Temporary image 6995c6ae-03d1-45bf-bf55-00575d1858e8 for user 799759e868094ea0b9dd27e5692ccba0 is deleted. {{(pid=86212) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 22 15:46:03 devstack cinder-volume[86212]: DEBUG cinder.volume.volume_utils [None req-ccf53723-4013-41a1-977e-27450f1f3f1c tempest-VolumesImageMetadata-353019529 None] Marking volume 57f012ca-59f4-4bb3-b899-a5d7744f2e3e as bootable. {{(pid=86212) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 22 15:46:03 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-020c7400-bd94-49c9-bcfb-2454a75c640f tempest-VolumesGetTest-2122974047 None] Acquiring lock "cinder-quobyte-0f2a7d78-aed3-4a49-95f6-095183ed063b" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:46:03 devstack cinder-volume[86212]: DEBUG cinder.volume.flows.manager.create_volume [None req-ccf53723-4013-41a1-977e-27450f1f3f1c tempest-VolumesImageMetadata-353019529 None] Copying metadata from image 6995c6ae-03d1-45bf-bf55-00575d1858e8 to 57f012ca-59f4-4bb3-b899-a5d7744f2e3e. {{(pid=86212) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 22 15:46:03 devstack cinder-volume[86212]: DEBUG cinder.volume.flows.manager.create_volume [None req-ccf53723-4013-41a1-977e-27450f1f3f1c tempest-VolumesImageMetadata-353019529 None] Creating volume glance metadata for volume 57f012ca-59f4-4bb3-b899-a5d7744f2e3e backed by image 6995c6ae-03d1-45bf-bf55-00575d1858e8 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '6995c6ae-03d1-45bf-bf55-00575d1858e8', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86212) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 22 15:46:03 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-020c7400-bd94-49c9-bcfb-2454a75c640f tempest-VolumesGetTest-2122974047 None] Lock "cinder-quobyte-0f2a7d78-aed3-4a49-95f6-095183ed063b" acquired by "delete_volume" :: waited 0.018s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:46:03 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[404837d3-1d24-45a3-a5ac-68c90fb36061]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:46:03 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-020c7400-bd94-49c9-bcfb-2454a75c640f tempest-VolumesGetTest-2122974047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-0f2a7d78-aed3-4a49-95f6-095183ed063b {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:46:03 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-ccf53723-4013-41a1-977e-27450f1f3f1c tempest-VolumesImageMetadata-353019529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e4a0dfc-754d-4049-93e8-3204b92e0a41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-57f012ca-59f4-4bb3-b899-a5d7744f2e3e', 'volume_size': 1, 'image_id': '6995c6ae-03d1-45bf-bf55-00575d1858e8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6995c6ae-03d1-45bf-bf55-00575d1858e8', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '28219d994ba546ed905a95ed90257a43', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6995c6ae-03d1-45bf-bf55-00575d1858e8', 'created_at': datetime.datetime(2026, 9, 22, 13, 30, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 13, 30, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6995c6ae-03d1-45bf-bf55-00575d1858e8/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:46:03 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-ccf53723-4013-41a1-977e-27450f1f3f1c tempest-VolumesImageMetadata-353019529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3defd7a-2ec3-4249-bba1-ab228a524a79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:46:03 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-ccf53723-4013-41a1-977e-27450f1f3f1c tempest-VolumesImageMetadata-353019529 None] Volume volume-57f012ca-59f4-4bb3-b899-a5d7744f2e3e (57f012ca-59f4-4bb3-b899-a5d7744f2e3e): created successfully Sep 22 15:46:03 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-ccf53723-4013-41a1-977e-27450f1f3f1c tempest-VolumesImageMetadata-353019529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3defd7a-2ec3-4249-bba1-ab228a524a79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:46:03 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-ccf53723-4013-41a1-977e-27450f1f3f1c tempest-VolumesImageMetadata-353019529 None] Flow 'volume_create_manager' (62c13fb7-da34-457b-a3dc-b9bcb0d344a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:46:03 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-ccf53723-4013-41a1-977e-27450f1f3f1c tempest-VolumesImageMetadata-353019529 None] Created volume successfully. Sep 22 15:46:03 devstack sudo[96189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-0f2a7d78-aed3-4a49-95f6-095183ed063b Sep 22 15:46:03 devstack sudo[96189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:46:04 devstack sudo[96189]: pam_unix(sudo:session): session closed for user root Sep 22 15:46:04 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-020c7400-bd94-49c9-bcfb-2454a75c640f tempest-VolumesGetTest-2122974047 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-0f2a7d78-aed3-4a49-95f6-095183ed063b" returned: 0 in 0.419s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:46:04 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-020c7400-bd94-49c9-bcfb-2454a75c640f tempest-VolumesGetTest-2122974047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-0f2a7d78-aed3-4a49-95f6-095183ed063b {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:46:04 devstack sudo[96194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-0f2a7d78-aed3-4a49-95f6-095183ed063b Sep 22 15:46:04 devstack sudo[96194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:46:04 devstack sudo[96194]: pam_unix(sudo:session): session closed for user root Sep 22 15:46:04 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-020c7400-bd94-49c9-bcfb-2454a75c640f tempest-VolumesGetTest-2122974047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-0f2a7d78-aed3-4a49-95f6-095183ed063b" returned: 0 in 0.302s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:46:04 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-020c7400-bd94-49c9-bcfb-2454a75c640f tempest-VolumesGetTest-2122974047 None] Lock "cinder-quobyte-0f2a7d78-aed3-4a49-95f6-095183ed063b" released by "delete_volume" :: held 0.782s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:46:04 devstack cinder-volume[86212]: DEBUG cinder.quota [None req-020c7400-bd94-49c9-bcfb-2454a75c640f tempest-VolumesGetTest-2122974047 None] Created reservations ['fb1fb17f-a49f-403e-aa98-c3acbeb4bb9d', '75f0285c-59c7-4722-9ea9-a25cc2ab91f3', '595c4ef3-af04-41d1-a97e-5cf188f2696e', 'b7be5ec3-1533-43c0-9a45-1b35a46a2d2a'] {{(pid=86212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 15:46:04 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-4a759a20-a385-491a-9049-299de083364a tempest-VolumesImageMetadata-353019529 None] Acquiring lock "cinder-57f012ca-59f4-4bb3-b899-a5d7744f2e3e-delete_volume" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:46:04 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-020c7400-bd94-49c9-bcfb-2454a75c640f tempest-VolumesGetTest-2122974047 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:46:04 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-020c7400-bd94-49c9-bcfb-2454a75c640f tempest-VolumesGetTest-2122974047 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:46:04 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-020c7400-bd94-49c9-bcfb-2454a75c640f tempest-VolumesGetTest-2122974047 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:46:04 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-020c7400-bd94-49c9-bcfb-2454a75c640f tempest-VolumesGetTest-2122974047 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:46:04 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-020c7400-bd94-49c9-bcfb-2454a75c640f tempest-VolumesGetTest-2122974047 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:46:04 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-020c7400-bd94-49c9-bcfb-2454a75c640f tempest-VolumesGetTest-2122974047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:46:04 devstack sudo[96197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc Sep 22 15:46:04 devstack sudo[96197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:46:04 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-4a759a20-a385-491a-9049-299de083364a tempest-VolumesImageMetadata-353019529 None] Lock "cinder-57f012ca-59f4-4bb3-b899-a5d7744f2e3e-delete_volume" acquired by "delete_volume" :: waited 0.090s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:46:04 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-4a759a20-a385-491a-9049-299de083364a tempest-VolumesImageMetadata-353019529 None] Acquiring lock "cinder-quobyte-57f012ca-59f4-4bb3-b899-a5d7744f2e3e" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:46:04 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-77b588ee-abe4-49fa-beda-dba70a8ceccd tempest-GroupSnapshotsTest-1556879145 None] Update group completed successfully. Sep 22 15:46:04 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-4a759a20-a385-491a-9049-299de083364a tempest-VolumesImageMetadata-353019529 None] Lock "cinder-quobyte-57f012ca-59f4-4bb3-b899-a5d7744f2e3e" acquired by "delete_volume" :: waited 0.030s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:46:04 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[52596fc3-9658-4e7c-9a06-d5f3b0922f3e]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:46:04 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-4a759a20-a385-491a-9049-299de083364a tempest-VolumesImageMetadata-353019529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-57f012ca-59f4-4bb3-b899-a5d7744f2e3e {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:46:05 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-a80ae62a-35fd-404e-8a01-96dc622c68c5 tempest-VolumesGetTest-2122974047 None] Acquiring lock "cinder-2c456c31-edfa-482a-a7b4-ac99ef32fc71-delete_volume" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:46:05 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-a80ae62a-35fd-404e-8a01-96dc622c68c5 tempest-VolumesGetTest-2122974047 None] Lock "cinder-2c456c31-edfa-482a-a7b4-ac99ef32fc71-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:46:05 devstack sudo[96197]: pam_unix(sudo:session): session closed for user root Sep 22 15:46:05 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-020c7400-bd94-49c9-bcfb-2454a75c640f tempest-VolumesGetTest-2122974047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc" returned: 0 in 0.335s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:46:05 devstack cinder-volume[86212]: DEBUG cinder.manager [None req-020c7400-bd94-49c9-bcfb-2454a75c640f tempest-VolumesGetTest-2122974047 None] Notifying Schedulers of capabilities ... {{(pid=86212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 15:46:05 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-020c7400-bd94-49c9-bcfb-2454a75c640f tempest-VolumesGetTest-2122974047 None] Deleted volume successfully. Sep 22 15:46:05 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-a80ae62a-35fd-404e-8a01-96dc622c68c5 tempest-VolumesGetTest-2122974047 None] Acquiring lock "cinder-quobyte-2c456c31-edfa-482a-a7b4-ac99ef32fc71" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:46:05 devstack sudo[96199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-57f012ca-59f4-4bb3-b899-a5d7744f2e3e Sep 22 15:46:05 devstack sudo[96199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:46:05 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-a80ae62a-35fd-404e-8a01-96dc622c68c5 tempest-VolumesGetTest-2122974047 None] Lock "cinder-quobyte-2c456c31-edfa-482a-a7b4-ac99ef32fc71" acquired by "delete_volume" :: waited 0.020s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:46:05 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-020c7400-bd94-49c9-bcfb-2454a75c640f tempest-VolumesGetTest-2122974047 None] Lock "cinder-0f2a7d78-aed3-4a49-95f6-095183ed063b-delete_volume" released by "delete_volume" :: held 1.485s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:46:05 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1d6ad90-8464-47b6-a09e-838885161ebb]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:46:05 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-a80ae62a-35fd-404e-8a01-96dc622c68c5 tempest-VolumesGetTest-2122974047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2c456c31-edfa-482a-a7b4-ac99ef32fc71 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:46:05 devstack sudo[96202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2c456c31-edfa-482a-a7b4-ac99ef32fc71 Sep 22 15:46:05 devstack sudo[96202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:46:05 devstack sudo[96199]: pam_unix(sudo:session): session closed for user root Sep 22 15:46:05 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-4a759a20-a385-491a-9049-299de083364a tempest-VolumesImageMetadata-353019529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-57f012ca-59f4-4bb3-b899-a5d7744f2e3e" returned: 0 in 0.510s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:46:05 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-4a759a20-a385-491a-9049-299de083364a tempest-VolumesImageMetadata-353019529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-57f012ca-59f4-4bb3-b899-a5d7744f2e3e {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:46:05 devstack sudo[96207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-57f012ca-59f4-4bb3-b899-a5d7744f2e3e Sep 22 15:46:05 devstack sudo[96207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:46:05 devstack sudo[96202]: pam_unix(sudo:session): session closed for user root Sep 22 15:46:05 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-a80ae62a-35fd-404e-8a01-96dc622c68c5 tempest-VolumesGetTest-2122974047 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2c456c31-edfa-482a-a7b4-ac99ef32fc71" returned: 0 in 0.419s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:46:05 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-a80ae62a-35fd-404e-8a01-96dc622c68c5 tempest-VolumesGetTest-2122974047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2c456c31-edfa-482a-a7b4-ac99ef32fc71 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:46:05 devstack sudo[96212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2c456c31-edfa-482a-a7b4-ac99ef32fc71 Sep 22 15:46:05 devstack sudo[96212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:46:05 devstack sudo[96207]: pam_unix(sudo:session): session closed for user root Sep 22 15:46:05 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-4a759a20-a385-491a-9049-299de083364a tempest-VolumesImageMetadata-353019529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-57f012ca-59f4-4bb3-b899-a5d7744f2e3e" returned: 0 in 0.310s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:46:05 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-4a759a20-a385-491a-9049-299de083364a tempest-VolumesImageMetadata-353019529 None] Lock "cinder-quobyte-57f012ca-59f4-4bb3-b899-a5d7744f2e3e" released by "delete_volume" :: held 0.896s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:46:05 devstack cinder-volume[86212]: DEBUG cinder.quota [None req-4a759a20-a385-491a-9049-299de083364a tempest-VolumesImageMetadata-353019529 None] Created reservations ['4d78cd8f-1b5a-4c8c-989f-d16653db75b5', 'b560dcf7-ca6d-4d18-a03d-596a182fc8c7', 'ce449a99-81e4-43c1-9263-700b4a0f794d', 'ee8a3ac9-646e-45a8-8040-a8628cefb20a'] {{(pid=86212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 15:46:05 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-4a759a20-a385-491a-9049-299de083364a tempest-VolumesImageMetadata-353019529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:46:05 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-4a759a20-a385-491a-9049-299de083364a tempest-VolumesImageMetadata-353019529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:46:05 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-4a759a20-a385-491a-9049-299de083364a tempest-VolumesImageMetadata-353019529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:46:05 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-4a759a20-a385-491a-9049-299de083364a tempest-VolumesImageMetadata-353019529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:46:05 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-4a759a20-a385-491a-9049-299de083364a tempest-VolumesImageMetadata-353019529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:46:05 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-4a759a20-a385-491a-9049-299de083364a tempest-VolumesImageMetadata-353019529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:46:05 devstack sudo[96212]: pam_unix(sudo:session): session closed for user root Sep 22 15:46:05 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-a80ae62a-35fd-404e-8a01-96dc622c68c5 tempest-VolumesGetTest-2122974047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2c456c31-edfa-482a-a7b4-ac99ef32fc71" returned: 0 in 0.346s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:46:06 devstack sudo[96216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc Sep 22 15:46:06 devstack sudo[96216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:46:06 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-a80ae62a-35fd-404e-8a01-96dc622c68c5 tempest-VolumesGetTest-2122974047 None] Lock "cinder-quobyte-2c456c31-edfa-482a-a7b4-ac99ef32fc71" released by "delete_volume" :: held 0.853s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:46:06 devstack cinder-volume[86212]: DEBUG dbcounter [-] [86212] Writing DB stats cinder:SELECT=169,cinder:INSERT=59,cinder:UPDATE=178,cinder:DELETE=15 {{(pid=86212) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 22 15:46:06 devstack cinder-volume[86212]: DEBUG dbcounter [-] [86212] Writing DB stats cinder:UPDATE=200,cinder:SELECT=159,cinder:INSERT=37,cinder:DELETE=11 {{(pid=86212) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 22 15:46:06 devstack cinder-volume[86212]: DEBUG cinder.quota [None req-a80ae62a-35fd-404e-8a01-96dc622c68c5 tempest-VolumesGetTest-2122974047 None] Created reservations ['7e61ca36-7b31-4976-9861-95bb630f7c85', 'f7cadfae-3938-4efd-95f5-cdb643aade1c', 'a4b1b629-20e3-4f39-9baa-06c47877a0da', 'f741719e-a094-437a-a540-dc7d1a40c15d'] {{(pid=86212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 15:46:06 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-50f6ae77-bbc1-459b-b85d-152784df304c tempest-GroupSnapshotsTest-1556879145 None] Update group completed successfully. Sep 22 15:46:06 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-a80ae62a-35fd-404e-8a01-96dc622c68c5 tempest-VolumesGetTest-2122974047 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:46:06 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-a80ae62a-35fd-404e-8a01-96dc622c68c5 tempest-VolumesGetTest-2122974047 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:46:06 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-a80ae62a-35fd-404e-8a01-96dc622c68c5 tempest-VolumesGetTest-2122974047 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:46:06 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-a80ae62a-35fd-404e-8a01-96dc622c68c5 tempest-VolumesGetTest-2122974047 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:46:06 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-a80ae62a-35fd-404e-8a01-96dc622c68c5 tempest-VolumesGetTest-2122974047 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:46:06 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-a80ae62a-35fd-404e-8a01-96dc622c68c5 tempest-VolumesGetTest-2122974047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:46:06 devstack sudo[96216]: pam_unix(sudo:session): session closed for user root Sep 22 15:46:06 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-4a759a20-a385-491a-9049-299de083364a tempest-VolumesImageMetadata-353019529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc" returned: 0 in 0.341s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:46:06 devstack cinder-volume[86212]: DEBUG cinder.manager [None req-4a759a20-a385-491a-9049-299de083364a tempest-VolumesImageMetadata-353019529 None] Notifying Schedulers of capabilities ... {{(pid=86212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 15:46:06 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-4a759a20-a385-491a-9049-299de083364a tempest-VolumesImageMetadata-353019529 None] Deleted volume successfully. Sep 22 15:46:06 devstack sudo[96219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc Sep 22 15:46:06 devstack sudo[96219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:46:06 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-4a759a20-a385-491a-9049-299de083364a tempest-VolumesImageMetadata-353019529 None] Lock "cinder-57f012ca-59f4-4bb3-b899-a5d7744f2e3e-delete_volume" released by "delete_volume" :: held 1.502s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:46:06 devstack sudo[96219]: pam_unix(sudo:session): session closed for user root Sep 22 15:46:06 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-a80ae62a-35fd-404e-8a01-96dc622c68c5 tempest-VolumesGetTest-2122974047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc" returned: 0 in 0.299s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:46:06 devstack cinder-volume[86212]: DEBUG cinder.manager [None req-a80ae62a-35fd-404e-8a01-96dc622c68c5 tempest-VolumesGetTest-2122974047 None] Notifying Schedulers of capabilities ... {{(pid=86212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 15:46:06 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-a80ae62a-35fd-404e-8a01-96dc622c68c5 tempest-VolumesGetTest-2122974047 None] Deleted volume successfully. Sep 22 15:46:06 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-a80ae62a-35fd-404e-8a01-96dc622c68c5 tempest-VolumesGetTest-2122974047 None] Lock "cinder-2c456c31-edfa-482a-a7b4-ac99ef32fc71-delete_volume" released by "delete_volume" :: held 1.540s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:46:07 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-51dfc2b4-7f8f-4a4c-9707-581026b6e71f tempest-GroupSnapshotsTest-1556879145 None] Update group completed successfully. Sep 22 15:46:08 devstack cinder-volume[86212]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7b4aca5-be7d-4278-bb2c-504d9caa560f tempest-VolumesGetTest-2122974047 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 15:46:08 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-e7b4aca5-be7d-4278-bb2c-504d9caa560f tempest-VolumesGetTest-2122974047 None] Flow 'volume_create_manager' (da486c91-d8e5-4dfc-863d-9cec4e46556e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:46:08 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-e7b4aca5-be7d-4278-bb2c-504d9caa560f tempest-VolumesGetTest-2122974047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac34213b-1c86-4965-89ef-c4f86a6cd8c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:46:08 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-e7b4aca5-be7d-4278-bb2c-504d9caa560f tempest-VolumesGetTest-2122974047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac34213b-1c86-4965-89ef-c4f86a6cd8c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:46:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-236643215',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7c4c12d-5b38-4b2d-b1a3-54910721165d,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='4ab605a12e704f698a0a4b7beeffe43f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:46:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:46:08Z,use_quota=True,user_id='a0b6cabdecf14f80b25b912b51474b36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:46:08 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-e7b4aca5-be7d-4278-bb2c-504d9caa560f tempest-VolumesGetTest-2122974047 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf0dada9-67a6-4965-99bf-fe8d50f92d72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:46:08 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-e7b4aca5-be7d-4278-bb2c-504d9caa560f tempest-VolumesGetTest-2122974047 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf0dada9-67a6-4965-99bf-fe8d50f92d72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:46:08 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-e7b4aca5-be7d-4278-bb2c-504d9caa560f tempest-VolumesGetTest-2122974047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff40f081-0851-47fa-9293-6051ece210d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:46:08 devstack cinder-volume[86212]: DEBUG cinder.image.glance [None req-e7b4aca5-be7d-4278-bb2c-504d9caa560f tempest-VolumesGetTest-2122974047 None] Creating Keystone auth plugin from conf {{(pid=86212) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 22 15:46:08 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-e7b4aca5-be7d-4278-bb2c-504d9caa560f tempest-VolumesGetTest-2122974047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff40f081-0851-47fa-9293-6051ece210d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f7c4c12d-5b38-4b2d-b1a3-54910721165d', 'volume_name': 'volume-f7c4c12d-5b38-4b2d-b1a3-54910721165d', 'volume_size': 1, 'image_id': '6995c6ae-03d1-45bf-bf55-00575d1858e8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6995c6ae-03d1-45bf-bf55-00575d1858e8', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '28219d994ba546ed905a95ed90257a43', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6995c6ae-03d1-45bf-bf55-00575d1858e8', 'created_at': datetime.datetime(2026, 9, 22, 13, 30, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 13, 30, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6995c6ae-03d1-45bf-bf55-00575d1858e8/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:46:08 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-e7b4aca5-be7d-4278-bb2c-504d9caa560f tempest-VolumesGetTest-2122974047 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7513fca4-d861-4115-affb-af11031247ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:46:08 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-e7b4aca5-be7d-4278-bb2c-504d9caa560f tempest-VolumesGetTest-2122974047 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7513fca4-d861-4115-affb-af11031247ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:46:08 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-e7b4aca5-be7d-4278-bb2c-504d9caa560f tempest-VolumesGetTest-2122974047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12d6d895-28a0-44f5-b2b5-09ebe92aa9af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:46:08 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-e7b4aca5-be7d-4278-bb2c-504d9caa560f tempest-VolumesGetTest-2122974047 None] Volume f7c4c12d-5b38-4b2d-b1a3-54910721165d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f7c4c12d-5b38-4b2d-b1a3-54910721165d', 'volume_size': 1, 'image_id': '6995c6ae-03d1-45bf-bf55-00575d1858e8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6995c6ae-03d1-45bf-bf55-00575d1858e8', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '28219d994ba546ed905a95ed90257a43', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6995c6ae-03d1-45bf-bf55-00575d1858e8', 'created_at': datetime.datetime(2026, 9, 22, 13, 30, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 13, 30, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6995c6ae-03d1-45bf-bf55-00575d1858e8/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 22 15:46:08 devstack cinder-volume[86212]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7b4aca5-be7d-4278-bb2c-504d9caa560f tempest-VolumesGetTest-2122974047 None] Trying to clone f7c4c12d-5b38-4b2d-b1a3-54910721165d from image 6995c6ae-03d1-45bf-bf55-00575d1858e8 at location (None, [{'url': 'file:///opt/stack/data/glance/images/6995c6ae-03d1-45bf-bf55-00575d1858e8', 'metadata': {}}]). {{(pid=86212) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 22 15:46:09 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-79a73b36-4fbe-4211-a787-1c4bdd326b64 tempest-GroupSnapshotsTest-1556879145 None] GroupSnapshot daf6fe1e-a2b7-4887-9452-1b0e07f67e71: creating. Sep 22 15:46:09 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-79a73b36-4fbe-4211-a787-1c4bdd326b64 tempest-GroupSnapshotsTest-1556879145 None] Group snapshot daf6fe1e-a2b7-4887-9452-1b0e07f67e71: creating. {{(pid=86212) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 22 15:46:09 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-79a73b36-4fbe-4211-a787-1c4bdd326b64 tempest-GroupSnapshotsTest-1556879145 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:46:09 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-79a73b36-4fbe-4211-a787-1c4bdd326b64 tempest-GroupSnapshotsTest-1556879145 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:46:09 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-79a73b36-4fbe-4211-a787-1c4bdd326b64 tempest-GroupSnapshotsTest-1556879145 None] Creating offline snapshot 5c9f418f-2beb-4b22-b835-46bf518b3c98 of volume b7c86c5e-e22e-4540-afa6-42b8e3340286 {{(pid=86212) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 22 15:46:09 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[821d6dd9-a026-43ec-86df-317d13ea4493]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:46:09 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-79a73b36-4fbe-4211-a787-1c4bdd326b64 tempest-GroupSnapshotsTest-1556879145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b7c86c5e-e22e-4540-afa6-42b8e3340286 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:46:09 devstack sudo[96223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b7c86c5e-e22e-4540-afa6-42b8e3340286 Sep 22 15:46:09 devstack sudo[96223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:46:09 devstack cinder-volume[86212]: DEBUG cinder.image.image_utils [None req-e7b4aca5-be7d-4278-bb2c-504d9caa560f tempest-VolumesGetTest-2122974047 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_6995c6ae-03d1-45bf-bf55-00575d1858e8_gc1miz3odevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86212) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 22 15:46:09 devstack cinder-volume[86212]: INFO cinder.image.image_utils [None req-e7b4aca5-be7d-4278-bb2c-504d9caa560f tempest-VolumesGetTest-2122974047 None] Image download 20.69 MB at 20.69 MB/s Sep 22 15:46:09 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[d407aba0-f5a0-4a0c-90b2-190ce1e5a14d]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:46:09 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-e7b4aca5-be7d-4278-bb2c-504d9caa560f tempest-VolumesGetTest-2122974047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6995c6ae-03d1-45bf-bf55-00575d1858e8_gc1miz3odevstack@QuobyteHD {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:46:09 devstack sudo[96226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6995c6ae-03d1-45bf-bf55-00575d1858e8_gc1miz3odevstack@QuobyteHD Sep 22 15:46:09 devstack sudo[96226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:46:09 devstack sudo[96223]: pam_unix(sudo:session): session closed for user root Sep 22 15:46:09 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-79a73b36-4fbe-4211-a787-1c4bdd326b64 tempest-GroupSnapshotsTest-1556879145 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b7c86c5e-e22e-4540-afa6-42b8e3340286" returned: 0 in 0.515s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:46:09 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-79a73b36-4fbe-4211-a787-1c4bdd326b64 tempest-GroupSnapshotsTest-1556879145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b7c86c5e-e22e-4540-afa6-42b8e3340286,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b7c86c5e-e22e-4540-afa6-42b8e3340286.5c9f418f-2beb-4b22-b835-46bf518b3c98 1G {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:46:09 devstack sudo[96232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b7c86c5e-e22e-4540-afa6-42b8e3340286,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b7c86c5e-e22e-4540-afa6-42b8e3340286.5c9f418f-2beb-4b22-b835-46bf518b3c98 1G Sep 22 15:46:09 devstack sudo[96232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:46:09 devstack sudo[96226]: pam_unix(sudo:session): session closed for user root Sep 22 15:46:09 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-e7b4aca5-be7d-4278-bb2c-504d9caa560f tempest-VolumesGetTest-2122974047 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6995c6ae-03d1-45bf-bf55-00575d1858e8_gc1miz3odevstack@QuobyteHD" returned: 0 in 0.407s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:46:09 devstack cinder-volume[86212]: DEBUG cinder.image.image_utils [None req-e7b4aca5-be7d-4278-bb2c-504d9caa560f tempest-VolumesGetTest-2122974047 None] Temporary image 6995c6ae-03d1-45bf-bf55-00575d1858e8 is fetched for user a0b6cabdecf14f80b25b912b51474b36. {{(pid=86212) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 22 15:46:09 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[d502267f-0528-4500-bf30-bc11fab95ca1]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:46:09 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-e7b4aca5-be7d-4278-bb2c-504d9caa560f tempest-VolumesGetTest-2122974047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6995c6ae-03d1-45bf-bf55-00575d1858e8_gc1miz3odevstack@QuobyteHD {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:46:10 devstack sudo[96240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6995c6ae-03d1-45bf-bf55-00575d1858e8_gc1miz3odevstack@QuobyteHD Sep 22 15:46:10 devstack sudo[96240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:46:10 devstack sudo[96232]: pam_unix(sudo:session): session closed for user root Sep 22 15:46:10 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-79a73b36-4fbe-4211-a787-1c4bdd326b64 tempest-GroupSnapshotsTest-1556879145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b7c86c5e-e22e-4540-afa6-42b8e3340286,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b7c86c5e-e22e-4540-afa6-42b8e3340286.5c9f418f-2beb-4b22-b835-46bf518b3c98 1G" returned: 0 in 0.563s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:46:10 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-79a73b36-4fbe-4211-a787-1c4bdd326b64 tempest-GroupSnapshotsTest-1556879145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b7c86c5e-e22e-4540-afa6-42b8e3340286 -F qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b7c86c5e-e22e-4540-afa6-42b8e3340286.5c9f418f-2beb-4b22-b835-46bf518b3c98 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:46:10 devstack sudo[96243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b7c86c5e-e22e-4540-afa6-42b8e3340286 -F qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b7c86c5e-e22e-4540-afa6-42b8e3340286.5c9f418f-2beb-4b22-b835-46bf518b3c98 Sep 22 15:46:10 devstack sudo[96243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:46:10 devstack sudo[96240]: pam_unix(sudo:session): session closed for user root Sep 22 15:46:10 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-e7b4aca5-be7d-4278-bb2c-504d9caa560f tempest-VolumesGetTest-2122974047 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6995c6ae-03d1-45bf-bf55-00575d1858e8_gc1miz3odevstack@QuobyteHD" returned: 0 in 0.472s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:46:10 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-e7b4aca5-be7d-4278-bb2c-504d9caa560f tempest-VolumesGetTest-2122974047 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:46:10 devstack sudo[96243]: pam_unix(sudo:session): session closed for user root Sep 22 15:46:10 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-79a73b36-4fbe-4211-a787-1c4bdd326b64 tempest-GroupSnapshotsTest-1556879145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b7c86c5e-e22e-4540-afa6-42b8e3340286 -F qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b7c86c5e-e22e-4540-afa6-42b8e3340286.5c9f418f-2beb-4b22-b835-46bf518b3c98" returned: 0 in 0.391s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:46:10 devstack cinder-volume[86212]: WARNING cinder.volume.drivers.remotefs [None req-79a73b36-4fbe-4211-a787-1c4bdd326b64 tempest-GroupSnapshotsTest-1556879145 None] /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b7c86c5e-e22e-4540-afa6-42b8e3340286.5c9f418f-2beb-4b22-b835-46bf518b3c98 is being set with open permissions: ugo+rw: NotImplementedError Sep 22 15:46:10 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-79a73b36-4fbe-4211-a787-1c4bdd326b64 tempest-GroupSnapshotsTest-1556879145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b7c86c5e-e22e-4540-afa6-42b8e3340286.5c9f418f-2beb-4b22-b835-46bf518b3c98 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:46:10 devstack sudo[96251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b7c86c5e-e22e-4540-afa6-42b8e3340286.5c9f418f-2beb-4b22-b835-46bf518b3c98 Sep 22 15:46:10 devstack sudo[96251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:46:10 devstack cinder-volume[86212]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c15d5c6-e939-44fd-8a95-863c52665bf5 tempest-SnapshotsActionsTest-743576267 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 15:46:10 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-6c15d5c6-e939-44fd-8a95-863c52665bf5 tempest-SnapshotsActionsTest-743576267 None] Flow 'volume_create_manager' (aab9d1b3-c158-4983-a9e9-8b09e66de920) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:46:10 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-6c15d5c6-e939-44fd-8a95-863c52665bf5 tempest-SnapshotsActionsTest-743576267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7aade91a-2e3c-4688-8542-cab7f81d2747) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:46:10 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-6c15d5c6-e939-44fd-8a95-863c52665bf5 tempest-SnapshotsActionsTest-743576267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7aade91a-2e3c-4688-8542-cab7f81d2747) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:46:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-872714932',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6fe5ce0-11b7-4bbc-8573-9a098af7add5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6e2fb8bc6234380a0c6c43a6b41a239',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:46:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:46:11Z,use_quota=True,user_id='56ea0bb7970d49e79a4e57639edacf70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:46:10 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-6c15d5c6-e939-44fd-8a95-863c52665bf5 tempest-SnapshotsActionsTest-743576267 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e357c100-6708-4be2-aee0-f731df13fc67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:46:10 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-6c15d5c6-e939-44fd-8a95-863c52665bf5 tempest-SnapshotsActionsTest-743576267 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e357c100-6708-4be2-aee0-f731df13fc67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:46:10 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-6c15d5c6-e939-44fd-8a95-863c52665bf5 tempest-SnapshotsActionsTest-743576267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6278347d-2593-4477-8f42-51a956b80639) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:46:10 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-6c15d5c6-e939-44fd-8a95-863c52665bf5 tempest-SnapshotsActionsTest-743576267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6278347d-2593-4477-8f42-51a956b80639) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b6fe5ce0-11b7-4bbc-8573-9a098af7add5', 'volume_name': 'volume-b6fe5ce0-11b7-4bbc-8573-9a098af7add5', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:46:10 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-6c15d5c6-e939-44fd-8a95-863c52665bf5 tempest-SnapshotsActionsTest-743576267 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e21f321-c530-4665-9e27-e6d14ccc4319) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:46:10 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-6c15d5c6-e939-44fd-8a95-863c52665bf5 tempest-SnapshotsActionsTest-743576267 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e21f321-c530-4665-9e27-e6d14ccc4319) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:46:10 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-6c15d5c6-e939-44fd-8a95-863c52665bf5 tempest-SnapshotsActionsTest-743576267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9719d51-3a8f-4981-92c2-c3b6ee36eea7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:46:10 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-6c15d5c6-e939-44fd-8a95-863c52665bf5 tempest-SnapshotsActionsTest-743576267 None] Volume b6fe5ce0-11b7-4bbc-8573-9a098af7add5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b6fe5ce0-11b7-4bbc-8573-9a098af7add5', 'volume_size': 1} Sep 22 15:46:10 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-6c15d5c6-e939-44fd-8a95-863c52665bf5 tempest-SnapshotsActionsTest-743576267 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:46:10 devstack sudo[96251]: pam_unix(sudo:session): session closed for user root Sep 22 15:46:10 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-79a73b36-4fbe-4211-a787-1c4bdd326b64 tempest-GroupSnapshotsTest-1556879145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b7c86c5e-e22e-4540-afa6-42b8e3340286.5c9f418f-2beb-4b22-b835-46bf518b3c98" returned: 0 in 0.299s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:46:10 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-79a73b36-4fbe-4211-a787-1c4bdd326b64 tempest-GroupSnapshotsTest-1556879145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b7c86c5e-e22e-4540-afa6-42b8e3340286.info {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:46:10 devstack sudo[96254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b7c86c5e-e22e-4540-afa6-42b8e3340286.info Sep 22 15:46:10 devstack sudo[96254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:46:11 devstack sudo[96254]: pam_unix(sudo:session): session closed for user root Sep 22 15:46:11 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-79a73b36-4fbe-4211-a787-1c4bdd326b64 tempest-GroupSnapshotsTest-1556879145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b7c86c5e-e22e-4540-afa6-42b8e3340286.info" returned: 0 in 0.265s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:46:11 devstack cinder-volume[86212]: WARNING cinder.volume.drivers.remotefs [None req-79a73b36-4fbe-4211-a787-1c4bdd326b64 tempest-GroupSnapshotsTest-1556879145 None] /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b7c86c5e-e22e-4540-afa6-42b8e3340286.info is being set with open permissions: ugo+rw: NotImplementedError Sep 22 15:46:11 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-79a73b36-4fbe-4211-a787-1c4bdd326b64 tempest-GroupSnapshotsTest-1556879145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b7c86c5e-e22e-4540-afa6-42b8e3340286.info {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:46:11 devstack sudo[96257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b7c86c5e-e22e-4540-afa6-42b8e3340286.info Sep 22 15:46:11 devstack sudo[96257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:46:11 devstack sudo[96257]: pam_unix(sudo:session): session closed for user root Sep 22 15:46:11 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-79a73b36-4fbe-4211-a787-1c4bdd326b64 tempest-GroupSnapshotsTest-1556879145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b7c86c5e-e22e-4540-afa6-42b8e3340286.info" returned: 0 in 0.257s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:46:11 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-79a73b36-4fbe-4211-a787-1c4bdd326b64 tempest-GroupSnapshotsTest-1556879145 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.429s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:46:11 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-79a73b36-4fbe-4211-a787-1c4bdd326b64 tempest-GroupSnapshotsTest-1556879145 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:46:11 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-79a73b36-4fbe-4211-a787-1c4bdd326b64 tempest-GroupSnapshotsTest-1556879145 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:46:11 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-79a73b36-4fbe-4211-a787-1c4bdd326b64 tempest-GroupSnapshotsTest-1556879145 None] Creating offline snapshot 6f2d73b5-4582-4a89-9e3b-c2052906138e of volume 36fece85-c391-4b3d-8484-d33f1e020467 {{(pid=86212) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 22 15:46:11 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[1df4599c-c625-4163-bb01-8f1f78f5ae12]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:46:11 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-79a73b36-4fbe-4211-a787-1c4bdd326b64 tempest-GroupSnapshotsTest-1556879145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-36fece85-c391-4b3d-8484-d33f1e020467 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:46:11 devstack sudo[96260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-36fece85-c391-4b3d-8484-d33f1e020467 Sep 22 15:46:11 devstack sudo[96260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:46:11 devstack cinder-volume[86212]: DEBUG cinder.volume.flows.manager.create_volume [None req-cbd1b687-ea0d-4d88-a27d-3278eb180657 tempest-AbsoluteLimitsTests-1863331633 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 15:46:11 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-cbd1b687-ea0d-4d88-a27d-3278eb180657 tempest-AbsoluteLimitsTests-1863331633 None] Flow 'volume_create_manager' (0bb86631-b460-4b7f-8d5c-7cf69ae0981b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:46:11 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-cbd1b687-ea0d-4d88-a27d-3278eb180657 tempest-AbsoluteLimitsTests-1863331633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (213edcb2-e57c-42c7-9a50-132279acb6c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:46:11 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-cbd1b687-ea0d-4d88-a27d-3278eb180657 tempest-AbsoluteLimitsTests-1863331633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (213edcb2-e57c-42c7-9a50-132279acb6c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:46:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-446908352',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0234d5f0-3d3b-42ae-80ba-fe9eeddd3260,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1b75218377d4e4f8d78bb1be92a96d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:46:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:46:12Z,use_quota=True,user_id='654c136c95494c829f25c3d471c048d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:46:11 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-cbd1b687-ea0d-4d88-a27d-3278eb180657 tempest-AbsoluteLimitsTests-1863331633 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (004800f7-c2b7-41f9-8c20-deea263e54b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:46:11 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-cbd1b687-ea0d-4d88-a27d-3278eb180657 tempest-AbsoluteLimitsTests-1863331633 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (004800f7-c2b7-41f9-8c20-deea263e54b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:46:11 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-cbd1b687-ea0d-4d88-a27d-3278eb180657 tempest-AbsoluteLimitsTests-1863331633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a98d5b02-517f-4c55-97b3-58673d8298d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:46:11 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-cbd1b687-ea0d-4d88-a27d-3278eb180657 tempest-AbsoluteLimitsTests-1863331633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a98d5b02-517f-4c55-97b3-58673d8298d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0234d5f0-3d3b-42ae-80ba-fe9eeddd3260', 'volume_name': 'volume-0234d5f0-3d3b-42ae-80ba-fe9eeddd3260', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:46:11 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-cbd1b687-ea0d-4d88-a27d-3278eb180657 tempest-AbsoluteLimitsTests-1863331633 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4af72117-0c9b-476c-9b05-61eba80986e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:46:11 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-cbd1b687-ea0d-4d88-a27d-3278eb180657 tempest-AbsoluteLimitsTests-1863331633 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4af72117-0c9b-476c-9b05-61eba80986e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:46:11 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-cbd1b687-ea0d-4d88-a27d-3278eb180657 tempest-AbsoluteLimitsTests-1863331633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2582ac0-179b-4578-9e7a-d95b80a07aa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:46:11 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-cbd1b687-ea0d-4d88-a27d-3278eb180657 tempest-AbsoluteLimitsTests-1863331633 None] Volume 0234d5f0-3d3b-42ae-80ba-fe9eeddd3260: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0234d5f0-3d3b-42ae-80ba-fe9eeddd3260', 'volume_size': 1} Sep 22 15:46:11 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-cbd1b687-ea0d-4d88-a27d-3278eb180657 tempest-AbsoluteLimitsTests-1863331633 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:46:11 devstack sudo[96260]: pam_unix(sudo:session): session closed for user root Sep 22 15:46:11 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-79a73b36-4fbe-4211-a787-1c4bdd326b64 tempest-GroupSnapshotsTest-1556879145 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-36fece85-c391-4b3d-8484-d33f1e020467" returned: 0 in 0.388s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:46:11 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-79a73b36-4fbe-4211-a787-1c4bdd326b64 tempest-GroupSnapshotsTest-1556879145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-36fece85-c391-4b3d-8484-d33f1e020467,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-36fece85-c391-4b3d-8484-d33f1e020467.6f2d73b5-4582-4a89-9e3b-c2052906138e 1G {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:46:11 devstack sudo[96265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-36fece85-c391-4b3d-8484-d33f1e020467,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-36fece85-c391-4b3d-8484-d33f1e020467.6f2d73b5-4582-4a89-9e3b-c2052906138e 1G Sep 22 15:46:11 devstack sudo[96265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:46:12 devstack sudo[96265]: pam_unix(sudo:session): session closed for user root Sep 22 15:46:12 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-79a73b36-4fbe-4211-a787-1c4bdd326b64 tempest-GroupSnapshotsTest-1556879145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-36fece85-c391-4b3d-8484-d33f1e020467,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-36fece85-c391-4b3d-8484-d33f1e020467.6f2d73b5-4582-4a89-9e3b-c2052906138e 1G" returned: 0 in 0.389s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:46:12 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-79a73b36-4fbe-4211-a787-1c4bdd326b64 tempest-GroupSnapshotsTest-1556879145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36fece85-c391-4b3d-8484-d33f1e020467 -F qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-36fece85-c391-4b3d-8484-d33f1e020467.6f2d73b5-4582-4a89-9e3b-c2052906138e {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:46:12 devstack sudo[96270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36fece85-c391-4b3d-8484-d33f1e020467 -F qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-36fece85-c391-4b3d-8484-d33f1e020467.6f2d73b5-4582-4a89-9e3b-c2052906138e Sep 22 15:46:12 devstack sudo[96270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:46:12 devstack sudo[96270]: pam_unix(sudo:session): session closed for user root Sep 22 15:46:12 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-79a73b36-4fbe-4211-a787-1c4bdd326b64 tempest-GroupSnapshotsTest-1556879145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36fece85-c391-4b3d-8484-d33f1e020467 -F qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-36fece85-c391-4b3d-8484-d33f1e020467.6f2d73b5-4582-4a89-9e3b-c2052906138e" returned: 0 in 0.291s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:46:12 devstack cinder-volume[86212]: WARNING cinder.volume.drivers.remotefs [None req-79a73b36-4fbe-4211-a787-1c4bdd326b64 tempest-GroupSnapshotsTest-1556879145 None] /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-36fece85-c391-4b3d-8484-d33f1e020467.6f2d73b5-4582-4a89-9e3b-c2052906138e is being set with open permissions: ugo+rw: NotImplementedError Sep 22 15:46:12 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-79a73b36-4fbe-4211-a787-1c4bdd326b64 tempest-GroupSnapshotsTest-1556879145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-36fece85-c391-4b3d-8484-d33f1e020467.6f2d73b5-4582-4a89-9e3b-c2052906138e {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:46:12 devstack sudo[96275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-36fece85-c391-4b3d-8484-d33f1e020467.6f2d73b5-4582-4a89-9e3b-c2052906138e Sep 22 15:46:12 devstack sudo[96275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:46:12 devstack sudo[96275]: pam_unix(sudo:session): session closed for user root Sep 22 15:46:12 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-79a73b36-4fbe-4211-a787-1c4bdd326b64 tempest-GroupSnapshotsTest-1556879145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-36fece85-c391-4b3d-8484-d33f1e020467.6f2d73b5-4582-4a89-9e3b-c2052906138e" returned: 0 in 0.243s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:46:12 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-79a73b36-4fbe-4211-a787-1c4bdd326b64 tempest-GroupSnapshotsTest-1556879145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-36fece85-c391-4b3d-8484-d33f1e020467.info {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:46:12 devstack sudo[96278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-36fece85-c391-4b3d-8484-d33f1e020467.info Sep 22 15:46:12 devstack sudo[96278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:46:13 devstack sudo[96278]: pam_unix(sudo:session): session closed for user root Sep 22 15:46:13 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-79a73b36-4fbe-4211-a787-1c4bdd326b64 tempest-GroupSnapshotsTest-1556879145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-36fece85-c391-4b3d-8484-d33f1e020467.info" returned: 0 in 0.244s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:46:13 devstack cinder-volume[86212]: WARNING cinder.volume.drivers.remotefs [None req-79a73b36-4fbe-4211-a787-1c4bdd326b64 tempest-GroupSnapshotsTest-1556879145 None] /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-36fece85-c391-4b3d-8484-d33f1e020467.info is being set with open permissions: ugo+rw: NotImplementedError Sep 22 15:46:13 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-79a73b36-4fbe-4211-a787-1c4bdd326b64 tempest-GroupSnapshotsTest-1556879145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-36fece85-c391-4b3d-8484-d33f1e020467.info {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:46:13 devstack sudo[96281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-36fece85-c391-4b3d-8484-d33f1e020467.info Sep 22 15:46:13 devstack sudo[96281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:46:13 devstack sudo[96281]: pam_unix(sudo:session): session closed for user root Sep 22 15:46:13 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-79a73b36-4fbe-4211-a787-1c4bdd326b64 tempest-GroupSnapshotsTest-1556879145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-36fece85-c391-4b3d-8484-d33f1e020467.info" returned: 0 in 0.242s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:46:13 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-79a73b36-4fbe-4211-a787-1c4bdd326b64 tempest-GroupSnapshotsTest-1556879145 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.886s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:46:13 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-6c15d5c6-e939-44fd-8a95-863c52665bf5 tempest-SnapshotsActionsTest-743576267 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.555s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:46:13 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-6c15d5c6-e939-44fd-8a95-863c52665bf5 tempest-SnapshotsActionsTest-743576267 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:46:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-872714932',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6fe5ce0-11b7-4bbc-8573-9a098af7add5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6e2fb8bc6234380a0c6c43a6b41a239',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:46:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:46:11Z,use_quota=True,user_id='56ea0bb7970d49e79a4e57639edacf70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)}" {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 15:46:13 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-6c15d5c6-e939-44fd-8a95-863c52665bf5 tempest-SnapshotsActionsTest-743576267 None] Creating volume b6fe5ce0-11b7-4bbc-8573-9a098af7add5 {{(pid=86212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 15:46:13 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-6c15d5c6-e939-44fd-8a95-863c52665bf5 tempest-SnapshotsActionsTest-743576267 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:46:13 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-6c15d5c6-e939-44fd-8a95-863c52665bf5 tempest-SnapshotsActionsTest-743576267 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:46:13 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-6c15d5c6-e939-44fd-8a95-863c52665bf5 tempest-SnapshotsActionsTest-743576267 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:46:13 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-6c15d5c6-e939-44fd-8a95-863c52665bf5 tempest-SnapshotsActionsTest-743576267 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:46:13 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-6c15d5c6-e939-44fd-8a95-863c52665bf5 tempest-SnapshotsActionsTest-743576267 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:46:13 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-6c15d5c6-e939-44fd-8a95-863c52665bf5 tempest-SnapshotsActionsTest-743576267 None] Selected osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 as target Quobyte volume. {{(pid=86212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 15:46:13 devstack cinder-volume[86212]: INFO cinder.volume.drivers.remotefs [None req-6c15d5c6-e939-44fd-8a95-863c52665bf5 tempest-SnapshotsActionsTest-743576267 None] casted to osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 Sep 22 15:46:13 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-6c15d5c6-e939-44fd-8a95-863c52665bf5 tempest-SnapshotsActionsTest-743576267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b6fe5ce0-11b7-4bbc-8573-9a098af7add5 1073741824 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:46:13 devstack sudo[96284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b6fe5ce0-11b7-4bbc-8573-9a098af7add5 1073741824 Sep 22 15:46:13 devstack sudo[96284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:46:13 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-79a73b36-4fbe-4211-a787-1c4bdd326b64 tempest-GroupSnapshotsTest-1556879145 None] group_snapshot daf6fe1e-a2b7-4887-9452-1b0e07f67e71: created successfully Sep 22 15:46:13 devstack sudo[96284]: pam_unix(sudo:session): session closed for user root Sep 22 15:46:13 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-6c15d5c6-e939-44fd-8a95-863c52665bf5 tempest-SnapshotsActionsTest-743576267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b6fe5ce0-11b7-4bbc-8573-9a098af7add5 1073741824" returned: 0 in 0.445s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:46:13 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-6c15d5c6-e939-44fd-8a95-863c52665bf5 tempest-SnapshotsActionsTest-743576267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b6fe5ce0-11b7-4bbc-8573-9a098af7add5 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:46:13 devstack sudo[96289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b6fe5ce0-11b7-4bbc-8573-9a098af7add5 Sep 22 15:46:13 devstack sudo[96289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:46:14 devstack sudo[96289]: pam_unix(sudo:session): session closed for user root Sep 22 15:46:14 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-6c15d5c6-e939-44fd-8a95-863c52665bf5 tempest-SnapshotsActionsTest-743576267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b6fe5ce0-11b7-4bbc-8573-9a098af7add5" returned: 0 in 0.246s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:46:14 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-6c15d5c6-e939-44fd-8a95-863c52665bf5 tempest-SnapshotsActionsTest-743576267 None] <== create_volume: return (730ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'} {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 15:46:14 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-6c15d5c6-e939-44fd-8a95-863c52665bf5 tempest-SnapshotsActionsTest-743576267 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.734s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:46:14 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-e7b4aca5-be7d-4278-bb2c-504d9caa560f tempest-VolumesGetTest-2122974047 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.689s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:46:14 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-e7b4aca5-be7d-4278-bb2c-504d9caa560f tempest-VolumesGetTest-2122974047 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:46:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-236643215',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7c4c12d-5b38-4b2d-b1a3-54910721165d,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='4ab605a12e704f698a0a4b7beeffe43f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:46:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:46:08Z,use_quota=True,user_id='a0b6cabdecf14f80b25b912b51474b36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)}" {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 15:46:14 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-e7b4aca5-be7d-4278-bb2c-504d9caa560f tempest-VolumesGetTest-2122974047 None] Creating volume f7c4c12d-5b38-4b2d-b1a3-54910721165d {{(pid=86212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 15:46:14 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-e7b4aca5-be7d-4278-bb2c-504d9caa560f tempest-VolumesGetTest-2122974047 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:46:14 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-e7b4aca5-be7d-4278-bb2c-504d9caa560f tempest-VolumesGetTest-2122974047 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:46:14 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-e7b4aca5-be7d-4278-bb2c-504d9caa560f tempest-VolumesGetTest-2122974047 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:46:14 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-e7b4aca5-be7d-4278-bb2c-504d9caa560f tempest-VolumesGetTest-2122974047 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:46:14 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-e7b4aca5-be7d-4278-bb2c-504d9caa560f tempest-VolumesGetTest-2122974047 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:46:14 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-e7b4aca5-be7d-4278-bb2c-504d9caa560f tempest-VolumesGetTest-2122974047 None] Selected osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 as target Quobyte volume. {{(pid=86212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 15:46:14 devstack cinder-volume[86212]: INFO cinder.volume.drivers.remotefs [None req-e7b4aca5-be7d-4278-bb2c-504d9caa560f tempest-VolumesGetTest-2122974047 None] casted to osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 Sep 22 15:46:14 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-e7b4aca5-be7d-4278-bb2c-504d9caa560f tempest-VolumesGetTest-2122974047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-f7c4c12d-5b38-4b2d-b1a3-54910721165d 1073741824 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:46:14 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-6c15d5c6-e939-44fd-8a95-863c52665bf5 tempest-SnapshotsActionsTest-743576267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9719d51-3a8f-4981-92c2-c3b6ee36eea7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b6fe5ce0-11b7-4bbc-8573-9a098af7add5', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:46:14 devstack sudo[96292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-f7c4c12d-5b38-4b2d-b1a3-54910721165d 1073741824 Sep 22 15:46:14 devstack sudo[96292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:46:14 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-6c15d5c6-e939-44fd-8a95-863c52665bf5 tempest-SnapshotsActionsTest-743576267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (811f9087-a593-482a-9a9d-feff33712ab2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:46:14 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-6c15d5c6-e939-44fd-8a95-863c52665bf5 tempest-SnapshotsActionsTest-743576267 None] Volume volume-b6fe5ce0-11b7-4bbc-8573-9a098af7add5 (b6fe5ce0-11b7-4bbc-8573-9a098af7add5): created successfully Sep 22 15:46:14 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-6c15d5c6-e939-44fd-8a95-863c52665bf5 tempest-SnapshotsActionsTest-743576267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (811f9087-a593-482a-9a9d-feff33712ab2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:46:14 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-6c15d5c6-e939-44fd-8a95-863c52665bf5 tempest-SnapshotsActionsTest-743576267 None] Flow 'volume_create_manager' (aab9d1b3-c158-4983-a9e9-8b09e66de920) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:46:14 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-6c15d5c6-e939-44fd-8a95-863c52665bf5 tempest-SnapshotsActionsTest-743576267 None] Created volume successfully. Sep 22 15:46:14 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-1e42c7a8-0c14-4512-a6b0-c4d1a0b8afc6 tempest-GroupSnapshotsTest-1556879145 None] group_snapshot daf6fe1e-a2b7-4887-9452-1b0e07f67e71: deleting Sep 22 15:46:14 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-1e42c7a8-0c14-4512-a6b0-c4d1a0b8afc6 tempest-GroupSnapshotsTest-1556879145 None] group_snapshot daf6fe1e-a2b7-4887-9452-1b0e07f67e71: deleting {{(pid=86212) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 22 15:46:14 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-1e42c7a8-0c14-4512-a6b0-c4d1a0b8afc6 tempest-GroupSnapshotsTest-1556879145 None] Acquiring lock "cinder-quobyte-b7c86c5e-e22e-4540-afa6-42b8e3340286" by "delete_snapshot" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:46:14 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-1e42c7a8-0c14-4512-a6b0-c4d1a0b8afc6 tempest-GroupSnapshotsTest-1556879145 None] Lock "cinder-quobyte-b7c86c5e-e22e-4540-afa6-42b8e3340286" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:46:14 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-1e42c7a8-0c14-4512-a6b0-c4d1a0b8afc6 tempest-GroupSnapshotsTest-1556879145 None] Acquiring lock "cinder-quobyte-5c9f418f-2beb-4b22-b835-46bf518b3c98" by "_delete_snapshot" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:46:14 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-1e42c7a8-0c14-4512-a6b0-c4d1a0b8afc6 tempest-GroupSnapshotsTest-1556879145 None] Lock "cinder-quobyte-5c9f418f-2beb-4b22-b835-46bf518b3c98" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:46:14 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-1e42c7a8-0c14-4512-a6b0-c4d1a0b8afc6 tempest-GroupSnapshotsTest-1556879145 None] Deleting offline snapshot 5c9f418f-2beb-4b22-b835-46bf518b3c98 of volume b7c86c5e-e22e-4540-afa6-42b8e3340286 {{(pid=86212) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 22 15:46:14 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-1e42c7a8-0c14-4512-a6b0-c4d1a0b8afc6 tempest-GroupSnapshotsTest-1556879145 None] snapshot_file for this snap is: volume-b7c86c5e-e22e-4540-afa6-42b8e3340286.5c9f418f-2beb-4b22-b835-46bf518b3c98 {{(pid=86212) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 22 15:46:14 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[eba86650-c6e0-4222-b6ac-2a87ff77092e]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:46:14 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-1e42c7a8-0c14-4512-a6b0-c4d1a0b8afc6 tempest-GroupSnapshotsTest-1556879145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b7c86c5e-e22e-4540-afa6-42b8e3340286.5c9f418f-2beb-4b22-b835-46bf518b3c98 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:46:14 devstack sudo[96292]: pam_unix(sudo:session): session closed for user root Sep 22 15:46:14 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-e7b4aca5-be7d-4278-bb2c-504d9caa560f tempest-VolumesGetTest-2122974047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-f7c4c12d-5b38-4b2d-b1a3-54910721165d 1073741824" returned: 0 in 0.526s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:46:14 devstack sudo[96298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b7c86c5e-e22e-4540-afa6-42b8e3340286.5c9f418f-2beb-4b22-b835-46bf518b3c98 Sep 22 15:46:14 devstack sudo[96298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:46:14 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-e7b4aca5-be7d-4278-bb2c-504d9caa560f tempest-VolumesGetTest-2122974047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-f7c4c12d-5b38-4b2d-b1a3-54910721165d {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:46:14 devstack sudo[96300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-f7c4c12d-5b38-4b2d-b1a3-54910721165d Sep 22 15:46:14 devstack sudo[96300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:46:14 devstack sudo[96300]: pam_unix(sudo:session): session closed for user root Sep 22 15:46:14 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-e7b4aca5-be7d-4278-bb2c-504d9caa560f tempest-VolumesGetTest-2122974047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-f7c4c12d-5b38-4b2d-b1a3-54910721165d" returned: 0 in 0.298s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:46:14 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-e7b4aca5-be7d-4278-bb2c-504d9caa560f tempest-VolumesGetTest-2122974047 None] <== create_volume: return (884ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'} {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 15:46:14 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-e7b4aca5-be7d-4278-bb2c-504d9caa560f tempest-VolumesGetTest-2122974047 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.887s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:46:14 devstack sudo[96298]: pam_unix(sudo:session): session closed for user root Sep 22 15:46:14 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-cbd1b687-ea0d-4d88-a27d-3278eb180657 tempest-AbsoluteLimitsTests-1863331633 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.243s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:46:14 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-cbd1b687-ea0d-4d88-a27d-3278eb180657 tempest-AbsoluteLimitsTests-1863331633 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:46:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-446908352',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0234d5f0-3d3b-42ae-80ba-fe9eeddd3260,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1b75218377d4e4f8d78bb1be92a96d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:46:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:46:12Z,use_quota=True,user_id='654c136c95494c829f25c3d471c048d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)}" {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 15:46:14 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-cbd1b687-ea0d-4d88-a27d-3278eb180657 tempest-AbsoluteLimitsTests-1863331633 None] Creating volume 0234d5f0-3d3b-42ae-80ba-fe9eeddd3260 {{(pid=86212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 15:46:14 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-cbd1b687-ea0d-4d88-a27d-3278eb180657 tempest-AbsoluteLimitsTests-1863331633 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:46:14 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-cbd1b687-ea0d-4d88-a27d-3278eb180657 tempest-AbsoluteLimitsTests-1863331633 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:46:15 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-cbd1b687-ea0d-4d88-a27d-3278eb180657 tempest-AbsoluteLimitsTests-1863331633 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:46:15 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-cbd1b687-ea0d-4d88-a27d-3278eb180657 tempest-AbsoluteLimitsTests-1863331633 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:46:15 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-cbd1b687-ea0d-4d88-a27d-3278eb180657 tempest-AbsoluteLimitsTests-1863331633 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:46:15 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-cbd1b687-ea0d-4d88-a27d-3278eb180657 tempest-AbsoluteLimitsTests-1863331633 None] Selected osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 as target Quobyte volume. {{(pid=86212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 15:46:15 devstack cinder-volume[86212]: INFO cinder.volume.drivers.remotefs [None req-cbd1b687-ea0d-4d88-a27d-3278eb180657 tempest-AbsoluteLimitsTests-1863331633 None] casted to osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 Sep 22 15:46:15 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-cbd1b687-ea0d-4d88-a27d-3278eb180657 tempest-AbsoluteLimitsTests-1863331633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-0234d5f0-3d3b-42ae-80ba-fe9eeddd3260 1073741824 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:46:15 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-1e42c7a8-0c14-4512-a6b0-c4d1a0b8afc6 tempest-GroupSnapshotsTest-1556879145 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b7c86c5e-e22e-4540-afa6-42b8e3340286.5c9f418f-2beb-4b22-b835-46bf518b3c98" returned: 0 in 0.460s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:46:15 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-1e42c7a8-0c14-4512-a6b0-c4d1a0b8afc6 tempest-GroupSnapshotsTest-1556879145 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b7c86c5e-e22e-4540-afa6-42b8e3340286(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86212) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 22 15:46:15 devstack sudo[96306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-0234d5f0-3d3b-42ae-80ba-fe9eeddd3260 1073741824 Sep 22 15:46:15 devstack sudo[96306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:46:15 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[e73fea8a-b9ea-4e6b-aa40-be56e8c561c7]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:46:15 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-1e42c7a8-0c14-4512-a6b0-c4d1a0b8afc6 tempest-GroupSnapshotsTest-1556879145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b7c86c5e-e22e-4540-afa6-42b8e3340286 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:46:15 devstack cinder-volume[86212]: DEBUG cinder.volume.volume_utils [None req-e7b4aca5-be7d-4278-bb2c-504d9caa560f tempest-VolumesGetTest-2122974047 None] Attempting download of 6995c6ae-03d1-45bf-bf55-00575d1858e8 ((None, [{'url': 'file:///opt/stack/data/glance/images/6995c6ae-03d1-45bf-bf55-00575d1858e8', 'metadata': {}}])) to volume f7c4c12d-5b38-4b2d-b1a3-54910721165d. {{(pid=86212) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 22 15:46:15 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-9722cbad-c90f-4758-bb53-229f567c50a6 tempest-SnapshotsActionsTest-743576267 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:46:15 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5333868-4001-4d65-9259-63c9c46cd02c]: (4, 'raw') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:46:15 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-e7b4aca5-be7d-4278-bb2c-504d9caa560f tempest-VolumesGetTest-2122974047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6995c6ae-03d1-45bf-bf55-00575d1858e8_7y4bkvwm {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:46:15 devstack sudo[96308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b7c86c5e-e22e-4540-afa6-42b8e3340286 Sep 22 15:46:15 devstack sudo[96308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:46:15 devstack sudo[96309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6995c6ae-03d1-45bf-bf55-00575d1858e8_7y4bkvwm Sep 22 15:46:15 devstack sudo[96309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:46:15 devstack sudo[96308]: pam_unix(sudo:session): session closed for user root Sep 22 15:46:15 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-1e42c7a8-0c14-4512-a6b0-c4d1a0b8afc6 tempest-GroupSnapshotsTest-1556879145 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b7c86c5e-e22e-4540-afa6-42b8e3340286" returned: 0 in 0.397s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:46:15 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-1e42c7a8-0c14-4512-a6b0-c4d1a0b8afc6 tempest-GroupSnapshotsTest-1556879145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b7c86c5e-e22e-4540-afa6-42b8e3340286.5c9f418f-2beb-4b22-b835-46bf518b3c98 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:46:15 devstack sudo[96306]: pam_unix(sudo:session): session closed for user root Sep 22 15:46:15 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-cbd1b687-ea0d-4d88-a27d-3278eb180657 tempest-AbsoluteLimitsTests-1863331633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-0234d5f0-3d3b-42ae-80ba-fe9eeddd3260 1073741824" returned: 0 in 0.480s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:46:15 devstack sudo[96319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b7c86c5e-e22e-4540-afa6-42b8e3340286.5c9f418f-2beb-4b22-b835-46bf518b3c98 Sep 22 15:46:15 devstack sudo[96319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:46:15 devstack sudo[96309]: pam_unix(sudo:session): session closed for user root Sep 22 15:46:15 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-e7b4aca5-be7d-4278-bb2c-504d9caa560f tempest-VolumesGetTest-2122974047 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6995c6ae-03d1-45bf-bf55-00575d1858e8_7y4bkvwm" returned: 0 in 0.366s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:46:15 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-e7b4aca5-be7d-4278-bb2c-504d9caa560f tempest-VolumesGetTest-2122974047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6995c6ae-03d1-45bf-bf55-00575d1858e8_7y4bkvwm {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:46:15 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-cbd1b687-ea0d-4d88-a27d-3278eb180657 tempest-AbsoluteLimitsTests-1863331633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-0234d5f0-3d3b-42ae-80ba-fe9eeddd3260 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:46:15 devstack sudo[96324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-0234d5f0-3d3b-42ae-80ba-fe9eeddd3260 Sep 22 15:46:15 devstack sudo[96324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:46:15 devstack sudo[96323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6995c6ae-03d1-45bf-bf55-00575d1858e8_7y4bkvwm Sep 22 15:46:15 devstack sudo[96323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:46:15 devstack sudo[96324]: pam_unix(sudo:session): session closed for user root Sep 22 15:46:15 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-cbd1b687-ea0d-4d88-a27d-3278eb180657 tempest-AbsoluteLimitsTests-1863331633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-0234d5f0-3d3b-42ae-80ba-fe9eeddd3260" returned: 0 in 0.266s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:46:15 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-cbd1b687-ea0d-4d88-a27d-3278eb180657 tempest-AbsoluteLimitsTests-1863331633 None] <== create_volume: return (817ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'} {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 15:46:15 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-cbd1b687-ea0d-4d88-a27d-3278eb180657 tempest-AbsoluteLimitsTests-1863331633 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.821s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:46:15 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-9722cbad-c90f-4758-bb53-229f567c50a6 tempest-SnapshotsActionsTest-743576267 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.703s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:46:15 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-9722cbad-c90f-4758-bb53-229f567c50a6 tempest-SnapshotsActionsTest-743576267 None] Creating offline snapshot 2e13acce-6d37-4365-8cc0-4f1c9390cf03 of volume b6fe5ce0-11b7-4bbc-8573-9a098af7add5 {{(pid=86212) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 22 15:46:15 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-cbd1b687-ea0d-4d88-a27d-3278eb180657 tempest-AbsoluteLimitsTests-1863331633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2582ac0-179b-4578-9e7a-d95b80a07aa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0234d5f0-3d3b-42ae-80ba-fe9eeddd3260', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:46:15 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-cbd1b687-ea0d-4d88-a27d-3278eb180657 tempest-AbsoluteLimitsTests-1863331633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eed1110e-4aa0-4455-ba60-0b07b3a6aba9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:46:15 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[92f26158-10f8-4984-ac63-14472a6d01a8]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:46:15 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-9722cbad-c90f-4758-bb53-229f567c50a6 tempest-SnapshotsActionsTest-743576267 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b6fe5ce0-11b7-4bbc-8573-9a098af7add5 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:46:15 devstack sudo[96323]: pam_unix(sudo:session): session closed for user root Sep 22 15:46:15 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-e7b4aca5-be7d-4278-bb2c-504d9caa560f tempest-VolumesGetTest-2122974047 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6995c6ae-03d1-45bf-bf55-00575d1858e8_7y4bkvwm" returned: 1 in 0.364s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:46:15 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-e7b4aca5-be7d-4278-bb2c-504d9caa560f tempest-VolumesGetTest-2122974047 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6995c6ae-03d1-45bf-bf55-00575d1858e8_7y4bkvwm' failed. Not Retrying. {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 22 15:46:15 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[515c41f4-0989-47d0-bf25-c8c8a73d57ae]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:46:15 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-e7b4aca5-be7d-4278-bb2c-504d9caa560f tempest-VolumesGetTest-2122974047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6995c6ae-03d1-45bf-bf55-00575d1858e8_gc1miz3odevstack@QuobyteHD {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:46:15 devstack sudo[96319]: pam_unix(sudo:session): session closed for user root Sep 22 15:46:15 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-cbd1b687-ea0d-4d88-a27d-3278eb180657 tempest-AbsoluteLimitsTests-1863331633 None] Volume volume-0234d5f0-3d3b-42ae-80ba-fe9eeddd3260 (0234d5f0-3d3b-42ae-80ba-fe9eeddd3260): created successfully Sep 22 15:46:15 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-cbd1b687-ea0d-4d88-a27d-3278eb180657 tempest-AbsoluteLimitsTests-1863331633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eed1110e-4aa0-4455-ba60-0b07b3a6aba9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:46:15 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-cbd1b687-ea0d-4d88-a27d-3278eb180657 tempest-AbsoluteLimitsTests-1863331633 None] Flow 'volume_create_manager' (0bb86631-b460-4b7f-8d5c-7cf69ae0981b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:46:15 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-1e42c7a8-0c14-4512-a6b0-c4d1a0b8afc6 tempest-GroupSnapshotsTest-1556879145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b7c86c5e-e22e-4540-afa6-42b8e3340286.5c9f418f-2beb-4b22-b835-46bf518b3c98" returned: 0 in 0.462s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:46:15 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-1e42c7a8-0c14-4512-a6b0-c4d1a0b8afc6 tempest-GroupSnapshotsTest-1556879145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b7c86c5e-e22e-4540-afa6-42b8e3340286.5c9f418f-2beb-4b22-b835-46bf518b3c98 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:46:15 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-cbd1b687-ea0d-4d88-a27d-3278eb180657 tempest-AbsoluteLimitsTests-1863331633 None] Created volume successfully. Sep 22 15:46:15 devstack sudo[96335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b7c86c5e-e22e-4540-afa6-42b8e3340286.5c9f418f-2beb-4b22-b835-46bf518b3c98 Sep 22 15:46:15 devstack sudo[96335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:46:15 devstack sudo[96333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b6fe5ce0-11b7-4bbc-8573-9a098af7add5 Sep 22 15:46:15 devstack sudo[96333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:46:16 devstack sudo[96334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6995c6ae-03d1-45bf-bf55-00575d1858e8_gc1miz3odevstack@QuobyteHD Sep 22 15:46:16 devstack sudo[96334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:46:16 devstack sudo[96335]: pam_unix(sudo:session): session closed for user root Sep 22 15:46:16 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-1e42c7a8-0c14-4512-a6b0-c4d1a0b8afc6 tempest-GroupSnapshotsTest-1556879145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b7c86c5e-e22e-4540-afa6-42b8e3340286.5c9f418f-2beb-4b22-b835-46bf518b3c98" returned: 0 in 0.272s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:46:16 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-1e42c7a8-0c14-4512-a6b0-c4d1a0b8afc6 tempest-GroupSnapshotsTest-1556879145 None] Lock "cinder-quobyte-5c9f418f-2beb-4b22-b835-46bf518b3c98" released by "_delete_snapshot" :: held 1.713s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:46:16 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-1e42c7a8-0c14-4512-a6b0-c4d1a0b8afc6 tempest-GroupSnapshotsTest-1556879145 None] Lock "cinder-quobyte-b7c86c5e-e22e-4540-afa6-42b8e3340286" released by "delete_snapshot" :: held 1.740s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:46:16 devstack sudo[96334]: pam_unix(sudo:session): session closed for user root Sep 22 15:46:16 devstack sudo[96333]: pam_unix(sudo:session): session closed for user root Sep 22 15:46:16 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-9722cbad-c90f-4758-bb53-229f567c50a6 tempest-SnapshotsActionsTest-743576267 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b6fe5ce0-11b7-4bbc-8573-9a098af7add5" returned: 0 in 0.382s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:46:16 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-e7b4aca5-be7d-4278-bb2c-504d9caa560f tempest-VolumesGetTest-2122974047 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6995c6ae-03d1-45bf-bf55-00575d1858e8_gc1miz3odevstack@QuobyteHD" returned: 0 in 0.359s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:46:16 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-9722cbad-c90f-4758-bb53-229f567c50a6 tempest-SnapshotsActionsTest-743576267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b6fe5ce0-11b7-4bbc-8573-9a098af7add5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b6fe5ce0-11b7-4bbc-8573-9a098af7add5.2e13acce-6d37-4365-8cc0-4f1c9390cf03 1G {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:46:16 devstack cinder-volume[86212]: DEBUG cinder.image.image_utils [None req-e7b4aca5-be7d-4278-bb2c-504d9caa560f tempest-VolumesGetTest-2122974047 None] 6995c6ae-03d1-45bf-bf55-00575d1858e8 was qcow2, converting to qcow2 {{(pid=86212) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 22 15:46:16 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-e7b4aca5-be7d-4278-bb2c-504d9caa560f tempest-VolumesGetTest-2122974047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6995c6ae-03d1-45bf-bf55-00575d1858e8_gc1miz3odevstack@QuobyteHD /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-f7c4c12d-5b38-4b2d-b1a3-54910721165d {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:46:16 devstack sudo[96346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b6fe5ce0-11b7-4bbc-8573-9a098af7add5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b6fe5ce0-11b7-4bbc-8573-9a098af7add5.2e13acce-6d37-4365-8cc0-4f1c9390cf03 1G Sep 22 15:46:16 devstack sudo[96346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:46:16 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-1e42c7a8-0c14-4512-a6b0-c4d1a0b8afc6 tempest-GroupSnapshotsTest-1556879145 None] Acquiring lock "cinder-quobyte-36fece85-c391-4b3d-8484-d33f1e020467" by "delete_snapshot" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:46:16 devstack sudo[96347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6995c6ae-03d1-45bf-bf55-00575d1858e8_gc1miz3odevstack@QuobyteHD /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-f7c4c12d-5b38-4b2d-b1a3-54910721165d Sep 22 15:46:16 devstack sudo[96347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:46:16 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-1e42c7a8-0c14-4512-a6b0-c4d1a0b8afc6 tempest-GroupSnapshotsTest-1556879145 None] Lock "cinder-quobyte-36fece85-c391-4b3d-8484-d33f1e020467" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:46:16 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-1e42c7a8-0c14-4512-a6b0-c4d1a0b8afc6 tempest-GroupSnapshotsTest-1556879145 None] Acquiring lock "cinder-quobyte-6f2d73b5-4582-4a89-9e3b-c2052906138e" by "_delete_snapshot" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:46:16 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-1e42c7a8-0c14-4512-a6b0-c4d1a0b8afc6 tempest-GroupSnapshotsTest-1556879145 None] Lock "cinder-quobyte-6f2d73b5-4582-4a89-9e3b-c2052906138e" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:46:16 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-1e42c7a8-0c14-4512-a6b0-c4d1a0b8afc6 tempest-GroupSnapshotsTest-1556879145 None] Deleting offline snapshot 6f2d73b5-4582-4a89-9e3b-c2052906138e of volume 36fece85-c391-4b3d-8484-d33f1e020467 {{(pid=86212) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 22 15:46:16 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-1e42c7a8-0c14-4512-a6b0-c4d1a0b8afc6 tempest-GroupSnapshotsTest-1556879145 None] snapshot_file for this snap is: volume-36fece85-c391-4b3d-8484-d33f1e020467.6f2d73b5-4582-4a89-9e3b-c2052906138e {{(pid=86212) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 22 15:46:16 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aaa943d-4b53-4e09-9b88-01f57a23f08c]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:46:16 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-1e42c7a8-0c14-4512-a6b0-c4d1a0b8afc6 tempest-GroupSnapshotsTest-1556879145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-36fece85-c391-4b3d-8484-d33f1e020467.6f2d73b5-4582-4a89-9e3b-c2052906138e {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:46:16 devstack sudo[96350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-36fece85-c391-4b3d-8484-d33f1e020467.6f2d73b5-4582-4a89-9e3b-c2052906138e Sep 22 15:46:16 devstack sudo[96350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:46:16 devstack sudo[96346]: pam_unix(sudo:session): session closed for user root Sep 22 15:46:16 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-9722cbad-c90f-4758-bb53-229f567c50a6 tempest-SnapshotsActionsTest-743576267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b6fe5ce0-11b7-4bbc-8573-9a098af7add5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b6fe5ce0-11b7-4bbc-8573-9a098af7add5.2e13acce-6d37-4365-8cc0-4f1c9390cf03 1G" returned: 0 in 0.424s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:46:16 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-9722cbad-c90f-4758-bb53-229f567c50a6 tempest-SnapshotsActionsTest-743576267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6fe5ce0-11b7-4bbc-8573-9a098af7add5 -F qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b6fe5ce0-11b7-4bbc-8573-9a098af7add5.2e13acce-6d37-4365-8cc0-4f1c9390cf03 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:46:16 devstack sudo[96359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6fe5ce0-11b7-4bbc-8573-9a098af7add5 -F qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b6fe5ce0-11b7-4bbc-8573-9a098af7add5.2e13acce-6d37-4365-8cc0-4f1c9390cf03 Sep 22 15:46:16 devstack sudo[96359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:46:16 devstack sudo[96350]: pam_unix(sudo:session): session closed for user root Sep 22 15:46:16 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-1e42c7a8-0c14-4512-a6b0-c4d1a0b8afc6 tempest-GroupSnapshotsTest-1556879145 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-36fece85-c391-4b3d-8484-d33f1e020467.6f2d73b5-4582-4a89-9e3b-c2052906138e" returned: 0 in 0.424s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:46:16 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-1e42c7a8-0c14-4512-a6b0-c4d1a0b8afc6 tempest-GroupSnapshotsTest-1556879145 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-36fece85-c391-4b3d-8484-d33f1e020467(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86212) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 22 15:46:16 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[387ea58f-c9a6-4f77-a8cd-b04d843c6527]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:46:16 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-1e42c7a8-0c14-4512-a6b0-c4d1a0b8afc6 tempest-GroupSnapshotsTest-1556879145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-36fece85-c391-4b3d-8484-d33f1e020467 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:46:16 devstack sudo[96369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-36fece85-c391-4b3d-8484-d33f1e020467 Sep 22 15:46:16 devstack sudo[96369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:46:17 devstack sudo[96359]: pam_unix(sudo:session): session closed for user root Sep 22 15:46:17 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-9722cbad-c90f-4758-bb53-229f567c50a6 tempest-SnapshotsActionsTest-743576267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6fe5ce0-11b7-4bbc-8573-9a098af7add5 -F qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b6fe5ce0-11b7-4bbc-8573-9a098af7add5.2e13acce-6d37-4365-8cc0-4f1c9390cf03" returned: 0 in 0.369s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:46:17 devstack cinder-volume[86212]: WARNING cinder.volume.drivers.remotefs [None req-9722cbad-c90f-4758-bb53-229f567c50a6 tempest-SnapshotsActionsTest-743576267 None] /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b6fe5ce0-11b7-4bbc-8573-9a098af7add5.2e13acce-6d37-4365-8cc0-4f1c9390cf03 is being set with open permissions: ugo+rw Sep 22 15:46:17 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-9722cbad-c90f-4758-bb53-229f567c50a6 tempest-SnapshotsActionsTest-743576267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b6fe5ce0-11b7-4bbc-8573-9a098af7add5.2e13acce-6d37-4365-8cc0-4f1c9390cf03 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:46:17 devstack sudo[96375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b6fe5ce0-11b7-4bbc-8573-9a098af7add5.2e13acce-6d37-4365-8cc0-4f1c9390cf03 Sep 22 15:46:17 devstack sudo[96375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:46:17 devstack sudo[96369]: pam_unix(sudo:session): session closed for user root Sep 22 15:46:17 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-1e42c7a8-0c14-4512-a6b0-c4d1a0b8afc6 tempest-GroupSnapshotsTest-1556879145 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-36fece85-c391-4b3d-8484-d33f1e020467" returned: 0 in 0.473s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:46:17 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-1e42c7a8-0c14-4512-a6b0-c4d1a0b8afc6 tempest-GroupSnapshotsTest-1556879145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-36fece85-c391-4b3d-8484-d33f1e020467.6f2d73b5-4582-4a89-9e3b-c2052906138e {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:46:17 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-9b64d27f-67c0-43d2-82ac-33a83b772895 tempest-AbsoluteLimitsTests-1863331633 None] Acquiring lock "cinder-0234d5f0-3d3b-42ae-80ba-fe9eeddd3260-delete_volume" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:46:17 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-9b64d27f-67c0-43d2-82ac-33a83b772895 tempest-AbsoluteLimitsTests-1863331633 None] Lock "cinder-0234d5f0-3d3b-42ae-80ba-fe9eeddd3260-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:46:17 devstack sudo[96375]: pam_unix(sudo:session): session closed for user root Sep 22 15:46:17 devstack sudo[96381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-36fece85-c391-4b3d-8484-d33f1e020467.6f2d73b5-4582-4a89-9e3b-c2052906138e Sep 22 15:46:17 devstack sudo[96381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:46:17 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-9722cbad-c90f-4758-bb53-229f567c50a6 tempest-SnapshotsActionsTest-743576267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b6fe5ce0-11b7-4bbc-8573-9a098af7add5.2e13acce-6d37-4365-8cc0-4f1c9390cf03" returned: 0 in 0.307s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:46:17 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-9722cbad-c90f-4758-bb53-229f567c50a6 tempest-SnapshotsActionsTest-743576267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b6fe5ce0-11b7-4bbc-8573-9a098af7add5.info {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:46:17 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-9b64d27f-67c0-43d2-82ac-33a83b772895 tempest-AbsoluteLimitsTests-1863331633 None] Acquiring lock "cinder-quobyte-0234d5f0-3d3b-42ae-80ba-fe9eeddd3260" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:46:17 devstack sudo[96384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b6fe5ce0-11b7-4bbc-8573-9a098af7add5.info Sep 22 15:46:17 devstack sudo[96384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:46:17 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-9b64d27f-67c0-43d2-82ac-33a83b772895 tempest-AbsoluteLimitsTests-1863331633 None] Lock "cinder-quobyte-0234d5f0-3d3b-42ae-80ba-fe9eeddd3260" acquired by "delete_volume" :: waited 0.023s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:46:17 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[76a6fe1d-407f-46b2-97d7-025d14c9f013]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:46:17 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-9b64d27f-67c0-43d2-82ac-33a83b772895 tempest-AbsoluteLimitsTests-1863331633 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-0234d5f0-3d3b-42ae-80ba-fe9eeddd3260 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:46:17 devstack sudo[96386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-0234d5f0-3d3b-42ae-80ba-fe9eeddd3260 Sep 22 15:46:17 devstack sudo[96386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:46:17 devstack sudo[96384]: pam_unix(sudo:session): session closed for user root Sep 22 15:46:17 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-9722cbad-c90f-4758-bb53-229f567c50a6 tempest-SnapshotsActionsTest-743576267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b6fe5ce0-11b7-4bbc-8573-9a098af7add5.info" returned: 0 in 0.344s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:46:17 devstack cinder-volume[86212]: WARNING cinder.volume.drivers.remotefs [None req-9722cbad-c90f-4758-bb53-229f567c50a6 tempest-SnapshotsActionsTest-743576267 None] /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b6fe5ce0-11b7-4bbc-8573-9a098af7add5.info is being set with open permissions: ugo+rw Sep 22 15:46:17 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-9722cbad-c90f-4758-bb53-229f567c50a6 tempest-SnapshotsActionsTest-743576267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b6fe5ce0-11b7-4bbc-8573-9a098af7add5.info {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:46:17 devstack sudo[96392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b6fe5ce0-11b7-4bbc-8573-9a098af7add5.info Sep 22 15:46:17 devstack sudo[96392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:46:17 devstack sudo[96381]: pam_unix(sudo:session): session closed for user root Sep 22 15:46:17 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-1e42c7a8-0c14-4512-a6b0-c4d1a0b8afc6 tempest-GroupSnapshotsTest-1556879145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-36fece85-c391-4b3d-8484-d33f1e020467.6f2d73b5-4582-4a89-9e3b-c2052906138e" returned: 0 in 0.555s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:46:17 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-1e42c7a8-0c14-4512-a6b0-c4d1a0b8afc6 tempest-GroupSnapshotsTest-1556879145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-36fece85-c391-4b3d-8484-d33f1e020467.6f2d73b5-4582-4a89-9e3b-c2052906138e {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:46:17 devstack sudo[96394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-36fece85-c391-4b3d-8484-d33f1e020467.6f2d73b5-4582-4a89-9e3b-c2052906138e Sep 22 15:46:17 devstack sudo[96394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:46:17 devstack sudo[96386]: pam_unix(sudo:session): session closed for user root Sep 22 15:46:17 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-9b64d27f-67c0-43d2-82ac-33a83b772895 tempest-AbsoluteLimitsTests-1863331633 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-0234d5f0-3d3b-42ae-80ba-fe9eeddd3260" returned: 0 in 0.489s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:46:17 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-9b64d27f-67c0-43d2-82ac-33a83b772895 tempest-AbsoluteLimitsTests-1863331633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-0234d5f0-3d3b-42ae-80ba-fe9eeddd3260 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:46:18 devstack sudo[96400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-0234d5f0-3d3b-42ae-80ba-fe9eeddd3260 Sep 22 15:46:18 devstack sudo[96400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:46:18 devstack sudo[96392]: pam_unix(sudo:session): session closed for user root Sep 22 15:46:18 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-9722cbad-c90f-4758-bb53-229f567c50a6 tempest-SnapshotsActionsTest-743576267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b6fe5ce0-11b7-4bbc-8573-9a098af7add5.info" returned: 0 in 0.322s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:46:18 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-9722cbad-c90f-4758-bb53-229f567c50a6 tempest-SnapshotsActionsTest-743576267 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.285s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:46:18 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-9722cbad-c90f-4758-bb53-229f567c50a6 tempest-SnapshotsActionsTest-743576267 None] Create snapshot completed successfully Sep 22 15:46:18 devstack sudo[96394]: pam_unix(sudo:session): session closed for user root Sep 22 15:46:18 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-1e42c7a8-0c14-4512-a6b0-c4d1a0b8afc6 tempest-GroupSnapshotsTest-1556879145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-36fece85-c391-4b3d-8484-d33f1e020467.6f2d73b5-4582-4a89-9e3b-c2052906138e" returned: 0 in 0.366s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:46:18 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-1e42c7a8-0c14-4512-a6b0-c4d1a0b8afc6 tempest-GroupSnapshotsTest-1556879145 None] Lock "cinder-quobyte-6f2d73b5-4582-4a89-9e3b-c2052906138e" released by "_delete_snapshot" :: held 1.942s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:46:18 devstack sudo[96400]: pam_unix(sudo:session): session closed for user root Sep 22 15:46:18 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-9b64d27f-67c0-43d2-82ac-33a83b772895 tempest-AbsoluteLimitsTests-1863331633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-0234d5f0-3d3b-42ae-80ba-fe9eeddd3260" returned: 0 in 0.295s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:46:18 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-1e42c7a8-0c14-4512-a6b0-c4d1a0b8afc6 tempest-GroupSnapshotsTest-1556879145 None] Lock "cinder-quobyte-36fece85-c391-4b3d-8484-d33f1e020467" released by "delete_snapshot" :: held 1.975s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:46:18 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-9b64d27f-67c0-43d2-82ac-33a83b772895 tempest-AbsoluteLimitsTests-1863331633 None] Lock "cinder-quobyte-0234d5f0-3d3b-42ae-80ba-fe9eeddd3260" released by "delete_volume" :: held 0.849s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:46:18 devstack cinder-volume[86212]: DEBUG cinder.quota [None req-9b64d27f-67c0-43d2-82ac-33a83b772895 tempest-AbsoluteLimitsTests-1863331633 None] Created reservations ['da3530fa-dac7-400a-b40e-ecd80ac5f8a2', '676ef2c4-82ed-4a36-b806-df8e14139614', 'bd436375-b7c9-4465-bd4d-0490ec46e462', '19e4c06e-f6a7-43f1-9bef-d57b444752ea'] {{(pid=86212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 15:46:18 devstack cinder-volume[86212]: WARNING cinder.quota [None req-1e42c7a8-0c14-4512-a6b0-c4d1a0b8afc6 tempest-GroupSnapshotsTest-1556879145 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-2030359038 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-2030359038, it is now deprecated. Please use the default quota class for default quota. Sep 22 15:46:18 devstack cinder-volume[86212]: WARNING cinder.quota [None req-1e42c7a8-0c14-4512-a6b0-c4d1a0b8afc6 tempest-GroupSnapshotsTest-1556879145 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-2030359038 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-2030359038, it is now deprecated. Please use the default quota class for default quota. Sep 22 15:46:18 devstack cinder-volume[86212]: DEBUG cinder.quota [None req-1e42c7a8-0c14-4512-a6b0-c4d1a0b8afc6 tempest-GroupSnapshotsTest-1556879145 None] Created reservations ['68acc9c0-e00f-45d4-b188-d88464b0171b', '7d89f107-4722-4cb3-be49-c4e297678349', 'aa4aa956-61ab-400e-b4fc-f3075e940d63', '6f06c99e-ed23-443c-9911-e4fb0f0d3aad'] {{(pid=86212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 15:46:18 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-9b64d27f-67c0-43d2-82ac-33a83b772895 tempest-AbsoluteLimitsTests-1863331633 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:46:18 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-9b64d27f-67c0-43d2-82ac-33a83b772895 tempest-AbsoluteLimitsTests-1863331633 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:46:18 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-9b64d27f-67c0-43d2-82ac-33a83b772895 tempest-AbsoluteLimitsTests-1863331633 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:46:18 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-9b64d27f-67c0-43d2-82ac-33a83b772895 tempest-AbsoluteLimitsTests-1863331633 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:46:18 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-9b64d27f-67c0-43d2-82ac-33a83b772895 tempest-AbsoluteLimitsTests-1863331633 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:46:18 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-9b64d27f-67c0-43d2-82ac-33a83b772895 tempest-AbsoluteLimitsTests-1863331633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:46:18 devstack sudo[96347]: pam_unix(sudo:session): session closed for user root Sep 22 15:46:18 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-e7b4aca5-be7d-4278-bb2c-504d9caa560f tempest-VolumesGetTest-2122974047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6995c6ae-03d1-45bf-bf55-00575d1858e8_gc1miz3odevstack@QuobyteHD /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-f7c4c12d-5b38-4b2d-b1a3-54910721165d" returned: 0 in 2.206s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:46:18 devstack cinder-volume[86212]: DEBUG cinder.image.image_utils [None req-e7b4aca5-be7d-4278-bb2c-504d9caa560f tempest-VolumesGetTest-2122974047 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_6995c6ae-03d1-45bf-bf55-00575d1858e8_gc1miz3odevstack@QuobyteHD, size 112.00 MB, duration 2.21 sec, destination /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-f7c4c12d-5b38-4b2d-b1a3-54910721165d {{(pid=86212) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 22 15:46:18 devstack cinder-volume[86212]: INFO cinder.image.image_utils [None req-e7b4aca5-be7d-4278-bb2c-504d9caa560f tempest-VolumesGetTest-2122974047 None] Converted 112.00 MB image at 50.73 MB/s Sep 22 15:46:18 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-e7b4aca5-be7d-4278-bb2c-504d9caa560f tempest-VolumesGetTest-2122974047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-f7c4c12d-5b38-4b2d-b1a3-54910721165d 1G {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:46:18 devstack sudo[96405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc Sep 22 15:46:18 devstack sudo[96405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:46:18 devstack sudo[96406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-f7c4c12d-5b38-4b2d-b1a3-54910721165d 1G Sep 22 15:46:18 devstack sudo[96406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:46:18 devstack cinder-volume[86212]: DEBUG cinder.quota [None req-1e42c7a8-0c14-4512-a6b0-c4d1a0b8afc6 tempest-GroupSnapshotsTest-1556879145 None] Created reservations ['7ed8209b-e789-49d7-8ae2-ed69d29456ee', '440f0d8d-5028-467a-ad49-b6519292b9d9', '1c850f41-998b-40b4-b185-e2ff07aae54a', '98a0b4c2-d4a1-4a7a-8ab0-13432375cf4f'] {{(pid=86212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 15:46:18 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-1e42c7a8-0c14-4512-a6b0-c4d1a0b8afc6 tempest-GroupSnapshotsTest-1556879145 None] group_snapshot daf6fe1e-a2b7-4887-9452-1b0e07f67e71: deleted successfully Sep 22 15:46:18 devstack sudo[96405]: pam_unix(sudo:session): session closed for user root Sep 22 15:46:18 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-9b64d27f-67c0-43d2-82ac-33a83b772895 tempest-AbsoluteLimitsTests-1863331633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc" returned: 0 in 0.311s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:46:18 devstack cinder-volume[86212]: DEBUG cinder.manager [None req-9b64d27f-67c0-43d2-82ac-33a83b772895 tempest-AbsoluteLimitsTests-1863331633 None] Notifying Schedulers of capabilities ... {{(pid=86212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 15:46:18 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-9b64d27f-67c0-43d2-82ac-33a83b772895 tempest-AbsoluteLimitsTests-1863331633 None] Deleted volume successfully. Sep 22 15:46:18 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-9b64d27f-67c0-43d2-82ac-33a83b772895 tempest-AbsoluteLimitsTests-1863331633 None] Lock "cinder-0234d5f0-3d3b-42ae-80ba-fe9eeddd3260-delete_volume" released by "delete_volume" :: held 1.454s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:46:18 devstack sudo[96406]: pam_unix(sudo:session): session closed for user root Sep 22 15:46:18 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-e7b4aca5-be7d-4278-bb2c-504d9caa560f tempest-VolumesGetTest-2122974047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-f7c4c12d-5b38-4b2d-b1a3-54910721165d 1G" returned: 0 in 0.399s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:46:18 devstack cinder-volume[86212]: DEBUG cinder.volume.volume_utils [None req-e7b4aca5-be7d-4278-bb2c-504d9caa560f tempest-VolumesGetTest-2122974047 None] Downloaded image 6995c6ae-03d1-45bf-bf55-00575d1858e8 ((None, [{'url': 'file:///opt/stack/data/glance/images/6995c6ae-03d1-45bf-bf55-00575d1858e8', 'metadata': {}}])) to volume f7c4c12d-5b38-4b2d-b1a3-54910721165d successfully. {{(pid=86212) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 22 15:46:18 devstack cinder-volume[86212]: DEBUG cinder.image.image_utils [None req-e7b4aca5-be7d-4278-bb2c-504d9caa560f tempest-VolumesGetTest-2122974047 None] Temporary image 6995c6ae-03d1-45bf-bf55-00575d1858e8 for user a0b6cabdecf14f80b25b912b51474b36 is deleted. {{(pid=86212) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 22 15:46:18 devstack cinder-volume[86212]: DEBUG cinder.volume.volume_utils [None req-e7b4aca5-be7d-4278-bb2c-504d9caa560f tempest-VolumesGetTest-2122974047 None] Marking volume f7c4c12d-5b38-4b2d-b1a3-54910721165d as bootable. {{(pid=86212) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 22 15:46:18 devstack cinder-volume[86212]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7b4aca5-be7d-4278-bb2c-504d9caa560f tempest-VolumesGetTest-2122974047 None] Copying metadata from image 6995c6ae-03d1-45bf-bf55-00575d1858e8 to f7c4c12d-5b38-4b2d-b1a3-54910721165d. {{(pid=86212) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 22 15:46:18 devstack cinder-volume[86212]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7b4aca5-be7d-4278-bb2c-504d9caa560f tempest-VolumesGetTest-2122974047 None] Creating volume glance metadata for volume f7c4c12d-5b38-4b2d-b1a3-54910721165d backed by image 6995c6ae-03d1-45bf-bf55-00575d1858e8 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '6995c6ae-03d1-45bf-bf55-00575d1858e8', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86212) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 22 15:46:18 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-e7b4aca5-be7d-4278-bb2c-504d9caa560f tempest-VolumesGetTest-2122974047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12d6d895-28a0-44f5-b2b5-09ebe92aa9af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f7c4c12d-5b38-4b2d-b1a3-54910721165d', 'volume_size': 1, 'image_id': '6995c6ae-03d1-45bf-bf55-00575d1858e8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6995c6ae-03d1-45bf-bf55-00575d1858e8', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '28219d994ba546ed905a95ed90257a43', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6995c6ae-03d1-45bf-bf55-00575d1858e8', 'created_at': datetime.datetime(2026, 9, 22, 13, 30, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 13, 30, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6995c6ae-03d1-45bf-bf55-00575d1858e8/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:46:19 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-e7b4aca5-be7d-4278-bb2c-504d9caa560f tempest-VolumesGetTest-2122974047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da3ae5c1-b58e-4abe-8741-88ab14e7c110) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:46:19 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-e7b4aca5-be7d-4278-bb2c-504d9caa560f tempest-VolumesGetTest-2122974047 None] Volume volume-f7c4c12d-5b38-4b2d-b1a3-54910721165d (f7c4c12d-5b38-4b2d-b1a3-54910721165d): created successfully Sep 22 15:46:19 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-e7b4aca5-be7d-4278-bb2c-504d9caa560f tempest-VolumesGetTest-2122974047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da3ae5c1-b58e-4abe-8741-88ab14e7c110) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:46:19 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-e7b4aca5-be7d-4278-bb2c-504d9caa560f tempest-VolumesGetTest-2122974047 None] Flow 'volume_create_manager' (da486c91-d8e5-4dfc-863d-9cec4e46556e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:46:19 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-e7b4aca5-be7d-4278-bb2c-504d9caa560f tempest-VolumesGetTest-2122974047 None] Created volume successfully. Sep 22 15:46:19 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-fd0ada06-8006-40a6-96cd-3c09b838bfbb tempest-GroupSnapshotsTest-1556879145 None] Acquiring lock "cinder-quobyte-36fece85-c391-4b3d-8484-d33f1e020467" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:46:19 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-fd0ada06-8006-40a6-96cd-3c09b838bfbb tempest-GroupSnapshotsTest-1556879145 None] Lock "cinder-quobyte-36fece85-c391-4b3d-8484-d33f1e020467" acquired by "delete_volume" :: waited 0.021s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:46:19 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[92b46971-6e4e-46f3-a859-58fc2c35c11a]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:46:19 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-fd0ada06-8006-40a6-96cd-3c09b838bfbb tempest-GroupSnapshotsTest-1556879145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-36fece85-c391-4b3d-8484-d33f1e020467 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:46:19 devstack sudo[96414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-36fece85-c391-4b3d-8484-d33f1e020467 Sep 22 15:46:19 devstack sudo[96414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:46:20 devstack sudo[96414]: pam_unix(sudo:session): session closed for user root Sep 22 15:46:20 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-fd0ada06-8006-40a6-96cd-3c09b838bfbb tempest-GroupSnapshotsTest-1556879145 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-36fece85-c391-4b3d-8484-d33f1e020467" returned: 0 in 0.524s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:46:20 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-fd0ada06-8006-40a6-96cd-3c09b838bfbb tempest-GroupSnapshotsTest-1556879145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-36fece85-c391-4b3d-8484-d33f1e020467 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:46:20 devstack sudo[96419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-36fece85-c391-4b3d-8484-d33f1e020467 Sep 22 15:46:20 devstack sudo[96419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:46:20 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-a8375c1e-3861-4fcc-a78f-e7621f4dfd10 tempest-SnapshotsActionsTest-743576267 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:46:20 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-a8375c1e-3861-4fcc-a78f-e7621f4dfd10 tempest-SnapshotsActionsTest-743576267 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:46:20 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-a8375c1e-3861-4fcc-a78f-e7621f4dfd10 tempest-SnapshotsActionsTest-743576267 None] Creating offline snapshot f9aafe67-0111-44d5-a57e-75a31a84444d of volume b6fe5ce0-11b7-4bbc-8573-9a098af7add5 {{(pid=86212) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 22 15:46:20 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[03329293-772b-41a6-936c-e6acb1e0dd77]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:46:20 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-a8375c1e-3861-4fcc-a78f-e7621f4dfd10 tempest-SnapshotsActionsTest-743576267 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b6fe5ce0-11b7-4bbc-8573-9a098af7add5.2e13acce-6d37-4365-8cc0-4f1c9390cf03 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:46:20 devstack sudo[96421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b6fe5ce0-11b7-4bbc-8573-9a098af7add5.2e13acce-6d37-4365-8cc0-4f1c9390cf03 Sep 22 15:46:20 devstack sudo[96421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:46:20 devstack sudo[96419]: pam_unix(sudo:session): session closed for user root Sep 22 15:46:20 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-fd0ada06-8006-40a6-96cd-3c09b838bfbb tempest-GroupSnapshotsTest-1556879145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-36fece85-c391-4b3d-8484-d33f1e020467" returned: 0 in 0.370s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:46:20 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-fd0ada06-8006-40a6-96cd-3c09b838bfbb tempest-GroupSnapshotsTest-1556879145 None] Lock "cinder-quobyte-36fece85-c391-4b3d-8484-d33f1e020467" released by "delete_volume" :: held 0.982s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:46:20 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-fd0ada06-8006-40a6-96cd-3c09b838bfbb tempest-GroupSnapshotsTest-1556879145 None] Acquiring lock "cinder-quobyte-b7c86c5e-e22e-4540-afa6-42b8e3340286" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:46:20 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-fd0ada06-8006-40a6-96cd-3c09b838bfbb tempest-GroupSnapshotsTest-1556879145 None] Lock "cinder-quobyte-b7c86c5e-e22e-4540-afa6-42b8e3340286" acquired by "delete_volume" :: waited 0.021s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:46:20 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[37f4ad9d-c4a4-403c-9768-3c4dcb8a2f44]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:46:20 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-fd0ada06-8006-40a6-96cd-3c09b838bfbb tempest-GroupSnapshotsTest-1556879145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b7c86c5e-e22e-4540-afa6-42b8e3340286 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:46:20 devstack sudo[96424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b7c86c5e-e22e-4540-afa6-42b8e3340286 Sep 22 15:46:20 devstack sudo[96424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:46:20 devstack sudo[96421]: pam_unix(sudo:session): session closed for user root Sep 22 15:46:20 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-a8375c1e-3861-4fcc-a78f-e7621f4dfd10 tempest-SnapshotsActionsTest-743576267 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b6fe5ce0-11b7-4bbc-8573-9a098af7add5.2e13acce-6d37-4365-8cc0-4f1c9390cf03" returned: 0 in 0.549s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:46:20 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-a8375c1e-3861-4fcc-a78f-e7621f4dfd10 tempest-SnapshotsActionsTest-743576267 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b6fe5ce0-11b7-4bbc-8573-9a098af7add5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86212) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 22 15:46:20 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-a8375c1e-3861-4fcc-a78f-e7621f4dfd10 tempest-SnapshotsActionsTest-743576267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b6fe5ce0-11b7-4bbc-8573-9a098af7add5.2e13acce-6d37-4365-8cc0-4f1c9390cf03,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b6fe5ce0-11b7-4bbc-8573-9a098af7add5.f9aafe67-0111-44d5-a57e-75a31a84444d 1G {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:46:20 devstack sudo[96429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b6fe5ce0-11b7-4bbc-8573-9a098af7add5.2e13acce-6d37-4365-8cc0-4f1c9390cf03,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b6fe5ce0-11b7-4bbc-8573-9a098af7add5.f9aafe67-0111-44d5-a57e-75a31a84444d 1G Sep 22 15:46:20 devstack sudo[96429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:46:21 devstack sudo[96424]: pam_unix(sudo:session): session closed for user root Sep 22 15:46:21 devstack cinder-volume[86212]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4d0c899-314e-4def-925e-abb5e18b314f tempest-VolumesGetTest-2122974047 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 15:46:21 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-d4d0c899-314e-4def-925e-abb5e18b314f tempest-VolumesGetTest-2122974047 None] Flow 'volume_create_manager' (3ea59c79-11b8-41da-a103-5bf2fcb5d788) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:46:21 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-d4d0c899-314e-4def-925e-abb5e18b314f tempest-VolumesGetTest-2122974047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a9a9b3f-b466-40f9-940f-bcc9dc1370e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:46:21 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-fd0ada06-8006-40a6-96cd-3c09b838bfbb tempest-GroupSnapshotsTest-1556879145 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b7c86c5e-e22e-4540-afa6-42b8e3340286" returned: 0 in 0.545s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:46:21 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-fd0ada06-8006-40a6-96cd-3c09b838bfbb tempest-GroupSnapshotsTest-1556879145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b7c86c5e-e22e-4540-afa6-42b8e3340286 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:46:21 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-d4d0c899-314e-4def-925e-abb5e18b314f tempest-VolumesGetTest-2122974047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a9a9b3f-b466-40f9-940f-bcc9dc1370e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:46:21Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1741379042',display_name='tempest-VolumesGetTest-Volume-1969833494',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0bfbc65-e8fd-4075-9ae0-45f09543db17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ab605a12e704f698a0a4b7beeffe43f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:46:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:46:21Z,use_quota=True,user_id='a0b6cabdecf14f80b25b912b51474b36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:46:21 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-d4d0c899-314e-4def-925e-abb5e18b314f tempest-VolumesGetTest-2122974047 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5187e3a7-1612-4276-8d57-ffe03148f933) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:46:21 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-d4d0c899-314e-4def-925e-abb5e18b314f tempest-VolumesGetTest-2122974047 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5187e3a7-1612-4276-8d57-ffe03148f933) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:46:21 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-d4d0c899-314e-4def-925e-abb5e18b314f tempest-VolumesGetTest-2122974047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (195b008d-60f6-4ace-a26a-dfe7a3ec0cfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:46:21 devstack sudo[96436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b7c86c5e-e22e-4540-afa6-42b8e3340286 Sep 22 15:46:21 devstack sudo[96436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:46:21 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-d4d0c899-314e-4def-925e-abb5e18b314f tempest-VolumesGetTest-2122974047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (195b008d-60f6-4ace-a26a-dfe7a3ec0cfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e0bfbc65-e8fd-4075-9ae0-45f09543db17', 'volume_name': 'volume-e0bfbc65-e8fd-4075-9ae0-45f09543db17', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:46:21 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-d4d0c899-314e-4def-925e-abb5e18b314f tempest-VolumesGetTest-2122974047 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae7043ab-f745-4efd-a35b-74ed349a604a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:46:21 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-d4d0c899-314e-4def-925e-abb5e18b314f tempest-VolumesGetTest-2122974047 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae7043ab-f745-4efd-a35b-74ed349a604a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:46:21 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-d4d0c899-314e-4def-925e-abb5e18b314f tempest-VolumesGetTest-2122974047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a133b9c-3084-4e03-a039-55e9c08ed6a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:46:21 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-d4d0c899-314e-4def-925e-abb5e18b314f tempest-VolumesGetTest-2122974047 None] Volume e0bfbc65-e8fd-4075-9ae0-45f09543db17: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e0bfbc65-e8fd-4075-9ae0-45f09543db17', 'volume_size': 1} Sep 22 15:46:21 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-d4d0c899-314e-4def-925e-abb5e18b314f tempest-VolumesGetTest-2122974047 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:46:21 devstack sudo[96429]: pam_unix(sudo:session): session closed for user root Sep 22 15:46:21 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-a8375c1e-3861-4fcc-a78f-e7621f4dfd10 tempest-SnapshotsActionsTest-743576267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b6fe5ce0-11b7-4bbc-8573-9a098af7add5.2e13acce-6d37-4365-8cc0-4f1c9390cf03,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b6fe5ce0-11b7-4bbc-8573-9a098af7add5.f9aafe67-0111-44d5-a57e-75a31a84444d 1G" returned: 0 in 0.530s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:46:21 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-a8375c1e-3861-4fcc-a78f-e7621f4dfd10 tempest-SnapshotsActionsTest-743576267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6fe5ce0-11b7-4bbc-8573-9a098af7add5.2e13acce-6d37-4365-8cc0-4f1c9390cf03 -F qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b6fe5ce0-11b7-4bbc-8573-9a098af7add5.f9aafe67-0111-44d5-a57e-75a31a84444d {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:46:21 devstack sudo[96441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6fe5ce0-11b7-4bbc-8573-9a098af7add5.2e13acce-6d37-4365-8cc0-4f1c9390cf03 -F qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b6fe5ce0-11b7-4bbc-8573-9a098af7add5.f9aafe67-0111-44d5-a57e-75a31a84444d Sep 22 15:46:21 devstack sudo[96441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:46:21 devstack sudo[96436]: pam_unix(sudo:session): session closed for user root Sep 22 15:46:21 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-fd0ada06-8006-40a6-96cd-3c09b838bfbb tempest-GroupSnapshotsTest-1556879145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b7c86c5e-e22e-4540-afa6-42b8e3340286" returned: 0 in 0.305s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:46:21 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-fd0ada06-8006-40a6-96cd-3c09b838bfbb tempest-GroupSnapshotsTest-1556879145 None] Lock "cinder-quobyte-b7c86c5e-e22e-4540-afa6-42b8e3340286" released by "delete_volume" :: held 0.954s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:46:21 devstack cinder-volume[86212]: DEBUG cinder.quota [None req-fd0ada06-8006-40a6-96cd-3c09b838bfbb tempest-GroupSnapshotsTest-1556879145 None] Created reservations ['b8082d49-f7c0-4b61-9f68-530a26314596'] {{(pid=86212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 15:46:21 devstack cinder-volume[86212]: WARNING cinder.quota [None req-fd0ada06-8006-40a6-96cd-3c09b838bfbb tempest-GroupSnapshotsTest-1556879145 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-2030359038 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-2030359038, it is now deprecated. Please use the default quota class for default quota. Sep 22 15:46:21 devstack cinder-volume[86212]: DEBUG cinder.quota [None req-fd0ada06-8006-40a6-96cd-3c09b838bfbb tempest-GroupSnapshotsTest-1556879145 None] Created reservations ['b3872b46-28a5-4e9b-83ac-a3c138a07a56', '27997065-5cc8-4bf1-aa92-b41996e9f08c', '7ab665de-e0f6-4c65-bf38-eba11ef779b1', '96ec2cb5-65a7-4cb6-9fa8-8e3e4826c4b9'] {{(pid=86212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 15:46:21 devstack sudo[96441]: pam_unix(sudo:session): session closed for user root Sep 22 15:46:21 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-a8375c1e-3861-4fcc-a78f-e7621f4dfd10 tempest-SnapshotsActionsTest-743576267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6fe5ce0-11b7-4bbc-8573-9a098af7add5.2e13acce-6d37-4365-8cc0-4f1c9390cf03 -F qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b6fe5ce0-11b7-4bbc-8573-9a098af7add5.f9aafe67-0111-44d5-a57e-75a31a84444d" returned: 0 in 0.349s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:46:21 devstack cinder-volume[86212]: WARNING cinder.volume.drivers.remotefs [None req-a8375c1e-3861-4fcc-a78f-e7621f4dfd10 tempest-SnapshotsActionsTest-743576267 None] /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b6fe5ce0-11b7-4bbc-8573-9a098af7add5.f9aafe67-0111-44d5-a57e-75a31a84444d is being set with open permissions: ugo+rw Sep 22 15:46:21 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-a8375c1e-3861-4fcc-a78f-e7621f4dfd10 tempest-SnapshotsActionsTest-743576267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b6fe5ce0-11b7-4bbc-8573-9a098af7add5.f9aafe67-0111-44d5-a57e-75a31a84444d {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:46:21 devstack cinder-volume[86212]: DEBUG cinder.quota [None req-fd0ada06-8006-40a6-96cd-3c09b838bfbb tempest-GroupSnapshotsTest-1556879145 None] Created reservations ['c6c02c7e-8cb9-4297-932b-ea6d4ec2b67f', '5bb44142-472d-4be3-9bbc-66cf17d747b6', '52d27c2f-93ca-4d77-9440-7352e3358bfa', '2431eabc-9f5d-46c3-8260-c911f5484639'] {{(pid=86212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 15:46:21 devstack sudo[96447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b6fe5ce0-11b7-4bbc-8573-9a098af7add5.f9aafe67-0111-44d5-a57e-75a31a84444d Sep 22 15:46:21 devstack sudo[96447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:46:21 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-fd0ada06-8006-40a6-96cd-3c09b838bfbb tempest-GroupSnapshotsTest-1556879145 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:46:21 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-fd0ada06-8006-40a6-96cd-3c09b838bfbb tempest-GroupSnapshotsTest-1556879145 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:46:21 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-fd0ada06-8006-40a6-96cd-3c09b838bfbb tempest-GroupSnapshotsTest-1556879145 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:46:21 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-fd0ada06-8006-40a6-96cd-3c09b838bfbb tempest-GroupSnapshotsTest-1556879145 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:46:21 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-fd0ada06-8006-40a6-96cd-3c09b838bfbb tempest-GroupSnapshotsTest-1556879145 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:46:21 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-fd0ada06-8006-40a6-96cd-3c09b838bfbb tempest-GroupSnapshotsTest-1556879145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:46:21 devstack sudo[96449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc Sep 22 15:46:21 devstack sudo[96449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:46:21 devstack sudo[96447]: pam_unix(sudo:session): session closed for user root Sep 22 15:46:21 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-a8375c1e-3861-4fcc-a78f-e7621f4dfd10 tempest-SnapshotsActionsTest-743576267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b6fe5ce0-11b7-4bbc-8573-9a098af7add5.f9aafe67-0111-44d5-a57e-75a31a84444d" returned: 0 in 0.295s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:46:22 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-a8375c1e-3861-4fcc-a78f-e7621f4dfd10 tempest-SnapshotsActionsTest-743576267 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.865s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:46:22 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-d4d0c899-314e-4def-925e-abb5e18b314f tempest-VolumesGetTest-2122974047 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.868s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:46:22 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-d4d0c899-314e-4def-925e-abb5e18b314f tempest-VolumesGetTest-2122974047 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:46:21Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1741379042',display_name='tempest-VolumesGetTest-Volume-1969833494',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0bfbc65-e8fd-4075-9ae0-45f09543db17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ab605a12e704f698a0a4b7beeffe43f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:46:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:46:21Z,use_quota=True,user_id='a0b6cabdecf14f80b25b912b51474b36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)}" {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 15:46:22 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-d4d0c899-314e-4def-925e-abb5e18b314f tempest-VolumesGetTest-2122974047 None] Creating volume e0bfbc65-e8fd-4075-9ae0-45f09543db17 {{(pid=86212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 15:46:22 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-d4d0c899-314e-4def-925e-abb5e18b314f tempest-VolumesGetTest-2122974047 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:46:22 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-d4d0c899-314e-4def-925e-abb5e18b314f tempest-VolumesGetTest-2122974047 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:46:22 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-d4d0c899-314e-4def-925e-abb5e18b314f tempest-VolumesGetTest-2122974047 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:46:22 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-d4d0c899-314e-4def-925e-abb5e18b314f tempest-VolumesGetTest-2122974047 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:46:22 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-d4d0c899-314e-4def-925e-abb5e18b314f tempest-VolumesGetTest-2122974047 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:46:22 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-d4d0c899-314e-4def-925e-abb5e18b314f tempest-VolumesGetTest-2122974047 None] Selected osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 as target Quobyte volume. {{(pid=86212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 15:46:22 devstack cinder-volume[86212]: INFO cinder.volume.drivers.remotefs [None req-d4d0c899-314e-4def-925e-abb5e18b314f tempest-VolumesGetTest-2122974047 None] casted to osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 Sep 22 15:46:22 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-d4d0c899-314e-4def-925e-abb5e18b314f tempest-VolumesGetTest-2122974047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-e0bfbc65-e8fd-4075-9ae0-45f09543db17 1073741824 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:46:22 devstack sudo[96452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-e0bfbc65-e8fd-4075-9ae0-45f09543db17 1073741824 Sep 22 15:46:22 devstack sudo[96452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:46:22 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-a8375c1e-3861-4fcc-a78f-e7621f4dfd10 tempest-SnapshotsActionsTest-743576267 None] Create snapshot completed successfully Sep 22 15:46:22 devstack sudo[96449]: pam_unix(sudo:session): session closed for user root Sep 22 15:46:22 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-fd0ada06-8006-40a6-96cd-3c09b838bfbb tempest-GroupSnapshotsTest-1556879145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc" returned: 0 in 0.355s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:46:22 devstack cinder-volume[86212]: DEBUG cinder.manager [None req-fd0ada06-8006-40a6-96cd-3c09b838bfbb tempest-GroupSnapshotsTest-1556879145 None] Notifying Schedulers of capabilities ... {{(pid=86212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 15:46:22 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-fd0ada06-8006-40a6-96cd-3c09b838bfbb tempest-GroupSnapshotsTest-1556879145 None] Delete group completed successfully. Sep 22 15:46:22 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-29ffb19d-0a4d-4285-a465-882aa1b0b909 tempest-SnapshotsActionsTest-1507444151 None] Acquiring lock "cinder-f9aafe67-0111-44d5-a57e-75a31a84444d-delete_snapshot" by "delete_snapshot" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:46:22 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-29ffb19d-0a4d-4285-a465-882aa1b0b909 tempest-SnapshotsActionsTest-1507444151 None] Lock "cinder-f9aafe67-0111-44d5-a57e-75a31a84444d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.045s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:46:22 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-29ffb19d-0a4d-4285-a465-882aa1b0b909 tempest-SnapshotsActionsTest-1507444151 None] Acquiring lock "cinder-quobyte-b6fe5ce0-11b7-4bbc-8573-9a098af7add5" by "delete_snapshot" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:46:22 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-1592fe9e-7c3b-426c-9122-f30f28cf927b tempest-GroupSnapshotsTest-1556879145 None] Group tempest-GroupSnapshotsTest-Group-542069018: creating Sep 22 15:46:22 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-29ffb19d-0a4d-4285-a465-882aa1b0b909 tempest-SnapshotsActionsTest-1507444151 None] Lock "cinder-quobyte-b6fe5ce0-11b7-4bbc-8573-9a098af7add5" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:46:22 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-29ffb19d-0a4d-4285-a465-882aa1b0b909 tempest-SnapshotsActionsTest-1507444151 None] Acquiring lock "cinder-quobyte-f9aafe67-0111-44d5-a57e-75a31a84444d" by "_delete_snapshot" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:46:22 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-29ffb19d-0a4d-4285-a465-882aa1b0b909 tempest-SnapshotsActionsTest-1507444151 None] Lock "cinder-quobyte-f9aafe67-0111-44d5-a57e-75a31a84444d" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:46:22 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-29ffb19d-0a4d-4285-a465-882aa1b0b909 tempest-SnapshotsActionsTest-1507444151 None] Deleting offline snapshot f9aafe67-0111-44d5-a57e-75a31a84444d of volume b6fe5ce0-11b7-4bbc-8573-9a098af7add5 {{(pid=86212) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 22 15:46:22 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-29ffb19d-0a4d-4285-a465-882aa1b0b909 tempest-SnapshotsActionsTest-1507444151 None] snapshot_file for this snap is: volume-b6fe5ce0-11b7-4bbc-8573-9a098af7add5.f9aafe67-0111-44d5-a57e-75a31a84444d {{(pid=86212) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 22 15:46:22 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[c972eeb8-657f-449a-a286-c95beec925f7]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:46:22 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-29ffb19d-0a4d-4285-a465-882aa1b0b909 tempest-SnapshotsActionsTest-1507444151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b6fe5ce0-11b7-4bbc-8573-9a098af7add5.f9aafe67-0111-44d5-a57e-75a31a84444d {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:46:22 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-1592fe9e-7c3b-426c-9122-f30f28cf927b tempest-GroupSnapshotsTest-1556879145 None] Group tempest-GroupSnapshotsTest-Group-542069018: created successfully Sep 22 15:46:22 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-1592fe9e-7c3b-426c-9122-f30f28cf927b tempest-GroupSnapshotsTest-1556879145 None] Create group completed successfully. Sep 22 15:46:22 devstack sudo[96452]: pam_unix(sudo:session): session closed for user root Sep 22 15:46:22 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-d4d0c899-314e-4def-925e-abb5e18b314f tempest-VolumesGetTest-2122974047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-e0bfbc65-e8fd-4075-9ae0-45f09543db17 1073741824" returned: 0 in 0.630s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:46:22 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-d4d0c899-314e-4def-925e-abb5e18b314f tempest-VolumesGetTest-2122974047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-e0bfbc65-e8fd-4075-9ae0-45f09543db17 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:46:22 devstack sudo[96465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-e0bfbc65-e8fd-4075-9ae0-45f09543db17 Sep 22 15:46:22 devstack sudo[96465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:46:22 devstack sudo[96462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b6fe5ce0-11b7-4bbc-8573-9a098af7add5.f9aafe67-0111-44d5-a57e-75a31a84444d Sep 22 15:46:22 devstack sudo[96462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:46:22 devstack sudo[96465]: pam_unix(sudo:session): session closed for user root Sep 22 15:46:22 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-d4d0c899-314e-4def-925e-abb5e18b314f tempest-VolumesGetTest-2122974047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-e0bfbc65-e8fd-4075-9ae0-45f09543db17" returned: 0 in 0.301s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:46:22 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-d4d0c899-314e-4def-925e-abb5e18b314f tempest-VolumesGetTest-2122974047 None] <== create_volume: return (978ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'} {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 15:46:22 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-d4d0c899-314e-4def-925e-abb5e18b314f tempest-VolumesGetTest-2122974047 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.981s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:46:23 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-d4d0c899-314e-4def-925e-abb5e18b314f tempest-VolumesGetTest-2122974047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a133b9c-3084-4e03-a039-55e9c08ed6a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e0bfbc65-e8fd-4075-9ae0-45f09543db17', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:46:23 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-d4d0c899-314e-4def-925e-abb5e18b314f tempest-VolumesGetTest-2122974047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (320dc6a5-7070-4487-83f0-43d1d7a740bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:46:23 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-d4d0c899-314e-4def-925e-abb5e18b314f tempest-VolumesGetTest-2122974047 None] Volume volume-e0bfbc65-e8fd-4075-9ae0-45f09543db17 (e0bfbc65-e8fd-4075-9ae0-45f09543db17): created successfully Sep 22 15:46:23 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-d4d0c899-314e-4def-925e-abb5e18b314f tempest-VolumesGetTest-2122974047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (320dc6a5-7070-4487-83f0-43d1d7a740bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:46:23 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-d4d0c899-314e-4def-925e-abb5e18b314f tempest-VolumesGetTest-2122974047 None] Flow 'volume_create_manager' (3ea59c79-11b8-41da-a103-5bf2fcb5d788) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:46:23 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-d4d0c899-314e-4def-925e-abb5e18b314f tempest-VolumesGetTest-2122974047 None] Created volume successfully. Sep 22 15:46:23 devstack sudo[96462]: pam_unix(sudo:session): session closed for user root Sep 22 15:46:23 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-29ffb19d-0a4d-4285-a465-882aa1b0b909 tempest-SnapshotsActionsTest-1507444151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b6fe5ce0-11b7-4bbc-8573-9a098af7add5.f9aafe67-0111-44d5-a57e-75a31a84444d" returned: 0 in 0.472s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:46:23 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-29ffb19d-0a4d-4285-a465-882aa1b0b909 tempest-SnapshotsActionsTest-1507444151 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b6fe5ce0-11b7-4bbc-8573-9a098af7add5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86212) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 22 15:46:23 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3d18512-fc0e-4c28-a8f3-75876a3e3d3c]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:46:23 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-29ffb19d-0a4d-4285-a465-882aa1b0b909 tempest-SnapshotsActionsTest-1507444151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b6fe5ce0-11b7-4bbc-8573-9a098af7add5.2e13acce-6d37-4365-8cc0-4f1c9390cf03 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:46:23 devstack sudo[96472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b6fe5ce0-11b7-4bbc-8573-9a098af7add5.2e13acce-6d37-4365-8cc0-4f1c9390cf03 Sep 22 15:46:23 devstack sudo[96472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:46:23 devstack sudo[96472]: pam_unix(sudo:session): session closed for user root Sep 22 15:46:23 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-29ffb19d-0a4d-4285-a465-882aa1b0b909 tempest-SnapshotsActionsTest-1507444151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b6fe5ce0-11b7-4bbc-8573-9a098af7add5.2e13acce-6d37-4365-8cc0-4f1c9390cf03" returned: 0 in 0.377s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:46:23 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-29ffb19d-0a4d-4285-a465-882aa1b0b909 tempest-SnapshotsActionsTest-1507444151 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b6fe5ce0-11b7-4bbc-8573-9a098af7add5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86212) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 22 15:46:23 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-29ffb19d-0a4d-4285-a465-882aa1b0b909 tempest-SnapshotsActionsTest-1507444151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b6fe5ce0-11b7-4bbc-8573-9a098af7add5.f9aafe67-0111-44d5-a57e-75a31a84444d {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:46:23 devstack sudo[96477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b6fe5ce0-11b7-4bbc-8573-9a098af7add5.f9aafe67-0111-44d5-a57e-75a31a84444d Sep 22 15:46:23 devstack sudo[96477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:46:23 devstack sudo[96477]: pam_unix(sudo:session): session closed for user root Sep 22 15:46:23 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-29ffb19d-0a4d-4285-a465-882aa1b0b909 tempest-SnapshotsActionsTest-1507444151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b6fe5ce0-11b7-4bbc-8573-9a098af7add5.f9aafe67-0111-44d5-a57e-75a31a84444d" returned: 0 in 0.435s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:46:23 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-29ffb19d-0a4d-4285-a465-882aa1b0b909 tempest-SnapshotsActionsTest-1507444151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b6fe5ce0-11b7-4bbc-8573-9a098af7add5.f9aafe67-0111-44d5-a57e-75a31a84444d {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:46:23 devstack sudo[96484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b6fe5ce0-11b7-4bbc-8573-9a098af7add5.f9aafe67-0111-44d5-a57e-75a31a84444d Sep 22 15:46:23 devstack sudo[96484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:46:24 devstack cinder-volume[86212]: DEBUG cinder.volume.flows.manager.create_volume [None req-649854f5-c39c-4d16-a95a-8f237fb38ebc tempest-GroupSnapshotsTest-1556879145 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 15:46:24 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-649854f5-c39c-4d16-a95a-8f237fb38ebc tempest-GroupSnapshotsTest-1556879145 None] Flow 'volume_create_manager' (f7639c93-576a-475a-be9c-191639902668) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:46:24 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-649854f5-c39c-4d16-a95a-8f237fb38ebc tempest-GroupSnapshotsTest-1556879145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0377cbe3-bc0d-4b64-a59a-ab9483d8c177) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:46:24 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-649854f5-c39c-4d16-a95a-8f237fb38ebc tempest-GroupSnapshotsTest-1556879145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0377cbe3-bc0d-4b64-a59a-ab9483d8c177) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:46:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1330599410',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=22e7d774-726b-4254-8491-03daff599586,host='devstack@QuobyteHD#QuobyteHD',id=5b746bb1-31aa-4497-880d-d80a2cb13e24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='302ce9fa5101463680fb8113ccce1f48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:46:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:46:24Z,use_quota=True,user_id='f8650ad05c3d4df895b954f3cea76df3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e8f7372-f26c-4473-8db9-8e845e2d53d8),volume_type_id=7e8f7372-f26c-4473-8db9-8e845e2d53d8)' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:46:24 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-649854f5-c39c-4d16-a95a-8f237fb38ebc tempest-GroupSnapshotsTest-1556879145 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4c5baab-445f-440c-b885-d92753b79cce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:46:24 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-649854f5-c39c-4d16-a95a-8f237fb38ebc tempest-GroupSnapshotsTest-1556879145 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4c5baab-445f-440c-b885-d92753b79cce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:46:24 devstack sudo[96484]: pam_unix(sudo:session): session closed for user root Sep 22 15:46:24 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-649854f5-c39c-4d16-a95a-8f237fb38ebc tempest-GroupSnapshotsTest-1556879145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57b18ece-1003-4279-a8ae-e0983a5b1a64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:46:24 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-649854f5-c39c-4d16-a95a-8f237fb38ebc tempest-GroupSnapshotsTest-1556879145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57b18ece-1003-4279-a8ae-e0983a5b1a64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5b746bb1-31aa-4497-880d-d80a2cb13e24', 'volume_name': 'volume-5b746bb1-31aa-4497-880d-d80a2cb13e24', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:46:24 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-649854f5-c39c-4d16-a95a-8f237fb38ebc tempest-GroupSnapshotsTest-1556879145 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48b5c303-9e6a-40e0-b905-4790729999b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:46:24 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-649854f5-c39c-4d16-a95a-8f237fb38ebc tempest-GroupSnapshotsTest-1556879145 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48b5c303-9e6a-40e0-b905-4790729999b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:46:24 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-649854f5-c39c-4d16-a95a-8f237fb38ebc tempest-GroupSnapshotsTest-1556879145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64eaee0e-1686-4e3d-bfff-99da251444f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:46:24 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-649854f5-c39c-4d16-a95a-8f237fb38ebc tempest-GroupSnapshotsTest-1556879145 None] Volume 5b746bb1-31aa-4497-880d-d80a2cb13e24: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5b746bb1-31aa-4497-880d-d80a2cb13e24', 'volume_size': 1} Sep 22 15:46:24 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-649854f5-c39c-4d16-a95a-8f237fb38ebc tempest-GroupSnapshotsTest-1556879145 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:46:24 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-649854f5-c39c-4d16-a95a-8f237fb38ebc tempest-GroupSnapshotsTest-1556879145 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:46:24 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-649854f5-c39c-4d16-a95a-8f237fb38ebc tempest-GroupSnapshotsTest-1556879145 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=22e7d774-726b-4254-8491-03daff599586,created_at=2026-09-22T13:46:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1330599410',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=22e7d774-726b-4254-8491-03daff599586,host='devstack@QuobyteHD#QuobyteHD',id=5b746bb1-31aa-4497-880d-d80a2cb13e24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='302ce9fa5101463680fb8113ccce1f48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:46:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:46:24Z,use_quota=True,user_id='f8650ad05c3d4df895b954f3cea76df3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e8f7372-f26c-4473-8db9-8e845e2d53d8),volume_type_id=7e8f7372-f26c-4473-8db9-8e845e2d53d8)}" {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 15:46:24 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-649854f5-c39c-4d16-a95a-8f237fb38ebc tempest-GroupSnapshotsTest-1556879145 None] Creating volume 5b746bb1-31aa-4497-880d-d80a2cb13e24 {{(pid=86212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 15:46:24 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-649854f5-c39c-4d16-a95a-8f237fb38ebc tempest-GroupSnapshotsTest-1556879145 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:46:24 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-649854f5-c39c-4d16-a95a-8f237fb38ebc tempest-GroupSnapshotsTest-1556879145 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:46:24 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-649854f5-c39c-4d16-a95a-8f237fb38ebc tempest-GroupSnapshotsTest-1556879145 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:46:24 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-649854f5-c39c-4d16-a95a-8f237fb38ebc tempest-GroupSnapshotsTest-1556879145 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:46:24 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-649854f5-c39c-4d16-a95a-8f237fb38ebc tempest-GroupSnapshotsTest-1556879145 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:46:24 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-649854f5-c39c-4d16-a95a-8f237fb38ebc tempest-GroupSnapshotsTest-1556879145 None] Selected osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 as target Quobyte volume. {{(pid=86212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 15:46:24 devstack cinder-volume[86212]: INFO cinder.volume.drivers.remotefs [None req-649854f5-c39c-4d16-a95a-8f237fb38ebc tempest-GroupSnapshotsTest-1556879145 None] casted to osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 Sep 22 15:46:24 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-649854f5-c39c-4d16-a95a-8f237fb38ebc tempest-GroupSnapshotsTest-1556879145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-5b746bb1-31aa-4497-880d-d80a2cb13e24 1073741824 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:46:24 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-29ffb19d-0a4d-4285-a465-882aa1b0b909 tempest-SnapshotsActionsTest-1507444151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b6fe5ce0-11b7-4bbc-8573-9a098af7add5.f9aafe67-0111-44d5-a57e-75a31a84444d" returned: 0 in 0.404s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:46:24 devstack sudo[96487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-5b746bb1-31aa-4497-880d-d80a2cb13e24 1073741824 Sep 22 15:46:24 devstack sudo[96487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:46:24 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-29ffb19d-0a4d-4285-a465-882aa1b0b909 tempest-SnapshotsActionsTest-1507444151 None] Lock "cinder-quobyte-f9aafe67-0111-44d5-a57e-75a31a84444d" released by "_delete_snapshot" :: held 1.832s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:46:24 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-29ffb19d-0a4d-4285-a465-882aa1b0b909 tempest-SnapshotsActionsTest-1507444151 None] Lock "cinder-quobyte-b6fe5ce0-11b7-4bbc-8573-9a098af7add5" released by "delete_snapshot" :: held 1.867s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:46:24 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-43a36ea5-06e0-4ae8-ab08-98bdb774d6d5 tempest-VolumesGetTest-2122974047 None] Acquiring lock "cinder-e0bfbc65-e8fd-4075-9ae0-45f09543db17-delete_volume" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:46:24 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-43a36ea5-06e0-4ae8-ab08-98bdb774d6d5 tempest-VolumesGetTest-2122974047 None] Lock "cinder-e0bfbc65-e8fd-4075-9ae0-45f09543db17-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:46:24 devstack cinder-volume[86212]: DEBUG cinder.volume.flows.manager.create_volume [None req-16691f67-3365-49aa-83b3-0080ea8b3548 tempest-VolumesMetadataTest-109461490 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 15:46:24 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-16691f67-3365-49aa-83b3-0080ea8b3548 tempest-VolumesMetadataTest-109461490 None] Flow 'volume_create_manager' (0dc2f910-8892-48d5-b141-196dad0660ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:46:24 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-16691f67-3365-49aa-83b3-0080ea8b3548 tempest-VolumesMetadataTest-109461490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5f32468-5550-4a61-b3b0-e913f020a3a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:46:24 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-16691f67-3365-49aa-83b3-0080ea8b3548 tempest-VolumesMetadataTest-109461490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5f32468-5550-4a61-b3b0-e913f020a3a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:46:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1430145724',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=943756d0-4ffc-4328-b761-9e021f15318a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b441a3e1e264493a93933bbd0ca0f2fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:46:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:46:24Z,use_quota=True,user_id='683004512d594fffa5976f866e31a187',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:46:24 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-16691f67-3365-49aa-83b3-0080ea8b3548 tempest-VolumesMetadataTest-109461490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6b32233-0095-45f0-9518-8a98990efaf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:46:24 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-16691f67-3365-49aa-83b3-0080ea8b3548 tempest-VolumesMetadataTest-109461490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6b32233-0095-45f0-9518-8a98990efaf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:46:24 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-16691f67-3365-49aa-83b3-0080ea8b3548 tempest-VolumesMetadataTest-109461490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c58d3f99-03cb-41e1-91f5-2d89e7e293e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:46:24 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-16691f67-3365-49aa-83b3-0080ea8b3548 tempest-VolumesMetadataTest-109461490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c58d3f99-03cb-41e1-91f5-2d89e7e293e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '943756d0-4ffc-4328-b761-9e021f15318a', 'volume_name': 'volume-943756d0-4ffc-4328-b761-9e021f15318a', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:46:24 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-16691f67-3365-49aa-83b3-0080ea8b3548 tempest-VolumesMetadataTest-109461490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f8c104b-ce6f-4e8c-910b-ea7efab01efc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:46:24 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-16691f67-3365-49aa-83b3-0080ea8b3548 tempest-VolumesMetadataTest-109461490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f8c104b-ce6f-4e8c-910b-ea7efab01efc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:46:24 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-16691f67-3365-49aa-83b3-0080ea8b3548 tempest-VolumesMetadataTest-109461490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d61dd85-6a78-40ab-b543-4e9971164c49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:46:24 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-16691f67-3365-49aa-83b3-0080ea8b3548 tempest-VolumesMetadataTest-109461490 None] Volume 943756d0-4ffc-4328-b761-9e021f15318a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-943756d0-4ffc-4328-b761-9e021f15318a', 'volume_size': 1} Sep 22 15:46:24 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-16691f67-3365-49aa-83b3-0080ea8b3548 tempest-VolumesMetadataTest-109461490 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:46:24 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-43a36ea5-06e0-4ae8-ab08-98bdb774d6d5 tempest-VolumesGetTest-2122974047 None] Acquiring lock "cinder-quobyte-e0bfbc65-e8fd-4075-9ae0-45f09543db17" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:46:24 devstack cinder-volume[86212]: DEBUG cinder.quota [None req-29ffb19d-0a4d-4285-a465-882aa1b0b909 tempest-SnapshotsActionsTest-1507444151 None] Created reservations ['7ffd13a1-38be-47a7-9a69-ac41c5c7b7c2', '72ba7175-c97e-4c94-bb06-9f3f4828efe2', '46eb1411-b1d5-4392-95a9-b7f94abc9c59', 'aa717e07-39fb-4c6a-9d17-3ab4b1e393e3'] {{(pid=86212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 15:46:24 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-43a36ea5-06e0-4ae8-ab08-98bdb774d6d5 tempest-VolumesGetTest-2122974047 None] Lock "cinder-quobyte-e0bfbc65-e8fd-4075-9ae0-45f09543db17" acquired by "delete_volume" :: waited 0.026s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:46:24 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[1391a484-d03d-4904-8a92-4155ae945c43]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:46:24 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-43a36ea5-06e0-4ae8-ab08-98bdb774d6d5 tempest-VolumesGetTest-2122974047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-e0bfbc65-e8fd-4075-9ae0-45f09543db17 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:46:24 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-29ffb19d-0a4d-4285-a465-882aa1b0b909 tempest-SnapshotsActionsTest-1507444151 None] Delete snapshot completed successfully. Sep 22 15:46:24 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-29ffb19d-0a4d-4285-a465-882aa1b0b909 tempest-SnapshotsActionsTest-1507444151 None] Lock "cinder-f9aafe67-0111-44d5-a57e-75a31a84444d-delete_snapshot" released by "delete_snapshot" :: held 2.253s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:46:24 devstack sudo[96492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-e0bfbc65-e8fd-4075-9ae0-45f09543db17 Sep 22 15:46:24 devstack sudo[96492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:46:24 devstack sudo[96487]: pam_unix(sudo:session): session closed for user root Sep 22 15:46:24 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-649854f5-c39c-4d16-a95a-8f237fb38ebc tempest-GroupSnapshotsTest-1556879145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-5b746bb1-31aa-4497-880d-d80a2cb13e24 1073741824" returned: 0 in 0.551s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:46:24 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-649854f5-c39c-4d16-a95a-8f237fb38ebc tempest-GroupSnapshotsTest-1556879145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-5b746bb1-31aa-4497-880d-d80a2cb13e24 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:46:24 devstack sudo[96497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-5b746bb1-31aa-4497-880d-d80a2cb13e24 Sep 22 15:46:24 devstack sudo[96497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:46:25 devstack sudo[96492]: pam_unix(sudo:session): session closed for user root Sep 22 15:46:25 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-43a36ea5-06e0-4ae8-ab08-98bdb774d6d5 tempest-VolumesGetTest-2122974047 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-e0bfbc65-e8fd-4075-9ae0-45f09543db17" returned: 0 in 0.397s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:46:25 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-43a36ea5-06e0-4ae8-ab08-98bdb774d6d5 tempest-VolumesGetTest-2122974047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-e0bfbc65-e8fd-4075-9ae0-45f09543db17 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:46:25 devstack sudo[96502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-e0bfbc65-e8fd-4075-9ae0-45f09543db17 Sep 22 15:46:25 devstack sudo[96502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:46:25 devstack sudo[96497]: pam_unix(sudo:session): session closed for user root Sep 22 15:46:25 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-649854f5-c39c-4d16-a95a-8f237fb38ebc tempest-GroupSnapshotsTest-1556879145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-5b746bb1-31aa-4497-880d-d80a2cb13e24" returned: 0 in 0.261s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:46:25 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-649854f5-c39c-4d16-a95a-8f237fb38ebc tempest-GroupSnapshotsTest-1556879145 None] <== create_volume: return (851ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'} {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 15:46:25 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-649854f5-c39c-4d16-a95a-8f237fb38ebc tempest-GroupSnapshotsTest-1556879145 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.854s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:46:25 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-16691f67-3365-49aa-83b3-0080ea8b3548 tempest-VolumesMetadataTest-109461490 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.576s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:46:25 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-16691f67-3365-49aa-83b3-0080ea8b3548 tempest-VolumesMetadataTest-109461490 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:46:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1430145724',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=943756d0-4ffc-4328-b761-9e021f15318a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b441a3e1e264493a93933bbd0ca0f2fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:46:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:46:24Z,use_quota=True,user_id='683004512d594fffa5976f866e31a187',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)}" {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 15:46:25 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-16691f67-3365-49aa-83b3-0080ea8b3548 tempest-VolumesMetadataTest-109461490 None] Creating volume 943756d0-4ffc-4328-b761-9e021f15318a {{(pid=86212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 15:46:25 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-16691f67-3365-49aa-83b3-0080ea8b3548 tempest-VolumesMetadataTest-109461490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:46:25 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-16691f67-3365-49aa-83b3-0080ea8b3548 tempest-VolumesMetadataTest-109461490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:46:25 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-16691f67-3365-49aa-83b3-0080ea8b3548 tempest-VolumesMetadataTest-109461490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:46:25 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-16691f67-3365-49aa-83b3-0080ea8b3548 tempest-VolumesMetadataTest-109461490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:46:25 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-16691f67-3365-49aa-83b3-0080ea8b3548 tempest-VolumesMetadataTest-109461490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:46:25 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-16691f67-3365-49aa-83b3-0080ea8b3548 tempest-VolumesMetadataTest-109461490 None] Selected osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 as target Quobyte volume. {{(pid=86212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 15:46:25 devstack cinder-volume[86212]: INFO cinder.volume.drivers.remotefs [None req-16691f67-3365-49aa-83b3-0080ea8b3548 tempest-VolumesMetadataTest-109461490 None] casted to osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 Sep 22 15:46:25 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-16691f67-3365-49aa-83b3-0080ea8b3548 tempest-VolumesMetadataTest-109461490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-943756d0-4ffc-4328-b761-9e021f15318a 1073741824 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:46:25 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-649854f5-c39c-4d16-a95a-8f237fb38ebc tempest-GroupSnapshotsTest-1556879145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64eaee0e-1686-4e3d-bfff-99da251444f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b746bb1-31aa-4497-880d-d80a2cb13e24', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:46:25 devstack sudo[96505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-943756d0-4ffc-4328-b761-9e021f15318a 1073741824 Sep 22 15:46:25 devstack sudo[96505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:46:25 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-649854f5-c39c-4d16-a95a-8f237fb38ebc tempest-GroupSnapshotsTest-1556879145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d993218c-52e3-44c9-983e-d9a385e3f868) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:46:25 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-649854f5-c39c-4d16-a95a-8f237fb38ebc tempest-GroupSnapshotsTest-1556879145 None] Volume volume-5b746bb1-31aa-4497-880d-d80a2cb13e24 (5b746bb1-31aa-4497-880d-d80a2cb13e24): created successfully Sep 22 15:46:25 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-649854f5-c39c-4d16-a95a-8f237fb38ebc tempest-GroupSnapshotsTest-1556879145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d993218c-52e3-44c9-983e-d9a385e3f868) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:46:25 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-649854f5-c39c-4d16-a95a-8f237fb38ebc tempest-GroupSnapshotsTest-1556879145 None] Flow 'volume_create_manager' (f7639c93-576a-475a-be9c-191639902668) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:46:25 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-649854f5-c39c-4d16-a95a-8f237fb38ebc tempest-GroupSnapshotsTest-1556879145 None] Created volume successfully. Sep 22 15:46:25 devstack sudo[96502]: pam_unix(sudo:session): session closed for user root Sep 22 15:46:25 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-43a36ea5-06e0-4ae8-ab08-98bdb774d6d5 tempest-VolumesGetTest-2122974047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-e0bfbc65-e8fd-4075-9ae0-45f09543db17" returned: 0 in 0.280s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:46:25 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-43a36ea5-06e0-4ae8-ab08-98bdb774d6d5 tempest-VolumesGetTest-2122974047 None] Lock "cinder-quobyte-e0bfbc65-e8fd-4075-9ae0-45f09543db17" released by "delete_volume" :: held 0.747s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:46:25 devstack cinder-volume[86212]: DEBUG cinder.quota [None req-43a36ea5-06e0-4ae8-ab08-98bdb774d6d5 tempest-VolumesGetTest-2122974047 None] Created reservations ['bdc9c9ac-9a5a-47c0-b838-136e93aee3a3', 'e28e7491-6035-4849-ab23-4c8f18c10c3e', '67321c56-20f7-4b98-816d-a17e7832c31f', 'ac8ed505-fde1-42a5-a007-060036070693'] {{(pid=86212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 15:46:25 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-43a36ea5-06e0-4ae8-ab08-98bdb774d6d5 tempest-VolumesGetTest-2122974047 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:46:25 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-43a36ea5-06e0-4ae8-ab08-98bdb774d6d5 tempest-VolumesGetTest-2122974047 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:46:25 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-43a36ea5-06e0-4ae8-ab08-98bdb774d6d5 tempest-VolumesGetTest-2122974047 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:46:25 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-43a36ea5-06e0-4ae8-ab08-98bdb774d6d5 tempest-VolumesGetTest-2122974047 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:46:25 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-43a36ea5-06e0-4ae8-ab08-98bdb774d6d5 tempest-VolumesGetTest-2122974047 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:46:25 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-43a36ea5-06e0-4ae8-ab08-98bdb774d6d5 tempest-VolumesGetTest-2122974047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:46:25 devstack sudo[96511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc Sep 22 15:46:25 devstack sudo[96511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:46:25 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-8566c9c6-6cb1-428f-a309-6ab1f0362eb6 tempest-GroupSnapshotsTest-1556879145 None] GroupSnapshot 4d211372-dc3c-4912-bf2a-79eb9a420e30: creating. Sep 22 15:46:25 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-8566c9c6-6cb1-428f-a309-6ab1f0362eb6 tempest-GroupSnapshotsTest-1556879145 None] Group snapshot 4d211372-dc3c-4912-bf2a-79eb9a420e30: creating. {{(pid=86212) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 22 15:46:25 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-8566c9c6-6cb1-428f-a309-6ab1f0362eb6 tempest-GroupSnapshotsTest-1556879145 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:46:25 devstack sudo[96505]: pam_unix(sudo:session): session closed for user root Sep 22 15:46:25 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-16691f67-3365-49aa-83b3-0080ea8b3548 tempest-VolumesMetadataTest-109461490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-943756d0-4ffc-4328-b761-9e021f15318a 1073741824" returned: 0 in 0.573s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:46:25 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-44085e27-a852-47f5-928f-63cd1a44e1ba tempest-VolumesGetTest-2122974047 None] Acquiring lock "cinder-f7c4c12d-5b38-4b2d-b1a3-54910721165d-delete_volume" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:46:25 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-16691f67-3365-49aa-83b3-0080ea8b3548 tempest-VolumesMetadataTest-109461490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-943756d0-4ffc-4328-b761-9e021f15318a {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:46:25 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-44085e27-a852-47f5-928f-63cd1a44e1ba tempest-VolumesGetTest-2122974047 None] Lock "cinder-f7c4c12d-5b38-4b2d-b1a3-54910721165d-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:46:25 devstack sudo[96511]: pam_unix(sudo:session): session closed for user root Sep 22 15:46:25 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-43a36ea5-06e0-4ae8-ab08-98bdb774d6d5 tempest-VolumesGetTest-2122974047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc" returned: 0 in 0.352s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:46:25 devstack cinder-volume[86212]: DEBUG cinder.manager [None req-43a36ea5-06e0-4ae8-ab08-98bdb774d6d5 tempest-VolumesGetTest-2122974047 None] Notifying Schedulers of capabilities ... {{(pid=86212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 15:46:25 devstack sudo[96515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-943756d0-4ffc-4328-b761-9e021f15318a Sep 22 15:46:25 devstack sudo[96515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:46:25 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-43a36ea5-06e0-4ae8-ab08-98bdb774d6d5 tempest-VolumesGetTest-2122974047 None] Deleted volume successfully. Sep 22 15:46:25 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-44085e27-a852-47f5-928f-63cd1a44e1ba tempest-VolumesGetTest-2122974047 None] Acquiring lock "cinder-quobyte-f7c4c12d-5b38-4b2d-b1a3-54910721165d" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:46:25 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-43a36ea5-06e0-4ae8-ab08-98bdb774d6d5 tempest-VolumesGetTest-2122974047 None] Lock "cinder-e0bfbc65-e8fd-4075-9ae0-45f09543db17-delete_volume" released by "delete_volume" :: held 1.463s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:46:25 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-44085e27-a852-47f5-928f-63cd1a44e1ba tempest-VolumesGetTest-2122974047 None] Lock "cinder-quobyte-f7c4c12d-5b38-4b2d-b1a3-54910721165d" acquired by "delete_volume" :: waited 0.032s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:46:25 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dffaa8c-a8f5-4a49-bf3e-a5840d18a4eb]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:46:25 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-44085e27-a852-47f5-928f-63cd1a44e1ba tempest-VolumesGetTest-2122974047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-f7c4c12d-5b38-4b2d-b1a3-54910721165d {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:46:26 devstack sudo[96517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-f7c4c12d-5b38-4b2d-b1a3-54910721165d Sep 22 15:46:26 devstack sudo[96517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:46:26 devstack sudo[96515]: pam_unix(sudo:session): session closed for user root Sep 22 15:46:26 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-16691f67-3365-49aa-83b3-0080ea8b3548 tempest-VolumesMetadataTest-109461490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-943756d0-4ffc-4328-b761-9e021f15318a" returned: 0 in 0.325s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:46:26 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-16691f67-3365-49aa-83b3-0080ea8b3548 tempest-VolumesMetadataTest-109461490 None] <== create_volume: return (965ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'} {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 15:46:26 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-16691f67-3365-49aa-83b3-0080ea8b3548 tempest-VolumesMetadataTest-109461490 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.969s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:46:26 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-8566c9c6-6cb1-428f-a309-6ab1f0362eb6 tempest-GroupSnapshotsTest-1556879145 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.391s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:46:26 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-4748095f-b4de-40e2-a86b-93a14ddc0e96 tempest-SnapshotsActionsTest-743576267 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:46:26 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-16691f67-3365-49aa-83b3-0080ea8b3548 tempest-VolumesMetadataTest-109461490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d61dd85-6a78-40ab-b543-4e9971164c49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-943756d0-4ffc-4328-b761-9e021f15318a', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:46:26 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-16691f67-3365-49aa-83b3-0080ea8b3548 tempest-VolumesMetadataTest-109461490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (998700de-1161-426c-9383-d26cb9699da5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:46:26 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-8566c9c6-6cb1-428f-a309-6ab1f0362eb6 tempest-GroupSnapshotsTest-1556879145 None] Creating offline snapshot b98b81c2-3d51-48ff-be59-dd34e7323fde of volume 5b746bb1-31aa-4497-880d-d80a2cb13e24 {{(pid=86212) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 22 15:46:26 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-16691f67-3365-49aa-83b3-0080ea8b3548 tempest-VolumesMetadataTest-109461490 None] Volume volume-943756d0-4ffc-4328-b761-9e021f15318a (943756d0-4ffc-4328-b761-9e021f15318a): created successfully Sep 22 15:46:26 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-16691f67-3365-49aa-83b3-0080ea8b3548 tempest-VolumesMetadataTest-109461490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (998700de-1161-426c-9383-d26cb9699da5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:46:26 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-16691f67-3365-49aa-83b3-0080ea8b3548 tempest-VolumesMetadataTest-109461490 None] Flow 'volume_create_manager' (0dc2f910-8892-48d5-b141-196dad0660ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:46:26 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e6a2195-3643-49fc-a0df-b8e4cf3733c8]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:46:26 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-8566c9c6-6cb1-428f-a309-6ab1f0362eb6 tempest-GroupSnapshotsTest-1556879145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-5b746bb1-31aa-4497-880d-d80a2cb13e24 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:46:26 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-16691f67-3365-49aa-83b3-0080ea8b3548 tempest-VolumesMetadataTest-109461490 None] Created volume successfully. Sep 22 15:46:26 devstack sudo[96520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-5b746bb1-31aa-4497-880d-d80a2cb13e24 Sep 22 15:46:26 devstack sudo[96520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:46:26 devstack sudo[96517]: pam_unix(sudo:session): session closed for user root Sep 22 15:46:26 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-44085e27-a852-47f5-928f-63cd1a44e1ba tempest-VolumesGetTest-2122974047 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-f7c4c12d-5b38-4b2d-b1a3-54910721165d" returned: 0 in 0.418s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:46:26 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-44085e27-a852-47f5-928f-63cd1a44e1ba tempest-VolumesGetTest-2122974047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-f7c4c12d-5b38-4b2d-b1a3-54910721165d {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:46:26 devstack sudo[96525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-f7c4c12d-5b38-4b2d-b1a3-54910721165d Sep 22 15:46:26 devstack sudo[96525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:46:26 devstack sudo[96520]: pam_unix(sudo:session): session closed for user root Sep 22 15:46:26 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-8566c9c6-6cb1-428f-a309-6ab1f0362eb6 tempest-GroupSnapshotsTest-1556879145 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-5b746bb1-31aa-4497-880d-d80a2cb13e24" returned: 0 in 0.394s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:46:26 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-8566c9c6-6cb1-428f-a309-6ab1f0362eb6 tempest-GroupSnapshotsTest-1556879145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-5b746bb1-31aa-4497-880d-d80a2cb13e24,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-5b746bb1-31aa-4497-880d-d80a2cb13e24.b98b81c2-3d51-48ff-be59-dd34e7323fde 1G {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:46:26 devstack sudo[96530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-5b746bb1-31aa-4497-880d-d80a2cb13e24,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-5b746bb1-31aa-4497-880d-d80a2cb13e24.b98b81c2-3d51-48ff-be59-dd34e7323fde 1G Sep 22 15:46:26 devstack sudo[96530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:46:26 devstack sudo[96525]: pam_unix(sudo:session): session closed for user root Sep 22 15:46:26 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-44085e27-a852-47f5-928f-63cd1a44e1ba tempest-VolumesGetTest-2122974047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-f7c4c12d-5b38-4b2d-b1a3-54910721165d" returned: 0 in 0.269s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:46:26 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-44085e27-a852-47f5-928f-63cd1a44e1ba tempest-VolumesGetTest-2122974047 None] Lock "cinder-quobyte-f7c4c12d-5b38-4b2d-b1a3-54910721165d" released by "delete_volume" :: held 0.742s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:46:26 devstack cinder-volume[86212]: DEBUG cinder.quota [None req-44085e27-a852-47f5-928f-63cd1a44e1ba tempest-VolumesGetTest-2122974047 None] Created reservations ['2674eda3-c029-41ff-bf04-c15371bddfbf', 'a83fe471-5db8-483a-b6a4-da82e36ada60', '2ef5aaa9-48b7-4de5-9f21-a8ccdf3a23b0', '476ac554-4188-41fd-868b-9a948cad166e'] {{(pid=86212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 15:46:26 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-44085e27-a852-47f5-928f-63cd1a44e1ba tempest-VolumesGetTest-2122974047 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:46:26 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-44085e27-a852-47f5-928f-63cd1a44e1ba tempest-VolumesGetTest-2122974047 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:46:26 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-44085e27-a852-47f5-928f-63cd1a44e1ba tempest-VolumesGetTest-2122974047 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:46:26 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-44085e27-a852-47f5-928f-63cd1a44e1ba tempest-VolumesGetTest-2122974047 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:46:26 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-44085e27-a852-47f5-928f-63cd1a44e1ba tempest-VolumesGetTest-2122974047 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:46:26 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-44085e27-a852-47f5-928f-63cd1a44e1ba tempest-VolumesGetTest-2122974047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:46:26 devstack sudo[96535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc Sep 22 15:46:26 devstack sudo[96535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:46:27 devstack sudo[96535]: pam_unix(sudo:session): session closed for user root Sep 22 15:46:27 devstack sudo[96530]: pam_unix(sudo:session): session closed for user root Sep 22 15:46:27 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-44085e27-a852-47f5-928f-63cd1a44e1ba tempest-VolumesGetTest-2122974047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc" returned: 0 in 0.274s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:46:27 devstack cinder-volume[86212]: DEBUG cinder.manager [None req-44085e27-a852-47f5-928f-63cd1a44e1ba tempest-VolumesGetTest-2122974047 None] Notifying Schedulers of capabilities ... {{(pid=86212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 15:46:27 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-8566c9c6-6cb1-428f-a309-6ab1f0362eb6 tempest-GroupSnapshotsTest-1556879145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-5b746bb1-31aa-4497-880d-d80a2cb13e24,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-5b746bb1-31aa-4497-880d-d80a2cb13e24.b98b81c2-3d51-48ff-be59-dd34e7323fde 1G" returned: 0 in 0.512s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:46:27 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-8566c9c6-6cb1-428f-a309-6ab1f0362eb6 tempest-GroupSnapshotsTest-1556879145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5b746bb1-31aa-4497-880d-d80a2cb13e24 -F qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-5b746bb1-31aa-4497-880d-d80a2cb13e24.b98b81c2-3d51-48ff-be59-dd34e7323fde {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:46:27 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-44085e27-a852-47f5-928f-63cd1a44e1ba tempest-VolumesGetTest-2122974047 None] Deleted volume successfully. Sep 22 15:46:27 devstack sudo[96540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5b746bb1-31aa-4497-880d-d80a2cb13e24 -F qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-5b746bb1-31aa-4497-880d-d80a2cb13e24.b98b81c2-3d51-48ff-be59-dd34e7323fde Sep 22 15:46:27 devstack sudo[96540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:46:27 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-44085e27-a852-47f5-928f-63cd1a44e1ba tempest-VolumesGetTest-2122974047 None] Lock "cinder-f7c4c12d-5b38-4b2d-b1a3-54910721165d-delete_volume" released by "delete_volume" :: held 1.314s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:46:27 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-07dbdc04-73ad-4e81-9e0c-4f1f178144eb tempest-VolumesMetadataTest-109461490 None] Acquiring lock "cinder-943756d0-4ffc-4328-b761-9e021f15318a-delete_volume" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:46:27 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-07dbdc04-73ad-4e81-9e0c-4f1f178144eb tempest-VolumesMetadataTest-109461490 None] Lock "cinder-943756d0-4ffc-4328-b761-9e021f15318a-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:46:27 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-07dbdc04-73ad-4e81-9e0c-4f1f178144eb tempest-VolumesMetadataTest-109461490 None] Acquiring lock "cinder-quobyte-943756d0-4ffc-4328-b761-9e021f15318a" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:46:27 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-07dbdc04-73ad-4e81-9e0c-4f1f178144eb tempest-VolumesMetadataTest-109461490 None] Lock "cinder-quobyte-943756d0-4ffc-4328-b761-9e021f15318a" acquired by "delete_volume" :: waited 0.020s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:46:27 devstack sudo[96540]: pam_unix(sudo:session): session closed for user root Sep 22 15:46:27 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-8566c9c6-6cb1-428f-a309-6ab1f0362eb6 tempest-GroupSnapshotsTest-1556879145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5b746bb1-31aa-4497-880d-d80a2cb13e24 -F qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-5b746bb1-31aa-4497-880d-d80a2cb13e24.b98b81c2-3d51-48ff-be59-dd34e7323fde" returned: 0 in 0.402s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:46:27 devstack cinder-volume[86212]: WARNING cinder.volume.drivers.remotefs [None req-8566c9c6-6cb1-428f-a309-6ab1f0362eb6 tempest-GroupSnapshotsTest-1556879145 None] /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-5b746bb1-31aa-4497-880d-d80a2cb13e24.b98b81c2-3d51-48ff-be59-dd34e7323fde is being set with open permissions: ugo+rw: NotImplementedError Sep 22 15:46:27 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-8566c9c6-6cb1-428f-a309-6ab1f0362eb6 tempest-GroupSnapshotsTest-1556879145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-5b746bb1-31aa-4497-880d-d80a2cb13e24.b98b81c2-3d51-48ff-be59-dd34e7323fde {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:46:27 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[6075a4c0-75a7-4569-a7ce-825bf649f447]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:46:27 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-07dbdc04-73ad-4e81-9e0c-4f1f178144eb tempest-VolumesMetadataTest-109461490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-943756d0-4ffc-4328-b761-9e021f15318a {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:46:27 devstack sudo[96546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-5b746bb1-31aa-4497-880d-d80a2cb13e24.b98b81c2-3d51-48ff-be59-dd34e7323fde Sep 22 15:46:27 devstack sudo[96546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:46:27 devstack sudo[96547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-943756d0-4ffc-4328-b761-9e021f15318a Sep 22 15:46:27 devstack sudo[96547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:46:27 devstack sudo[96546]: pam_unix(sudo:session): session closed for user root Sep 22 15:46:27 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-8566c9c6-6cb1-428f-a309-6ab1f0362eb6 tempest-GroupSnapshotsTest-1556879145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-5b746bb1-31aa-4497-880d-d80a2cb13e24.b98b81c2-3d51-48ff-be59-dd34e7323fde" returned: 0 in 0.281s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:46:27 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-8566c9c6-6cb1-428f-a309-6ab1f0362eb6 tempest-GroupSnapshotsTest-1556879145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-5b746bb1-31aa-4497-880d-d80a2cb13e24.info {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:46:27 devstack sudo[96551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-5b746bb1-31aa-4497-880d-d80a2cb13e24.info Sep 22 15:46:27 devstack sudo[96551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:46:27 devstack sudo[96547]: pam_unix(sudo:session): session closed for user root Sep 22 15:46:27 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-07dbdc04-73ad-4e81-9e0c-4f1f178144eb tempest-VolumesMetadataTest-109461490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-943756d0-4ffc-4328-b761-9e021f15318a" returned: 0 in 0.414s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:46:27 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-07dbdc04-73ad-4e81-9e0c-4f1f178144eb tempest-VolumesMetadataTest-109461490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-943756d0-4ffc-4328-b761-9e021f15318a {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:46:27 devstack sudo[96556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-943756d0-4ffc-4328-b761-9e021f15318a Sep 22 15:46:27 devstack sudo[96556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:46:28 devstack sudo[96551]: pam_unix(sudo:session): session closed for user root Sep 22 15:46:28 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-8566c9c6-6cb1-428f-a309-6ab1f0362eb6 tempest-GroupSnapshotsTest-1556879145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-5b746bb1-31aa-4497-880d-d80a2cb13e24.info" returned: 0 in 0.284s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:46:28 devstack cinder-volume[86212]: WARNING cinder.volume.drivers.remotefs [None req-8566c9c6-6cb1-428f-a309-6ab1f0362eb6 tempest-GroupSnapshotsTest-1556879145 None] /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-5b746bb1-31aa-4497-880d-d80a2cb13e24.info is being set with open permissions: ugo+rw: NotImplementedError Sep 22 15:46:28 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-8566c9c6-6cb1-428f-a309-6ab1f0362eb6 tempest-GroupSnapshotsTest-1556879145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-5b746bb1-31aa-4497-880d-d80a2cb13e24.info {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:46:28 devstack sudo[96559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-5b746bb1-31aa-4497-880d-d80a2cb13e24.info Sep 22 15:46:28 devstack sudo[96559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:46:28 devstack sudo[96556]: pam_unix(sudo:session): session closed for user root Sep 22 15:46:28 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-07dbdc04-73ad-4e81-9e0c-4f1f178144eb tempest-VolumesMetadataTest-109461490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-943756d0-4ffc-4328-b761-9e021f15318a" returned: 0 in 0.289s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:46:28 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-07dbdc04-73ad-4e81-9e0c-4f1f178144eb tempest-VolumesMetadataTest-109461490 None] Lock "cinder-quobyte-943756d0-4ffc-4328-b761-9e021f15318a" released by "delete_volume" :: held 0.757s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:46:28 devstack cinder-volume[86212]: DEBUG cinder.quota [None req-07dbdc04-73ad-4e81-9e0c-4f1f178144eb tempest-VolumesMetadataTest-109461490 None] Created reservations ['7fc3f3e8-56ab-4502-8c0b-9c57f16817ea', 'a22b4401-33d5-4e28-9e7f-963586b2238e', '3a5f75b8-9dbe-47a5-9034-c9fcd1973fa4', '29a330a5-5f2d-4467-99a9-802f4942cb33'] {{(pid=86212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 15:46:28 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-07dbdc04-73ad-4e81-9e0c-4f1f178144eb tempest-VolumesMetadataTest-109461490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:46:28 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-07dbdc04-73ad-4e81-9e0c-4f1f178144eb tempest-VolumesMetadataTest-109461490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:46:28 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-07dbdc04-73ad-4e81-9e0c-4f1f178144eb tempest-VolumesMetadataTest-109461490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:46:28 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-07dbdc04-73ad-4e81-9e0c-4f1f178144eb tempest-VolumesMetadataTest-109461490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:46:28 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-07dbdc04-73ad-4e81-9e0c-4f1f178144eb tempest-VolumesMetadataTest-109461490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:46:28 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-07dbdc04-73ad-4e81-9e0c-4f1f178144eb tempest-VolumesMetadataTest-109461490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:46:28 devstack sudo[96559]: pam_unix(sudo:session): session closed for user root Sep 22 15:46:28 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-8566c9c6-6cb1-428f-a309-6ab1f0362eb6 tempest-GroupSnapshotsTest-1556879145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-5b746bb1-31aa-4497-880d-d80a2cb13e24.info" returned: 0 in 0.291s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:46:28 devstack sudo[96563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc Sep 22 15:46:28 devstack sudo[96563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:46:28 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-8566c9c6-6cb1-428f-a309-6ab1f0362eb6 tempest-GroupSnapshotsTest-1556879145 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.281s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:46:28 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-4748095f-b4de-40e2-a86b-93a14ddc0e96 tempest-SnapshotsActionsTest-743576267 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.284s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:46:28 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-4748095f-b4de-40e2-a86b-93a14ddc0e96 tempest-SnapshotsActionsTest-743576267 None] Creating offline snapshot 1a0ada5c-4d7b-4aa1-aa24-8ff210ec41f4 of volume b6fe5ce0-11b7-4bbc-8573-9a098af7add5 {{(pid=86212) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 22 15:46:28 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ed1563e-ccbf-4baa-87b0-d21234e8635e]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:46:28 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-4748095f-b4de-40e2-a86b-93a14ddc0e96 tempest-SnapshotsActionsTest-743576267 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b6fe5ce0-11b7-4bbc-8573-9a098af7add5.2e13acce-6d37-4365-8cc0-4f1c9390cf03 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:46:28 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-8566c9c6-6cb1-428f-a309-6ab1f0362eb6 tempest-GroupSnapshotsTest-1556879145 None] group_snapshot 4d211372-dc3c-4912-bf2a-79eb9a420e30: created successfully Sep 22 15:46:28 devstack sudo[96563]: pam_unix(sudo:session): session closed for user root Sep 22 15:46:28 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-07dbdc04-73ad-4e81-9e0c-4f1f178144eb tempest-VolumesMetadataTest-109461490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc" returned: 0 in 0.334s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:46:28 devstack cinder-volume[86212]: DEBUG cinder.manager [None req-07dbdc04-73ad-4e81-9e0c-4f1f178144eb tempest-VolumesMetadataTest-109461490 None] Notifying Schedulers of capabilities ... {{(pid=86212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 15:46:28 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-07dbdc04-73ad-4e81-9e0c-4f1f178144eb tempest-VolumesMetadataTest-109461490 None] Deleted volume successfully. Sep 22 15:46:28 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-07dbdc04-73ad-4e81-9e0c-4f1f178144eb tempest-VolumesMetadataTest-109461490 None] Lock "cinder-943756d0-4ffc-4328-b761-9e021f15318a-delete_volume" released by "delete_volume" :: held 1.339s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:46:28 devstack sudo[96565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b6fe5ce0-11b7-4bbc-8573-9a098af7add5.2e13acce-6d37-4365-8cc0-4f1c9390cf03 Sep 22 15:46:28 devstack sudo[96565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:46:29 devstack sudo[96565]: pam_unix(sudo:session): session closed for user root Sep 22 15:46:29 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-4748095f-b4de-40e2-a86b-93a14ddc0e96 tempest-SnapshotsActionsTest-743576267 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b6fe5ce0-11b7-4bbc-8573-9a098af7add5.2e13acce-6d37-4365-8cc0-4f1c9390cf03" returned: 0 in 0.536s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:46:29 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-4748095f-b4de-40e2-a86b-93a14ddc0e96 tempest-SnapshotsActionsTest-743576267 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b6fe5ce0-11b7-4bbc-8573-9a098af7add5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86212) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 22 15:46:29 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-4748095f-b4de-40e2-a86b-93a14ddc0e96 tempest-SnapshotsActionsTest-743576267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b6fe5ce0-11b7-4bbc-8573-9a098af7add5.2e13acce-6d37-4365-8cc0-4f1c9390cf03,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b6fe5ce0-11b7-4bbc-8573-9a098af7add5.1a0ada5c-4d7b-4aa1-aa24-8ff210ec41f4 1G {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:46:29 devstack sudo[96572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b6fe5ce0-11b7-4bbc-8573-9a098af7add5.2e13acce-6d37-4365-8cc0-4f1c9390cf03,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b6fe5ce0-11b7-4bbc-8573-9a098af7add5.1a0ada5c-4d7b-4aa1-aa24-8ff210ec41f4 1G Sep 22 15:46:29 devstack sudo[96572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:46:29 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-e5b2be25-7c9d-43e5-bf0d-d49d3e7b017a tempest-GroupSnapshotsTest-1556879145 None] group_snapshot 4d211372-dc3c-4912-bf2a-79eb9a420e30: deleting Sep 22 15:46:29 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-e5b2be25-7c9d-43e5-bf0d-d49d3e7b017a tempest-GroupSnapshotsTest-1556879145 None] group_snapshot 4d211372-dc3c-4912-bf2a-79eb9a420e30: deleting {{(pid=86212) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 22 15:46:29 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-e5b2be25-7c9d-43e5-bf0d-d49d3e7b017a tempest-GroupSnapshotsTest-1556879145 None] Acquiring lock "cinder-quobyte-5b746bb1-31aa-4497-880d-d80a2cb13e24" by "delete_snapshot" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:46:29 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-e5b2be25-7c9d-43e5-bf0d-d49d3e7b017a tempest-GroupSnapshotsTest-1556879145 None] Lock "cinder-quobyte-5b746bb1-31aa-4497-880d-d80a2cb13e24" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:46:29 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-e5b2be25-7c9d-43e5-bf0d-d49d3e7b017a tempest-GroupSnapshotsTest-1556879145 None] Acquiring lock "cinder-quobyte-b98b81c2-3d51-48ff-be59-dd34e7323fde" by "_delete_snapshot" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:46:29 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-e5b2be25-7c9d-43e5-bf0d-d49d3e7b017a tempest-GroupSnapshotsTest-1556879145 None] Lock "cinder-quobyte-b98b81c2-3d51-48ff-be59-dd34e7323fde" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:46:29 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-e5b2be25-7c9d-43e5-bf0d-d49d3e7b017a tempest-GroupSnapshotsTest-1556879145 None] Deleting offline snapshot b98b81c2-3d51-48ff-be59-dd34e7323fde of volume 5b746bb1-31aa-4497-880d-d80a2cb13e24 {{(pid=86212) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 22 15:46:29 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-e5b2be25-7c9d-43e5-bf0d-d49d3e7b017a tempest-GroupSnapshotsTest-1556879145 None] snapshot_file for this snap is: volume-5b746bb1-31aa-4497-880d-d80a2cb13e24.b98b81c2-3d51-48ff-be59-dd34e7323fde {{(pid=86212) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 22 15:46:29 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[b64cb9f7-4bf6-48e1-a3c3-0c57420a3727]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:46:29 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-e5b2be25-7c9d-43e5-bf0d-d49d3e7b017a tempest-GroupSnapshotsTest-1556879145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-5b746bb1-31aa-4497-880d-d80a2cb13e24.b98b81c2-3d51-48ff-be59-dd34e7323fde {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:46:29 devstack sudo[96574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-5b746bb1-31aa-4497-880d-d80a2cb13e24.b98b81c2-3d51-48ff-be59-dd34e7323fde Sep 22 15:46:29 devstack sudo[96574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:46:29 devstack sudo[96572]: pam_unix(sudo:session): session closed for user root Sep 22 15:46:29 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-4748095f-b4de-40e2-a86b-93a14ddc0e96 tempest-SnapshotsActionsTest-743576267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b6fe5ce0-11b7-4bbc-8573-9a098af7add5.2e13acce-6d37-4365-8cc0-4f1c9390cf03,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b6fe5ce0-11b7-4bbc-8573-9a098af7add5.1a0ada5c-4d7b-4aa1-aa24-8ff210ec41f4 1G" returned: 0 in 0.745s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:46:29 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-4748095f-b4de-40e2-a86b-93a14ddc0e96 tempest-SnapshotsActionsTest-743576267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6fe5ce0-11b7-4bbc-8573-9a098af7add5.2e13acce-6d37-4365-8cc0-4f1c9390cf03 -F qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b6fe5ce0-11b7-4bbc-8573-9a098af7add5.1a0ada5c-4d7b-4aa1-aa24-8ff210ec41f4 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:46:29 devstack sudo[96582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6fe5ce0-11b7-4bbc-8573-9a098af7add5.2e13acce-6d37-4365-8cc0-4f1c9390cf03 -F qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b6fe5ce0-11b7-4bbc-8573-9a098af7add5.1a0ada5c-4d7b-4aa1-aa24-8ff210ec41f4 Sep 22 15:46:29 devstack sudo[96582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:46:29 devstack sudo[96574]: pam_unix(sudo:session): session closed for user root Sep 22 15:46:29 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-e5b2be25-7c9d-43e5-bf0d-d49d3e7b017a tempest-GroupSnapshotsTest-1556879145 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-5b746bb1-31aa-4497-880d-d80a2cb13e24.b98b81c2-3d51-48ff-be59-dd34e7323fde" returned: 0 in 0.541s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:46:29 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-e5b2be25-7c9d-43e5-bf0d-d49d3e7b017a tempest-GroupSnapshotsTest-1556879145 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5b746bb1-31aa-4497-880d-d80a2cb13e24(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86212) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 22 15:46:29 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[86255b09-aa62-4a59-9d21-e2def846aef9]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:46:29 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-e5b2be25-7c9d-43e5-bf0d-d49d3e7b017a tempest-GroupSnapshotsTest-1556879145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-5b746bb1-31aa-4497-880d-d80a2cb13e24 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:46:30 devstack sudo[96585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-5b746bb1-31aa-4497-880d-d80a2cb13e24 Sep 22 15:46:30 devstack sudo[96585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:46:30 devstack sudo[96582]: pam_unix(sudo:session): session closed for user root Sep 22 15:46:30 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-4748095f-b4de-40e2-a86b-93a14ddc0e96 tempest-SnapshotsActionsTest-743576267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6fe5ce0-11b7-4bbc-8573-9a098af7add5.2e13acce-6d37-4365-8cc0-4f1c9390cf03 -F qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b6fe5ce0-11b7-4bbc-8573-9a098af7add5.1a0ada5c-4d7b-4aa1-aa24-8ff210ec41f4" returned: 0 in 0.380s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:46:30 devstack cinder-volume[86212]: WARNING cinder.volume.drivers.remotefs [None req-4748095f-b4de-40e2-a86b-93a14ddc0e96 tempest-SnapshotsActionsTest-743576267 None] /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b6fe5ce0-11b7-4bbc-8573-9a098af7add5.1a0ada5c-4d7b-4aa1-aa24-8ff210ec41f4 is being set with open permissions: ugo+rw Sep 22 15:46:30 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-4748095f-b4de-40e2-a86b-93a14ddc0e96 tempest-SnapshotsActionsTest-743576267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b6fe5ce0-11b7-4bbc-8573-9a098af7add5.1a0ada5c-4d7b-4aa1-aa24-8ff210ec41f4 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:46:30 devstack sudo[96593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b6fe5ce0-11b7-4bbc-8573-9a098af7add5.1a0ada5c-4d7b-4aa1-aa24-8ff210ec41f4 Sep 22 15:46:30 devstack sudo[96593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:46:30 devstack sudo[96585]: pam_unix(sudo:session): session closed for user root Sep 22 15:46:30 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-e5b2be25-7c9d-43e5-bf0d-d49d3e7b017a tempest-GroupSnapshotsTest-1556879145 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-5b746bb1-31aa-4497-880d-d80a2cb13e24" returned: 0 in 0.457s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:46:30 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-e5b2be25-7c9d-43e5-bf0d-d49d3e7b017a tempest-GroupSnapshotsTest-1556879145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-5b746bb1-31aa-4497-880d-d80a2cb13e24.b98b81c2-3d51-48ff-be59-dd34e7323fde {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:46:30 devstack sudo[96598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-5b746bb1-31aa-4497-880d-d80a2cb13e24.b98b81c2-3d51-48ff-be59-dd34e7323fde Sep 22 15:46:30 devstack sudo[96598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:46:30 devstack sudo[96593]: pam_unix(sudo:session): session closed for user root Sep 22 15:46:30 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-4748095f-b4de-40e2-a86b-93a14ddc0e96 tempest-SnapshotsActionsTest-743576267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b6fe5ce0-11b7-4bbc-8573-9a098af7add5.1a0ada5c-4d7b-4aa1-aa24-8ff210ec41f4" returned: 0 in 0.337s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:46:30 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-4748095f-b4de-40e2-a86b-93a14ddc0e96 tempest-SnapshotsActionsTest-743576267 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.198s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:46:30 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-4748095f-b4de-40e2-a86b-93a14ddc0e96 tempest-SnapshotsActionsTest-743576267 None] Create snapshot completed successfully Sep 22 15:46:30 devstack sudo[96598]: pam_unix(sudo:session): session closed for user root Sep 22 15:46:30 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-e5b2be25-7c9d-43e5-bf0d-d49d3e7b017a tempest-GroupSnapshotsTest-1556879145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-5b746bb1-31aa-4497-880d-d80a2cb13e24.b98b81c2-3d51-48ff-be59-dd34e7323fde" returned: 0 in 0.461s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:46:30 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-e5b2be25-7c9d-43e5-bf0d-d49d3e7b017a tempest-GroupSnapshotsTest-1556879145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-5b746bb1-31aa-4497-880d-d80a2cb13e24.b98b81c2-3d51-48ff-be59-dd34e7323fde {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:46:30 devstack sudo[96604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-5b746bb1-31aa-4497-880d-d80a2cb13e24.b98b81c2-3d51-48ff-be59-dd34e7323fde Sep 22 15:46:30 devstack sudo[96604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:46:31 devstack sudo[96604]: pam_unix(sudo:session): session closed for user root Sep 22 15:46:31 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-e5b2be25-7c9d-43e5-bf0d-d49d3e7b017a tempest-GroupSnapshotsTest-1556879145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-5b746bb1-31aa-4497-880d-d80a2cb13e24.b98b81c2-3d51-48ff-be59-dd34e7323fde" returned: 0 in 0.254s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:46:31 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-e5b2be25-7c9d-43e5-bf0d-d49d3e7b017a tempest-GroupSnapshotsTest-1556879145 None] Lock "cinder-quobyte-b98b81c2-3d51-48ff-be59-dd34e7323fde" released by "_delete_snapshot" :: held 1.866s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:46:31 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-e5b2be25-7c9d-43e5-bf0d-d49d3e7b017a tempest-GroupSnapshotsTest-1556879145 None] Lock "cinder-quobyte-5b746bb1-31aa-4497-880d-d80a2cb13e24" released by "delete_snapshot" :: held 1.898s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:46:31 devstack cinder-volume[86212]: WARNING cinder.quota [None req-e5b2be25-7c9d-43e5-bf0d-d49d3e7b017a tempest-GroupSnapshotsTest-1556879145 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-844631746 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-844631746, it is now deprecated. Please use the default quota class for default quota. Sep 22 15:46:31 devstack cinder-volume[86212]: WARNING cinder.quota [None req-e5b2be25-7c9d-43e5-bf0d-d49d3e7b017a tempest-GroupSnapshotsTest-1556879145 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-844631746 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-844631746, it is now deprecated. Please use the default quota class for default quota. Sep 22 15:46:31 devstack cinder-volume[86212]: DEBUG cinder.quota [None req-e5b2be25-7c9d-43e5-bf0d-d49d3e7b017a tempest-GroupSnapshotsTest-1556879145 None] Created reservations ['239e071f-2b54-4f7c-9161-16216f7a2af7', '06e7e47e-2cee-4751-aeab-b3e9d86d7d5e', '174c31ab-d42f-4bed-aca9-ee2d3b9448ae', '72b6deae-dc5d-4ed5-ad42-bfa96fc5d089'] {{(pid=86212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 15:46:31 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-e5b2be25-7c9d-43e5-bf0d-d49d3e7b017a tempest-GroupSnapshotsTest-1556879145 None] group_snapshot 4d211372-dc3c-4912-bf2a-79eb9a420e30: deleted successfully Sep 22 15:46:31 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-6bfa4f8c-13fe-4b7b-a33a-e76cfcbc8571 tempest-SnapshotsActionsTest-1507444151 None] Acquiring lock "cinder-1a0ada5c-4d7b-4aa1-aa24-8ff210ec41f4-delete_snapshot" by "delete_snapshot" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:46:31 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-6bfa4f8c-13fe-4b7b-a33a-e76cfcbc8571 tempest-SnapshotsActionsTest-1507444151 None] Lock "cinder-1a0ada5c-4d7b-4aa1-aa24-8ff210ec41f4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:46:31 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-6bfa4f8c-13fe-4b7b-a33a-e76cfcbc8571 tempest-SnapshotsActionsTest-1507444151 None] Acquiring lock "cinder-quobyte-b6fe5ce0-11b7-4bbc-8573-9a098af7add5" by "delete_snapshot" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:46:31 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-6bfa4f8c-13fe-4b7b-a33a-e76cfcbc8571 tempest-SnapshotsActionsTest-1507444151 None] Lock "cinder-quobyte-b6fe5ce0-11b7-4bbc-8573-9a098af7add5" acquired by "delete_snapshot" :: waited 0.037s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:46:31 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-6bfa4f8c-13fe-4b7b-a33a-e76cfcbc8571 tempest-SnapshotsActionsTest-1507444151 None] Acquiring lock "cinder-quobyte-1a0ada5c-4d7b-4aa1-aa24-8ff210ec41f4" by "_delete_snapshot" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:46:31 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-6bfa4f8c-13fe-4b7b-a33a-e76cfcbc8571 tempest-SnapshotsActionsTest-1507444151 None] Lock "cinder-quobyte-1a0ada5c-4d7b-4aa1-aa24-8ff210ec41f4" acquired by "_delete_snapshot" :: waited 0.053s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:46:31 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-6bfa4f8c-13fe-4b7b-a33a-e76cfcbc8571 tempest-SnapshotsActionsTest-1507444151 None] Deleting offline snapshot 1a0ada5c-4d7b-4aa1-aa24-8ff210ec41f4 of volume b6fe5ce0-11b7-4bbc-8573-9a098af7add5 {{(pid=86212) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 22 15:46:31 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-6bfa4f8c-13fe-4b7b-a33a-e76cfcbc8571 tempest-SnapshotsActionsTest-1507444151 None] snapshot_file for this snap is: volume-b6fe5ce0-11b7-4bbc-8573-9a098af7add5.1a0ada5c-4d7b-4aa1-aa24-8ff210ec41f4 {{(pid=86212) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 22 15:46:31 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[0809ed84-0bae-4f98-ac45-3e56edd63475]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:46:31 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-6bfa4f8c-13fe-4b7b-a33a-e76cfcbc8571 tempest-SnapshotsActionsTest-1507444151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b6fe5ce0-11b7-4bbc-8573-9a098af7add5.1a0ada5c-4d7b-4aa1-aa24-8ff210ec41f4 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:46:31 devstack sudo[96607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b6fe5ce0-11b7-4bbc-8573-9a098af7add5.1a0ada5c-4d7b-4aa1-aa24-8ff210ec41f4 Sep 22 15:46:31 devstack sudo[96607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:46:32 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-94ff5cd1-74d0-4787-a286-3adc23cee73e tempest-GroupSnapshotsTest-1556879145 None] Acquiring lock "cinder-quobyte-5b746bb1-31aa-4497-880d-d80a2cb13e24" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:46:32 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-94ff5cd1-74d0-4787-a286-3adc23cee73e tempest-GroupSnapshotsTest-1556879145 None] Lock "cinder-quobyte-5b746bb1-31aa-4497-880d-d80a2cb13e24" acquired by "delete_volume" :: waited 0.026s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:46:32 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[d224580a-b96e-495e-a91c-c7d0797531a2]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:46:32 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-94ff5cd1-74d0-4787-a286-3adc23cee73e tempest-GroupSnapshotsTest-1556879145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-5b746bb1-31aa-4497-880d-d80a2cb13e24 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:46:32 devstack sudo[96607]: pam_unix(sudo:session): session closed for user root Sep 22 15:46:32 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-6bfa4f8c-13fe-4b7b-a33a-e76cfcbc8571 tempest-SnapshotsActionsTest-1507444151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b6fe5ce0-11b7-4bbc-8573-9a098af7add5.1a0ada5c-4d7b-4aa1-aa24-8ff210ec41f4" returned: 0 in 0.484s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:46:32 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-6bfa4f8c-13fe-4b7b-a33a-e76cfcbc8571 tempest-SnapshotsActionsTest-1507444151 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b6fe5ce0-11b7-4bbc-8573-9a098af7add5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86212) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 22 15:46:32 devstack sudo[96610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-5b746bb1-31aa-4497-880d-d80a2cb13e24 Sep 22 15:46:32 devstack sudo[96610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:46:32 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc8fc3e6-c1ee-49ac-bdf9-516b5c89953a]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:46:32 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-6bfa4f8c-13fe-4b7b-a33a-e76cfcbc8571 tempest-SnapshotsActionsTest-1507444151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b6fe5ce0-11b7-4bbc-8573-9a098af7add5.2e13acce-6d37-4365-8cc0-4f1c9390cf03 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:46:32 devstack sudo[96614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b6fe5ce0-11b7-4bbc-8573-9a098af7add5.2e13acce-6d37-4365-8cc0-4f1c9390cf03 Sep 22 15:46:32 devstack sudo[96614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:46:32 devstack sudo[96610]: pam_unix(sudo:session): session closed for user root Sep 22 15:46:32 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-94ff5cd1-74d0-4787-a286-3adc23cee73e tempest-GroupSnapshotsTest-1556879145 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-5b746bb1-31aa-4497-880d-d80a2cb13e24" returned: 0 in 0.462s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:46:32 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-94ff5cd1-74d0-4787-a286-3adc23cee73e tempest-GroupSnapshotsTest-1556879145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-5b746bb1-31aa-4497-880d-d80a2cb13e24 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:46:32 devstack sudo[96620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-5b746bb1-31aa-4497-880d-d80a2cb13e24 Sep 22 15:46:32 devstack sudo[96620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:46:32 devstack sudo[96614]: pam_unix(sudo:session): session closed for user root Sep 22 15:46:32 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-6bfa4f8c-13fe-4b7b-a33a-e76cfcbc8571 tempest-SnapshotsActionsTest-1507444151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b6fe5ce0-11b7-4bbc-8573-9a098af7add5.2e13acce-6d37-4365-8cc0-4f1c9390cf03" returned: 0 in 0.473s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:46:32 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-6bfa4f8c-13fe-4b7b-a33a-e76cfcbc8571 tempest-SnapshotsActionsTest-1507444151 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b6fe5ce0-11b7-4bbc-8573-9a098af7add5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86212) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 22 15:46:32 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-6bfa4f8c-13fe-4b7b-a33a-e76cfcbc8571 tempest-SnapshotsActionsTest-1507444151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b6fe5ce0-11b7-4bbc-8573-9a098af7add5.1a0ada5c-4d7b-4aa1-aa24-8ff210ec41f4 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:46:32 devstack sudo[96625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b6fe5ce0-11b7-4bbc-8573-9a098af7add5.1a0ada5c-4d7b-4aa1-aa24-8ff210ec41f4 Sep 22 15:46:32 devstack sudo[96625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:46:32 devstack sudo[96620]: pam_unix(sudo:session): session closed for user root Sep 22 15:46:32 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-94ff5cd1-74d0-4787-a286-3adc23cee73e tempest-GroupSnapshotsTest-1556879145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-5b746bb1-31aa-4497-880d-d80a2cb13e24" returned: 0 in 0.358s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:46:32 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-94ff5cd1-74d0-4787-a286-3adc23cee73e tempest-GroupSnapshotsTest-1556879145 None] Lock "cinder-quobyte-5b746bb1-31aa-4497-880d-d80a2cb13e24" released by "delete_volume" :: held 0.911s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:46:33 devstack cinder-volume[86212]: DEBUG cinder.quota [None req-94ff5cd1-74d0-4787-a286-3adc23cee73e tempest-GroupSnapshotsTest-1556879145 None] Created reservations ['615ca770-eb4c-476e-b5fb-a9b42fcca345'] {{(pid=86212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 15:46:33 devstack cinder-volume[86212]: WARNING cinder.quota [None req-94ff5cd1-74d0-4787-a286-3adc23cee73e tempest-GroupSnapshotsTest-1556879145 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-844631746 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-844631746, it is now deprecated. Please use the default quota class for default quota. Sep 22 15:46:33 devstack cinder-volume[86212]: DEBUG cinder.quota [None req-94ff5cd1-74d0-4787-a286-3adc23cee73e tempest-GroupSnapshotsTest-1556879145 None] Created reservations ['1c5ffac2-535d-4905-a254-2c16ed71b081', 'ca5c6f85-1b48-47f2-acbf-ba507d238b6c', '980a4738-36d2-498f-a9b6-7072757de8d1', '422fd572-8f07-49b2-ac5d-3372b6c2c542'] {{(pid=86212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 15:46:33 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-94ff5cd1-74d0-4787-a286-3adc23cee73e tempest-GroupSnapshotsTest-1556879145 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:46:33 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-94ff5cd1-74d0-4787-a286-3adc23cee73e tempest-GroupSnapshotsTest-1556879145 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:46:33 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-94ff5cd1-74d0-4787-a286-3adc23cee73e tempest-GroupSnapshotsTest-1556879145 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:46:33 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-94ff5cd1-74d0-4787-a286-3adc23cee73e tempest-GroupSnapshotsTest-1556879145 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:46:33 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-94ff5cd1-74d0-4787-a286-3adc23cee73e tempest-GroupSnapshotsTest-1556879145 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:46:33 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-94ff5cd1-74d0-4787-a286-3adc23cee73e tempest-GroupSnapshotsTest-1556879145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:46:33 devstack sudo[96625]: pam_unix(sudo:session): session closed for user root Sep 22 15:46:33 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-6bfa4f8c-13fe-4b7b-a33a-e76cfcbc8571 tempest-SnapshotsActionsTest-1507444151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b6fe5ce0-11b7-4bbc-8573-9a098af7add5.1a0ada5c-4d7b-4aa1-aa24-8ff210ec41f4" returned: 0 in 0.589s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:46:33 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-6bfa4f8c-13fe-4b7b-a33a-e76cfcbc8571 tempest-SnapshotsActionsTest-1507444151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b6fe5ce0-11b7-4bbc-8573-9a098af7add5.1a0ada5c-4d7b-4aa1-aa24-8ff210ec41f4 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:46:33 devstack sudo[96633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc Sep 22 15:46:33 devstack sudo[96633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:46:33 devstack sudo[96635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b6fe5ce0-11b7-4bbc-8573-9a098af7add5.1a0ada5c-4d7b-4aa1-aa24-8ff210ec41f4 Sep 22 15:46:33 devstack sudo[96635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:46:33 devstack sudo[96633]: pam_unix(sudo:session): session closed for user root Sep 22 15:46:33 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-94ff5cd1-74d0-4787-a286-3adc23cee73e tempest-GroupSnapshotsTest-1556879145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc" returned: 0 in 0.292s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:46:33 devstack cinder-volume[86212]: DEBUG cinder.manager [None req-94ff5cd1-74d0-4787-a286-3adc23cee73e tempest-GroupSnapshotsTest-1556879145 None] Notifying Schedulers of capabilities ... {{(pid=86212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 15:46:33 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-94ff5cd1-74d0-4787-a286-3adc23cee73e tempest-GroupSnapshotsTest-1556879145 None] Delete group completed successfully. Sep 22 15:46:33 devstack sudo[96635]: pam_unix(sudo:session): session closed for user root Sep 22 15:46:33 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-6bfa4f8c-13fe-4b7b-a33a-e76cfcbc8571 tempest-SnapshotsActionsTest-1507444151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b6fe5ce0-11b7-4bbc-8573-9a098af7add5.1a0ada5c-4d7b-4aa1-aa24-8ff210ec41f4" returned: 0 in 0.353s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:46:33 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-6bfa4f8c-13fe-4b7b-a33a-e76cfcbc8571 tempest-SnapshotsActionsTest-1507444151 None] Lock "cinder-quobyte-1a0ada5c-4d7b-4aa1-aa24-8ff210ec41f4" released by "_delete_snapshot" :: held 2.060s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:46:33 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-6bfa4f8c-13fe-4b7b-a33a-e76cfcbc8571 tempest-SnapshotsActionsTest-1507444151 None] Lock "cinder-quobyte-b6fe5ce0-11b7-4bbc-8573-9a098af7add5" released by "delete_snapshot" :: held 2.123s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:46:33 devstack cinder-volume[86212]: DEBUG cinder.quota [None req-6bfa4f8c-13fe-4b7b-a33a-e76cfcbc8571 tempest-SnapshotsActionsTest-1507444151 None] Created reservations ['98d5cf37-fe77-4201-a413-6e7d47dea9d1', '7cead4a4-dd92-4243-a197-102b965a30ea', 'fcf48092-64be-42b8-aebe-9b2debd792e4', 'a02f4542-c85b-40ef-b1d4-10502351f1be'] {{(pid=86212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 15:46:33 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-6bfa4f8c-13fe-4b7b-a33a-e76cfcbc8571 tempest-SnapshotsActionsTest-1507444151 None] Delete snapshot completed successfully. Sep 22 15:46:33 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-6bfa4f8c-13fe-4b7b-a33a-e76cfcbc8571 tempest-SnapshotsActionsTest-1507444151 None] Lock "cinder-1a0ada5c-4d7b-4aa1-aa24-8ff210ec41f4-delete_snapshot" released by "delete_snapshot" :: held 2.304s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:46:35 devstack cinder-volume[86212]: DEBUG cinder.volume.flows.manager.create_volume [None req-14ed4687-126b-4226-a33c-18f082bf3ae1 tempest-VolumesTransfersTest-134941449 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 15:46:35 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-14ed4687-126b-4226-a33c-18f082bf3ae1 tempest-VolumesTransfersTest-134941449 None] Flow 'volume_create_manager' (0e387fd8-4e56-436f-9cab-348ee6f2804e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:46:35 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-14ed4687-126b-4226-a33c-18f082bf3ae1 tempest-VolumesTransfersTest-134941449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9278de80-0e59-405b-9472-f9f399cb49d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:46:35 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-14ed4687-126b-4226-a33c-18f082bf3ae1 tempest-VolumesTransfersTest-134941449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9278de80-0e59-405b-9472-f9f399cb49d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:46:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1748513727',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9e57161-0091-4845-ae37-73dfc7ee950b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04cb80d070174eae996eff054d371173',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:46:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:46:35Z,use_quota=True,user_id='8d4732e4c6744b6681b3ddabb942ca5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:46:35 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-14ed4687-126b-4226-a33c-18f082bf3ae1 tempest-VolumesTransfersTest-134941449 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce36e37e-3c70-43b8-9b63-dae4e87a4cbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:46:35 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-14ed4687-126b-4226-a33c-18f082bf3ae1 tempest-VolumesTransfersTest-134941449 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce36e37e-3c70-43b8-9b63-dae4e87a4cbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:46:35 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-14ed4687-126b-4226-a33c-18f082bf3ae1 tempest-VolumesTransfersTest-134941449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f284c6c-a7ff-45e0-9f7c-e5deeca12926) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:46:35 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-14ed4687-126b-4226-a33c-18f082bf3ae1 tempest-VolumesTransfersTest-134941449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f284c6c-a7ff-45e0-9f7c-e5deeca12926) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd9e57161-0091-4845-ae37-73dfc7ee950b', 'volume_name': 'volume-d9e57161-0091-4845-ae37-73dfc7ee950b', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:46:35 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-14ed4687-126b-4226-a33c-18f082bf3ae1 tempest-VolumesTransfersTest-134941449 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e04ddd2-7007-4654-92a1-ec93fa61f19b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:46:35 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-14ed4687-126b-4226-a33c-18f082bf3ae1 tempest-VolumesTransfersTest-134941449 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e04ddd2-7007-4654-92a1-ec93fa61f19b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:46:35 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-14ed4687-126b-4226-a33c-18f082bf3ae1 tempest-VolumesTransfersTest-134941449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffbf94c5-b9c3-42b0-99b8-92a9409ed0e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:46:35 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-14ed4687-126b-4226-a33c-18f082bf3ae1 tempest-VolumesTransfersTest-134941449 None] Volume d9e57161-0091-4845-ae37-73dfc7ee950b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d9e57161-0091-4845-ae37-73dfc7ee950b', 'volume_size': 1} Sep 22 15:46:35 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-14ed4687-126b-4226-a33c-18f082bf3ae1 tempest-VolumesTransfersTest-134941449 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:46:35 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-14ed4687-126b-4226-a33c-18f082bf3ae1 tempest-VolumesTransfersTest-134941449 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:46:35 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-14ed4687-126b-4226-a33c-18f082bf3ae1 tempest-VolumesTransfersTest-134941449 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:46:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1748513727',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9e57161-0091-4845-ae37-73dfc7ee950b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04cb80d070174eae996eff054d371173',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:46:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:46:35Z,use_quota=True,user_id='8d4732e4c6744b6681b3ddabb942ca5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)}" {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 15:46:35 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-14ed4687-126b-4226-a33c-18f082bf3ae1 tempest-VolumesTransfersTest-134941449 None] Creating volume d9e57161-0091-4845-ae37-73dfc7ee950b {{(pid=86212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 15:46:35 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-14ed4687-126b-4226-a33c-18f082bf3ae1 tempest-VolumesTransfersTest-134941449 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:46:35 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-14ed4687-126b-4226-a33c-18f082bf3ae1 tempest-VolumesTransfersTest-134941449 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:46:35 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-14ed4687-126b-4226-a33c-18f082bf3ae1 tempest-VolumesTransfersTest-134941449 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:46:35 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-14ed4687-126b-4226-a33c-18f082bf3ae1 tempest-VolumesTransfersTest-134941449 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:46:35 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-14ed4687-126b-4226-a33c-18f082bf3ae1 tempest-VolumesTransfersTest-134941449 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:46:35 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-14ed4687-126b-4226-a33c-18f082bf3ae1 tempest-VolumesTransfersTest-134941449 None] Selected osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 as target Quobyte volume. {{(pid=86212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 15:46:35 devstack cinder-volume[86212]: INFO cinder.volume.drivers.remotefs [None req-14ed4687-126b-4226-a33c-18f082bf3ae1 tempest-VolumesTransfersTest-134941449 None] casted to osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 Sep 22 15:46:35 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-14ed4687-126b-4226-a33c-18f082bf3ae1 tempest-VolumesTransfersTest-134941449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-d9e57161-0091-4845-ae37-73dfc7ee950b 1073741824 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:46:35 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-497ac33a-31e0-4bd7-ac97-7ccd63cbd430 tempest-SnapshotsActionsTest-743576267 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:46:35 devstack sudo[96640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-d9e57161-0091-4845-ae37-73dfc7ee950b 1073741824 Sep 22 15:46:35 devstack sudo[96640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:46:35 devstack sudo[96640]: pam_unix(sudo:session): session closed for user root Sep 22 15:46:35 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-14ed4687-126b-4226-a33c-18f082bf3ae1 tempest-VolumesTransfersTest-134941449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-d9e57161-0091-4845-ae37-73dfc7ee950b 1073741824" returned: 0 in 0.605s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:46:36 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-14ed4687-126b-4226-a33c-18f082bf3ae1 tempest-VolumesTransfersTest-134941449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-d9e57161-0091-4845-ae37-73dfc7ee950b {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:46:36 devstack sudo[96645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-d9e57161-0091-4845-ae37-73dfc7ee950b Sep 22 15:46:36 devstack sudo[96645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:46:36 devstack sudo[96645]: pam_unix(sudo:session): session closed for user root Sep 22 15:46:36 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-14ed4687-126b-4226-a33c-18f082bf3ae1 tempest-VolumesTransfersTest-134941449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-d9e57161-0091-4845-ae37-73dfc7ee950b" returned: 0 in 0.303s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:46:36 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-14ed4687-126b-4226-a33c-18f082bf3ae1 tempest-VolumesTransfersTest-134941449 None] <== create_volume: return (960ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'} {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 15:46:36 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-14ed4687-126b-4226-a33c-18f082bf3ae1 tempest-VolumesTransfersTest-134941449 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.962s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:46:36 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-497ac33a-31e0-4bd7-ac97-7ccd63cbd430 tempest-SnapshotsActionsTest-743576267 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.925s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:46:36 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-14ed4687-126b-4226-a33c-18f082bf3ae1 tempest-VolumesTransfersTest-134941449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffbf94c5-b9c3-42b0-99b8-92a9409ed0e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d9e57161-0091-4845-ae37-73dfc7ee950b', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:46:36 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-14ed4687-126b-4226-a33c-18f082bf3ae1 tempest-VolumesTransfersTest-134941449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eda1f628-9f39-452f-ba50-39f22810b91c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:46:36 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-497ac33a-31e0-4bd7-ac97-7ccd63cbd430 tempest-SnapshotsActionsTest-743576267 None] Creating offline snapshot 3aa48348-a67c-4439-96a5-0543cacc5a05 of volume b6fe5ce0-11b7-4bbc-8573-9a098af7add5 {{(pid=86212) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 22 15:46:36 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-14ed4687-126b-4226-a33c-18f082bf3ae1 tempest-VolumesTransfersTest-134941449 None] Volume volume-d9e57161-0091-4845-ae37-73dfc7ee950b (d9e57161-0091-4845-ae37-73dfc7ee950b): created successfully Sep 22 15:46:36 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-14ed4687-126b-4226-a33c-18f082bf3ae1 tempest-VolumesTransfersTest-134941449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eda1f628-9f39-452f-ba50-39f22810b91c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:46:36 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-14ed4687-126b-4226-a33c-18f082bf3ae1 tempest-VolumesTransfersTest-134941449 None] Flow 'volume_create_manager' (0e387fd8-4e56-436f-9cab-348ee6f2804e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:46:36 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[1efd701d-2429-4f58-8373-cd66d6dbbe36]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:46:36 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-497ac33a-31e0-4bd7-ac97-7ccd63cbd430 tempest-SnapshotsActionsTest-743576267 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b6fe5ce0-11b7-4bbc-8573-9a098af7add5.2e13acce-6d37-4365-8cc0-4f1c9390cf03 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:46:36 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-14ed4687-126b-4226-a33c-18f082bf3ae1 tempest-VolumesTransfersTest-134941449 None] Created volume successfully. Sep 22 15:46:36 devstack sudo[96682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b6fe5ce0-11b7-4bbc-8573-9a098af7add5.2e13acce-6d37-4365-8cc0-4f1c9390cf03 Sep 22 15:46:36 devstack sudo[96682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:46:37 devstack sudo[96682]: pam_unix(sudo:session): session closed for user root Sep 22 15:46:37 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-497ac33a-31e0-4bd7-ac97-7ccd63cbd430 tempest-SnapshotsActionsTest-743576267 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b6fe5ce0-11b7-4bbc-8573-9a098af7add5.2e13acce-6d37-4365-8cc0-4f1c9390cf03" returned: 0 in 0.635s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:46:37 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-497ac33a-31e0-4bd7-ac97-7ccd63cbd430 tempest-SnapshotsActionsTest-743576267 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b6fe5ce0-11b7-4bbc-8573-9a098af7add5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86212) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 22 15:46:37 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-497ac33a-31e0-4bd7-ac97-7ccd63cbd430 tempest-SnapshotsActionsTest-743576267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b6fe5ce0-11b7-4bbc-8573-9a098af7add5.2e13acce-6d37-4365-8cc0-4f1c9390cf03,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b6fe5ce0-11b7-4bbc-8573-9a098af7add5.3aa48348-a67c-4439-96a5-0543cacc5a05 1G {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:46:37 devstack sudo[96690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b6fe5ce0-11b7-4bbc-8573-9a098af7add5.2e13acce-6d37-4365-8cc0-4f1c9390cf03,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b6fe5ce0-11b7-4bbc-8573-9a098af7add5.3aa48348-a67c-4439-96a5-0543cacc5a05 1G Sep 22 15:46:37 devstack sudo[96690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:46:37 devstack sudo[96690]: pam_unix(sudo:session): session closed for user root Sep 22 15:46:37 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-497ac33a-31e0-4bd7-ac97-7ccd63cbd430 tempest-SnapshotsActionsTest-743576267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b6fe5ce0-11b7-4bbc-8573-9a098af7add5.2e13acce-6d37-4365-8cc0-4f1c9390cf03,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b6fe5ce0-11b7-4bbc-8573-9a098af7add5.3aa48348-a67c-4439-96a5-0543cacc5a05 1G" returned: 0 in 0.803s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:46:37 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-497ac33a-31e0-4bd7-ac97-7ccd63cbd430 tempest-SnapshotsActionsTest-743576267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6fe5ce0-11b7-4bbc-8573-9a098af7add5.2e13acce-6d37-4365-8cc0-4f1c9390cf03 -F qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b6fe5ce0-11b7-4bbc-8573-9a098af7add5.3aa48348-a67c-4439-96a5-0543cacc5a05 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:46:38 devstack sudo[96697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6fe5ce0-11b7-4bbc-8573-9a098af7add5.2e13acce-6d37-4365-8cc0-4f1c9390cf03 -F qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b6fe5ce0-11b7-4bbc-8573-9a098af7add5.3aa48348-a67c-4439-96a5-0543cacc5a05 Sep 22 15:46:38 devstack sudo[96697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:46:38 devstack cinder-volume[86212]: DEBUG oslo_service.periodic_task [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86212) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 22 15:46:38 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:46:38 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:46:38 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:46:38 devstack sudo[96697]: pam_unix(sudo:session): session closed for user root Sep 22 15:46:38 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:46:38 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:46:38 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:46:38 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-497ac33a-31e0-4bd7-ac97-7ccd63cbd430 tempest-SnapshotsActionsTest-743576267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6fe5ce0-11b7-4bbc-8573-9a098af7add5.2e13acce-6d37-4365-8cc0-4f1c9390cf03 -F qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b6fe5ce0-11b7-4bbc-8573-9a098af7add5.3aa48348-a67c-4439-96a5-0543cacc5a05" returned: 0 in 0.544s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:46:38 devstack cinder-volume[86212]: WARNING cinder.volume.drivers.remotefs [None req-497ac33a-31e0-4bd7-ac97-7ccd63cbd430 tempest-SnapshotsActionsTest-743576267 None] /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b6fe5ce0-11b7-4bbc-8573-9a098af7add5.3aa48348-a67c-4439-96a5-0543cacc5a05 is being set with open permissions: ugo+rw Sep 22 15:46:38 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-497ac33a-31e0-4bd7-ac97-7ccd63cbd430 tempest-SnapshotsActionsTest-743576267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b6fe5ce0-11b7-4bbc-8573-9a098af7add5.3aa48348-a67c-4439-96a5-0543cacc5a05 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:46:38 devstack sudo[96702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc Sep 22 15:46:38 devstack sudo[96702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:46:38 devstack sudo[96704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b6fe5ce0-11b7-4bbc-8573-9a098af7add5.3aa48348-a67c-4439-96a5-0543cacc5a05 Sep 22 15:46:38 devstack sudo[96704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:46:38 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-d7bc4e65-c834-43a0-8ba2-376d7820e772 tempest-VolumesTransfersTest-1541297971 None] Transfer volume completed successfully. Sep 22 15:46:38 devstack sudo[96704]: pam_unix(sudo:session): session closed for user root Sep 22 15:46:38 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-497ac33a-31e0-4bd7-ac97-7ccd63cbd430 tempest-SnapshotsActionsTest-743576267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b6fe5ce0-11b7-4bbc-8573-9a098af7add5.3aa48348-a67c-4439-96a5-0543cacc5a05" returned: 0 in 0.365s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:46:38 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-497ac33a-31e0-4bd7-ac97-7ccd63cbd430 tempest-SnapshotsActionsTest-743576267 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.576s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:46:38 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-497ac33a-31e0-4bd7-ac97-7ccd63cbd430 tempest-SnapshotsActionsTest-743576267 None] Create snapshot completed successfully Sep 22 15:46:38 devstack sudo[96702]: pam_unix(sudo:session): session closed for user root Sep 22 15:46:38 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc" returned: 0 in 0.512s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:46:38 devstack cinder-volume[86212]: DEBUG cinder.manager [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] Notifying Schedulers of capabilities ... {{(pid=86212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 15:46:39 devstack cinder-volume[86212]: DEBUG oslo_service.periodic_task [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] Running periodic task VolumeManager._thread_info {{(pid=86212) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 22 15:46:39 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] thread count: 28 {{(pid=86212) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 22 15:46:39 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] thread info: [<_MainThread(MainThread, started 136163191222400)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86212) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 22 15:46:39 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-d921fdce-fac4-4d5a-b067-7c1dcab28537 tempest-SnapshotsActionsTest-1507444151 None] Acquiring lock "cinder-3aa48348-a67c-4439-96a5-0543cacc5a05-delete_snapshot" by "delete_snapshot" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:46:39 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-d921fdce-fac4-4d5a-b067-7c1dcab28537 tempest-SnapshotsActionsTest-1507444151 None] Lock "cinder-3aa48348-a67c-4439-96a5-0543cacc5a05-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:46:39 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-d921fdce-fac4-4d5a-b067-7c1dcab28537 tempest-SnapshotsActionsTest-1507444151 None] Acquiring lock "cinder-quobyte-b6fe5ce0-11b7-4bbc-8573-9a098af7add5" by "delete_snapshot" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:46:39 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-d921fdce-fac4-4d5a-b067-7c1dcab28537 tempest-SnapshotsActionsTest-1507444151 None] Lock "cinder-quobyte-b6fe5ce0-11b7-4bbc-8573-9a098af7add5" acquired by "delete_snapshot" :: waited 0.046s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:46:39 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-d921fdce-fac4-4d5a-b067-7c1dcab28537 tempest-SnapshotsActionsTest-1507444151 None] Acquiring lock "cinder-quobyte-3aa48348-a67c-4439-96a5-0543cacc5a05" by "_delete_snapshot" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:46:39 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-d921fdce-fac4-4d5a-b067-7c1dcab28537 tempest-SnapshotsActionsTest-1507444151 None] Lock "cinder-quobyte-3aa48348-a67c-4439-96a5-0543cacc5a05" acquired by "_delete_snapshot" :: waited 0.038s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:46:39 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-d921fdce-fac4-4d5a-b067-7c1dcab28537 tempest-SnapshotsActionsTest-1507444151 None] Deleting offline snapshot 3aa48348-a67c-4439-96a5-0543cacc5a05 of volume b6fe5ce0-11b7-4bbc-8573-9a098af7add5 {{(pid=86212) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 22 15:46:39 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-d921fdce-fac4-4d5a-b067-7c1dcab28537 tempest-SnapshotsActionsTest-1507444151 None] snapshot_file for this snap is: volume-b6fe5ce0-11b7-4bbc-8573-9a098af7add5.3aa48348-a67c-4439-96a5-0543cacc5a05 {{(pid=86212) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 22 15:46:39 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-6a4ee71e-8fe6-403c-9c57-ae367fe2b9fa tempest-VolumesTransfersTest-1938212425 None] Acquiring lock "cinder-d9e57161-0091-4845-ae37-73dfc7ee950b-delete_volume" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:46:39 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f58efe2-0047-4d55-9b66-fd4058e164ac]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:46:39 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-d921fdce-fac4-4d5a-b067-7c1dcab28537 tempest-SnapshotsActionsTest-1507444151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b6fe5ce0-11b7-4bbc-8573-9a098af7add5.3aa48348-a67c-4439-96a5-0543cacc5a05 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:46:39 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-6a4ee71e-8fe6-403c-9c57-ae367fe2b9fa tempest-VolumesTransfersTest-1938212425 None] Lock "cinder-d9e57161-0091-4845-ae37-73dfc7ee950b-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:46:39 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-6a4ee71e-8fe6-403c-9c57-ae367fe2b9fa tempest-VolumesTransfersTest-1938212425 None] Acquiring lock "cinder-quobyte-d9e57161-0091-4845-ae37-73dfc7ee950b" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:46:40 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-6a4ee71e-8fe6-403c-9c57-ae367fe2b9fa tempest-VolumesTransfersTest-1938212425 None] Lock "cinder-quobyte-d9e57161-0091-4845-ae37-73dfc7ee950b" acquired by "delete_volume" :: waited 0.036s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:46:40 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[61e6627d-7568-4418-b1c5-13d52ff609bb]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:46:40 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-6a4ee71e-8fe6-403c-9c57-ae367fe2b9fa tempest-VolumesTransfersTest-1938212425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-d9e57161-0091-4845-ae37-73dfc7ee950b {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:46:40 devstack sudo[96708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b6fe5ce0-11b7-4bbc-8573-9a098af7add5.3aa48348-a67c-4439-96a5-0543cacc5a05 Sep 22 15:46:40 devstack sudo[96708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:46:40 devstack sudo[96709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-d9e57161-0091-4845-ae37-73dfc7ee950b Sep 22 15:46:40 devstack sudo[96709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:46:40 devstack sudo[96708]: pam_unix(sudo:session): session closed for user root Sep 22 15:46:40 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-d921fdce-fac4-4d5a-b067-7c1dcab28537 tempest-SnapshotsActionsTest-1507444151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b6fe5ce0-11b7-4bbc-8573-9a098af7add5.3aa48348-a67c-4439-96a5-0543cacc5a05" returned: 0 in 0.523s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:46:40 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-d921fdce-fac4-4d5a-b067-7c1dcab28537 tempest-SnapshotsActionsTest-1507444151 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b6fe5ce0-11b7-4bbc-8573-9a098af7add5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86212) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 22 15:46:40 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[01ee4a65-e69f-4ea8-91d9-0ce2eff7da17]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:46:40 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-d921fdce-fac4-4d5a-b067-7c1dcab28537 tempest-SnapshotsActionsTest-1507444151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b6fe5ce0-11b7-4bbc-8573-9a098af7add5.2e13acce-6d37-4365-8cc0-4f1c9390cf03 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:46:40 devstack sudo[96709]: pam_unix(sudo:session): session closed for user root Sep 22 15:46:40 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-6a4ee71e-8fe6-403c-9c57-ae367fe2b9fa tempest-VolumesTransfersTest-1938212425 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-d9e57161-0091-4845-ae37-73dfc7ee950b" returned: 0 in 0.424s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:46:40 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-6a4ee71e-8fe6-403c-9c57-ae367fe2b9fa tempest-VolumesTransfersTest-1938212425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-d9e57161-0091-4845-ae37-73dfc7ee950b {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:46:40 devstack sudo[96724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-d9e57161-0091-4845-ae37-73dfc7ee950b Sep 22 15:46:40 devstack sudo[96724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:46:40 devstack sudo[96723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b6fe5ce0-11b7-4bbc-8573-9a098af7add5.2e13acce-6d37-4365-8cc0-4f1c9390cf03 Sep 22 15:46:40 devstack sudo[96723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:46:40 devstack sudo[96724]: pam_unix(sudo:session): session closed for user root Sep 22 15:46:40 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-6a4ee71e-8fe6-403c-9c57-ae367fe2b9fa tempest-VolumesTransfersTest-1938212425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-d9e57161-0091-4845-ae37-73dfc7ee950b" returned: 0 in 0.391s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:46:40 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-6a4ee71e-8fe6-403c-9c57-ae367fe2b9fa tempest-VolumesTransfersTest-1938212425 None] Lock "cinder-quobyte-d9e57161-0091-4845-ae37-73dfc7ee950b" released by "delete_volume" :: held 0.885s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:46:41 devstack sudo[96723]: pam_unix(sudo:session): session closed for user root Sep 22 15:46:41 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-d921fdce-fac4-4d5a-b067-7c1dcab28537 tempest-SnapshotsActionsTest-1507444151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b6fe5ce0-11b7-4bbc-8573-9a098af7add5.2e13acce-6d37-4365-8cc0-4f1c9390cf03" returned: 0 in 0.528s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:46:41 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-d921fdce-fac4-4d5a-b067-7c1dcab28537 tempest-SnapshotsActionsTest-1507444151 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b6fe5ce0-11b7-4bbc-8573-9a098af7add5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86212) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 22 15:46:41 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-d921fdce-fac4-4d5a-b067-7c1dcab28537 tempest-SnapshotsActionsTest-1507444151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b6fe5ce0-11b7-4bbc-8573-9a098af7add5.3aa48348-a67c-4439-96a5-0543cacc5a05 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:46:41 devstack cinder-volume[86212]: DEBUG cinder.quota [None req-6a4ee71e-8fe6-403c-9c57-ae367fe2b9fa tempest-VolumesTransfersTest-1938212425 None] Created reservations ['2bda9371-b8f2-43de-8a75-f3f1cd9528ea', 'b1b649cf-84b3-4898-95be-2f5a3a72d39d', 'e6a704ae-5a84-443a-a48c-bc82b45a5910', '51c50bd7-ccb1-4b2c-9e49-826071afb514'] {{(pid=86212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 15:46:41 devstack sudo[96732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b6fe5ce0-11b7-4bbc-8573-9a098af7add5.3aa48348-a67c-4439-96a5-0543cacc5a05 Sep 22 15:46:41 devstack sudo[96732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:46:41 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-6a4ee71e-8fe6-403c-9c57-ae367fe2b9fa tempest-VolumesTransfersTest-1938212425 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:46:41 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-6a4ee71e-8fe6-403c-9c57-ae367fe2b9fa tempest-VolumesTransfersTest-1938212425 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:46:41 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-6a4ee71e-8fe6-403c-9c57-ae367fe2b9fa tempest-VolumesTransfersTest-1938212425 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:46:41 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-6a4ee71e-8fe6-403c-9c57-ae367fe2b9fa tempest-VolumesTransfersTest-1938212425 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:46:41 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-6a4ee71e-8fe6-403c-9c57-ae367fe2b9fa tempest-VolumesTransfersTest-1938212425 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:46:41 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-6a4ee71e-8fe6-403c-9c57-ae367fe2b9fa tempest-VolumesTransfersTest-1938212425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:46:41 devstack sudo[96734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc Sep 22 15:46:41 devstack sudo[96734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:46:41 devstack sudo[96734]: pam_unix(sudo:session): session closed for user root Sep 22 15:46:41 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-6a4ee71e-8fe6-403c-9c57-ae367fe2b9fa tempest-VolumesTransfersTest-1938212425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc" returned: 0 in 0.280s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:46:41 devstack cinder-volume[86212]: DEBUG cinder.manager [None req-6a4ee71e-8fe6-403c-9c57-ae367fe2b9fa tempest-VolumesTransfersTest-1938212425 None] Notifying Schedulers of capabilities ... {{(pid=86212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 15:46:41 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-6a4ee71e-8fe6-403c-9c57-ae367fe2b9fa tempest-VolumesTransfersTest-1938212425 None] Deleted volume successfully. Sep 22 15:46:41 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-6a4ee71e-8fe6-403c-9c57-ae367fe2b9fa tempest-VolumesTransfersTest-1938212425 None] Lock "cinder-d9e57161-0091-4845-ae37-73dfc7ee950b-delete_volume" released by "delete_volume" :: held 1.586s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:46:41 devstack sudo[96732]: pam_unix(sudo:session): session closed for user root Sep 22 15:46:41 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-d921fdce-fac4-4d5a-b067-7c1dcab28537 tempest-SnapshotsActionsTest-1507444151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b6fe5ce0-11b7-4bbc-8573-9a098af7add5.3aa48348-a67c-4439-96a5-0543cacc5a05" returned: 0 in 0.630s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:46:41 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-d921fdce-fac4-4d5a-b067-7c1dcab28537 tempest-SnapshotsActionsTest-1507444151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b6fe5ce0-11b7-4bbc-8573-9a098af7add5.3aa48348-a67c-4439-96a5-0543cacc5a05 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:46:41 devstack sudo[96740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b6fe5ce0-11b7-4bbc-8573-9a098af7add5.3aa48348-a67c-4439-96a5-0543cacc5a05 Sep 22 15:46:41 devstack sudo[96740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:46:42 devstack sudo[96740]: pam_unix(sudo:session): session closed for user root Sep 22 15:46:42 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-d921fdce-fac4-4d5a-b067-7c1dcab28537 tempest-SnapshotsActionsTest-1507444151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b6fe5ce0-11b7-4bbc-8573-9a098af7add5.3aa48348-a67c-4439-96a5-0543cacc5a05" returned: 0 in 0.426s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:46:42 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-d921fdce-fac4-4d5a-b067-7c1dcab28537 tempest-SnapshotsActionsTest-1507444151 None] Lock "cinder-quobyte-3aa48348-a67c-4439-96a5-0543cacc5a05" released by "_delete_snapshot" :: held 2.320s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:46:42 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-d921fdce-fac4-4d5a-b067-7c1dcab28537 tempest-SnapshotsActionsTest-1507444151 None] Lock "cinder-quobyte-b6fe5ce0-11b7-4bbc-8573-9a098af7add5" released by "delete_snapshot" :: held 2.375s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:46:42 devstack cinder-volume[86212]: DEBUG cinder.quota [None req-d921fdce-fac4-4d5a-b067-7c1dcab28537 tempest-SnapshotsActionsTest-1507444151 None] Created reservations ['2e574f70-7b3c-4617-9166-48af8b381a0b', 'dc3ddd37-1952-4996-8d1d-5a6ae1dd27aa', 'baab2191-446b-497a-a278-a185be68f117', '030b7716-cfde-4aa7-9106-f69a482864f8'] {{(pid=86212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 15:46:42 devstack cinder-volume[86212]: DEBUG cinder.volume.flows.manager.create_volume [None req-b419bbd7-4599-4c05-9f8e-d3e63b18efd8 tempest-VolumesSnapshotTestJSON-1852940089 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 15:46:42 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-b419bbd7-4599-4c05-9f8e-d3e63b18efd8 tempest-VolumesSnapshotTestJSON-1852940089 None] Flow 'volume_create_manager' (3ac959ad-05cd-4bda-a1d2-d976cc31110b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:46:42 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-b419bbd7-4599-4c05-9f8e-d3e63b18efd8 tempest-VolumesSnapshotTestJSON-1852940089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b58eab4-06bf-4bf2-b206-5258c44b3837) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:46:42 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-b419bbd7-4599-4c05-9f8e-d3e63b18efd8 tempest-VolumesSnapshotTestJSON-1852940089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b58eab4-06bf-4bf2-b206-5258c44b3837) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:46:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1273857340',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c475acc-bd33-49e6-a138-3b7cf95f5ee3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6705e2e1e5874f378f80abd1ee561d94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:46:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:46:42Z,use_quota=True,user_id='92fadb836e974dcb9aae676729372d23',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:46:42 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-b419bbd7-4599-4c05-9f8e-d3e63b18efd8 tempest-VolumesSnapshotTestJSON-1852940089 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bd8e23c-1943-4b9a-a6f2-83b4276f4727) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:46:42 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-b419bbd7-4599-4c05-9f8e-d3e63b18efd8 tempest-VolumesSnapshotTestJSON-1852940089 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bd8e23c-1943-4b9a-a6f2-83b4276f4727) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:46:42 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-b419bbd7-4599-4c05-9f8e-d3e63b18efd8 tempest-VolumesSnapshotTestJSON-1852940089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16bceb72-9faa-461a-90f4-251f0d08474e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:46:42 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-b419bbd7-4599-4c05-9f8e-d3e63b18efd8 tempest-VolumesSnapshotTestJSON-1852940089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16bceb72-9faa-461a-90f4-251f0d08474e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2c475acc-bd33-49e6-a138-3b7cf95f5ee3', 'volume_name': 'volume-2c475acc-bd33-49e6-a138-3b7cf95f5ee3', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:46:42 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-b419bbd7-4599-4c05-9f8e-d3e63b18efd8 tempest-VolumesSnapshotTestJSON-1852940089 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (197c62a5-2a35-4020-8ba9-70f87b6624d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:46:42 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-b419bbd7-4599-4c05-9f8e-d3e63b18efd8 tempest-VolumesSnapshotTestJSON-1852940089 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (197c62a5-2a35-4020-8ba9-70f87b6624d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:46:42 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-b419bbd7-4599-4c05-9f8e-d3e63b18efd8 tempest-VolumesSnapshotTestJSON-1852940089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f24a62bf-f4dc-4b57-ab7b-c403af6c8c77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:46:42 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-b419bbd7-4599-4c05-9f8e-d3e63b18efd8 tempest-VolumesSnapshotTestJSON-1852940089 None] Volume 2c475acc-bd33-49e6-a138-3b7cf95f5ee3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2c475acc-bd33-49e6-a138-3b7cf95f5ee3', 'volume_size': 1} Sep 22 15:46:42 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-b419bbd7-4599-4c05-9f8e-d3e63b18efd8 tempest-VolumesSnapshotTestJSON-1852940089 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:46:42 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-b419bbd7-4599-4c05-9f8e-d3e63b18efd8 tempest-VolumesSnapshotTestJSON-1852940089 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:46:42 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-b419bbd7-4599-4c05-9f8e-d3e63b18efd8 tempest-VolumesSnapshotTestJSON-1852940089 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:46:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1273857340',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c475acc-bd33-49e6-a138-3b7cf95f5ee3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6705e2e1e5874f378f80abd1ee561d94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:46:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:46:42Z,use_quota=True,user_id='92fadb836e974dcb9aae676729372d23',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)}" {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 15:46:42 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-b419bbd7-4599-4c05-9f8e-d3e63b18efd8 tempest-VolumesSnapshotTestJSON-1852940089 None] Creating volume 2c475acc-bd33-49e6-a138-3b7cf95f5ee3 {{(pid=86212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 15:46:42 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-b419bbd7-4599-4c05-9f8e-d3e63b18efd8 tempest-VolumesSnapshotTestJSON-1852940089 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:46:42 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-b419bbd7-4599-4c05-9f8e-d3e63b18efd8 tempest-VolumesSnapshotTestJSON-1852940089 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:46:42 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-b419bbd7-4599-4c05-9f8e-d3e63b18efd8 tempest-VolumesSnapshotTestJSON-1852940089 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:46:42 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-b419bbd7-4599-4c05-9f8e-d3e63b18efd8 tempest-VolumesSnapshotTestJSON-1852940089 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:46:42 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-b419bbd7-4599-4c05-9f8e-d3e63b18efd8 tempest-VolumesSnapshotTestJSON-1852940089 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:46:42 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-b419bbd7-4599-4c05-9f8e-d3e63b18efd8 tempest-VolumesSnapshotTestJSON-1852940089 None] Selected osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 as target Quobyte volume. {{(pid=86212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 15:46:42 devstack cinder-volume[86212]: INFO cinder.volume.drivers.remotefs [None req-b419bbd7-4599-4c05-9f8e-d3e63b18efd8 tempest-VolumesSnapshotTestJSON-1852940089 None] casted to osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 Sep 22 15:46:42 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-b419bbd7-4599-4c05-9f8e-d3e63b18efd8 tempest-VolumesSnapshotTestJSON-1852940089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2c475acc-bd33-49e6-a138-3b7cf95f5ee3 1073741824 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:46:42 devstack sudo[96743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2c475acc-bd33-49e6-a138-3b7cf95f5ee3 1073741824 Sep 22 15:46:42 devstack sudo[96743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:46:42 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-d921fdce-fac4-4d5a-b067-7c1dcab28537 tempest-SnapshotsActionsTest-1507444151 None] Delete snapshot completed successfully. Sep 22 15:46:42 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-d921fdce-fac4-4d5a-b067-7c1dcab28537 tempest-SnapshotsActionsTest-1507444151 None] Lock "cinder-3aa48348-a67c-4439-96a5-0543cacc5a05-delete_snapshot" released by "delete_snapshot" :: held 2.879s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:46:42 devstack cinder-volume[86212]: DEBUG cinder.volume.flows.manager.create_volume [None req-9918e32c-96fb-41ed-86c3-5ffafbae4832 tempest-VolumesTransfersTest-134941449 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 15:46:43 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-9918e32c-96fb-41ed-86c3-5ffafbae4832 tempest-VolumesTransfersTest-134941449 None] Flow 'volume_create_manager' (2bf89be7-cccb-4d0f-a233-8947e471f120) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:46:43 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-9918e32c-96fb-41ed-86c3-5ffafbae4832 tempest-VolumesTransfersTest-134941449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41317988-c6d0-4124-936f-fe5503518d31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:46:43 devstack sudo[96743]: pam_unix(sudo:session): session closed for user root Sep 22 15:46:43 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-b419bbd7-4599-4c05-9f8e-d3e63b18efd8 tempest-VolumesSnapshotTestJSON-1852940089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2c475acc-bd33-49e6-a138-3b7cf95f5ee3 1073741824" returned: 0 in 0.605s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:46:43 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-9918e32c-96fb-41ed-86c3-5ffafbae4832 tempest-VolumesTransfersTest-134941449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41317988-c6d0-4124-936f-fe5503518d31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:46:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-720105743',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6961ae3-f36c-489a-8495-fcd60f537bd2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04cb80d070174eae996eff054d371173',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:46:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:46:43Z,use_quota=True,user_id='8d4732e4c6744b6681b3ddabb942ca5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:46:43 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-9918e32c-96fb-41ed-86c3-5ffafbae4832 tempest-VolumesTransfersTest-134941449 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7d6e129-eb54-43d5-8768-98c482d6e5a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:46:43 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-9918e32c-96fb-41ed-86c3-5ffafbae4832 tempest-VolumesTransfersTest-134941449 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7d6e129-eb54-43d5-8768-98c482d6e5a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:46:43 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-9918e32c-96fb-41ed-86c3-5ffafbae4832 tempest-VolumesTransfersTest-134941449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (859bc58d-4994-4200-b73f-5d436aa32c68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:46:43 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-9918e32c-96fb-41ed-86c3-5ffafbae4832 tempest-VolumesTransfersTest-134941449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (859bc58d-4994-4200-b73f-5d436aa32c68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b6961ae3-f36c-489a-8495-fcd60f537bd2', 'volume_name': 'volume-b6961ae3-f36c-489a-8495-fcd60f537bd2', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:46:43 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-9918e32c-96fb-41ed-86c3-5ffafbae4832 tempest-VolumesTransfersTest-134941449 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3347c87e-63d5-453d-a2ee-50bfae9609a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:46:43 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-9918e32c-96fb-41ed-86c3-5ffafbae4832 tempest-VolumesTransfersTest-134941449 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3347c87e-63d5-453d-a2ee-50bfae9609a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:46:43 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-9918e32c-96fb-41ed-86c3-5ffafbae4832 tempest-VolumesTransfersTest-134941449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (718dc240-21d1-4588-9d47-28a5c3fc25b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:46:43 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-9918e32c-96fb-41ed-86c3-5ffafbae4832 tempest-VolumesTransfersTest-134941449 None] Volume b6961ae3-f36c-489a-8495-fcd60f537bd2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b6961ae3-f36c-489a-8495-fcd60f537bd2', 'volume_size': 1} Sep 22 15:46:43 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-9918e32c-96fb-41ed-86c3-5ffafbae4832 tempest-VolumesTransfersTest-134941449 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:46:43 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-b419bbd7-4599-4c05-9f8e-d3e63b18efd8 tempest-VolumesSnapshotTestJSON-1852940089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2c475acc-bd33-49e6-a138-3b7cf95f5ee3 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:46:43 devstack sudo[96748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2c475acc-bd33-49e6-a138-3b7cf95f5ee3 Sep 22 15:46:43 devstack sudo[96748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:46:43 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-8aed36b2-d23c-4e10-8c31-c79df751d0d0 tempest-SnapshotsActionsTest-743576267 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:46:43 devstack sudo[96748]: pam_unix(sudo:session): session closed for user root Sep 22 15:46:43 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-b419bbd7-4599-4c05-9f8e-d3e63b18efd8 tempest-VolumesSnapshotTestJSON-1852940089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2c475acc-bd33-49e6-a138-3b7cf95f5ee3" returned: 0 in 0.316s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:46:43 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-b419bbd7-4599-4c05-9f8e-d3e63b18efd8 tempest-VolumesSnapshotTestJSON-1852940089 None] <== create_volume: return (1021ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'} {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 15:46:43 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-b419bbd7-4599-4c05-9f8e-d3e63b18efd8 tempest-VolumesSnapshotTestJSON-1852940089 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.024s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:46:43 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-9918e32c-96fb-41ed-86c3-5ffafbae4832 tempest-VolumesTransfersTest-134941449 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.351s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:46:43 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-9918e32c-96fb-41ed-86c3-5ffafbae4832 tempest-VolumesTransfersTest-134941449 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:46:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-720105743',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6961ae3-f36c-489a-8495-fcd60f537bd2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04cb80d070174eae996eff054d371173',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:46:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:46:43Z,use_quota=True,user_id='8d4732e4c6744b6681b3ddabb942ca5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)}" {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 15:46:43 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-9918e32c-96fb-41ed-86c3-5ffafbae4832 tempest-VolumesTransfersTest-134941449 None] Creating volume b6961ae3-f36c-489a-8495-fcd60f537bd2 {{(pid=86212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 15:46:43 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-9918e32c-96fb-41ed-86c3-5ffafbae4832 tempest-VolumesTransfersTest-134941449 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:46:43 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-9918e32c-96fb-41ed-86c3-5ffafbae4832 tempest-VolumesTransfersTest-134941449 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:46:43 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-9918e32c-96fb-41ed-86c3-5ffafbae4832 tempest-VolumesTransfersTest-134941449 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:46:43 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-9918e32c-96fb-41ed-86c3-5ffafbae4832 tempest-VolumesTransfersTest-134941449 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:46:43 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-9918e32c-96fb-41ed-86c3-5ffafbae4832 tempest-VolumesTransfersTest-134941449 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:46:43 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-9918e32c-96fb-41ed-86c3-5ffafbae4832 tempest-VolumesTransfersTest-134941449 None] Selected osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 as target Quobyte volume. {{(pid=86212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 15:46:43 devstack cinder-volume[86212]: INFO cinder.volume.drivers.remotefs [None req-9918e32c-96fb-41ed-86c3-5ffafbae4832 tempest-VolumesTransfersTest-134941449 None] casted to osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 Sep 22 15:46:43 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-9918e32c-96fb-41ed-86c3-5ffafbae4832 tempest-VolumesTransfersTest-134941449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b6961ae3-f36c-489a-8495-fcd60f537bd2 1073741824 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:46:43 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-b419bbd7-4599-4c05-9f8e-d3e63b18efd8 tempest-VolumesSnapshotTestJSON-1852940089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f24a62bf-f4dc-4b57-ab7b-c403af6c8c77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2c475acc-bd33-49e6-a138-3b7cf95f5ee3', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:46:43 devstack sudo[96751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b6961ae3-f36c-489a-8495-fcd60f537bd2 1073741824 Sep 22 15:46:43 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-b419bbd7-4599-4c05-9f8e-d3e63b18efd8 tempest-VolumesSnapshotTestJSON-1852940089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (406a61b3-ff7d-4825-bdb9-a5fafc539d3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:46:43 devstack sudo[96751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:46:43 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-b419bbd7-4599-4c05-9f8e-d3e63b18efd8 tempest-VolumesSnapshotTestJSON-1852940089 None] Volume volume-2c475acc-bd33-49e6-a138-3b7cf95f5ee3 (2c475acc-bd33-49e6-a138-3b7cf95f5ee3): created successfully Sep 22 15:46:43 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-b419bbd7-4599-4c05-9f8e-d3e63b18efd8 tempest-VolumesSnapshotTestJSON-1852940089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (406a61b3-ff7d-4825-bdb9-a5fafc539d3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:46:43 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-b419bbd7-4599-4c05-9f8e-d3e63b18efd8 tempest-VolumesSnapshotTestJSON-1852940089 None] Flow 'volume_create_manager' (3ac959ad-05cd-4bda-a1d2-d976cc31110b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:46:43 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-b419bbd7-4599-4c05-9f8e-d3e63b18efd8 tempest-VolumesSnapshotTestJSON-1852940089 None] Created volume successfully. Sep 22 15:46:43 devstack sudo[96751]: pam_unix(sudo:session): session closed for user root Sep 22 15:46:43 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-9918e32c-96fb-41ed-86c3-5ffafbae4832 tempest-VolumesTransfersTest-134941449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b6961ae3-f36c-489a-8495-fcd60f537bd2 1073741824" returned: 0 in 0.470s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:46:43 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-9918e32c-96fb-41ed-86c3-5ffafbae4832 tempest-VolumesTransfersTest-134941449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b6961ae3-f36c-489a-8495-fcd60f537bd2 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:46:43 devstack sudo[96757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b6961ae3-f36c-489a-8495-fcd60f537bd2 Sep 22 15:46:43 devstack sudo[96757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:46:44 devstack sudo[96757]: pam_unix(sudo:session): session closed for user root Sep 22 15:46:44 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-9918e32c-96fb-41ed-86c3-5ffafbae4832 tempest-VolumesTransfersTest-134941449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b6961ae3-f36c-489a-8495-fcd60f537bd2" returned: 0 in 0.257s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:46:44 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-9918e32c-96fb-41ed-86c3-5ffafbae4832 tempest-VolumesTransfersTest-134941449 None] <== create_volume: return (770ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'} {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 15:46:44 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-9918e32c-96fb-41ed-86c3-5ffafbae4832 tempest-VolumesTransfersTest-134941449 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.773s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:46:44 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-8aed36b2-d23c-4e10-8c31-c79df751d0d0 tempest-SnapshotsActionsTest-743576267 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.936s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:46:44 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-9918e32c-96fb-41ed-86c3-5ffafbae4832 tempest-VolumesTransfersTest-134941449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (718dc240-21d1-4588-9d47-28a5c3fc25b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b6961ae3-f36c-489a-8495-fcd60f537bd2', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:46:44 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-9918e32c-96fb-41ed-86c3-5ffafbae4832 tempest-VolumesTransfersTest-134941449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (893ed78d-b48b-40ac-9789-b11c12baf980) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:46:44 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-8aed36b2-d23c-4e10-8c31-c79df751d0d0 tempest-SnapshotsActionsTest-743576267 None] Creating offline snapshot 289e10f8-3e66-421e-a08e-a1e7232c78ca of volume b6fe5ce0-11b7-4bbc-8573-9a098af7add5 {{(pid=86212) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 22 15:46:44 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-9918e32c-96fb-41ed-86c3-5ffafbae4832 tempest-VolumesTransfersTest-134941449 None] Volume volume-b6961ae3-f36c-489a-8495-fcd60f537bd2 (b6961ae3-f36c-489a-8495-fcd60f537bd2): created successfully Sep 22 15:46:44 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-9918e32c-96fb-41ed-86c3-5ffafbae4832 tempest-VolumesTransfersTest-134941449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (893ed78d-b48b-40ac-9789-b11c12baf980) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:46:44 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-9918e32c-96fb-41ed-86c3-5ffafbae4832 tempest-VolumesTransfersTest-134941449 None] Flow 'volume_create_manager' (2bf89be7-cccb-4d0f-a233-8947e471f120) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:46:44 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[da1a8718-11bd-4994-bf92-242ca9f0000a]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:46:44 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-8aed36b2-d23c-4e10-8c31-c79df751d0d0 tempest-SnapshotsActionsTest-743576267 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b6fe5ce0-11b7-4bbc-8573-9a098af7add5.2e13acce-6d37-4365-8cc0-4f1c9390cf03 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:46:44 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-9918e32c-96fb-41ed-86c3-5ffafbae4832 tempest-VolumesTransfersTest-134941449 None] Created volume successfully. Sep 22 15:46:44 devstack sudo[96760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b6fe5ce0-11b7-4bbc-8573-9a098af7add5.2e13acce-6d37-4365-8cc0-4f1c9390cf03 Sep 22 15:46:44 devstack sudo[96760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:46:44 devstack sudo[96760]: pam_unix(sudo:session): session closed for user root Sep 22 15:46:44 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-8aed36b2-d23c-4e10-8c31-c79df751d0d0 tempest-SnapshotsActionsTest-743576267 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b6fe5ce0-11b7-4bbc-8573-9a098af7add5.2e13acce-6d37-4365-8cc0-4f1c9390cf03" returned: 0 in 0.417s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:46:44 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-8aed36b2-d23c-4e10-8c31-c79df751d0d0 tempest-SnapshotsActionsTest-743576267 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b6fe5ce0-11b7-4bbc-8573-9a098af7add5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86212) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 22 15:46:44 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-8aed36b2-d23c-4e10-8c31-c79df751d0d0 tempest-SnapshotsActionsTest-743576267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b6fe5ce0-11b7-4bbc-8573-9a098af7add5.2e13acce-6d37-4365-8cc0-4f1c9390cf03,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b6fe5ce0-11b7-4bbc-8573-9a098af7add5.289e10f8-3e66-421e-a08e-a1e7232c78ca 1G {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:46:44 devstack sudo[96765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b6fe5ce0-11b7-4bbc-8573-9a098af7add5.2e13acce-6d37-4365-8cc0-4f1c9390cf03,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b6fe5ce0-11b7-4bbc-8573-9a098af7add5.289e10f8-3e66-421e-a08e-a1e7232c78ca 1G Sep 22 15:46:44 devstack sudo[96765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:46:44 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-97c31bdf-6729-4b98-80a6-3ecb749049c5 tempest-VolumesSnapshotTestJSON-1852940089 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:46:45 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-04f96cfa-50ab-4a65-81a8-a08803179144 tempest-GroupSnapshotsV319Test-1640878424 None] Group tempest-GroupSnapshotsV319Test-Group-390062120: creating Sep 22 15:46:45 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-04f96cfa-50ab-4a65-81a8-a08803179144 tempest-GroupSnapshotsV319Test-1640878424 None] Group tempest-GroupSnapshotsV319Test-Group-390062120: created successfully Sep 22 15:46:45 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-04f96cfa-50ab-4a65-81a8-a08803179144 tempest-GroupSnapshotsV319Test-1640878424 None] Create group completed successfully. Sep 22 15:46:45 devstack sudo[96765]: pam_unix(sudo:session): session closed for user root Sep 22 15:46:45 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-8aed36b2-d23c-4e10-8c31-c79df751d0d0 tempest-SnapshotsActionsTest-743576267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b6fe5ce0-11b7-4bbc-8573-9a098af7add5.2e13acce-6d37-4365-8cc0-4f1c9390cf03,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b6fe5ce0-11b7-4bbc-8573-9a098af7add5.289e10f8-3e66-421e-a08e-a1e7232c78ca 1G" returned: 0 in 0.535s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:46:45 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-8aed36b2-d23c-4e10-8c31-c79df751d0d0 tempest-SnapshotsActionsTest-743576267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6fe5ce0-11b7-4bbc-8573-9a098af7add5.2e13acce-6d37-4365-8cc0-4f1c9390cf03 -F qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b6fe5ce0-11b7-4bbc-8573-9a098af7add5.289e10f8-3e66-421e-a08e-a1e7232c78ca {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:46:45 devstack sudo[96771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6fe5ce0-11b7-4bbc-8573-9a098af7add5.2e13acce-6d37-4365-8cc0-4f1c9390cf03 -F qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b6fe5ce0-11b7-4bbc-8573-9a098af7add5.289e10f8-3e66-421e-a08e-a1e7232c78ca Sep 22 15:46:45 devstack sudo[96771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:46:45 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-6763b229-6127-4f65-a220-ee66d11d8d8a tempest-VolumesTransfersTest-1938212425 None] Acquiring lock "cinder-b6961ae3-f36c-489a-8495-fcd60f537bd2-delete_volume" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:46:45 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-6763b229-6127-4f65-a220-ee66d11d8d8a tempest-VolumesTransfersTest-1938212425 None] Lock "cinder-b6961ae3-f36c-489a-8495-fcd60f537bd2-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:46:45 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-6763b229-6127-4f65-a220-ee66d11d8d8a tempest-VolumesTransfersTest-1938212425 None] Acquiring lock "cinder-quobyte-b6961ae3-f36c-489a-8495-fcd60f537bd2" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:46:45 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-6763b229-6127-4f65-a220-ee66d11d8d8a tempest-VolumesTransfersTest-1938212425 None] Lock "cinder-quobyte-b6961ae3-f36c-489a-8495-fcd60f537bd2" acquired by "delete_volume" :: waited 0.020s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:46:45 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fd0fc92-bdb5-436d-a8e0-b80dd5aa752d]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:46:45 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-6763b229-6127-4f65-a220-ee66d11d8d8a tempest-VolumesTransfersTest-1938212425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b6961ae3-f36c-489a-8495-fcd60f537bd2 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:46:45 devstack sudo[96773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b6961ae3-f36c-489a-8495-fcd60f537bd2 Sep 22 15:46:45 devstack sudo[96773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:46:45 devstack sudo[96771]: pam_unix(sudo:session): session closed for user root Sep 22 15:46:45 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-8aed36b2-d23c-4e10-8c31-c79df751d0d0 tempest-SnapshotsActionsTest-743576267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6fe5ce0-11b7-4bbc-8573-9a098af7add5.2e13acce-6d37-4365-8cc0-4f1c9390cf03 -F qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b6fe5ce0-11b7-4bbc-8573-9a098af7add5.289e10f8-3e66-421e-a08e-a1e7232c78ca" returned: 0 in 0.343s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:46:45 devstack cinder-volume[86212]: WARNING cinder.volume.drivers.remotefs [None req-8aed36b2-d23c-4e10-8c31-c79df751d0d0 tempest-SnapshotsActionsTest-743576267 None] /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b6fe5ce0-11b7-4bbc-8573-9a098af7add5.289e10f8-3e66-421e-a08e-a1e7232c78ca is being set with open permissions: ugo+rw Sep 22 15:46:45 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-8aed36b2-d23c-4e10-8c31-c79df751d0d0 tempest-SnapshotsActionsTest-743576267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b6fe5ce0-11b7-4bbc-8573-9a098af7add5.289e10f8-3e66-421e-a08e-a1e7232c78ca {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:46:45 devstack sudo[96778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b6fe5ce0-11b7-4bbc-8573-9a098af7add5.289e10f8-3e66-421e-a08e-a1e7232c78ca Sep 22 15:46:45 devstack sudo[96778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:46:45 devstack sudo[96778]: pam_unix(sudo:session): session closed for user root Sep 22 15:46:45 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-8aed36b2-d23c-4e10-8c31-c79df751d0d0 tempest-SnapshotsActionsTest-743576267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b6fe5ce0-11b7-4bbc-8573-9a098af7add5.289e10f8-3e66-421e-a08e-a1e7232c78ca" returned: 0 in 0.267s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:46:45 devstack sudo[96773]: pam_unix(sudo:session): session closed for user root Sep 22 15:46:45 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-8aed36b2-d23c-4e10-8c31-c79df751d0d0 tempest-SnapshotsActionsTest-743576267 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.714s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:46:45 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-97c31bdf-6729-4b98-80a6-3ecb749049c5 tempest-VolumesSnapshotTestJSON-1852940089 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.064s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:46:45 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-6763b229-6127-4f65-a220-ee66d11d8d8a tempest-VolumesTransfersTest-1938212425 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b6961ae3-f36c-489a-8495-fcd60f537bd2" returned: 0 in 0.443s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:46:45 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-6763b229-6127-4f65-a220-ee66d11d8d8a tempest-VolumesTransfersTest-1938212425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b6961ae3-f36c-489a-8495-fcd60f537bd2 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:46:45 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-97c31bdf-6729-4b98-80a6-3ecb749049c5 tempest-VolumesSnapshotTestJSON-1852940089 None] Creating offline snapshot e1251a27-cb58-484c-be19-45ff7679949d of volume 2c475acc-bd33-49e6-a138-3b7cf95f5ee3 {{(pid=86212) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 22 15:46:45 devstack sudo[96784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b6961ae3-f36c-489a-8495-fcd60f537bd2 Sep 22 15:46:45 devstack sudo[96784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:46:45 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-8aed36b2-d23c-4e10-8c31-c79df751d0d0 tempest-SnapshotsActionsTest-743576267 None] Create snapshot completed successfully Sep 22 15:46:46 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[a55cf87c-e60f-465c-a90a-3e0e6b588f68]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:46:46 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-97c31bdf-6729-4b98-80a6-3ecb749049c5 tempest-VolumesSnapshotTestJSON-1852940089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2c475acc-bd33-49e6-a138-3b7cf95f5ee3 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:46:46 devstack sudo[96786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2c475acc-bd33-49e6-a138-3b7cf95f5ee3 Sep 22 15:46:46 devstack sudo[96786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:46:46 devstack sudo[96784]: pam_unix(sudo:session): session closed for user root Sep 22 15:46:46 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-6763b229-6127-4f65-a220-ee66d11d8d8a tempest-VolumesTransfersTest-1938212425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b6961ae3-f36c-489a-8495-fcd60f537bd2" returned: 0 in 0.270s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:46:46 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-6763b229-6127-4f65-a220-ee66d11d8d8a tempest-VolumesTransfersTest-1938212425 None] Lock "cinder-quobyte-b6961ae3-f36c-489a-8495-fcd60f537bd2" released by "delete_volume" :: held 0.772s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:46:46 devstack cinder-volume[86212]: DEBUG cinder.quota [None req-6763b229-6127-4f65-a220-ee66d11d8d8a tempest-VolumesTransfersTest-1938212425 None] Created reservations ['93d655f6-e531-4887-81a1-a65f4ed9921f', '501de454-fd58-48ae-8298-2aad2f262d97', '05a73092-af82-47c8-81b4-2a2dbe30faf8', 'e2c5e3f2-41d3-4c21-b572-0174434778a7'] {{(pid=86212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 15:46:46 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-6763b229-6127-4f65-a220-ee66d11d8d8a tempest-VolumesTransfersTest-1938212425 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:46:46 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-6763b229-6127-4f65-a220-ee66d11d8d8a tempest-VolumesTransfersTest-1938212425 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:46:46 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-6763b229-6127-4f65-a220-ee66d11d8d8a tempest-VolumesTransfersTest-1938212425 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:46:46 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-6763b229-6127-4f65-a220-ee66d11d8d8a tempest-VolumesTransfersTest-1938212425 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:46:46 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-6763b229-6127-4f65-a220-ee66d11d8d8a tempest-VolumesTransfersTest-1938212425 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:46:46 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-6763b229-6127-4f65-a220-ee66d11d8d8a tempest-VolumesTransfersTest-1938212425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:46:46 devstack sudo[96792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc Sep 22 15:46:46 devstack sudo[96792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:46:46 devstack sudo[96786]: pam_unix(sudo:session): session closed for user root Sep 22 15:46:46 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-97c31bdf-6729-4b98-80a6-3ecb749049c5 tempest-VolumesSnapshotTestJSON-1852940089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2c475acc-bd33-49e6-a138-3b7cf95f5ee3" returned: 0 in 0.462s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:46:46 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-97c31bdf-6729-4b98-80a6-3ecb749049c5 tempest-VolumesSnapshotTestJSON-1852940089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2c475acc-bd33-49e6-a138-3b7cf95f5ee3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2c475acc-bd33-49e6-a138-3b7cf95f5ee3.e1251a27-cb58-484c-be19-45ff7679949d 1G {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:46:46 devstack sudo[96794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2c475acc-bd33-49e6-a138-3b7cf95f5ee3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2c475acc-bd33-49e6-a138-3b7cf95f5ee3.e1251a27-cb58-484c-be19-45ff7679949d 1G Sep 22 15:46:46 devstack sudo[96794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:46:46 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-8945976d-1f1e-4278-81ed-a0cf1a0d0850 tempest-SnapshotsActionsTest-1507444151 None] Acquiring lock "cinder-289e10f8-3e66-421e-a08e-a1e7232c78ca-delete_snapshot" by "delete_snapshot" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:46:46 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-8945976d-1f1e-4278-81ed-a0cf1a0d0850 tempest-SnapshotsActionsTest-1507444151 None] Lock "cinder-289e10f8-3e66-421e-a08e-a1e7232c78ca-delete_snapshot" acquired by "delete_snapshot" :: waited 0.059s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:46:46 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-8945976d-1f1e-4278-81ed-a0cf1a0d0850 tempest-SnapshotsActionsTest-1507444151 None] Acquiring lock "cinder-quobyte-b6fe5ce0-11b7-4bbc-8573-9a098af7add5" by "delete_snapshot" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:46:46 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-8945976d-1f1e-4278-81ed-a0cf1a0d0850 tempest-SnapshotsActionsTest-1507444151 None] Lock "cinder-quobyte-b6fe5ce0-11b7-4bbc-8573-9a098af7add5" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:46:46 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-8945976d-1f1e-4278-81ed-a0cf1a0d0850 tempest-SnapshotsActionsTest-1507444151 None] Acquiring lock "cinder-quobyte-289e10f8-3e66-421e-a08e-a1e7232c78ca" by "_delete_snapshot" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:46:46 devstack sudo[96792]: pam_unix(sudo:session): session closed for user root Sep 22 15:46:46 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-8945976d-1f1e-4278-81ed-a0cf1a0d0850 tempest-SnapshotsActionsTest-1507444151 None] Lock "cinder-quobyte-289e10f8-3e66-421e-a08e-a1e7232c78ca" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:46:46 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-8945976d-1f1e-4278-81ed-a0cf1a0d0850 tempest-SnapshotsActionsTest-1507444151 None] Deleting offline snapshot 289e10f8-3e66-421e-a08e-a1e7232c78ca of volume b6fe5ce0-11b7-4bbc-8573-9a098af7add5 {{(pid=86212) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 22 15:46:46 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-8945976d-1f1e-4278-81ed-a0cf1a0d0850 tempest-SnapshotsActionsTest-1507444151 None] snapshot_file for this snap is: volume-b6fe5ce0-11b7-4bbc-8573-9a098af7add5.289e10f8-3e66-421e-a08e-a1e7232c78ca {{(pid=86212) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 22 15:46:46 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-6763b229-6127-4f65-a220-ee66d11d8d8a tempest-VolumesTransfersTest-1938212425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc" returned: 0 in 0.432s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:46:46 devstack cinder-volume[86212]: DEBUG cinder.manager [None req-6763b229-6127-4f65-a220-ee66d11d8d8a tempest-VolumesTransfersTest-1938212425 None] Notifying Schedulers of capabilities ... {{(pid=86212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 15:46:46 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[342adb7e-00e3-44bd-914a-b03717d70b3b]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:46:46 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-8945976d-1f1e-4278-81ed-a0cf1a0d0850 tempest-SnapshotsActionsTest-1507444151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b6fe5ce0-11b7-4bbc-8573-9a098af7add5.289e10f8-3e66-421e-a08e-a1e7232c78ca {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:46:46 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-6763b229-6127-4f65-a220-ee66d11d8d8a tempest-VolumesTransfersTest-1938212425 None] Deleted volume successfully. Sep 22 15:46:46 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-6763b229-6127-4f65-a220-ee66d11d8d8a tempest-VolumesTransfersTest-1938212425 None] Lock "cinder-b6961ae3-f36c-489a-8495-fcd60f537bd2-delete_volume" released by "delete_volume" :: held 1.579s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:46:46 devstack cinder-volume[86212]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6051764-6f55-45a0-bfbe-eb5d5b9e4b04 tempest-GroupSnapshotsV319Test-1640878424 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 15:46:46 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-c6051764-6f55-45a0-bfbe-eb5d5b9e4b04 tempest-GroupSnapshotsV319Test-1640878424 None] Flow 'volume_create_manager' (9cddb331-1157-4981-ac4e-01a21604352e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:46:47 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-c6051764-6f55-45a0-bfbe-eb5d5b9e4b04 tempest-GroupSnapshotsV319Test-1640878424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de7b3538-0223-4c5a-b511-309a8db41352) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:46:47 devstack sudo[96797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b6fe5ce0-11b7-4bbc-8573-9a098af7add5.289e10f8-3e66-421e-a08e-a1e7232c78ca Sep 22 15:46:47 devstack sudo[96797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:46:47 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-c6051764-6f55-45a0-bfbe-eb5d5b9e4b04 tempest-GroupSnapshotsV319Test-1640878424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de7b3538-0223-4c5a-b511-309a8db41352) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:46:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1200658041',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ce34ce2b-eeaf-4d05-bf45-8091944d0757,host='devstack@QuobyteHD#QuobyteHD',id=b435c79c-262e-41d2-b6af-53406b1c939b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3bafe7c692e477e96196b82f1878758',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:46:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:46:47Z,use_quota=True,user_id='27be69c82960423eb443895866956222',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f9870f5f-37e2-4929-8f0b-7df4f53e7ffa),volume_type_id=f9870f5f-37e2-4929-8f0b-7df4f53e7ffa)' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:46:47 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-c6051764-6f55-45a0-bfbe-eb5d5b9e4b04 tempest-GroupSnapshotsV319Test-1640878424 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (886d8186-6c65-4836-9b98-7ac4f4fa842c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:46:47 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-c6051764-6f55-45a0-bfbe-eb5d5b9e4b04 tempest-GroupSnapshotsV319Test-1640878424 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (886d8186-6c65-4836-9b98-7ac4f4fa842c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:46:47 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-c6051764-6f55-45a0-bfbe-eb5d5b9e4b04 tempest-GroupSnapshotsV319Test-1640878424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1610f751-b798-417d-900b-9497d1641b4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:46:47 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-c6051764-6f55-45a0-bfbe-eb5d5b9e4b04 tempest-GroupSnapshotsV319Test-1640878424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1610f751-b798-417d-900b-9497d1641b4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b435c79c-262e-41d2-b6af-53406b1c939b', 'volume_name': 'volume-b435c79c-262e-41d2-b6af-53406b1c939b', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:46:47 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-c6051764-6f55-45a0-bfbe-eb5d5b9e4b04 tempest-GroupSnapshotsV319Test-1640878424 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (485fd5a7-567e-46c2-ba22-5821c7302250) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:46:47 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-c6051764-6f55-45a0-bfbe-eb5d5b9e4b04 tempest-GroupSnapshotsV319Test-1640878424 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (485fd5a7-567e-46c2-ba22-5821c7302250) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:46:47 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-c6051764-6f55-45a0-bfbe-eb5d5b9e4b04 tempest-GroupSnapshotsV319Test-1640878424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed7a4965-b717-4de2-9f82-626ba86563a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:46:47 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-c6051764-6f55-45a0-bfbe-eb5d5b9e4b04 tempest-GroupSnapshotsV319Test-1640878424 None] Volume b435c79c-262e-41d2-b6af-53406b1c939b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b435c79c-262e-41d2-b6af-53406b1c939b', 'volume_size': 1} Sep 22 15:46:47 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-c6051764-6f55-45a0-bfbe-eb5d5b9e4b04 tempest-GroupSnapshotsV319Test-1640878424 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:46:47 devstack sudo[96794]: pam_unix(sudo:session): session closed for user root Sep 22 15:46:47 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-97c31bdf-6729-4b98-80a6-3ecb749049c5 tempest-VolumesSnapshotTestJSON-1852940089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2c475acc-bd33-49e6-a138-3b7cf95f5ee3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2c475acc-bd33-49e6-a138-3b7cf95f5ee3.e1251a27-cb58-484c-be19-45ff7679949d 1G" returned: 0 in 0.724s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:46:47 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-97c31bdf-6729-4b98-80a6-3ecb749049c5 tempest-VolumesSnapshotTestJSON-1852940089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2c475acc-bd33-49e6-a138-3b7cf95f5ee3 -F qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2c475acc-bd33-49e6-a138-3b7cf95f5ee3.e1251a27-cb58-484c-be19-45ff7679949d {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:46:47 devstack sudo[96802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2c475acc-bd33-49e6-a138-3b7cf95f5ee3 -F qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2c475acc-bd33-49e6-a138-3b7cf95f5ee3.e1251a27-cb58-484c-be19-45ff7679949d Sep 22 15:46:47 devstack sudo[96802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:46:47 devstack sudo[96797]: pam_unix(sudo:session): session closed for user root Sep 22 15:46:47 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-8945976d-1f1e-4278-81ed-a0cf1a0d0850 tempest-SnapshotsActionsTest-1507444151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b6fe5ce0-11b7-4bbc-8573-9a098af7add5.289e10f8-3e66-421e-a08e-a1e7232c78ca" returned: 0 in 0.488s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:46:47 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-8945976d-1f1e-4278-81ed-a0cf1a0d0850 tempest-SnapshotsActionsTest-1507444151 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b6fe5ce0-11b7-4bbc-8573-9a098af7add5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86212) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 22 15:46:47 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b2dcc1a-d595-4243-a75a-c421f9861a0f]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:46:47 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-8945976d-1f1e-4278-81ed-a0cf1a0d0850 tempest-SnapshotsActionsTest-1507444151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b6fe5ce0-11b7-4bbc-8573-9a098af7add5.2e13acce-6d37-4365-8cc0-4f1c9390cf03 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:46:47 devstack sudo[96807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b6fe5ce0-11b7-4bbc-8573-9a098af7add5.2e13acce-6d37-4365-8cc0-4f1c9390cf03 Sep 22 15:46:47 devstack sudo[96807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:46:47 devstack sudo[96802]: pam_unix(sudo:session): session closed for user root Sep 22 15:46:47 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-97c31bdf-6729-4b98-80a6-3ecb749049c5 tempest-VolumesSnapshotTestJSON-1852940089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2c475acc-bd33-49e6-a138-3b7cf95f5ee3 -F qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2c475acc-bd33-49e6-a138-3b7cf95f5ee3.e1251a27-cb58-484c-be19-45ff7679949d" returned: 0 in 0.324s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:46:47 devstack cinder-volume[86212]: WARNING cinder.volume.drivers.remotefs [None req-97c31bdf-6729-4b98-80a6-3ecb749049c5 tempest-VolumesSnapshotTestJSON-1852940089 None] /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2c475acc-bd33-49e6-a138-3b7cf95f5ee3.e1251a27-cb58-484c-be19-45ff7679949d is being set with open permissions: ugo+rw Sep 22 15:46:47 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-97c31bdf-6729-4b98-80a6-3ecb749049c5 tempest-VolumesSnapshotTestJSON-1852940089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2c475acc-bd33-49e6-a138-3b7cf95f5ee3.e1251a27-cb58-484c-be19-45ff7679949d {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:46:47 devstack sudo[96813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2c475acc-bd33-49e6-a138-3b7cf95f5ee3.e1251a27-cb58-484c-be19-45ff7679949d Sep 22 15:46:47 devstack sudo[96813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:46:47 devstack sudo[96813]: pam_unix(sudo:session): session closed for user root Sep 22 15:46:47 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-97c31bdf-6729-4b98-80a6-3ecb749049c5 tempest-VolumesSnapshotTestJSON-1852940089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2c475acc-bd33-49e6-a138-3b7cf95f5ee3.e1251a27-cb58-484c-be19-45ff7679949d" returned: 0 in 0.271s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:46:47 devstack sudo[96807]: pam_unix(sudo:session): session closed for user root Sep 22 15:46:47 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-8945976d-1f1e-4278-81ed-a0cf1a0d0850 tempest-SnapshotsActionsTest-1507444151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b6fe5ce0-11b7-4bbc-8573-9a098af7add5.2e13acce-6d37-4365-8cc0-4f1c9390cf03" returned: 0 in 0.437s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:46:47 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-8945976d-1f1e-4278-81ed-a0cf1a0d0850 tempest-SnapshotsActionsTest-1507444151 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b6fe5ce0-11b7-4bbc-8573-9a098af7add5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86212) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 22 15:46:47 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-8945976d-1f1e-4278-81ed-a0cf1a0d0850 tempest-SnapshotsActionsTest-1507444151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b6fe5ce0-11b7-4bbc-8573-9a098af7add5.289e10f8-3e66-421e-a08e-a1e7232c78ca {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:46:47 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-97c31bdf-6729-4b98-80a6-3ecb749049c5 tempest-VolumesSnapshotTestJSON-1852940089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2c475acc-bd33-49e6-a138-3b7cf95f5ee3.info {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:46:47 devstack sudo[96822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b6fe5ce0-11b7-4bbc-8573-9a098af7add5.289e10f8-3e66-421e-a08e-a1e7232c78ca Sep 22 15:46:47 devstack sudo[96822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:46:47 devstack sudo[96824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2c475acc-bd33-49e6-a138-3b7cf95f5ee3.info Sep 22 15:46:47 devstack sudo[96824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:46:48 devstack sudo[96824]: pam_unix(sudo:session): session closed for user root Sep 22 15:46:48 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-97c31bdf-6729-4b98-80a6-3ecb749049c5 tempest-VolumesSnapshotTestJSON-1852940089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2c475acc-bd33-49e6-a138-3b7cf95f5ee3.info" returned: 0 in 0.290s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:46:48 devstack cinder-volume[86212]: WARNING cinder.volume.drivers.remotefs [None req-97c31bdf-6729-4b98-80a6-3ecb749049c5 tempest-VolumesSnapshotTestJSON-1852940089 None] /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2c475acc-bd33-49e6-a138-3b7cf95f5ee3.info is being set with open permissions: ugo+rw Sep 22 15:46:48 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-97c31bdf-6729-4b98-80a6-3ecb749049c5 tempest-VolumesSnapshotTestJSON-1852940089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2c475acc-bd33-49e6-a138-3b7cf95f5ee3.info {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:46:48 devstack sudo[96831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2c475acc-bd33-49e6-a138-3b7cf95f5ee3.info Sep 22 15:46:48 devstack sudo[96831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:46:48 devstack sudo[96822]: pam_unix(sudo:session): session closed for user root Sep 22 15:46:48 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-8945976d-1f1e-4278-81ed-a0cf1a0d0850 tempest-SnapshotsActionsTest-1507444151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b6fe5ce0-11b7-4bbc-8573-9a098af7add5.289e10f8-3e66-421e-a08e-a1e7232c78ca" returned: 0 in 0.445s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:46:48 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-8945976d-1f1e-4278-81ed-a0cf1a0d0850 tempest-SnapshotsActionsTest-1507444151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b6fe5ce0-11b7-4bbc-8573-9a098af7add5.289e10f8-3e66-421e-a08e-a1e7232c78ca {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:46:48 devstack sudo[96833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b6fe5ce0-11b7-4bbc-8573-9a098af7add5.289e10f8-3e66-421e-a08e-a1e7232c78ca Sep 22 15:46:48 devstack sudo[96833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:46:48 devstack sudo[96831]: pam_unix(sudo:session): session closed for user root Sep 22 15:46:48 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-97c31bdf-6729-4b98-80a6-3ecb749049c5 tempest-VolumesSnapshotTestJSON-1852940089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2c475acc-bd33-49e6-a138-3b7cf95f5ee3.info" returned: 0 in 0.291s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:46:48 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-97c31bdf-6729-4b98-80a6-3ecb749049c5 tempest-VolumesSnapshotTestJSON-1852940089 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.501s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:46:48 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-c6051764-6f55-45a0-bfbe-eb5d5b9e4b04 tempest-GroupSnapshotsV319Test-1640878424 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.376s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:46:48 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-c6051764-6f55-45a0-bfbe-eb5d5b9e4b04 tempest-GroupSnapshotsV319Test-1640878424 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=ce34ce2b-eeaf-4d05-bf45-8091944d0757,created_at=2026-09-22T13:46:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1200658041',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ce34ce2b-eeaf-4d05-bf45-8091944d0757,host='devstack@QuobyteHD#QuobyteHD',id=b435c79c-262e-41d2-b6af-53406b1c939b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3bafe7c692e477e96196b82f1878758',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:46:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:46:47Z,use_quota=True,user_id='27be69c82960423eb443895866956222',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f9870f5f-37e2-4929-8f0b-7df4f53e7ffa),volume_type_id=f9870f5f-37e2-4929-8f0b-7df4f53e7ffa)}" {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 15:46:48 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-c6051764-6f55-45a0-bfbe-eb5d5b9e4b04 tempest-GroupSnapshotsV319Test-1640878424 None] Creating volume b435c79c-262e-41d2-b6af-53406b1c939b {{(pid=86212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 15:46:48 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-c6051764-6f55-45a0-bfbe-eb5d5b9e4b04 tempest-GroupSnapshotsV319Test-1640878424 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:46:48 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-c6051764-6f55-45a0-bfbe-eb5d5b9e4b04 tempest-GroupSnapshotsV319Test-1640878424 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:46:48 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-c6051764-6f55-45a0-bfbe-eb5d5b9e4b04 tempest-GroupSnapshotsV319Test-1640878424 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:46:48 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-c6051764-6f55-45a0-bfbe-eb5d5b9e4b04 tempest-GroupSnapshotsV319Test-1640878424 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:46:48 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-c6051764-6f55-45a0-bfbe-eb5d5b9e4b04 tempest-GroupSnapshotsV319Test-1640878424 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:46:48 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-c6051764-6f55-45a0-bfbe-eb5d5b9e4b04 tempest-GroupSnapshotsV319Test-1640878424 None] Selected osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 as target Quobyte volume. {{(pid=86212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 15:46:48 devstack cinder-volume[86212]: INFO cinder.volume.drivers.remotefs [None req-c6051764-6f55-45a0-bfbe-eb5d5b9e4b04 tempest-GroupSnapshotsV319Test-1640878424 None] casted to osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 Sep 22 15:46:48 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-c6051764-6f55-45a0-bfbe-eb5d5b9e4b04 tempest-GroupSnapshotsV319Test-1640878424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b435c79c-262e-41d2-b6af-53406b1c939b 1073741824 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:46:48 devstack sudo[96836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b435c79c-262e-41d2-b6af-53406b1c939b 1073741824 Sep 22 15:46:48 devstack sudo[96836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:46:48 devstack sudo[96833]: pam_unix(sudo:session): session closed for user root Sep 22 15:46:48 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-8945976d-1f1e-4278-81ed-a0cf1a0d0850 tempest-SnapshotsActionsTest-1507444151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b6fe5ce0-11b7-4bbc-8573-9a098af7add5.289e10f8-3e66-421e-a08e-a1e7232c78ca" returned: 0 in 0.284s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:46:48 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-97c31bdf-6729-4b98-80a6-3ecb749049c5 tempest-VolumesSnapshotTestJSON-1852940089 None] Create snapshot completed successfully Sep 22 15:46:48 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-8945976d-1f1e-4278-81ed-a0cf1a0d0850 tempest-SnapshotsActionsTest-1507444151 None] Lock "cinder-quobyte-289e10f8-3e66-421e-a08e-a1e7232c78ca" released by "_delete_snapshot" :: held 1.804s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:46:48 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-8945976d-1f1e-4278-81ed-a0cf1a0d0850 tempest-SnapshotsActionsTest-1507444151 None] Lock "cinder-quobyte-b6fe5ce0-11b7-4bbc-8573-9a098af7add5" released by "delete_snapshot" :: held 1.847s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:46:48 devstack cinder-volume[86212]: DEBUG cinder.quota [None req-8945976d-1f1e-4278-81ed-a0cf1a0d0850 tempest-SnapshotsActionsTest-1507444151 None] Created reservations ['704f41b6-9d0f-4b52-9822-b62bfa275ac7', '13beed67-5506-40ef-93b1-bad252862277', '5c5b68bd-0596-48df-b20e-4c7364bedb8a', 'dc7e0734-621c-4813-a016-d29b69971bd9'] {{(pid=86212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 15:46:48 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-8945976d-1f1e-4278-81ed-a0cf1a0d0850 tempest-SnapshotsActionsTest-1507444151 None] Delete snapshot completed successfully. Sep 22 15:46:48 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-8945976d-1f1e-4278-81ed-a0cf1a0d0850 tempest-SnapshotsActionsTest-1507444151 None] Lock "cinder-289e10f8-3e66-421e-a08e-a1e7232c78ca-delete_snapshot" released by "delete_snapshot" :: held 2.030s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:46:49 devstack sudo[96836]: pam_unix(sudo:session): session closed for user root Sep 22 15:46:49 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-c6051764-6f55-45a0-bfbe-eb5d5b9e4b04 tempest-GroupSnapshotsV319Test-1640878424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b435c79c-262e-41d2-b6af-53406b1c939b 1073741824" returned: 0 in 0.637s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:46:49 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-c6051764-6f55-45a0-bfbe-eb5d5b9e4b04 tempest-GroupSnapshotsV319Test-1640878424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b435c79c-262e-41d2-b6af-53406b1c939b {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:46:49 devstack sudo[96843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b435c79c-262e-41d2-b6af-53406b1c939b Sep 22 15:46:49 devstack sudo[96843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:46:49 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-f03df893-fbab-44d5-90df-881c845433b9 tempest-VolumesSnapshotTestJSON-1852940089 None] Acquiring lock "cinder-e1251a27-cb58-484c-be19-45ff7679949d-delete_snapshot" by "delete_snapshot" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:46:49 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-5762df8a-a26d-4fae-9e2f-e849cb189a63 tempest-SnapshotsActionsTest-743576267 None] Acquiring lock "cinder-2e13acce-6d37-4365-8cc0-4f1c9390cf03-delete_snapshot" by "delete_snapshot" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:46:49 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-5762df8a-a26d-4fae-9e2f-e849cb189a63 tempest-SnapshotsActionsTest-743576267 None] Lock "cinder-2e13acce-6d37-4365-8cc0-4f1c9390cf03-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:46:49 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-5762df8a-a26d-4fae-9e2f-e849cb189a63 tempest-SnapshotsActionsTest-743576267 None] Acquiring lock "cinder-quobyte-b6fe5ce0-11b7-4bbc-8573-9a098af7add5" by "delete_snapshot" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:46:49 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-f03df893-fbab-44d5-90df-881c845433b9 tempest-VolumesSnapshotTestJSON-1852940089 None] Lock "cinder-e1251a27-cb58-484c-be19-45ff7679949d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.062s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:46:49 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-5762df8a-a26d-4fae-9e2f-e849cb189a63 tempest-SnapshotsActionsTest-743576267 None] Lock "cinder-quobyte-b6fe5ce0-11b7-4bbc-8573-9a098af7add5" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:46:49 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-5762df8a-a26d-4fae-9e2f-e849cb189a63 tempest-SnapshotsActionsTest-743576267 None] Acquiring lock "cinder-quobyte-2e13acce-6d37-4365-8cc0-4f1c9390cf03" by "_delete_snapshot" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:46:49 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-5762df8a-a26d-4fae-9e2f-e849cb189a63 tempest-SnapshotsActionsTest-743576267 None] Lock "cinder-quobyte-2e13acce-6d37-4365-8cc0-4f1c9390cf03" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:46:49 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-5762df8a-a26d-4fae-9e2f-e849cb189a63 tempest-SnapshotsActionsTest-743576267 None] Deleting offline snapshot 2e13acce-6d37-4365-8cc0-4f1c9390cf03 of volume b6fe5ce0-11b7-4bbc-8573-9a098af7add5 {{(pid=86212) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 22 15:46:49 devstack sudo[96843]: pam_unix(sudo:session): session closed for user root Sep 22 15:46:49 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-5762df8a-a26d-4fae-9e2f-e849cb189a63 tempest-SnapshotsActionsTest-743576267 None] snapshot_file for this snap is: volume-b6fe5ce0-11b7-4bbc-8573-9a098af7add5.2e13acce-6d37-4365-8cc0-4f1c9390cf03 {{(pid=86212) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 22 15:46:49 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-c6051764-6f55-45a0-bfbe-eb5d5b9e4b04 tempest-GroupSnapshotsV319Test-1640878424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b435c79c-262e-41d2-b6af-53406b1c939b" returned: 0 in 0.401s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:46:49 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-c6051764-6f55-45a0-bfbe-eb5d5b9e4b04 tempest-GroupSnapshotsV319Test-1640878424 None] <== create_volume: return (1100ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'} {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 15:46:49 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-c6051764-6f55-45a0-bfbe-eb5d5b9e4b04 tempest-GroupSnapshotsV319Test-1640878424 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.104s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:46:49 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc2bdb81-aafd-4285-b9a9-c57719079f19]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:46:49 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-5762df8a-a26d-4fae-9e2f-e849cb189a63 tempest-SnapshotsActionsTest-743576267 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b6fe5ce0-11b7-4bbc-8573-9a098af7add5.2e13acce-6d37-4365-8cc0-4f1c9390cf03 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:46:49 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-f03df893-fbab-44d5-90df-881c845433b9 tempest-VolumesSnapshotTestJSON-1852940089 None] Acquiring lock "cinder-quobyte-2c475acc-bd33-49e6-a138-3b7cf95f5ee3" by "delete_snapshot" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:46:49 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-c6051764-6f55-45a0-bfbe-eb5d5b9e4b04 tempest-GroupSnapshotsV319Test-1640878424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed7a4965-b717-4de2-9f82-626ba86563a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b435c79c-262e-41d2-b6af-53406b1c939b', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:46:49 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-c6051764-6f55-45a0-bfbe-eb5d5b9e4b04 tempest-GroupSnapshotsV319Test-1640878424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d4f9bba-d00a-45b8-9479-a8f193c6fee8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:46:49 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-f03df893-fbab-44d5-90df-881c845433b9 tempest-VolumesSnapshotTestJSON-1852940089 None] Lock "cinder-quobyte-2c475acc-bd33-49e6-a138-3b7cf95f5ee3" acquired by "delete_snapshot" :: waited 0.044s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:46:49 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-f03df893-fbab-44d5-90df-881c845433b9 tempest-VolumesSnapshotTestJSON-1852940089 None] Acquiring lock "cinder-quobyte-e1251a27-cb58-484c-be19-45ff7679949d" by "_delete_snapshot" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:46:49 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-c6051764-6f55-45a0-bfbe-eb5d5b9e4b04 tempest-GroupSnapshotsV319Test-1640878424 None] Volume volume-b435c79c-262e-41d2-b6af-53406b1c939b (b435c79c-262e-41d2-b6af-53406b1c939b): created successfully Sep 22 15:46:49 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-c6051764-6f55-45a0-bfbe-eb5d5b9e4b04 tempest-GroupSnapshotsV319Test-1640878424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d4f9bba-d00a-45b8-9479-a8f193c6fee8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:46:49 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-c6051764-6f55-45a0-bfbe-eb5d5b9e4b04 tempest-GroupSnapshotsV319Test-1640878424 None] Flow 'volume_create_manager' (9cddb331-1157-4981-ac4e-01a21604352e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:46:49 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-f03df893-fbab-44d5-90df-881c845433b9 tempest-VolumesSnapshotTestJSON-1852940089 None] Lock "cinder-quobyte-e1251a27-cb58-484c-be19-45ff7679949d" acquired by "_delete_snapshot" :: waited 0.036s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:46:49 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-f03df893-fbab-44d5-90df-881c845433b9 tempest-VolumesSnapshotTestJSON-1852940089 None] Deleting offline snapshot e1251a27-cb58-484c-be19-45ff7679949d of volume 2c475acc-bd33-49e6-a138-3b7cf95f5ee3 {{(pid=86212) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 22 15:46:49 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-f03df893-fbab-44d5-90df-881c845433b9 tempest-VolumesSnapshotTestJSON-1852940089 None] snapshot_file for this snap is: volume-2c475acc-bd33-49e6-a138-3b7cf95f5ee3.e1251a27-cb58-484c-be19-45ff7679949d {{(pid=86212) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 22 15:46:49 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-c6051764-6f55-45a0-bfbe-eb5d5b9e4b04 tempest-GroupSnapshotsV319Test-1640878424 None] Created volume successfully. Sep 22 15:46:49 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e2fe25c-0f1f-4837-978c-dec7522aeb30]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:46:49 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-f03df893-fbab-44d5-90df-881c845433b9 tempest-VolumesSnapshotTestJSON-1852940089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2c475acc-bd33-49e6-a138-3b7cf95f5ee3.e1251a27-cb58-484c-be19-45ff7679949d {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:46:49 devstack sudo[96846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b6fe5ce0-11b7-4bbc-8573-9a098af7add5.2e13acce-6d37-4365-8cc0-4f1c9390cf03 Sep 22 15:46:49 devstack sudo[96846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:46:49 devstack sudo[96847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2c475acc-bd33-49e6-a138-3b7cf95f5ee3.e1251a27-cb58-484c-be19-45ff7679949d Sep 22 15:46:49 devstack sudo[96847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:46:50 devstack sudo[96846]: pam_unix(sudo:session): session closed for user root Sep 22 15:46:50 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-5762df8a-a26d-4fae-9e2f-e849cb189a63 tempest-SnapshotsActionsTest-743576267 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b6fe5ce0-11b7-4bbc-8573-9a098af7add5.2e13acce-6d37-4365-8cc0-4f1c9390cf03" returned: 0 in 0.466s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:46:50 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-5762df8a-a26d-4fae-9e2f-e849cb189a63 tempest-SnapshotsActionsTest-743576267 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b6fe5ce0-11b7-4bbc-8573-9a098af7add5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86212) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 22 15:46:50 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cd1f75c-c33f-4e4f-9791-2c58823f723b]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:46:50 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-5762df8a-a26d-4fae-9e2f-e849cb189a63 tempest-SnapshotsActionsTest-743576267 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b6fe5ce0-11b7-4bbc-8573-9a098af7add5 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:46:50 devstack sudo[96847]: pam_unix(sudo:session): session closed for user root Sep 22 15:46:50 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-f03df893-fbab-44d5-90df-881c845433b9 tempest-VolumesSnapshotTestJSON-1852940089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2c475acc-bd33-49e6-a138-3b7cf95f5ee3.e1251a27-cb58-484c-be19-45ff7679949d" returned: 0 in 0.415s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:46:50 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-f03df893-fbab-44d5-90df-881c845433b9 tempest-VolumesSnapshotTestJSON-1852940089 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2c475acc-bd33-49e6-a138-3b7cf95f5ee3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86212) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 22 15:46:50 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3bbde52-144f-4c83-b1b7-8de005a77a61]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:46:50 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-f03df893-fbab-44d5-90df-881c845433b9 tempest-VolumesSnapshotTestJSON-1852940089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2c475acc-bd33-49e6-a138-3b7cf95f5ee3 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:46:50 devstack sudo[96856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b6fe5ce0-11b7-4bbc-8573-9a098af7add5 Sep 22 15:46:50 devstack sudo[96856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:46:50 devstack sudo[96857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2c475acc-bd33-49e6-a138-3b7cf95f5ee3 Sep 22 15:46:50 devstack sudo[96857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:46:50 devstack sudo[96856]: pam_unix(sudo:session): session closed for user root Sep 22 15:46:50 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-5762df8a-a26d-4fae-9e2f-e849cb189a63 tempest-SnapshotsActionsTest-743576267 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b6fe5ce0-11b7-4bbc-8573-9a098af7add5" returned: 0 in 0.461s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:46:50 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-5762df8a-a26d-4fae-9e2f-e849cb189a63 tempest-SnapshotsActionsTest-743576267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b6fe5ce0-11b7-4bbc-8573-9a098af7add5.2e13acce-6d37-4365-8cc0-4f1c9390cf03 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:46:50 devstack sudo[96864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b6fe5ce0-11b7-4bbc-8573-9a098af7add5.2e13acce-6d37-4365-8cc0-4f1c9390cf03 Sep 22 15:46:50 devstack sudo[96864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:46:50 devstack sudo[96857]: pam_unix(sudo:session): session closed for user root Sep 22 15:46:50 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-f03df893-fbab-44d5-90df-881c845433b9 tempest-VolumesSnapshotTestJSON-1852940089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2c475acc-bd33-49e6-a138-3b7cf95f5ee3" returned: 0 in 0.521s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:46:50 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-f03df893-fbab-44d5-90df-881c845433b9 tempest-VolumesSnapshotTestJSON-1852940089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2c475acc-bd33-49e6-a138-3b7cf95f5ee3.e1251a27-cb58-484c-be19-45ff7679949d {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:46:50 devstack sudo[96869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2c475acc-bd33-49e6-a138-3b7cf95f5ee3.e1251a27-cb58-484c-be19-45ff7679949d Sep 22 15:46:50 devstack sudo[96869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:46:50 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-860e8302-7a1c-470c-b5c1-19317f7d5d21 tempest-GroupSnapshotsV319Test-1640878424 None] GroupSnapshot 3c719bdc-5f1b-48d8-9956-45317e8f125e: creating. Sep 22 15:46:50 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-860e8302-7a1c-470c-b5c1-19317f7d5d21 tempest-GroupSnapshotsV319Test-1640878424 None] Group snapshot 3c719bdc-5f1b-48d8-9956-45317e8f125e: creating. {{(pid=86212) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 22 15:46:50 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-860e8302-7a1c-470c-b5c1-19317f7d5d21 tempest-GroupSnapshotsV319Test-1640878424 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:46:50 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-860e8302-7a1c-470c-b5c1-19317f7d5d21 tempest-GroupSnapshotsV319Test-1640878424 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:46:50 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-860e8302-7a1c-470c-b5c1-19317f7d5d21 tempest-GroupSnapshotsV319Test-1640878424 None] Creating offline snapshot eb560784-dd0c-4e06-8b8f-2c2a36b57dd7 of volume b435c79c-262e-41d2-b6af-53406b1c939b {{(pid=86212) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 22 15:46:50 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a7f5cd8-301f-4787-be58-b572b959bb6c]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:46:50 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-860e8302-7a1c-470c-b5c1-19317f7d5d21 tempest-GroupSnapshotsV319Test-1640878424 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b435c79c-262e-41d2-b6af-53406b1c939b {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:46:51 devstack sudo[96864]: pam_unix(sudo:session): session closed for user root Sep 22 15:46:51 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-5762df8a-a26d-4fae-9e2f-e849cb189a63 tempest-SnapshotsActionsTest-743576267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b6fe5ce0-11b7-4bbc-8573-9a098af7add5.2e13acce-6d37-4365-8cc0-4f1c9390cf03" returned: 0 in 0.511s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:46:51 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-5762df8a-a26d-4fae-9e2f-e849cb189a63 tempest-SnapshotsActionsTest-743576267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b6fe5ce0-11b7-4bbc-8573-9a098af7add5.2e13acce-6d37-4365-8cc0-4f1c9390cf03 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:46:51 devstack sudo[96879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b6fe5ce0-11b7-4bbc-8573-9a098af7add5.2e13acce-6d37-4365-8cc0-4f1c9390cf03 Sep 22 15:46:51 devstack sudo[96879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:46:51 devstack sudo[96877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b435c79c-262e-41d2-b6af-53406b1c939b Sep 22 15:46:51 devstack sudo[96877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:46:51 devstack sudo[96869]: pam_unix(sudo:session): session closed for user root Sep 22 15:46:51 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-f03df893-fbab-44d5-90df-881c845433b9 tempest-VolumesSnapshotTestJSON-1852940089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2c475acc-bd33-49e6-a138-3b7cf95f5ee3.e1251a27-cb58-484c-be19-45ff7679949d" returned: 0 in 0.481s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:46:51 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-f03df893-fbab-44d5-90df-881c845433b9 tempest-VolumesSnapshotTestJSON-1852940089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2c475acc-bd33-49e6-a138-3b7cf95f5ee3.e1251a27-cb58-484c-be19-45ff7679949d {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:46:51 devstack sudo[96883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2c475acc-bd33-49e6-a138-3b7cf95f5ee3.e1251a27-cb58-484c-be19-45ff7679949d Sep 22 15:46:51 devstack sudo[96883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:46:51 devstack sudo[96879]: pam_unix(sudo:session): session closed for user root Sep 22 15:46:51 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-5762df8a-a26d-4fae-9e2f-e849cb189a63 tempest-SnapshotsActionsTest-743576267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b6fe5ce0-11b7-4bbc-8573-9a098af7add5.2e13acce-6d37-4365-8cc0-4f1c9390cf03" returned: 0 in 0.354s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:46:51 devstack sudo[96877]: pam_unix(sudo:session): session closed for user root Sep 22 15:46:51 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-860e8302-7a1c-470c-b5c1-19317f7d5d21 tempest-GroupSnapshotsV319Test-1640878424 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b435c79c-262e-41d2-b6af-53406b1c939b" returned: 0 in 0.440s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:46:51 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-860e8302-7a1c-470c-b5c1-19317f7d5d21 tempest-GroupSnapshotsV319Test-1640878424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b435c79c-262e-41d2-b6af-53406b1c939b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b435c79c-262e-41d2-b6af-53406b1c939b.eb560784-dd0c-4e06-8b8f-2c2a36b57dd7 1G {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:46:51 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-5762df8a-a26d-4fae-9e2f-e849cb189a63 tempest-SnapshotsActionsTest-743576267 None] Lock "cinder-quobyte-2e13acce-6d37-4365-8cc0-4f1c9390cf03" released by "_delete_snapshot" :: held 1.946s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:46:51 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-5762df8a-a26d-4fae-9e2f-e849cb189a63 tempest-SnapshotsActionsTest-743576267 None] Lock "cinder-quobyte-b6fe5ce0-11b7-4bbc-8573-9a098af7add5" released by "delete_snapshot" :: held 1.981s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:46:51 devstack sudo[96894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b435c79c-262e-41d2-b6af-53406b1c939b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b435c79c-262e-41d2-b6af-53406b1c939b.eb560784-dd0c-4e06-8b8f-2c2a36b57dd7 1G Sep 22 15:46:51 devstack sudo[96894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:46:51 devstack sudo[96883]: pam_unix(sudo:session): session closed for user root Sep 22 15:46:51 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-f03df893-fbab-44d5-90df-881c845433b9 tempest-VolumesSnapshotTestJSON-1852940089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2c475acc-bd33-49e6-a138-3b7cf95f5ee3.e1251a27-cb58-484c-be19-45ff7679949d" returned: 0 in 0.383s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:46:51 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-f03df893-fbab-44d5-90df-881c845433b9 tempest-VolumesSnapshotTestJSON-1852940089 None] Lock "cinder-quobyte-e1251a27-cb58-484c-be19-45ff7679949d" released by "_delete_snapshot" :: held 1.953s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:46:51 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-f03df893-fbab-44d5-90df-881c845433b9 tempest-VolumesSnapshotTestJSON-1852940089 None] Lock "cinder-quobyte-2c475acc-bd33-49e6-a138-3b7cf95f5ee3" released by "delete_snapshot" :: held 2.005s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:46:51 devstack cinder-volume[86212]: DEBUG cinder.quota [None req-5762df8a-a26d-4fae-9e2f-e849cb189a63 tempest-SnapshotsActionsTest-743576267 None] Created reservations ['0b6f2e75-60e2-4dee-89fe-620c97314ea0', 'f3d4a63f-2e18-4f2a-8f54-b28d30b1fe37', '359c9254-d46e-47f4-a9d7-d8af37d91838', '356dc233-cd13-462b-9532-243972db0e0b'] {{(pid=86212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 15:46:51 devstack cinder-volume[86212]: DEBUG cinder.quota [None req-f03df893-fbab-44d5-90df-881c845433b9 tempest-VolumesSnapshotTestJSON-1852940089 None] Created reservations ['db6c84a4-1a90-49ba-8ac8-04026654bddf', '603fd00f-c189-48db-8baa-25f8d4346a65', '6167a74d-0ed4-4032-8bdf-003e3949455d', '81cdbe09-1a85-4f33-9a48-7462bd8e3ed6'] {{(pid=86212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 15:46:51 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-5762df8a-a26d-4fae-9e2f-e849cb189a63 tempest-SnapshotsActionsTest-743576267 None] Delete snapshot completed successfully. Sep 22 15:46:51 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-5762df8a-a26d-4fae-9e2f-e849cb189a63 tempest-SnapshotsActionsTest-743576267 None] Lock "cinder-2e13acce-6d37-4365-8cc0-4f1c9390cf03-delete_snapshot" released by "delete_snapshot" :: held 2.333s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:46:51 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-f03df893-fbab-44d5-90df-881c845433b9 tempest-VolumesSnapshotTestJSON-1852940089 None] Delete snapshot completed successfully. Sep 22 15:46:51 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-f03df893-fbab-44d5-90df-881c845433b9 tempest-VolumesSnapshotTestJSON-1852940089 None] Lock "cinder-e1251a27-cb58-484c-be19-45ff7679949d-delete_snapshot" released by "delete_snapshot" :: held 2.366s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:46:51 devstack sudo[96894]: pam_unix(sudo:session): session closed for user root Sep 22 15:46:51 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-860e8302-7a1c-470c-b5c1-19317f7d5d21 tempest-GroupSnapshotsV319Test-1640878424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b435c79c-262e-41d2-b6af-53406b1c939b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b435c79c-262e-41d2-b6af-53406b1c939b.eb560784-dd0c-4e06-8b8f-2c2a36b57dd7 1G" returned: 0 in 0.505s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:46:51 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-860e8302-7a1c-470c-b5c1-19317f7d5d21 tempest-GroupSnapshotsV319Test-1640878424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b435c79c-262e-41d2-b6af-53406b1c939b -F qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b435c79c-262e-41d2-b6af-53406b1c939b.eb560784-dd0c-4e06-8b8f-2c2a36b57dd7 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:46:51 devstack sudo[96901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b435c79c-262e-41d2-b6af-53406b1c939b -F qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b435c79c-262e-41d2-b6af-53406b1c939b.eb560784-dd0c-4e06-8b8f-2c2a36b57dd7 Sep 22 15:46:51 devstack sudo[96901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:46:52 devstack sudo[96901]: pam_unix(sudo:session): session closed for user root Sep 22 15:46:52 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-860e8302-7a1c-470c-b5c1-19317f7d5d21 tempest-GroupSnapshotsV319Test-1640878424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b435c79c-262e-41d2-b6af-53406b1c939b -F qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b435c79c-262e-41d2-b6af-53406b1c939b.eb560784-dd0c-4e06-8b8f-2c2a36b57dd7" returned: 0 in 0.304s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:46:52 devstack cinder-volume[86212]: WARNING cinder.volume.drivers.remotefs [None req-860e8302-7a1c-470c-b5c1-19317f7d5d21 tempest-GroupSnapshotsV319Test-1640878424 None] /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b435c79c-262e-41d2-b6af-53406b1c939b.eb560784-dd0c-4e06-8b8f-2c2a36b57dd7 is being set with open permissions: ugo+rw: NotImplementedError Sep 22 15:46:52 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-860e8302-7a1c-470c-b5c1-19317f7d5d21 tempest-GroupSnapshotsV319Test-1640878424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b435c79c-262e-41d2-b6af-53406b1c939b.eb560784-dd0c-4e06-8b8f-2c2a36b57dd7 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:46:52 devstack sudo[96906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b435c79c-262e-41d2-b6af-53406b1c939b.eb560784-dd0c-4e06-8b8f-2c2a36b57dd7 Sep 22 15:46:52 devstack sudo[96906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:46:52 devstack sudo[96906]: pam_unix(sudo:session): session closed for user root Sep 22 15:46:52 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-860e8302-7a1c-470c-b5c1-19317f7d5d21 tempest-GroupSnapshotsV319Test-1640878424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b435c79c-262e-41d2-b6af-53406b1c939b.eb560784-dd0c-4e06-8b8f-2c2a36b57dd7" returned: 0 in 0.278s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:46:52 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-860e8302-7a1c-470c-b5c1-19317f7d5d21 tempest-GroupSnapshotsV319Test-1640878424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b435c79c-262e-41d2-b6af-53406b1c939b.info {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:46:52 devstack sudo[96909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b435c79c-262e-41d2-b6af-53406b1c939b.info Sep 22 15:46:52 devstack sudo[96909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:46:52 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-865ea660-b096-4103-a0e5-626e778686db tempest-SnapshotsActionsTest-743576267 None] Acquiring lock "cinder-b6fe5ce0-11b7-4bbc-8573-9a098af7add5-delete_volume" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:46:52 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-865ea660-b096-4103-a0e5-626e778686db tempest-SnapshotsActionsTest-743576267 None] Lock "cinder-b6fe5ce0-11b7-4bbc-8573-9a098af7add5-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:46:52 devstack sudo[96909]: pam_unix(sudo:session): session closed for user root Sep 22 15:46:52 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-860e8302-7a1c-470c-b5c1-19317f7d5d21 tempest-GroupSnapshotsV319Test-1640878424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b435c79c-262e-41d2-b6af-53406b1c939b.info" returned: 0 in 0.329s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:46:52 devstack cinder-volume[86212]: WARNING cinder.volume.drivers.remotefs [None req-860e8302-7a1c-470c-b5c1-19317f7d5d21 tempest-GroupSnapshotsV319Test-1640878424 None] /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b435c79c-262e-41d2-b6af-53406b1c939b.info is being set with open permissions: ugo+rw: NotImplementedError Sep 22 15:46:52 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-860e8302-7a1c-470c-b5c1-19317f7d5d21 tempest-GroupSnapshotsV319Test-1640878424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b435c79c-262e-41d2-b6af-53406b1c939b.info {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:46:52 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-865ea660-b096-4103-a0e5-626e778686db tempest-SnapshotsActionsTest-743576267 None] Acquiring lock "cinder-quobyte-b6fe5ce0-11b7-4bbc-8573-9a098af7add5" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:46:52 devstack sudo[96912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b435c79c-262e-41d2-b6af-53406b1c939b.info Sep 22 15:46:52 devstack sudo[96912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:46:52 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-865ea660-b096-4103-a0e5-626e778686db tempest-SnapshotsActionsTest-743576267 None] Lock "cinder-quobyte-b6fe5ce0-11b7-4bbc-8573-9a098af7add5" acquired by "delete_volume" :: waited 0.019s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:46:52 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[62b97fdc-f9e4-49d6-b7bd-0e5185030ba1]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:46:52 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-865ea660-b096-4103-a0e5-626e778686db tempest-SnapshotsActionsTest-743576267 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b6fe5ce0-11b7-4bbc-8573-9a098af7add5 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:46:53 devstack sudo[96914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b6fe5ce0-11b7-4bbc-8573-9a098af7add5 Sep 22 15:46:53 devstack sudo[96914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:46:53 devstack sudo[96912]: pam_unix(sudo:session): session closed for user root Sep 22 15:46:53 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-860e8302-7a1c-470c-b5c1-19317f7d5d21 tempest-GroupSnapshotsV319Test-1640878424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b435c79c-262e-41d2-b6af-53406b1c939b.info" returned: 0 in 0.398s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:46:53 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-860e8302-7a1c-470c-b5c1-19317f7d5d21 tempest-GroupSnapshotsV319Test-1640878424 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.370s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:46:53 devstack cinder-volume[86212]: DEBUG cinder.volume.flows.manager.create_volume [None req-c7c53243-0be9-44c3-bdd5-e19c343c0cd5 tempest-VolumesSnapshotTestJSON-1852940089 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 15:46:53 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-c7c53243-0be9-44c3-bdd5-e19c343c0cd5 tempest-VolumesSnapshotTestJSON-1852940089 None] Flow 'volume_create_manager' (03aed23f-ebc3-4e49-a46a-918ea3d7692f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:46:53 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-c7c53243-0be9-44c3-bdd5-e19c343c0cd5 tempest-VolumesSnapshotTestJSON-1852940089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (813ea12f-597a-4333-bdd0-e317a22226a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:46:53 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-860e8302-7a1c-470c-b5c1-19317f7d5d21 tempest-GroupSnapshotsV319Test-1640878424 None] group_snapshot 3c719bdc-5f1b-48d8-9956-45317e8f125e: created successfully Sep 22 15:46:53 devstack sudo[96914]: pam_unix(sudo:session): session closed for user root Sep 22 15:46:53 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-c7c53243-0be9-44c3-bdd5-e19c343c0cd5 tempest-VolumesSnapshotTestJSON-1852940089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (813ea12f-597a-4333-bdd0-e317a22226a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:46:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-415514403',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4fe80f5-0207-439e-ae69-5e96be043b59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6705e2e1e5874f378f80abd1ee561d94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:46:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:46:53Z,use_quota=True,user_id='92fadb836e974dcb9aae676729372d23',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:46:53 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-c7c53243-0be9-44c3-bdd5-e19c343c0cd5 tempest-VolumesSnapshotTestJSON-1852940089 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0617a96-9d3b-4311-9eac-32787bef3668) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:46:53 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-c7c53243-0be9-44c3-bdd5-e19c343c0cd5 tempest-VolumesSnapshotTestJSON-1852940089 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0617a96-9d3b-4311-9eac-32787bef3668) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:46:53 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-c7c53243-0be9-44c3-bdd5-e19c343c0cd5 tempest-VolumesSnapshotTestJSON-1852940089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d20f8b72-4b3c-4028-ba7a-db853e1ab9e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:46:53 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-c7c53243-0be9-44c3-bdd5-e19c343c0cd5 tempest-VolumesSnapshotTestJSON-1852940089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d20f8b72-4b3c-4028-ba7a-db853e1ab9e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a4fe80f5-0207-439e-ae69-5e96be043b59', 'volume_name': 'volume-a4fe80f5-0207-439e-ae69-5e96be043b59', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:46:53 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-c7c53243-0be9-44c3-bdd5-e19c343c0cd5 tempest-VolumesSnapshotTestJSON-1852940089 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d180e7d8-c400-4b2d-904b-44041955e16f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:46:53 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-c7c53243-0be9-44c3-bdd5-e19c343c0cd5 tempest-VolumesSnapshotTestJSON-1852940089 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d180e7d8-c400-4b2d-904b-44041955e16f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:46:53 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-c7c53243-0be9-44c3-bdd5-e19c343c0cd5 tempest-VolumesSnapshotTestJSON-1852940089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c59a80fa-4f3e-47d2-a5c8-802618372848) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:46:53 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-c7c53243-0be9-44c3-bdd5-e19c343c0cd5 tempest-VolumesSnapshotTestJSON-1852940089 None] Volume a4fe80f5-0207-439e-ae69-5e96be043b59: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a4fe80f5-0207-439e-ae69-5e96be043b59', 'volume_size': 1} Sep 22 15:46:53 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-c7c53243-0be9-44c3-bdd5-e19c343c0cd5 tempest-VolumesSnapshotTestJSON-1852940089 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:46:53 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-c7c53243-0be9-44c3-bdd5-e19c343c0cd5 tempest-VolumesSnapshotTestJSON-1852940089 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:46:53 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-c7c53243-0be9-44c3-bdd5-e19c343c0cd5 tempest-VolumesSnapshotTestJSON-1852940089 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:46:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-415514403',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4fe80f5-0207-439e-ae69-5e96be043b59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6705e2e1e5874f378f80abd1ee561d94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:46:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:46:53Z,use_quota=True,user_id='92fadb836e974dcb9aae676729372d23',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)}" {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 15:46:53 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-c7c53243-0be9-44c3-bdd5-e19c343c0cd5 tempest-VolumesSnapshotTestJSON-1852940089 None] Creating volume a4fe80f5-0207-439e-ae69-5e96be043b59 {{(pid=86212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 15:46:53 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-c7c53243-0be9-44c3-bdd5-e19c343c0cd5 tempest-VolumesSnapshotTestJSON-1852940089 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:46:53 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-c7c53243-0be9-44c3-bdd5-e19c343c0cd5 tempest-VolumesSnapshotTestJSON-1852940089 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:46:53 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-c7c53243-0be9-44c3-bdd5-e19c343c0cd5 tempest-VolumesSnapshotTestJSON-1852940089 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:46:53 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-c7c53243-0be9-44c3-bdd5-e19c343c0cd5 tempest-VolumesSnapshotTestJSON-1852940089 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:46:53 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-c7c53243-0be9-44c3-bdd5-e19c343c0cd5 tempest-VolumesSnapshotTestJSON-1852940089 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:46:53 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-c7c53243-0be9-44c3-bdd5-e19c343c0cd5 tempest-VolumesSnapshotTestJSON-1852940089 None] Selected osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 as target Quobyte volume. {{(pid=86212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 15:46:53 devstack cinder-volume[86212]: INFO cinder.volume.drivers.remotefs [None req-c7c53243-0be9-44c3-bdd5-e19c343c0cd5 tempest-VolumesSnapshotTestJSON-1852940089 None] casted to osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 Sep 22 15:46:53 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-c7c53243-0be9-44c3-bdd5-e19c343c0cd5 tempest-VolumesSnapshotTestJSON-1852940089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a4fe80f5-0207-439e-ae69-5e96be043b59 1073741824 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:46:53 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-865ea660-b096-4103-a0e5-626e778686db tempest-SnapshotsActionsTest-743576267 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b6fe5ce0-11b7-4bbc-8573-9a098af7add5" returned: 0 in 0.543s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:46:53 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-865ea660-b096-4103-a0e5-626e778686db tempest-SnapshotsActionsTest-743576267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b6fe5ce0-11b7-4bbc-8573-9a098af7add5 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:46:53 devstack sudo[96920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a4fe80f5-0207-439e-ae69-5e96be043b59 1073741824 Sep 22 15:46:53 devstack sudo[96920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:46:53 devstack sudo[96921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b6fe5ce0-11b7-4bbc-8573-9a098af7add5 Sep 22 15:46:53 devstack sudo[96921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:46:53 devstack sudo[96921]: pam_unix(sudo:session): session closed for user root Sep 22 15:46:53 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-865ea660-b096-4103-a0e5-626e778686db tempest-SnapshotsActionsTest-743576267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b6fe5ce0-11b7-4bbc-8573-9a098af7add5" returned: 0 in 0.292s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:46:53 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-865ea660-b096-4103-a0e5-626e778686db tempest-SnapshotsActionsTest-743576267 None] Lock "cinder-quobyte-b6fe5ce0-11b7-4bbc-8573-9a098af7add5" released by "delete_volume" :: held 0.922s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:46:53 devstack cinder-volume[86212]: DEBUG cinder.quota [None req-865ea660-b096-4103-a0e5-626e778686db tempest-SnapshotsActionsTest-743576267 None] Created reservations ['04ea0cbb-38b2-4d70-a390-e0346565cc9d', '1d248d15-ba36-4df8-882b-596e3de56643', '6f43ac12-45f7-40dc-8438-9ee985116ce3', 'aa709074-3047-4186-8f96-b68e7d6cba45'] {{(pid=86212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 15:46:53 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-865ea660-b096-4103-a0e5-626e778686db tempest-SnapshotsActionsTest-743576267 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:46:53 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-865ea660-b096-4103-a0e5-626e778686db tempest-SnapshotsActionsTest-743576267 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:46:53 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-865ea660-b096-4103-a0e5-626e778686db tempest-SnapshotsActionsTest-743576267 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:46:54 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-865ea660-b096-4103-a0e5-626e778686db tempest-SnapshotsActionsTest-743576267 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:46:54 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-865ea660-b096-4103-a0e5-626e778686db tempest-SnapshotsActionsTest-743576267 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:46:54 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-865ea660-b096-4103-a0e5-626e778686db tempest-SnapshotsActionsTest-743576267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:46:54 devstack sudo[96929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc Sep 22 15:46:54 devstack sudo[96929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:46:54 devstack sudo[96920]: pam_unix(sudo:session): session closed for user root Sep 22 15:46:54 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-c7c53243-0be9-44c3-bdd5-e19c343c0cd5 tempest-VolumesSnapshotTestJSON-1852940089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a4fe80f5-0207-439e-ae69-5e96be043b59 1073741824" returned: 0 in 0.591s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:46:54 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-c7c53243-0be9-44c3-bdd5-e19c343c0cd5 tempest-VolumesSnapshotTestJSON-1852940089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a4fe80f5-0207-439e-ae69-5e96be043b59 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:46:54 devstack sudo[96931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a4fe80f5-0207-439e-ae69-5e96be043b59 Sep 22 15:46:54 devstack sudo[96931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:46:54 devstack sudo[96929]: pam_unix(sudo:session): session closed for user root Sep 22 15:46:54 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-865ea660-b096-4103-a0e5-626e778686db tempest-SnapshotsActionsTest-743576267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc" returned: 0 in 0.330s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:46:54 devstack cinder-volume[86212]: DEBUG cinder.manager [None req-865ea660-b096-4103-a0e5-626e778686db tempest-SnapshotsActionsTest-743576267 None] Notifying Schedulers of capabilities ... {{(pid=86212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 15:46:54 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-865ea660-b096-4103-a0e5-626e778686db tempest-SnapshotsActionsTest-743576267 None] Deleted volume successfully. Sep 22 15:46:54 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-865ea660-b096-4103-a0e5-626e778686db tempest-SnapshotsActionsTest-743576267 None] Lock "cinder-b6fe5ce0-11b7-4bbc-8573-9a098af7add5-delete_volume" released by "delete_volume" :: held 1.554s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:46:54 devstack sudo[96931]: pam_unix(sudo:session): session closed for user root Sep 22 15:46:54 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-c7c53243-0be9-44c3-bdd5-e19c343c0cd5 tempest-VolumesSnapshotTestJSON-1852940089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a4fe80f5-0207-439e-ae69-5e96be043b59" returned: 0 in 0.415s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:46:54 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-c7c53243-0be9-44c3-bdd5-e19c343c0cd5 tempest-VolumesSnapshotTestJSON-1852940089 None] <== create_volume: return (1095ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'} {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 15:46:54 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-c7c53243-0be9-44c3-bdd5-e19c343c0cd5 tempest-VolumesSnapshotTestJSON-1852940089 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.098s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:46:54 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-c7c53243-0be9-44c3-bdd5-e19c343c0cd5 tempest-VolumesSnapshotTestJSON-1852940089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c59a80fa-4f3e-47d2-a5c8-802618372848) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a4fe80f5-0207-439e-ae69-5e96be043b59', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:46:54 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-c7c53243-0be9-44c3-bdd5-e19c343c0cd5 tempest-VolumesSnapshotTestJSON-1852940089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fcfafe5-3fd3-4aaa-aa15-9d9bcf1be3c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:46:54 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-3e8a051d-179d-4724-ba29-2c813bed4946 tempest-GroupSnapshotsV319Test-1640878424 None] group_snapshot 3c719bdc-5f1b-48d8-9956-45317e8f125e: deleting Sep 22 15:46:54 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-c7c53243-0be9-44c3-bdd5-e19c343c0cd5 tempest-VolumesSnapshotTestJSON-1852940089 None] Volume volume-a4fe80f5-0207-439e-ae69-5e96be043b59 (a4fe80f5-0207-439e-ae69-5e96be043b59): created successfully Sep 22 15:46:54 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-c7c53243-0be9-44c3-bdd5-e19c343c0cd5 tempest-VolumesSnapshotTestJSON-1852940089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fcfafe5-3fd3-4aaa-aa15-9d9bcf1be3c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:46:54 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-c7c53243-0be9-44c3-bdd5-e19c343c0cd5 tempest-VolumesSnapshotTestJSON-1852940089 None] Flow 'volume_create_manager' (03aed23f-ebc3-4e49-a46a-918ea3d7692f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:46:54 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-c7c53243-0be9-44c3-bdd5-e19c343c0cd5 tempest-VolumesSnapshotTestJSON-1852940089 None] Created volume successfully. Sep 22 15:46:54 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-3e8a051d-179d-4724-ba29-2c813bed4946 tempest-GroupSnapshotsV319Test-1640878424 None] group_snapshot 3c719bdc-5f1b-48d8-9956-45317e8f125e: deleting {{(pid=86212) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 22 15:46:54 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-3e8a051d-179d-4724-ba29-2c813bed4946 tempest-GroupSnapshotsV319Test-1640878424 None] Acquiring lock "cinder-quobyte-b435c79c-262e-41d2-b6af-53406b1c939b" by "delete_snapshot" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:46:54 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-3e8a051d-179d-4724-ba29-2c813bed4946 tempest-GroupSnapshotsV319Test-1640878424 None] Lock "cinder-quobyte-b435c79c-262e-41d2-b6af-53406b1c939b" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:46:54 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-3e8a051d-179d-4724-ba29-2c813bed4946 tempest-GroupSnapshotsV319Test-1640878424 None] Acquiring lock "cinder-quobyte-eb560784-dd0c-4e06-8b8f-2c2a36b57dd7" by "_delete_snapshot" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:46:54 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-3e8a051d-179d-4724-ba29-2c813bed4946 tempest-GroupSnapshotsV319Test-1640878424 None] Lock "cinder-quobyte-eb560784-dd0c-4e06-8b8f-2c2a36b57dd7" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:46:54 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-3e8a051d-179d-4724-ba29-2c813bed4946 tempest-GroupSnapshotsV319Test-1640878424 None] Deleting offline snapshot eb560784-dd0c-4e06-8b8f-2c2a36b57dd7 of volume b435c79c-262e-41d2-b6af-53406b1c939b {{(pid=86212) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 22 15:46:54 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-3e8a051d-179d-4724-ba29-2c813bed4946 tempest-GroupSnapshotsV319Test-1640878424 None] snapshot_file for this snap is: volume-b435c79c-262e-41d2-b6af-53406b1c939b.eb560784-dd0c-4e06-8b8f-2c2a36b57dd7 {{(pid=86212) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 22 15:46:54 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cce847a-f6d3-4ccf-87c4-7fe56549e8c5]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:46:54 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-3e8a051d-179d-4724-ba29-2c813bed4946 tempest-GroupSnapshotsV319Test-1640878424 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b435c79c-262e-41d2-b6af-53406b1c939b.eb560784-dd0c-4e06-8b8f-2c2a36b57dd7 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:46:54 devstack sudo[96936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b435c79c-262e-41d2-b6af-53406b1c939b.eb560784-dd0c-4e06-8b8f-2c2a36b57dd7 Sep 22 15:46:54 devstack sudo[96936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:46:55 devstack sudo[96936]: pam_unix(sudo:session): session closed for user root Sep 22 15:46:55 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-3e8a051d-179d-4724-ba29-2c813bed4946 tempest-GroupSnapshotsV319Test-1640878424 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b435c79c-262e-41d2-b6af-53406b1c939b.eb560784-dd0c-4e06-8b8f-2c2a36b57dd7" returned: 0 in 0.438s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:46:55 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-3e8a051d-179d-4724-ba29-2c813bed4946 tempest-GroupSnapshotsV319Test-1640878424 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b435c79c-262e-41d2-b6af-53406b1c939b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86212) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 22 15:46:55 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e817637-ff78-442f-822b-9684058e2286]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:46:55 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-3e8a051d-179d-4724-ba29-2c813bed4946 tempest-GroupSnapshotsV319Test-1640878424 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b435c79c-262e-41d2-b6af-53406b1c939b {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:46:55 devstack sudo[96943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b435c79c-262e-41d2-b6af-53406b1c939b Sep 22 15:46:55 devstack sudo[96943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:46:55 devstack sudo[96943]: pam_unix(sudo:session): session closed for user root Sep 22 15:46:55 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-3e8a051d-179d-4724-ba29-2c813bed4946 tempest-GroupSnapshotsV319Test-1640878424 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b435c79c-262e-41d2-b6af-53406b1c939b" returned: 0 in 0.489s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:46:55 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-3e8a051d-179d-4724-ba29-2c813bed4946 tempest-GroupSnapshotsV319Test-1640878424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b435c79c-262e-41d2-b6af-53406b1c939b.eb560784-dd0c-4e06-8b8f-2c2a36b57dd7 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:46:55 devstack sudo[96948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b435c79c-262e-41d2-b6af-53406b1c939b.eb560784-dd0c-4e06-8b8f-2c2a36b57dd7 Sep 22 15:46:55 devstack sudo[96948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:46:55 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-6cc291f6-ee2c-4408-bd48-9e143ffb2044 tempest-VolumesSnapshotTestJSON-1852940089 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:46:55 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-6cc291f6-ee2c-4408-bd48-9e143ffb2044 tempest-VolumesSnapshotTestJSON-1852940089 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:46:55 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-6cc291f6-ee2c-4408-bd48-9e143ffb2044 tempest-VolumesSnapshotTestJSON-1852940089 None] Creating offline snapshot dc756100-fe5f-417b-8db7-c9bffa0fe973 of volume a4fe80f5-0207-439e-ae69-5e96be043b59 {{(pid=86212) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 22 15:46:55 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c6015d3-9daf-48b8-81d0-0d60c96b900d]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:46:55 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-6cc291f6-ee2c-4408-bd48-9e143ffb2044 tempest-VolumesSnapshotTestJSON-1852940089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a4fe80f5-0207-439e-ae69-5e96be043b59 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:46:56 devstack sudo[96950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a4fe80f5-0207-439e-ae69-5e96be043b59 Sep 22 15:46:56 devstack sudo[96950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:46:56 devstack sudo[96948]: pam_unix(sudo:session): session closed for user root Sep 22 15:46:56 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-3e8a051d-179d-4724-ba29-2c813bed4946 tempest-GroupSnapshotsV319Test-1640878424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b435c79c-262e-41d2-b6af-53406b1c939b.eb560784-dd0c-4e06-8b8f-2c2a36b57dd7" returned: 0 in 0.514s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:46:56 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-3e8a051d-179d-4724-ba29-2c813bed4946 tempest-GroupSnapshotsV319Test-1640878424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b435c79c-262e-41d2-b6af-53406b1c939b.eb560784-dd0c-4e06-8b8f-2c2a36b57dd7 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:46:56 devstack sudo[96958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b435c79c-262e-41d2-b6af-53406b1c939b.eb560784-dd0c-4e06-8b8f-2c2a36b57dd7 Sep 22 15:46:56 devstack sudo[96958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:46:56 devstack sudo[96950]: pam_unix(sudo:session): session closed for user root Sep 22 15:46:56 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-6cc291f6-ee2c-4408-bd48-9e143ffb2044 tempest-VolumesSnapshotTestJSON-1852940089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a4fe80f5-0207-439e-ae69-5e96be043b59" returned: 0 in 0.485s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:46:56 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-6cc291f6-ee2c-4408-bd48-9e143ffb2044 tempest-VolumesSnapshotTestJSON-1852940089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a4fe80f5-0207-439e-ae69-5e96be043b59,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a4fe80f5-0207-439e-ae69-5e96be043b59.dc756100-fe5f-417b-8db7-c9bffa0fe973 1G {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:46:56 devstack sudo[96961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a4fe80f5-0207-439e-ae69-5e96be043b59,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a4fe80f5-0207-439e-ae69-5e96be043b59.dc756100-fe5f-417b-8db7-c9bffa0fe973 1G Sep 22 15:46:56 devstack sudo[96961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:46:56 devstack sudo[96958]: pam_unix(sudo:session): session closed for user root Sep 22 15:46:56 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-3e8a051d-179d-4724-ba29-2c813bed4946 tempest-GroupSnapshotsV319Test-1640878424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b435c79c-262e-41d2-b6af-53406b1c939b.eb560784-dd0c-4e06-8b8f-2c2a36b57dd7" returned: 0 in 0.305s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:46:56 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-3e8a051d-179d-4724-ba29-2c813bed4946 tempest-GroupSnapshotsV319Test-1640878424 None] Lock "cinder-quobyte-eb560784-dd0c-4e06-8b8f-2c2a36b57dd7" released by "_delete_snapshot" :: held 1.885s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:46:56 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-3e8a051d-179d-4724-ba29-2c813bed4946 tempest-GroupSnapshotsV319Test-1640878424 None] Lock "cinder-quobyte-b435c79c-262e-41d2-b6af-53406b1c939b" released by "delete_snapshot" :: held 1.934s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:46:56 devstack cinder-volume[86212]: WARNING cinder.quota [None req-3e8a051d-179d-4724-ba29-2c813bed4946 tempest-GroupSnapshotsV319Test-1640878424 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1439150304 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1439150304, it is now deprecated. Please use the default quota class for default quota. Sep 22 15:46:56 devstack cinder-volume[86212]: WARNING cinder.quota [None req-3e8a051d-179d-4724-ba29-2c813bed4946 tempest-GroupSnapshotsV319Test-1640878424 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1439150304 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1439150304, it is now deprecated. Please use the default quota class for default quota. Sep 22 15:46:56 devstack cinder-volume[86212]: DEBUG cinder.quota [None req-3e8a051d-179d-4724-ba29-2c813bed4946 tempest-GroupSnapshotsV319Test-1640878424 None] Created reservations ['0d630cb9-ae4b-49d0-a35a-61981ca5fab0', '9963c060-edea-4859-87c9-a391909a1d06', 'e4b15aff-72ed-4192-8760-851cf60d7106', 'b95f85b5-486b-4afc-a9f6-6044f99b1efb'] {{(pid=86212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 15:46:56 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-3e8a051d-179d-4724-ba29-2c813bed4946 tempest-GroupSnapshotsV319Test-1640878424 None] group_snapshot 3c719bdc-5f1b-48d8-9956-45317e8f125e: deleted successfully Sep 22 15:46:56 devstack sudo[96961]: pam_unix(sudo:session): session closed for user root Sep 22 15:46:56 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-6cc291f6-ee2c-4408-bd48-9e143ffb2044 tempest-VolumesSnapshotTestJSON-1852940089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a4fe80f5-0207-439e-ae69-5e96be043b59,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a4fe80f5-0207-439e-ae69-5e96be043b59.dc756100-fe5f-417b-8db7-c9bffa0fe973 1G" returned: 0 in 0.559s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:46:56 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-6cc291f6-ee2c-4408-bd48-9e143ffb2044 tempest-VolumesSnapshotTestJSON-1852940089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a4fe80f5-0207-439e-ae69-5e96be043b59 -F qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a4fe80f5-0207-439e-ae69-5e96be043b59.dc756100-fe5f-417b-8db7-c9bffa0fe973 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:46:57 devstack sudo[96968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a4fe80f5-0207-439e-ae69-5e96be043b59 -F qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a4fe80f5-0207-439e-ae69-5e96be043b59.dc756100-fe5f-417b-8db7-c9bffa0fe973 Sep 22 15:46:57 devstack sudo[96968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:46:57 devstack sudo[96968]: pam_unix(sudo:session): session closed for user root Sep 22 15:46:57 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-6cc291f6-ee2c-4408-bd48-9e143ffb2044 tempest-VolumesSnapshotTestJSON-1852940089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a4fe80f5-0207-439e-ae69-5e96be043b59 -F qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a4fe80f5-0207-439e-ae69-5e96be043b59.dc756100-fe5f-417b-8db7-c9bffa0fe973" returned: 0 in 0.399s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:46:57 devstack cinder-volume[86212]: WARNING cinder.volume.drivers.remotefs [None req-6cc291f6-ee2c-4408-bd48-9e143ffb2044 tempest-VolumesSnapshotTestJSON-1852940089 None] /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a4fe80f5-0207-439e-ae69-5e96be043b59.dc756100-fe5f-417b-8db7-c9bffa0fe973 is being set with open permissions: ugo+rw Sep 22 15:46:57 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-6cc291f6-ee2c-4408-bd48-9e143ffb2044 tempest-VolumesSnapshotTestJSON-1852940089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a4fe80f5-0207-439e-ae69-5e96be043b59.dc756100-fe5f-417b-8db7-c9bffa0fe973 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:46:57 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-cb18f288-ff32-4aab-87a5-dcac9d64cc71 tempest-GroupSnapshotsV319Test-1640878424 None] Acquiring lock "cinder-quobyte-b435c79c-262e-41d2-b6af-53406b1c939b" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:46:57 devstack sudo[96974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a4fe80f5-0207-439e-ae69-5e96be043b59.dc756100-fe5f-417b-8db7-c9bffa0fe973 Sep 22 15:46:57 devstack sudo[96974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:46:57 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-cb18f288-ff32-4aab-87a5-dcac9d64cc71 tempest-GroupSnapshotsV319Test-1640878424 None] Lock "cinder-quobyte-b435c79c-262e-41d2-b6af-53406b1c939b" acquired by "delete_volume" :: waited 0.028s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:46:57 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[1feb3747-1e4f-4791-800a-97e6bc126aca]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:46:57 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-cb18f288-ff32-4aab-87a5-dcac9d64cc71 tempest-GroupSnapshotsV319Test-1640878424 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b435c79c-262e-41d2-b6af-53406b1c939b {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:46:57 devstack sudo[96977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b435c79c-262e-41d2-b6af-53406b1c939b Sep 22 15:46:57 devstack sudo[96977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:46:57 devstack sudo[96974]: pam_unix(sudo:session): session closed for user root Sep 22 15:46:57 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-6cc291f6-ee2c-4408-bd48-9e143ffb2044 tempest-VolumesSnapshotTestJSON-1852940089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a4fe80f5-0207-439e-ae69-5e96be043b59.dc756100-fe5f-417b-8db7-c9bffa0fe973" returned: 0 in 0.370s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:46:57 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-6cc291f6-ee2c-4408-bd48-9e143ffb2044 tempest-VolumesSnapshotTestJSON-1852940089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a4fe80f5-0207-439e-ae69-5e96be043b59.info {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:46:57 devstack sudo[96980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a4fe80f5-0207-439e-ae69-5e96be043b59.info Sep 22 15:46:57 devstack sudo[96980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:46:58 devstack sudo[96977]: pam_unix(sudo:session): session closed for user root Sep 22 15:46:58 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-cb18f288-ff32-4aab-87a5-dcac9d64cc71 tempest-GroupSnapshotsV319Test-1640878424 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b435c79c-262e-41d2-b6af-53406b1c939b" returned: 0 in 0.513s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:46:58 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-cb18f288-ff32-4aab-87a5-dcac9d64cc71 tempest-GroupSnapshotsV319Test-1640878424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b435c79c-262e-41d2-b6af-53406b1c939b {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:46:58 devstack sudo[96985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b435c79c-262e-41d2-b6af-53406b1c939b Sep 22 15:46:58 devstack sudo[96985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:46:58 devstack sudo[96980]: pam_unix(sudo:session): session closed for user root Sep 22 15:46:58 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-6cc291f6-ee2c-4408-bd48-9e143ffb2044 tempest-VolumesSnapshotTestJSON-1852940089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a4fe80f5-0207-439e-ae69-5e96be043b59.info" returned: 0 in 0.323s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:46:58 devstack cinder-volume[86212]: WARNING cinder.volume.drivers.remotefs [None req-6cc291f6-ee2c-4408-bd48-9e143ffb2044 tempest-VolumesSnapshotTestJSON-1852940089 None] /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a4fe80f5-0207-439e-ae69-5e96be043b59.info is being set with open permissions: ugo+rw Sep 22 15:46:58 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-6cc291f6-ee2c-4408-bd48-9e143ffb2044 tempest-VolumesSnapshotTestJSON-1852940089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a4fe80f5-0207-439e-ae69-5e96be043b59.info {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:46:58 devstack sudo[96988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a4fe80f5-0207-439e-ae69-5e96be043b59.info Sep 22 15:46:58 devstack sudo[96988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:46:58 devstack sudo[96985]: pam_unix(sudo:session): session closed for user root Sep 22 15:46:58 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-cb18f288-ff32-4aab-87a5-dcac9d64cc71 tempest-GroupSnapshotsV319Test-1640878424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b435c79c-262e-41d2-b6af-53406b1c939b" returned: 0 in 0.312s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:46:58 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-cb18f288-ff32-4aab-87a5-dcac9d64cc71 tempest-GroupSnapshotsV319Test-1640878424 None] Lock "cinder-quobyte-b435c79c-262e-41d2-b6af-53406b1c939b" released by "delete_volume" :: held 0.925s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:46:58 devstack cinder-volume[86212]: DEBUG cinder.quota [None req-cb18f288-ff32-4aab-87a5-dcac9d64cc71 tempest-GroupSnapshotsV319Test-1640878424 None] Created reservations ['118a0913-df5b-4ed7-9959-f8c39fcd911a'] {{(pid=86212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 15:46:58 devstack sudo[96988]: pam_unix(sudo:session): session closed for user root Sep 22 15:46:58 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-6cc291f6-ee2c-4408-bd48-9e143ffb2044 tempest-VolumesSnapshotTestJSON-1852940089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a4fe80f5-0207-439e-ae69-5e96be043b59.info" returned: 0 in 0.321s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:46:58 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-6cc291f6-ee2c-4408-bd48-9e143ffb2044 tempest-VolumesSnapshotTestJSON-1852940089 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.592s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:46:58 devstack cinder-volume[86212]: WARNING cinder.quota [None req-cb18f288-ff32-4aab-87a5-dcac9d64cc71 tempest-GroupSnapshotsV319Test-1640878424 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1439150304 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1439150304, it is now deprecated. Please use the default quota class for default quota. Sep 22 15:46:58 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-6cc291f6-ee2c-4408-bd48-9e143ffb2044 tempest-VolumesSnapshotTestJSON-1852940089 None] Create snapshot completed successfully Sep 22 15:46:58 devstack cinder-volume[86212]: DEBUG cinder.quota [None req-cb18f288-ff32-4aab-87a5-dcac9d64cc71 tempest-GroupSnapshotsV319Test-1640878424 None] Created reservations ['565f99f5-34c2-4f79-848e-038a24738322', '80c0da36-dc16-4fe5-b44e-a58fec6bbbca', 'fc635a3d-6c6e-4773-9b52-f432da021c47', 'd6aba528-68c9-4602-b529-9520c31b6763'] {{(pid=86212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 15:46:58 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-cb18f288-ff32-4aab-87a5-dcac9d64cc71 tempest-GroupSnapshotsV319Test-1640878424 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:46:58 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-cb18f288-ff32-4aab-87a5-dcac9d64cc71 tempest-GroupSnapshotsV319Test-1640878424 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:46:58 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-cb18f288-ff32-4aab-87a5-dcac9d64cc71 tempest-GroupSnapshotsV319Test-1640878424 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:46:58 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-cb18f288-ff32-4aab-87a5-dcac9d64cc71 tempest-GroupSnapshotsV319Test-1640878424 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:46:58 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-cb18f288-ff32-4aab-87a5-dcac9d64cc71 tempest-GroupSnapshotsV319Test-1640878424 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:46:58 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-cb18f288-ff32-4aab-87a5-dcac9d64cc71 tempest-GroupSnapshotsV319Test-1640878424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:46:58 devstack sudo[96992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc Sep 22 15:46:58 devstack sudo[96992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:46:59 devstack sudo[96992]: pam_unix(sudo:session): session closed for user root Sep 22 15:46:59 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-cb18f288-ff32-4aab-87a5-dcac9d64cc71 tempest-GroupSnapshotsV319Test-1640878424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc" returned: 0 in 0.274s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:46:59 devstack cinder-volume[86212]: DEBUG cinder.manager [None req-cb18f288-ff32-4aab-87a5-dcac9d64cc71 tempest-GroupSnapshotsV319Test-1640878424 None] Notifying Schedulers of capabilities ... {{(pid=86212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 15:46:59 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-cb18f288-ff32-4aab-87a5-dcac9d64cc71 tempest-GroupSnapshotsV319Test-1640878424 None] Delete group completed successfully. Sep 22 15:46:59 devstack cinder-volume[86212]: DEBUG cinder.volume.flows.manager.create_volume [None req-39a10f9d-27ca-4670-b69b-ffb2353b7e71 tempest-VolumesSnapshotTestJSON-1852940089 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 15:46:59 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-39a10f9d-27ca-4670-b69b-ffb2353b7e71 tempest-VolumesSnapshotTestJSON-1852940089 None] Flow 'volume_create_manager' (c6cfeaa4-2bb2-4bd1-a1a0-c9f15ef016aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:46:59 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-39a10f9d-27ca-4670-b69b-ffb2353b7e71 tempest-VolumesSnapshotTestJSON-1852940089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f98c9a50-74ba-4ce7-bfb9-97961ac14711) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:46:59 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-39a10f9d-27ca-4670-b69b-ffb2353b7e71 tempest-VolumesSnapshotTestJSON-1852940089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f98c9a50-74ba-4ce7-bfb9-97961ac14711) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:46:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-403759387',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=003a9672-6b68-45df-b22a-ae3c9de90e66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6705e2e1e5874f378f80abd1ee561d94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:47:00Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=dc756100-fe5f-417b-8db7-c9bffa0fe973,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:47:00Z,use_quota=True,user_id='92fadb836e974dcb9aae676729372d23',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:46:59 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-39a10f9d-27ca-4670-b69b-ffb2353b7e71 tempest-VolumesSnapshotTestJSON-1852940089 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c3b2a5d-c3a3-4727-b58e-955188529afc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:46:59 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-39a10f9d-27ca-4670-b69b-ffb2353b7e71 tempest-VolumesSnapshotTestJSON-1852940089 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c3b2a5d-c3a3-4727-b58e-955188529afc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:46:59 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-39a10f9d-27ca-4670-b69b-ffb2353b7e71 tempest-VolumesSnapshotTestJSON-1852940089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92af02d3-e61c-486a-90fa-3483dd23610d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:46:59 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-39a10f9d-27ca-4670-b69b-ffb2353b7e71 tempest-VolumesSnapshotTestJSON-1852940089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92af02d3-e61c-486a-90fa-3483dd23610d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '003a9672-6b68-45df-b22a-ae3c9de90e66', 'volume_name': 'volume-003a9672-6b68-45df-b22a-ae3c9de90e66', 'volume_size': 2, 'snapshot_id': 'dc756100-fe5f-417b-8db7-c9bffa0fe973'}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:46:59 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-39a10f9d-27ca-4670-b69b-ffb2353b7e71 tempest-VolumesSnapshotTestJSON-1852940089 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c67cc4f-67d2-4fcd-ade8-90762d674f68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:46:59 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-39a10f9d-27ca-4670-b69b-ffb2353b7e71 tempest-VolumesSnapshotTestJSON-1852940089 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c67cc4f-67d2-4fcd-ade8-90762d674f68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:46:59 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-39a10f9d-27ca-4670-b69b-ffb2353b7e71 tempest-VolumesSnapshotTestJSON-1852940089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90e172b2-a4d6-407e-b18c-e5b0ef1186c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:46:59 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-39a10f9d-27ca-4670-b69b-ffb2353b7e71 tempest-VolumesSnapshotTestJSON-1852940089 None] Volume 003a9672-6b68-45df-b22a-ae3c9de90e66: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-003a9672-6b68-45df-b22a-ae3c9de90e66', 'volume_size': 2, 'snapshot_id': 'dc756100-fe5f-417b-8db7-c9bffa0fe973'} Sep 22 15:46:59 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-39a10f9d-27ca-4670-b69b-ffb2353b7e71 tempest-VolumesSnapshotTestJSON-1852940089 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:46:59 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-39a10f9d-27ca-4670-b69b-ffb2353b7e71 tempest-VolumesSnapshotTestJSON-1852940089 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:46:59 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-39a10f9d-27ca-4670-b69b-ffb2353b7e71 tempest-VolumesSnapshotTestJSON-1852940089 None] Acquiring lock "cinder-quobyte-dc756100-fe5f-417b-8db7-c9bffa0fe973-003a9672-6b68-45df-b22a-ae3c9de90e66" by "_create_volume_from_snapshot" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:46:59 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-39a10f9d-27ca-4670-b69b-ffb2353b7e71 tempest-VolumesSnapshotTestJSON-1852940089 None] Lock "cinder-quobyte-dc756100-fe5f-417b-8db7-c9bffa0fe973-003a9672-6b68-45df-b22a-ae3c9de90e66" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:46:59 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-39a10f9d-27ca-4670-b69b-ffb2353b7e71 tempest-VolumesSnapshotTestJSON-1852940089 None] Creating volume 003a9672-6b68-45df-b22a-ae3c9de90e66 from snapshot dc756100-fe5f-417b-8db7-c9bffa0fe973 {{(pid=86212) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 22 15:46:59 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-39a10f9d-27ca-4670-b69b-ffb2353b7e71 tempest-VolumesSnapshotTestJSON-1852940089 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:46:59 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-39a10f9d-27ca-4670-b69b-ffb2353b7e71 tempest-VolumesSnapshotTestJSON-1852940089 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:46:59 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-39a10f9d-27ca-4670-b69b-ffb2353b7e71 tempest-VolumesSnapshotTestJSON-1852940089 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:46:59 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-39a10f9d-27ca-4670-b69b-ffb2353b7e71 tempest-VolumesSnapshotTestJSON-1852940089 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:46:59 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-39a10f9d-27ca-4670-b69b-ffb2353b7e71 tempest-VolumesSnapshotTestJSON-1852940089 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:46:59 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-39a10f9d-27ca-4670-b69b-ffb2353b7e71 tempest-VolumesSnapshotTestJSON-1852940089 None] Selected osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 as target Quobyte volume. {{(pid=86212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 15:46:59 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-39a10f9d-27ca-4670-b69b-ffb2353b7e71 tempest-VolumesSnapshotTestJSON-1852940089 None] Acquiring lock "cinder-quobyte-003a9672-6b68-45df-b22a-ae3c9de90e66" by "_copy_volume_from_snapshot" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:46:59 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-39a10f9d-27ca-4670-b69b-ffb2353b7e71 tempest-VolumesSnapshotTestJSON-1852940089 None] Lock "cinder-quobyte-003a9672-6b68-45df-b22a-ae3c9de90e66" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:46:59 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-39a10f9d-27ca-4670-b69b-ffb2353b7e71 tempest-VolumesSnapshotTestJSON-1852940089 None] snapshot: dc756100-fe5f-417b-8db7-c9bffa0fe973, volume: 003a9672-6b68-45df-b22a-ae3c9de90e66, {{(pid=86212) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 22 15:46:59 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-39a10f9d-27ca-4670-b69b-ffb2353b7e71 tempest-VolumesSnapshotTestJSON-1852940089 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:46:59 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-39a10f9d-27ca-4670-b69b-ffb2353b7e71 tempest-VolumesSnapshotTestJSON-1852940089 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:46:59 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-39a10f9d-27ca-4670-b69b-ffb2353b7e71 tempest-VolumesSnapshotTestJSON-1852940089 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:46:59 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-39a10f9d-27ca-4670-b69b-ffb2353b7e71 tempest-VolumesSnapshotTestJSON-1852940089 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:46:59 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-39a10f9d-27ca-4670-b69b-ffb2353b7e71 tempest-VolumesSnapshotTestJSON-1852940089 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:46:59 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e42485a-cb49-4193-923f-3776dbcdade4]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:46:59 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-39a10f9d-27ca-4670-b69b-ffb2353b7e71 tempest-VolumesSnapshotTestJSON-1852940089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a4fe80f5-0207-439e-ae69-5e96be043b59.dc756100-fe5f-417b-8db7-c9bffa0fe973 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:47:00 devstack sudo[96995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a4fe80f5-0207-439e-ae69-5e96be043b59.dc756100-fe5f-417b-8db7-c9bffa0fe973 Sep 22 15:47:00 devstack sudo[96995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:47:00 devstack sudo[96995]: pam_unix(sudo:session): session closed for user root Sep 22 15:47:00 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-39a10f9d-27ca-4670-b69b-ffb2353b7e71 tempest-VolumesSnapshotTestJSON-1852940089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a4fe80f5-0207-439e-ae69-5e96be043b59.dc756100-fe5f-417b-8db7-c9bffa0fe973" returned: 0 in 0.475s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:47:00 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-39a10f9d-27ca-4670-b69b-ffb2353b7e71 tempest-VolumesSnapshotTestJSON-1852940089 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a4fe80f5-0207-439e-ae69-5e96be043b59(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86212) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 22 15:47:00 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff667217-0142-41ef-a298-5228fa0f9329]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:47:00 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-39a10f9d-27ca-4670-b69b-ffb2353b7e71 tempest-VolumesSnapshotTestJSON-1852940089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a4fe80f5-0207-439e-ae69-5e96be043b59 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:47:00 devstack sudo[97000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a4fe80f5-0207-439e-ae69-5e96be043b59 Sep 22 15:47:00 devstack sudo[97000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:47:00 devstack sudo[97000]: pam_unix(sudo:session): session closed for user root Sep 22 15:47:00 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-39a10f9d-27ca-4670-b69b-ffb2353b7e71 tempest-VolumesSnapshotTestJSON-1852940089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a4fe80f5-0207-439e-ae69-5e96be043b59" returned: 0 in 0.471s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:47:00 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-39a10f9d-27ca-4670-b69b-ffb2353b7e71 tempest-VolumesSnapshotTestJSON-1852940089 None] will copy from snapshot at /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a4fe80f5-0207-439e-ae69-5e96be043b59 {{(pid=86212) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 22 15:47:00 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-39a10f9d-27ca-4670-b69b-ffb2353b7e71 tempest-VolumesSnapshotTestJSON-1852940089 None] Creating direct copy from snapshot {{(pid=86212) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 22 15:47:00 devstack cinder-volume[86212]: DEBUG cinder.utils [None req-39a10f9d-27ca-4670-b69b-ffb2353b7e71 tempest-VolumesSnapshotTestJSON-1852940089 None] Path /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-003a9672-6b68-45df-b22a-ae3c9de90e66 not found in is_blk_device check {{(pid=86212) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 22 15:47:00 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-39a10f9d-27ca-4670-b69b-ffb2353b7e71 tempest-VolumesSnapshotTestJSON-1852940089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a4fe80f5-0207-439e-ae69-5e96be043b59 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-003a9672-6b68-45df-b22a-ae3c9de90e66 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:47:00 devstack sudo[97006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a4fe80f5-0207-439e-ae69-5e96be043b59 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-003a9672-6b68-45df-b22a-ae3c9de90e66 Sep 22 15:47:00 devstack sudo[97006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:47:09 devstack cinder-volume[86212]: DEBUG dbcounter [-] [86212] Writing DB stats cinder:SELECT=215,cinder:INSERT=58,cinder:UPDATE=210,cinder:DELETE=11 {{(pid=86212) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 22 15:47:09 devstack cinder-volume[86212]: DEBUG dbcounter [-] [86212] Writing DB stats cinder:UPDATE=224,cinder:SELECT=197,cinder:DELETE=16,cinder:INSERT=64 {{(pid=86212) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 22 15:47:10 devstack sudo[97006]: pam_unix(sudo:session): session closed for user root Sep 22 15:47:10 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-39a10f9d-27ca-4670-b69b-ffb2353b7e71 tempest-VolumesSnapshotTestJSON-1852940089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a4fe80f5-0207-439e-ae69-5e96be043b59 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-003a9672-6b68-45df-b22a-ae3c9de90e66" returned: 0 in 9.443s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:47:10 devstack cinder-volume[86212]: DEBUG cinder.image.image_utils [None req-39a10f9d-27ca-4670-b69b-ffb2353b7e71 tempest-VolumesSnapshotTestJSON-1852940089 None] Image conversion details: src /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a4fe80f5-0207-439e-ae69-5e96be043b59, size 1024.00 MB, duration 9.44 sec, destination /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-003a9672-6b68-45df-b22a-ae3c9de90e66 {{(pid=86212) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 22 15:47:10 devstack cinder-volume[86212]: INFO cinder.image.image_utils [None req-39a10f9d-27ca-4670-b69b-ffb2353b7e71 tempest-VolumesSnapshotTestJSON-1852940089 None] Converted 1024.00 MB image at 108.43 MB/s Sep 22 15:47:10 devstack cinder-volume[86212]: WARNING cinder.volume.drivers.remotefs [None req-39a10f9d-27ca-4670-b69b-ffb2353b7e71 tempest-VolumesSnapshotTestJSON-1852940089 None] /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-003a9672-6b68-45df-b22a-ae3c9de90e66 is being set with open permissions: ugo+rw Sep 22 15:47:10 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-39a10f9d-27ca-4670-b69b-ffb2353b7e71 tempest-VolumesSnapshotTestJSON-1852940089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-003a9672-6b68-45df-b22a-ae3c9de90e66 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:47:10 devstack sudo[97019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-003a9672-6b68-45df-b22a-ae3c9de90e66 Sep 22 15:47:10 devstack sudo[97019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:47:10 devstack sudo[97019]: pam_unix(sudo:session): session closed for user root Sep 22 15:47:10 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-39a10f9d-27ca-4670-b69b-ffb2353b7e71 tempest-VolumesSnapshotTestJSON-1852940089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-003a9672-6b68-45df-b22a-ae3c9de90e66" returned: 0 in 0.348s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:47:10 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-39a10f9d-27ca-4670-b69b-ffb2353b7e71 tempest-VolumesSnapshotTestJSON-1852940089 None] Lock "cinder-quobyte-003a9672-6b68-45df-b22a-ae3c9de90e66" released by "_copy_volume_from_snapshot" :: held 10.859s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:47:10 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-39a10f9d-27ca-4670-b69b-ffb2353b7e71 tempest-VolumesSnapshotTestJSON-1852940089 None] Lock "cinder-quobyte-dc756100-fe5f-417b-8db7-c9bffa0fe973-003a9672-6b68-45df-b22a-ae3c9de90e66" released by "_create_volume_from_snapshot" :: held 10.953s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:47:10 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-39a10f9d-27ca-4670-b69b-ffb2353b7e71 tempest-VolumesSnapshotTestJSON-1852940089 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.973s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:47:10 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-39a10f9d-27ca-4670-b69b-ffb2353b7e71 tempest-VolumesSnapshotTestJSON-1852940089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90e172b2-a4d6-407e-b18c-e5b0ef1186c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-003a9672-6b68-45df-b22a-ae3c9de90e66', 'volume_size': 2, 'snapshot_id': 'dc756100-fe5f-417b-8db7-c9bffa0fe973'}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:47:10 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-39a10f9d-27ca-4670-b69b-ffb2353b7e71 tempest-VolumesSnapshotTestJSON-1852940089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac2cec24-01c0-4acd-a6c5-d51af480a86a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:47:10 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-39a10f9d-27ca-4670-b69b-ffb2353b7e71 tempest-VolumesSnapshotTestJSON-1852940089 None] Volume volume-003a9672-6b68-45df-b22a-ae3c9de90e66 (003a9672-6b68-45df-b22a-ae3c9de90e66): created successfully Sep 22 15:47:10 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-39a10f9d-27ca-4670-b69b-ffb2353b7e71 tempest-VolumesSnapshotTestJSON-1852940089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac2cec24-01c0-4acd-a6c5-d51af480a86a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:47:10 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-39a10f9d-27ca-4670-b69b-ffb2353b7e71 tempest-VolumesSnapshotTestJSON-1852940089 None] Flow 'volume_create_manager' (c6cfeaa4-2bb2-4bd1-a1a0-c9f15ef016aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:47:10 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-39a10f9d-27ca-4670-b69b-ffb2353b7e71 tempest-VolumesSnapshotTestJSON-1852940089 None] Created volume successfully. Sep 22 15:47:11 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-b87ae830-ea5a-4918-aaaa-61c847016804 tempest-VolumesSnapshotTestJSON-1852940089 None] Acquiring lock "cinder-003a9672-6b68-45df-b22a-ae3c9de90e66-delete_volume" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:47:11 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-b87ae830-ea5a-4918-aaaa-61c847016804 tempest-VolumesSnapshotTestJSON-1852940089 None] Lock "cinder-003a9672-6b68-45df-b22a-ae3c9de90e66-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:47:11 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-b87ae830-ea5a-4918-aaaa-61c847016804 tempest-VolumesSnapshotTestJSON-1852940089 None] Acquiring lock "cinder-quobyte-003a9672-6b68-45df-b22a-ae3c9de90e66" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:47:11 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-b87ae830-ea5a-4918-aaaa-61c847016804 tempest-VolumesSnapshotTestJSON-1852940089 None] Lock "cinder-quobyte-003a9672-6b68-45df-b22a-ae3c9de90e66" acquired by "delete_volume" :: waited 0.030s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:47:11 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[f809b9f6-34a9-46ee-8b67-1223000a09a4]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:47:11 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-b87ae830-ea5a-4918-aaaa-61c847016804 tempest-VolumesSnapshotTestJSON-1852940089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-003a9672-6b68-45df-b22a-ae3c9de90e66 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:47:11 devstack sudo[97022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-003a9672-6b68-45df-b22a-ae3c9de90e66 Sep 22 15:47:11 devstack sudo[97022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:47:11 devstack sudo[97022]: pam_unix(sudo:session): session closed for user root Sep 22 15:47:11 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-b87ae830-ea5a-4918-aaaa-61c847016804 tempest-VolumesSnapshotTestJSON-1852940089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-003a9672-6b68-45df-b22a-ae3c9de90e66" returned: 0 in 0.552s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:47:11 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-b87ae830-ea5a-4918-aaaa-61c847016804 tempest-VolumesSnapshotTestJSON-1852940089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-003a9672-6b68-45df-b22a-ae3c9de90e66 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:47:11 devstack sudo[97027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-003a9672-6b68-45df-b22a-ae3c9de90e66 Sep 22 15:47:11 devstack sudo[97027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:47:12 devstack sudo[97027]: pam_unix(sudo:session): session closed for user root Sep 22 15:47:12 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-b87ae830-ea5a-4918-aaaa-61c847016804 tempest-VolumesSnapshotTestJSON-1852940089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-003a9672-6b68-45df-b22a-ae3c9de90e66" returned: 0 in 0.313s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:47:12 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-b87ae830-ea5a-4918-aaaa-61c847016804 tempest-VolumesSnapshotTestJSON-1852940089 None] Lock "cinder-quobyte-003a9672-6b68-45df-b22a-ae3c9de90e66" released by "delete_volume" :: held 0.952s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:47:12 devstack cinder-volume[86212]: DEBUG cinder.quota [None req-b87ae830-ea5a-4918-aaaa-61c847016804 tempest-VolumesSnapshotTestJSON-1852940089 None] Created reservations ['75b93884-d03c-4346-a90a-c84cb0c34a38', '10ebadba-7123-4792-9a08-fae338bff3f2', '868ce3a0-3933-4a15-9967-2ef772ab9dab', '291a145d-a919-4bca-92ca-04eb2a71d958'] {{(pid=86212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 15:47:12 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-b87ae830-ea5a-4918-aaaa-61c847016804 tempest-VolumesSnapshotTestJSON-1852940089 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:47:12 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-b87ae830-ea5a-4918-aaaa-61c847016804 tempest-VolumesSnapshotTestJSON-1852940089 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:47:12 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-b87ae830-ea5a-4918-aaaa-61c847016804 tempest-VolumesSnapshotTestJSON-1852940089 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:47:12 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-b87ae830-ea5a-4918-aaaa-61c847016804 tempest-VolumesSnapshotTestJSON-1852940089 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:47:12 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-b87ae830-ea5a-4918-aaaa-61c847016804 tempest-VolumesSnapshotTestJSON-1852940089 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:47:12 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-b87ae830-ea5a-4918-aaaa-61c847016804 tempest-VolumesSnapshotTestJSON-1852940089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:47:12 devstack sudo[97030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc Sep 22 15:47:12 devstack sudo[97030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:47:12 devstack sudo[97030]: pam_unix(sudo:session): session closed for user root Sep 22 15:47:12 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-b87ae830-ea5a-4918-aaaa-61c847016804 tempest-VolumesSnapshotTestJSON-1852940089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc" returned: 0 in 0.333s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:47:12 devstack cinder-volume[86212]: DEBUG cinder.manager [None req-b87ae830-ea5a-4918-aaaa-61c847016804 tempest-VolumesSnapshotTestJSON-1852940089 None] Notifying Schedulers of capabilities ... {{(pid=86212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 15:47:12 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-b87ae830-ea5a-4918-aaaa-61c847016804 tempest-VolumesSnapshotTestJSON-1852940089 None] Deleted volume successfully. Sep 22 15:47:12 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-b87ae830-ea5a-4918-aaaa-61c847016804 tempest-VolumesSnapshotTestJSON-1852940089 None] Lock "cinder-003a9672-6b68-45df-b22a-ae3c9de90e66-delete_volume" released by "delete_volume" :: held 1.726s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:47:13 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-35ced286-2795-4c2b-80e1-e26ec610cce2 tempest-VolumesSnapshotTestJSON-1852940089 None] Acquiring lock "cinder-dc756100-fe5f-417b-8db7-c9bffa0fe973-delete_snapshot" by "delete_snapshot" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:47:13 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-35ced286-2795-4c2b-80e1-e26ec610cce2 tempest-VolumesSnapshotTestJSON-1852940089 None] Lock "cinder-dc756100-fe5f-417b-8db7-c9bffa0fe973-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:47:13 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-35ced286-2795-4c2b-80e1-e26ec610cce2 tempest-VolumesSnapshotTestJSON-1852940089 None] Acquiring lock "cinder-quobyte-a4fe80f5-0207-439e-ae69-5e96be043b59" by "delete_snapshot" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:47:13 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-35ced286-2795-4c2b-80e1-e26ec610cce2 tempest-VolumesSnapshotTestJSON-1852940089 None] Lock "cinder-quobyte-a4fe80f5-0207-439e-ae69-5e96be043b59" acquired by "delete_snapshot" :: waited 0.050s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:47:13 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-35ced286-2795-4c2b-80e1-e26ec610cce2 tempest-VolumesSnapshotTestJSON-1852940089 None] Acquiring lock "cinder-quobyte-dc756100-fe5f-417b-8db7-c9bffa0fe973" by "_delete_snapshot" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:47:13 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-35ced286-2795-4c2b-80e1-e26ec610cce2 tempest-VolumesSnapshotTestJSON-1852940089 None] Lock "cinder-quobyte-dc756100-fe5f-417b-8db7-c9bffa0fe973" acquired by "_delete_snapshot" :: waited 0.041s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:47:13 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-35ced286-2795-4c2b-80e1-e26ec610cce2 tempest-VolumesSnapshotTestJSON-1852940089 None] Deleting offline snapshot dc756100-fe5f-417b-8db7-c9bffa0fe973 of volume a4fe80f5-0207-439e-ae69-5e96be043b59 {{(pid=86212) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 22 15:47:13 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-35ced286-2795-4c2b-80e1-e26ec610cce2 tempest-VolumesSnapshotTestJSON-1852940089 None] snapshot_file for this snap is: volume-a4fe80f5-0207-439e-ae69-5e96be043b59.dc756100-fe5f-417b-8db7-c9bffa0fe973 {{(pid=86212) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 22 15:47:13 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[83649793-9fff-4d8a-8b6b-b95445436a53]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:47:13 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-35ced286-2795-4c2b-80e1-e26ec610cce2 tempest-VolumesSnapshotTestJSON-1852940089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a4fe80f5-0207-439e-ae69-5e96be043b59.dc756100-fe5f-417b-8db7-c9bffa0fe973 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:47:13 devstack sudo[97033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a4fe80f5-0207-439e-ae69-5e96be043b59.dc756100-fe5f-417b-8db7-c9bffa0fe973 Sep 22 15:47:13 devstack sudo[97033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:47:14 devstack cinder-volume[86212]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f9bf0f5-a05b-49f0-9298-d1cc57925edc tempest-VolumeQuotasAdminTestJSON-617939521 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 15:47:14 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-1f9bf0f5-a05b-49f0-9298-d1cc57925edc tempest-VolumeQuotasAdminTestJSON-617939521 None] Flow 'volume_create_manager' (d5bfa849-75a1-4658-83cc-4e2b68268d5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:47:14 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-1f9bf0f5-a05b-49f0-9298-d1cc57925edc tempest-VolumeQuotasAdminTestJSON-617939521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2eb9e298-3da1-4eb9-a45f-37b39779134a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:47:14 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-1f9bf0f5-a05b-49f0-9298-d1cc57925edc tempest-VolumeQuotasAdminTestJSON-617939521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2eb9e298-3da1-4eb9-a45f-37b39779134a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:47:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-713483693',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd804077-8e0f-4ca3-8a68-40d1265c8876,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a6bdfd6d21c4d95b55a9ebb42d7d1d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:47:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:47:14Z,use_quota=True,user_id='98e3fd1627e0415a9d9b2b1bcf8fa03e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:47:14 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-1f9bf0f5-a05b-49f0-9298-d1cc57925edc tempest-VolumeQuotasAdminTestJSON-617939521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a162d0b-a871-404e-a4ee-f57d14223216) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:47:14 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-1f9bf0f5-a05b-49f0-9298-d1cc57925edc tempest-VolumeQuotasAdminTestJSON-617939521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a162d0b-a871-404e-a4ee-f57d14223216) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:47:14 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-1f9bf0f5-a05b-49f0-9298-d1cc57925edc tempest-VolumeQuotasAdminTestJSON-617939521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbb0f582-2e14-4cd7-91fe-c33d3cd94b8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:47:14 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-1f9bf0f5-a05b-49f0-9298-d1cc57925edc tempest-VolumeQuotasAdminTestJSON-617939521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbb0f582-2e14-4cd7-91fe-c33d3cd94b8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bd804077-8e0f-4ca3-8a68-40d1265c8876', 'volume_name': 'volume-bd804077-8e0f-4ca3-8a68-40d1265c8876', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:47:14 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-1f9bf0f5-a05b-49f0-9298-d1cc57925edc tempest-VolumeQuotasAdminTestJSON-617939521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a88c3a4-7f84-4ab0-bb2c-8b4eeec1577d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:47:14 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-1f9bf0f5-a05b-49f0-9298-d1cc57925edc tempest-VolumeQuotasAdminTestJSON-617939521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a88c3a4-7f84-4ab0-bb2c-8b4eeec1577d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:47:14 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-1f9bf0f5-a05b-49f0-9298-d1cc57925edc tempest-VolumeQuotasAdminTestJSON-617939521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8bb16c76-fe92-4d10-a958-fe478acc4c2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:47:14 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-1f9bf0f5-a05b-49f0-9298-d1cc57925edc tempest-VolumeQuotasAdminTestJSON-617939521 None] Volume bd804077-8e0f-4ca3-8a68-40d1265c8876: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bd804077-8e0f-4ca3-8a68-40d1265c8876', 'volume_size': 1} Sep 22 15:47:14 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-1f9bf0f5-a05b-49f0-9298-d1cc57925edc tempest-VolumeQuotasAdminTestJSON-617939521 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:47:14 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-1f9bf0f5-a05b-49f0-9298-d1cc57925edc tempest-VolumeQuotasAdminTestJSON-617939521 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:47:14 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-1f9bf0f5-a05b-49f0-9298-d1cc57925edc tempest-VolumeQuotasAdminTestJSON-617939521 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:47:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-713483693',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd804077-8e0f-4ca3-8a68-40d1265c8876,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a6bdfd6d21c4d95b55a9ebb42d7d1d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:47:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:47:14Z,use_quota=True,user_id='98e3fd1627e0415a9d9b2b1bcf8fa03e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)}" {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 15:47:14 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-1f9bf0f5-a05b-49f0-9298-d1cc57925edc tempest-VolumeQuotasAdminTestJSON-617939521 None] Creating volume bd804077-8e0f-4ca3-8a68-40d1265c8876 {{(pid=86212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 15:47:14 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-1f9bf0f5-a05b-49f0-9298-d1cc57925edc tempest-VolumeQuotasAdminTestJSON-617939521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:47:14 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-1f9bf0f5-a05b-49f0-9298-d1cc57925edc tempest-VolumeQuotasAdminTestJSON-617939521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:47:14 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-1f9bf0f5-a05b-49f0-9298-d1cc57925edc tempest-VolumeQuotasAdminTestJSON-617939521 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:47:14 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-1f9bf0f5-a05b-49f0-9298-d1cc57925edc tempest-VolumeQuotasAdminTestJSON-617939521 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:47:14 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-1f9bf0f5-a05b-49f0-9298-d1cc57925edc tempest-VolumeQuotasAdminTestJSON-617939521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:47:14 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-1f9bf0f5-a05b-49f0-9298-d1cc57925edc tempest-VolumeQuotasAdminTestJSON-617939521 None] Selected osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 as target Quobyte volume. {{(pid=86212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 15:47:14 devstack cinder-volume[86212]: INFO cinder.volume.drivers.remotefs [None req-1f9bf0f5-a05b-49f0-9298-d1cc57925edc tempest-VolumeQuotasAdminTestJSON-617939521 None] casted to osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 Sep 22 15:47:14 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-1f9bf0f5-a05b-49f0-9298-d1cc57925edc tempest-VolumeQuotasAdminTestJSON-617939521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-bd804077-8e0f-4ca3-8a68-40d1265c8876 1073741824 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:47:14 devstack sudo[97035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-bd804077-8e0f-4ca3-8a68-40d1265c8876 1073741824 Sep 22 15:47:14 devstack sudo[97035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:47:14 devstack sudo[97033]: pam_unix(sudo:session): session closed for user root Sep 22 15:47:14 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-35ced286-2795-4c2b-80e1-e26ec610cce2 tempest-VolumesSnapshotTestJSON-1852940089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a4fe80f5-0207-439e-ae69-5e96be043b59.dc756100-fe5f-417b-8db7-c9bffa0fe973" returned: 0 in 0.510s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:47:14 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-35ced286-2795-4c2b-80e1-e26ec610cce2 tempest-VolumesSnapshotTestJSON-1852940089 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a4fe80f5-0207-439e-ae69-5e96be043b59(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86212) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 22 15:47:14 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5d3cf61-7ed9-47f4-b592-8c0ab0889e26]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:47:14 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-35ced286-2795-4c2b-80e1-e26ec610cce2 tempest-VolumesSnapshotTestJSON-1852940089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a4fe80f5-0207-439e-ae69-5e96be043b59 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:47:14 devstack sudo[97040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a4fe80f5-0207-439e-ae69-5e96be043b59 Sep 22 15:47:14 devstack sudo[97040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:47:14 devstack sudo[97035]: pam_unix(sudo:session): session closed for user root Sep 22 15:47:14 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-1f9bf0f5-a05b-49f0-9298-d1cc57925edc tempest-VolumeQuotasAdminTestJSON-617939521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-bd804077-8e0f-4ca3-8a68-40d1265c8876 1073741824" returned: 0 in 0.654s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:47:14 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-1f9bf0f5-a05b-49f0-9298-d1cc57925edc tempest-VolumeQuotasAdminTestJSON-617939521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-bd804077-8e0f-4ca3-8a68-40d1265c8876 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:47:14 devstack sudo[97048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-bd804077-8e0f-4ca3-8a68-40d1265c8876 Sep 22 15:47:14 devstack sudo[97048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:47:15 devstack sudo[97040]: pam_unix(sudo:session): session closed for user root Sep 22 15:47:15 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-35ced286-2795-4c2b-80e1-e26ec610cce2 tempest-VolumesSnapshotTestJSON-1852940089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a4fe80f5-0207-439e-ae69-5e96be043b59" returned: 0 in 0.754s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:47:15 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-35ced286-2795-4c2b-80e1-e26ec610cce2 tempest-VolumesSnapshotTestJSON-1852940089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a4fe80f5-0207-439e-ae69-5e96be043b59.dc756100-fe5f-417b-8db7-c9bffa0fe973 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:47:15 devstack sudo[97048]: pam_unix(sudo:session): session closed for user root Sep 22 15:47:15 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-1f9bf0f5-a05b-49f0-9298-d1cc57925edc tempest-VolumeQuotasAdminTestJSON-617939521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-bd804077-8e0f-4ca3-8a68-40d1265c8876" returned: 0 in 0.293s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:47:15 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-1f9bf0f5-a05b-49f0-9298-d1cc57925edc tempest-VolumeQuotasAdminTestJSON-617939521 None] <== create_volume: return (1022ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'} {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 15:47:15 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-1f9bf0f5-a05b-49f0-9298-d1cc57925edc tempest-VolumeQuotasAdminTestJSON-617939521 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.027s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:47:15 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-1f9bf0f5-a05b-49f0-9298-d1cc57925edc tempest-VolumeQuotasAdminTestJSON-617939521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8bb16c76-fe92-4d10-a958-fe478acc4c2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd804077-8e0f-4ca3-8a68-40d1265c8876', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:47:15 devstack sudo[97053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a4fe80f5-0207-439e-ae69-5e96be043b59.dc756100-fe5f-417b-8db7-c9bffa0fe973 Sep 22 15:47:15 devstack sudo[97053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:47:15 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-1f9bf0f5-a05b-49f0-9298-d1cc57925edc tempest-VolumeQuotasAdminTestJSON-617939521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b998f297-025b-4de9-97c4-42031bce8893) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:47:15 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-1f9bf0f5-a05b-49f0-9298-d1cc57925edc tempest-VolumeQuotasAdminTestJSON-617939521 None] Volume volume-bd804077-8e0f-4ca3-8a68-40d1265c8876 (bd804077-8e0f-4ca3-8a68-40d1265c8876): created successfully Sep 22 15:47:15 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-1f9bf0f5-a05b-49f0-9298-d1cc57925edc tempest-VolumeQuotasAdminTestJSON-617939521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b998f297-025b-4de9-97c4-42031bce8893) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:47:15 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-1f9bf0f5-a05b-49f0-9298-d1cc57925edc tempest-VolumeQuotasAdminTestJSON-617939521 None] Flow 'volume_create_manager' (d5bfa849-75a1-4658-83cc-4e2b68268d5d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:47:15 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-1f9bf0f5-a05b-49f0-9298-d1cc57925edc tempest-VolumeQuotasAdminTestJSON-617939521 None] Created volume successfully. Sep 22 15:47:15 devstack sudo[97053]: pam_unix(sudo:session): session closed for user root Sep 22 15:47:15 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-35ced286-2795-4c2b-80e1-e26ec610cce2 tempest-VolumesSnapshotTestJSON-1852940089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a4fe80f5-0207-439e-ae69-5e96be043b59.dc756100-fe5f-417b-8db7-c9bffa0fe973" returned: 0 in 0.459s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:47:15 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-35ced286-2795-4c2b-80e1-e26ec610cce2 tempest-VolumesSnapshotTestJSON-1852940089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a4fe80f5-0207-439e-ae69-5e96be043b59.dc756100-fe5f-417b-8db7-c9bffa0fe973 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:47:15 devstack sudo[97059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a4fe80f5-0207-439e-ae69-5e96be043b59.dc756100-fe5f-417b-8db7-c9bffa0fe973 Sep 22 15:47:15 devstack sudo[97059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:47:15 devstack sudo[97059]: pam_unix(sudo:session): session closed for user root Sep 22 15:47:15 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-35ced286-2795-4c2b-80e1-e26ec610cce2 tempest-VolumesSnapshotTestJSON-1852940089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a4fe80f5-0207-439e-ae69-5e96be043b59.dc756100-fe5f-417b-8db7-c9bffa0fe973" returned: 0 in 0.294s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:47:15 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-35ced286-2795-4c2b-80e1-e26ec610cce2 tempest-VolumesSnapshotTestJSON-1852940089 None] Lock "cinder-quobyte-dc756100-fe5f-417b-8db7-c9bffa0fe973" released by "_delete_snapshot" :: held 2.194s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:47:15 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-35ced286-2795-4c2b-80e1-e26ec610cce2 tempest-VolumesSnapshotTestJSON-1852940089 None] Lock "cinder-quobyte-a4fe80f5-0207-439e-ae69-5e96be043b59" released by "delete_snapshot" :: held 2.260s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:47:16 devstack cinder-volume[86212]: DEBUG cinder.quota [None req-35ced286-2795-4c2b-80e1-e26ec610cce2 tempest-VolumesSnapshotTestJSON-1852940089 None] Created reservations ['70682ad6-1d6d-492c-be8a-e80219592558', '62eaca5a-79f9-4851-971e-867ac58769ea', '3475bf31-5b36-4922-808b-6a83149d6c54', '9121022c-2216-4809-b57e-b64bda168230'] {{(pid=86212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 15:47:16 devstack cinder-volume[86212]: DEBUG cinder.volume.flows.manager.create_volume [None req-b27a3908-1b42-4fe6-b0a4-16ccd2fb7b00 tempest-VolumesServicesTestJSON-893684327 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 15:47:16 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-b27a3908-1b42-4fe6-b0a4-16ccd2fb7b00 tempest-VolumesServicesTestJSON-893684327 None] Flow 'volume_create_manager' (6e910f85-2ad5-47b0-a86f-aab6fef0bf81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:47:16 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-b27a3908-1b42-4fe6-b0a4-16ccd2fb7b00 tempest-VolumesServicesTestJSON-893684327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a6eeb7d-cc9d-4716-aba5-66d24641d5b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:47:16 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-b27a3908-1b42-4fe6-b0a4-16ccd2fb7b00 tempest-VolumesServicesTestJSON-893684327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a6eeb7d-cc9d-4716-aba5-66d24641d5b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:47:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-511934871',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d9227e3-f112-4f69-94cb-a8015220329e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81818224fb8e4c98aead47d052ab77ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:47:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:47:16Z,use_quota=True,user_id='f72d00b6fe4347578fddf9ff31e08b6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:47:16 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-b27a3908-1b42-4fe6-b0a4-16ccd2fb7b00 tempest-VolumesServicesTestJSON-893684327 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1aebeaf1-b495-4052-ab8a-35f6d0377fad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:47:16 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-b27a3908-1b42-4fe6-b0a4-16ccd2fb7b00 tempest-VolumesServicesTestJSON-893684327 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1aebeaf1-b495-4052-ab8a-35f6d0377fad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:47:16 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-b27a3908-1b42-4fe6-b0a4-16ccd2fb7b00 tempest-VolumesServicesTestJSON-893684327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4edb5acf-8b4b-40f4-84e6-79441672af16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:47:16 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-b27a3908-1b42-4fe6-b0a4-16ccd2fb7b00 tempest-VolumesServicesTestJSON-893684327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4edb5acf-8b4b-40f4-84e6-79441672af16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d9227e3-f112-4f69-94cb-a8015220329e', 'volume_name': 'volume-1d9227e3-f112-4f69-94cb-a8015220329e', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:47:16 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-b27a3908-1b42-4fe6-b0a4-16ccd2fb7b00 tempest-VolumesServicesTestJSON-893684327 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3f1ff8e-f346-416b-a2fc-2d62c699d55e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:47:16 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-b27a3908-1b42-4fe6-b0a4-16ccd2fb7b00 tempest-VolumesServicesTestJSON-893684327 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3f1ff8e-f346-416b-a2fc-2d62c699d55e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:47:16 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-b27a3908-1b42-4fe6-b0a4-16ccd2fb7b00 tempest-VolumesServicesTestJSON-893684327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b0babc4-d6f3-406d-ac37-c3c1d535be54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:47:16 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-b27a3908-1b42-4fe6-b0a4-16ccd2fb7b00 tempest-VolumesServicesTestJSON-893684327 None] Volume 1d9227e3-f112-4f69-94cb-a8015220329e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d9227e3-f112-4f69-94cb-a8015220329e', 'volume_size': 1} Sep 22 15:47:16 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-b27a3908-1b42-4fe6-b0a4-16ccd2fb7b00 tempest-VolumesServicesTestJSON-893684327 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:47:16 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-b27a3908-1b42-4fe6-b0a4-16ccd2fb7b00 tempest-VolumesServicesTestJSON-893684327 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:47:16 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-b27a3908-1b42-4fe6-b0a4-16ccd2fb7b00 tempest-VolumesServicesTestJSON-893684327 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:47:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-511934871',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d9227e3-f112-4f69-94cb-a8015220329e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81818224fb8e4c98aead47d052ab77ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:47:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:47:16Z,use_quota=True,user_id='f72d00b6fe4347578fddf9ff31e08b6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)}" {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 15:47:16 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-b27a3908-1b42-4fe6-b0a4-16ccd2fb7b00 tempest-VolumesServicesTestJSON-893684327 None] Creating volume 1d9227e3-f112-4f69-94cb-a8015220329e {{(pid=86212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 15:47:16 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-b27a3908-1b42-4fe6-b0a4-16ccd2fb7b00 tempest-VolumesServicesTestJSON-893684327 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:47:16 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-b27a3908-1b42-4fe6-b0a4-16ccd2fb7b00 tempest-VolumesServicesTestJSON-893684327 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:47:16 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-b27a3908-1b42-4fe6-b0a4-16ccd2fb7b00 tempest-VolumesServicesTestJSON-893684327 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:47:16 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-b27a3908-1b42-4fe6-b0a4-16ccd2fb7b00 tempest-VolumesServicesTestJSON-893684327 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:47:16 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-b27a3908-1b42-4fe6-b0a4-16ccd2fb7b00 tempest-VolumesServicesTestJSON-893684327 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:47:16 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-b27a3908-1b42-4fe6-b0a4-16ccd2fb7b00 tempest-VolumesServicesTestJSON-893684327 None] Selected osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 as target Quobyte volume. {{(pid=86212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 15:47:16 devstack cinder-volume[86212]: INFO cinder.volume.drivers.remotefs [None req-b27a3908-1b42-4fe6-b0a4-16ccd2fb7b00 tempest-VolumesServicesTestJSON-893684327 None] casted to osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 Sep 22 15:47:16 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-b27a3908-1b42-4fe6-b0a4-16ccd2fb7b00 tempest-VolumesServicesTestJSON-893684327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-1d9227e3-f112-4f69-94cb-a8015220329e 1073741824 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:47:16 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-152b6456-c110-42f3-a617-f230e6c66082 tempest-VolumeQuotasAdminTestJSON-617939521 None] Acquiring lock "cinder-bd804077-8e0f-4ca3-8a68-40d1265c8876-delete_volume" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:47:16 devstack sudo[97062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-1d9227e3-f112-4f69-94cb-a8015220329e 1073741824 Sep 22 15:47:16 devstack sudo[97062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:47:16 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-152b6456-c110-42f3-a617-f230e6c66082 tempest-VolumeQuotasAdminTestJSON-617939521 None] Lock "cinder-bd804077-8e0f-4ca3-8a68-40d1265c8876-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:47:16 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-35ced286-2795-4c2b-80e1-e26ec610cce2 tempest-VolumesSnapshotTestJSON-1852940089 None] Delete snapshot completed successfully. Sep 22 15:47:16 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-35ced286-2795-4c2b-80e1-e26ec610cce2 tempest-VolumesSnapshotTestJSON-1852940089 None] Lock "cinder-dc756100-fe5f-417b-8db7-c9bffa0fe973-delete_snapshot" released by "delete_snapshot" :: held 2.702s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:47:16 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-152b6456-c110-42f3-a617-f230e6c66082 tempest-VolumeQuotasAdminTestJSON-617939521 None] Acquiring lock "cinder-quobyte-bd804077-8e0f-4ca3-8a68-40d1265c8876" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:47:16 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-152b6456-c110-42f3-a617-f230e6c66082 tempest-VolumeQuotasAdminTestJSON-617939521 None] Lock "cinder-quobyte-bd804077-8e0f-4ca3-8a68-40d1265c8876" acquired by "delete_volume" :: waited 0.021s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:47:16 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[338ac473-d09a-4543-b405-dff14773dbf2]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:47:16 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-152b6456-c110-42f3-a617-f230e6c66082 tempest-VolumeQuotasAdminTestJSON-617939521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-bd804077-8e0f-4ca3-8a68-40d1265c8876 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:47:16 devstack sudo[97064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-bd804077-8e0f-4ca3-8a68-40d1265c8876 Sep 22 15:47:16 devstack sudo[97064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:47:16 devstack sudo[97062]: pam_unix(sudo:session): session closed for user root Sep 22 15:47:16 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-b27a3908-1b42-4fe6-b0a4-16ccd2fb7b00 tempest-VolumesServicesTestJSON-893684327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-1d9227e3-f112-4f69-94cb-a8015220329e 1073741824" returned: 0 in 0.488s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:47:16 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-b27a3908-1b42-4fe6-b0a4-16ccd2fb7b00 tempest-VolumesServicesTestJSON-893684327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-1d9227e3-f112-4f69-94cb-a8015220329e {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:47:16 devstack sudo[97073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-1d9227e3-f112-4f69-94cb-a8015220329e Sep 22 15:47:16 devstack sudo[97073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:47:16 devstack sudo[97064]: pam_unix(sudo:session): session closed for user root Sep 22 15:47:16 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-152b6456-c110-42f3-a617-f230e6c66082 tempest-VolumeQuotasAdminTestJSON-617939521 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-bd804077-8e0f-4ca3-8a68-40d1265c8876" returned: 0 in 0.478s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:47:16 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-152b6456-c110-42f3-a617-f230e6c66082 tempest-VolumeQuotasAdminTestJSON-617939521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-bd804077-8e0f-4ca3-8a68-40d1265c8876 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:47:16 devstack sudo[97075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-bd804077-8e0f-4ca3-8a68-40d1265c8876 Sep 22 15:47:16 devstack sudo[97075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:47:17 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-97a7d1cd-862b-44d3-a50a-fb2324de209b tempest-VolumesSnapshotTestJSON-1852940089 None] Acquiring lock "cinder-a4fe80f5-0207-439e-ae69-5e96be043b59-delete_volume" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:47:17 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-97a7d1cd-862b-44d3-a50a-fb2324de209b tempest-VolumesSnapshotTestJSON-1852940089 None] Lock "cinder-a4fe80f5-0207-439e-ae69-5e96be043b59-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:47:17 devstack sudo[97073]: pam_unix(sudo:session): session closed for user root Sep 22 15:47:17 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-b27a3908-1b42-4fe6-b0a4-16ccd2fb7b00 tempest-VolumesServicesTestJSON-893684327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-1d9227e3-f112-4f69-94cb-a8015220329e" returned: 0 in 0.325s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:47:17 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-b27a3908-1b42-4fe6-b0a4-16ccd2fb7b00 tempest-VolumesServicesTestJSON-893684327 None] <== create_volume: return (880ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'} {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 15:47:17 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-b27a3908-1b42-4fe6-b0a4-16ccd2fb7b00 tempest-VolumesServicesTestJSON-893684327 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.882s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:47:17 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-b27a3908-1b42-4fe6-b0a4-16ccd2fb7b00 tempest-VolumesServicesTestJSON-893684327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b0babc4-d6f3-406d-ac37-c3c1d535be54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d9227e3-f112-4f69-94cb-a8015220329e', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:47:17 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-b27a3908-1b42-4fe6-b0a4-16ccd2fb7b00 tempest-VolumesServicesTestJSON-893684327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f941285-d143-4d69-b230-ecbd7ee74eb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:47:17 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-b27a3908-1b42-4fe6-b0a4-16ccd2fb7b00 tempest-VolumesServicesTestJSON-893684327 None] Volume volume-1d9227e3-f112-4f69-94cb-a8015220329e (1d9227e3-f112-4f69-94cb-a8015220329e): created successfully Sep 22 15:47:17 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-b27a3908-1b42-4fe6-b0a4-16ccd2fb7b00 tempest-VolumesServicesTestJSON-893684327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f941285-d143-4d69-b230-ecbd7ee74eb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:47:17 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-b27a3908-1b42-4fe6-b0a4-16ccd2fb7b00 tempest-VolumesServicesTestJSON-893684327 None] Flow 'volume_create_manager' (6e910f85-2ad5-47b0-a86f-aab6fef0bf81) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:47:17 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-97a7d1cd-862b-44d3-a50a-fb2324de209b tempest-VolumesSnapshotTestJSON-1852940089 None] Acquiring lock "cinder-quobyte-a4fe80f5-0207-439e-ae69-5e96be043b59" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:47:17 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-b27a3908-1b42-4fe6-b0a4-16ccd2fb7b00 tempest-VolumesServicesTestJSON-893684327 None] Created volume successfully. Sep 22 15:47:17 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-97a7d1cd-862b-44d3-a50a-fb2324de209b tempest-VolumesSnapshotTestJSON-1852940089 None] Lock "cinder-quobyte-a4fe80f5-0207-439e-ae69-5e96be043b59" acquired by "delete_volume" :: waited 0.022s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:47:17 devstack sudo[97075]: pam_unix(sudo:session): session closed for user root Sep 22 15:47:17 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-152b6456-c110-42f3-a617-f230e6c66082 tempest-VolumeQuotasAdminTestJSON-617939521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-bd804077-8e0f-4ca3-8a68-40d1265c8876" returned: 0 in 0.369s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:47:17 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[05befd05-3bae-48cb-9ddd-b325e0be57c0]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:47:17 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-97a7d1cd-862b-44d3-a50a-fb2324de209b tempest-VolumesSnapshotTestJSON-1852940089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a4fe80f5-0207-439e-ae69-5e96be043b59 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:47:17 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-152b6456-c110-42f3-a617-f230e6c66082 tempest-VolumeQuotasAdminTestJSON-617939521 None] Lock "cinder-quobyte-bd804077-8e0f-4ca3-8a68-40d1265c8876" released by "delete_volume" :: held 0.903s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:47:17 devstack cinder-volume[86212]: DEBUG cinder.quota [None req-152b6456-c110-42f3-a617-f230e6c66082 tempest-VolumeQuotasAdminTestJSON-617939521 None] Created reservations ['e90a4b64-cbe6-426a-9b13-144b5ba39006', 'aaaa4b8d-7414-46b4-9d13-faaca76fb825', '27b5f8c8-6ba6-4223-b36c-26b0a5c921fd', 'cf8aff23-2e0d-4227-82bd-982d58b8c3cb'] {{(pid=86212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 15:47:17 devstack sudo[97079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a4fe80f5-0207-439e-ae69-5e96be043b59 Sep 22 15:47:17 devstack sudo[97079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:47:17 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-152b6456-c110-42f3-a617-f230e6c66082 tempest-VolumeQuotasAdminTestJSON-617939521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:47:17 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-152b6456-c110-42f3-a617-f230e6c66082 tempest-VolumeQuotasAdminTestJSON-617939521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:47:17 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-152b6456-c110-42f3-a617-f230e6c66082 tempest-VolumeQuotasAdminTestJSON-617939521 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:47:17 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-152b6456-c110-42f3-a617-f230e6c66082 tempest-VolumeQuotasAdminTestJSON-617939521 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:47:17 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-152b6456-c110-42f3-a617-f230e6c66082 tempest-VolumeQuotasAdminTestJSON-617939521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:47:17 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-152b6456-c110-42f3-a617-f230e6c66082 tempest-VolumeQuotasAdminTestJSON-617939521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:47:17 devstack sudo[97081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc Sep 22 15:47:17 devstack sudo[97081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:47:17 devstack sudo[97079]: pam_unix(sudo:session): session closed for user root Sep 22 15:47:17 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-97a7d1cd-862b-44d3-a50a-fb2324de209b tempest-VolumesSnapshotTestJSON-1852940089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a4fe80f5-0207-439e-ae69-5e96be043b59" returned: 0 in 0.410s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:47:17 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-97a7d1cd-862b-44d3-a50a-fb2324de209b tempest-VolumesSnapshotTestJSON-1852940089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a4fe80f5-0207-439e-ae69-5e96be043b59 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:47:17 devstack sudo[97081]: pam_unix(sudo:session): session closed for user root Sep 22 15:47:17 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-152b6456-c110-42f3-a617-f230e6c66082 tempest-VolumeQuotasAdminTestJSON-617939521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc" returned: 0 in 0.260s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:47:17 devstack cinder-volume[86212]: DEBUG cinder.manager [None req-152b6456-c110-42f3-a617-f230e6c66082 tempest-VolumeQuotasAdminTestJSON-617939521 None] Notifying Schedulers of capabilities ... {{(pid=86212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 15:47:17 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-152b6456-c110-42f3-a617-f230e6c66082 tempest-VolumeQuotasAdminTestJSON-617939521 None] Deleted volume successfully. Sep 22 15:47:17 devstack sudo[97088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a4fe80f5-0207-439e-ae69-5e96be043b59 Sep 22 15:47:17 devstack sudo[97088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:47:17 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-152b6456-c110-42f3-a617-f230e6c66082 tempest-VolumeQuotasAdminTestJSON-617939521 None] Lock "cinder-bd804077-8e0f-4ca3-8a68-40d1265c8876-delete_volume" released by "delete_volume" :: held 1.413s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:47:17 devstack sudo[97088]: pam_unix(sudo:session): session closed for user root Sep 22 15:47:17 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-97a7d1cd-862b-44d3-a50a-fb2324de209b tempest-VolumesSnapshotTestJSON-1852940089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a4fe80f5-0207-439e-ae69-5e96be043b59" returned: 0 in 0.249s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:47:17 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-97a7d1cd-862b-44d3-a50a-fb2324de209b tempest-VolumesSnapshotTestJSON-1852940089 None] Lock "cinder-quobyte-a4fe80f5-0207-439e-ae69-5e96be043b59" released by "delete_volume" :: held 0.736s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:47:17 devstack cinder-volume[86212]: DEBUG cinder.quota [None req-97a7d1cd-862b-44d3-a50a-fb2324de209b tempest-VolumesSnapshotTestJSON-1852940089 None] Created reservations ['f9dcddd2-29ee-48e6-a1ba-664dd3cbcc4a', '1564ccd9-a43a-4dc9-b97d-f8d987a621a2', 'd14a860e-22a8-4df4-ab02-888e230dccbd', '4516ffa7-48c4-4088-8988-84974542a38f'] {{(pid=86212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 15:47:18 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-97a7d1cd-862b-44d3-a50a-fb2324de209b tempest-VolumesSnapshotTestJSON-1852940089 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:47:18 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-97a7d1cd-862b-44d3-a50a-fb2324de209b tempest-VolumesSnapshotTestJSON-1852940089 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:47:18 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-97a7d1cd-862b-44d3-a50a-fb2324de209b tempest-VolumesSnapshotTestJSON-1852940089 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:47:18 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-97a7d1cd-862b-44d3-a50a-fb2324de209b tempest-VolumesSnapshotTestJSON-1852940089 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:47:18 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-97a7d1cd-862b-44d3-a50a-fb2324de209b tempest-VolumesSnapshotTestJSON-1852940089 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:47:18 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-97a7d1cd-862b-44d3-a50a-fb2324de209b tempest-VolumesSnapshotTestJSON-1852940089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:47:18 devstack sudo[97091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc Sep 22 15:47:18 devstack sudo[97091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:47:18 devstack sudo[97091]: pam_unix(sudo:session): session closed for user root Sep 22 15:47:18 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-97a7d1cd-862b-44d3-a50a-fb2324de209b tempest-VolumesSnapshotTestJSON-1852940089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc" returned: 0 in 0.328s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:47:18 devstack cinder-volume[86212]: DEBUG cinder.manager [None req-97a7d1cd-862b-44d3-a50a-fb2324de209b tempest-VolumesSnapshotTestJSON-1852940089 None] Notifying Schedulers of capabilities ... {{(pid=86212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 15:47:18 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-97a7d1cd-862b-44d3-a50a-fb2324de209b tempest-VolumesSnapshotTestJSON-1852940089 None] Deleted volume successfully. Sep 22 15:47:18 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-97a7d1cd-862b-44d3-a50a-fb2324de209b tempest-VolumesSnapshotTestJSON-1852940089 None] Lock "cinder-a4fe80f5-0207-439e-ae69-5e96be043b59-delete_volume" released by "delete_volume" :: held 1.380s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:47:18 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-e6e3eab8-a515-45d3-a8f8-abc94476038a tempest-VolumesServicesTestJSON-893684327 None] Acquiring lock "cinder-1d9227e3-f112-4f69-94cb-a8015220329e-delete_volume" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:47:18 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-e6e3eab8-a515-45d3-a8f8-abc94476038a tempest-VolumesServicesTestJSON-893684327 None] Lock "cinder-1d9227e3-f112-4f69-94cb-a8015220329e-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:47:18 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-e6e3eab8-a515-45d3-a8f8-abc94476038a tempest-VolumesServicesTestJSON-893684327 None] Acquiring lock "cinder-quobyte-1d9227e3-f112-4f69-94cb-a8015220329e" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:47:18 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-e6e3eab8-a515-45d3-a8f8-abc94476038a tempest-VolumesServicesTestJSON-893684327 None] Lock "cinder-quobyte-1d9227e3-f112-4f69-94cb-a8015220329e" acquired by "delete_volume" :: waited 0.017s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:47:18 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f78b046-43df-413c-b0ce-187e5ed54499]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:47:18 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-e6e3eab8-a515-45d3-a8f8-abc94476038a tempest-VolumesServicesTestJSON-893684327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-1d9227e3-f112-4f69-94cb-a8015220329e {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:47:18 devstack sudo[97094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-1d9227e3-f112-4f69-94cb-a8015220329e Sep 22 15:47:18 devstack sudo[97094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:47:19 devstack cinder-volume[86212]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9d28205-e7b1-444e-b427-0a27cea2abc6 tempest-VolumesSnapshotTestJSON-1852940089 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 15:47:19 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-d9d28205-e7b1-444e-b427-0a27cea2abc6 tempest-VolumesSnapshotTestJSON-1852940089 None] Flow 'volume_create_manager' (1f00d96c-4cf0-4a45-8c2d-0162939c6e98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:47:19 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-d9d28205-e7b1-444e-b427-0a27cea2abc6 tempest-VolumesSnapshotTestJSON-1852940089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8593ca29-ca8f-4fc4-9cb7-9831a2447c02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:47:19 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-d9d28205-e7b1-444e-b427-0a27cea2abc6 tempest-VolumesSnapshotTestJSON-1852940089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8593ca29-ca8f-4fc4-9cb7-9831a2447c02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:47:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1754848691',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42581491-9b0a-4012-9b92-6c0be5239ad1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6705e2e1e5874f378f80abd1ee561d94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:47:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:47:19Z,use_quota=True,user_id='92fadb836e974dcb9aae676729372d23',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:47:19 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-d9d28205-e7b1-444e-b427-0a27cea2abc6 tempest-VolumesSnapshotTestJSON-1852940089 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53023ce5-710e-464c-8d4d-58af03c96c5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:47:19 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-d9d28205-e7b1-444e-b427-0a27cea2abc6 tempest-VolumesSnapshotTestJSON-1852940089 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53023ce5-710e-464c-8d4d-58af03c96c5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:47:19 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-d9d28205-e7b1-444e-b427-0a27cea2abc6 tempest-VolumesSnapshotTestJSON-1852940089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d8f1331-5b31-4741-8ab6-58dfec5d8039) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:47:19 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-d9d28205-e7b1-444e-b427-0a27cea2abc6 tempest-VolumesSnapshotTestJSON-1852940089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d8f1331-5b31-4741-8ab6-58dfec5d8039) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '42581491-9b0a-4012-9b92-6c0be5239ad1', 'volume_name': 'volume-42581491-9b0a-4012-9b92-6c0be5239ad1', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:47:19 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-d9d28205-e7b1-444e-b427-0a27cea2abc6 tempest-VolumesSnapshotTestJSON-1852940089 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d088779f-a977-4ae2-95c1-3a5a2258cab5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:47:19 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-d9d28205-e7b1-444e-b427-0a27cea2abc6 tempest-VolumesSnapshotTestJSON-1852940089 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d088779f-a977-4ae2-95c1-3a5a2258cab5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:47:19 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-d9d28205-e7b1-444e-b427-0a27cea2abc6 tempest-VolumesSnapshotTestJSON-1852940089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c783d80c-67c7-4c11-81bd-035d0fbc7e26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:47:19 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-d9d28205-e7b1-444e-b427-0a27cea2abc6 tempest-VolumesSnapshotTestJSON-1852940089 None] Volume 42581491-9b0a-4012-9b92-6c0be5239ad1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-42581491-9b0a-4012-9b92-6c0be5239ad1', 'volume_size': 1} Sep 22 15:47:19 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-d9d28205-e7b1-444e-b427-0a27cea2abc6 tempest-VolumesSnapshotTestJSON-1852940089 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:47:19 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-d9d28205-e7b1-444e-b427-0a27cea2abc6 tempest-VolumesSnapshotTestJSON-1852940089 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:47:19 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-d9d28205-e7b1-444e-b427-0a27cea2abc6 tempest-VolumesSnapshotTestJSON-1852940089 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:47:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1754848691',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42581491-9b0a-4012-9b92-6c0be5239ad1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6705e2e1e5874f378f80abd1ee561d94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:47:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:47:19Z,use_quota=True,user_id='92fadb836e974dcb9aae676729372d23',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)}" {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 15:47:19 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-d9d28205-e7b1-444e-b427-0a27cea2abc6 tempest-VolumesSnapshotTestJSON-1852940089 None] Creating volume 42581491-9b0a-4012-9b92-6c0be5239ad1 {{(pid=86212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 15:47:19 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-d9d28205-e7b1-444e-b427-0a27cea2abc6 tempest-VolumesSnapshotTestJSON-1852940089 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:47:19 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-d9d28205-e7b1-444e-b427-0a27cea2abc6 tempest-VolumesSnapshotTestJSON-1852940089 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:47:19 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-d9d28205-e7b1-444e-b427-0a27cea2abc6 tempest-VolumesSnapshotTestJSON-1852940089 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:47:19 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-d9d28205-e7b1-444e-b427-0a27cea2abc6 tempest-VolumesSnapshotTestJSON-1852940089 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:47:19 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-d9d28205-e7b1-444e-b427-0a27cea2abc6 tempest-VolumesSnapshotTestJSON-1852940089 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:47:19 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-d9d28205-e7b1-444e-b427-0a27cea2abc6 tempest-VolumesSnapshotTestJSON-1852940089 None] Selected osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 as target Quobyte volume. {{(pid=86212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 15:47:19 devstack cinder-volume[86212]: INFO cinder.volume.drivers.remotefs [None req-d9d28205-e7b1-444e-b427-0a27cea2abc6 tempest-VolumesSnapshotTestJSON-1852940089 None] casted to osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 Sep 22 15:47:19 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-d9d28205-e7b1-444e-b427-0a27cea2abc6 tempest-VolumesSnapshotTestJSON-1852940089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-42581491-9b0a-4012-9b92-6c0be5239ad1 1073741824 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:47:19 devstack sudo[97094]: pam_unix(sudo:session): session closed for user root Sep 22 15:47:19 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-e6e3eab8-a515-45d3-a8f8-abc94476038a tempest-VolumesServicesTestJSON-893684327 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-1d9227e3-f112-4f69-94cb-a8015220329e" returned: 0 in 0.585s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:47:19 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-e6e3eab8-a515-45d3-a8f8-abc94476038a tempest-VolumesServicesTestJSON-893684327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-1d9227e3-f112-4f69-94cb-a8015220329e {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:47:19 devstack sudo[97100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-42581491-9b0a-4012-9b92-6c0be5239ad1 1073741824 Sep 22 15:47:19 devstack sudo[97100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:47:19 devstack cinder-volume[86212]: DEBUG cinder.volume.flows.manager.create_volume [None req-67889e63-ffca-4381-84bb-ab7fa4a5e962 tempest-VolumeQuotasAdminTestJSON-617939521 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 15:47:19 devstack sudo[97102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-1d9227e3-f112-4f69-94cb-a8015220329e Sep 22 15:47:19 devstack sudo[97102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:47:19 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-67889e63-ffca-4381-84bb-ab7fa4a5e962 tempest-VolumeQuotasAdminTestJSON-617939521 None] Flow 'volume_create_manager' (7dc4ed1a-45ec-49c9-9321-3cb1a09b8467) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:47:19 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-67889e63-ffca-4381-84bb-ab7fa4a5e962 tempest-VolumeQuotasAdminTestJSON-617939521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (142e3242-d807-413f-b66d-c31e9324f722) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:47:19 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-67889e63-ffca-4381-84bb-ab7fa4a5e962 tempest-VolumeQuotasAdminTestJSON-617939521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (142e3242-d807-413f-b66d-c31e9324f722) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:47:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-153648646',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c96f4635-ce47-4dcf-b2e5-5b45a8a98fa9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a6bdfd6d21c4d95b55a9ebb42d7d1d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:47:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:47:19Z,use_quota=True,user_id='98e3fd1627e0415a9d9b2b1bcf8fa03e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:47:19 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-67889e63-ffca-4381-84bb-ab7fa4a5e962 tempest-VolumeQuotasAdminTestJSON-617939521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f84f5e0-00dd-46a4-b232-6b4658e8a9ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:47:19 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-67889e63-ffca-4381-84bb-ab7fa4a5e962 tempest-VolumeQuotasAdminTestJSON-617939521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f84f5e0-00dd-46a4-b232-6b4658e8a9ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:47:19 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-67889e63-ffca-4381-84bb-ab7fa4a5e962 tempest-VolumeQuotasAdminTestJSON-617939521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67db5d3a-5186-48be-9705-9fbb0e3e48ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:47:19 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-67889e63-ffca-4381-84bb-ab7fa4a5e962 tempest-VolumeQuotasAdminTestJSON-617939521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67db5d3a-5186-48be-9705-9fbb0e3e48ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c96f4635-ce47-4dcf-b2e5-5b45a8a98fa9', 'volume_name': 'volume-c96f4635-ce47-4dcf-b2e5-5b45a8a98fa9', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:47:19 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-67889e63-ffca-4381-84bb-ab7fa4a5e962 tempest-VolumeQuotasAdminTestJSON-617939521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1edc8e2a-c6ff-47fa-9b1c-3e75bd1e293d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:47:19 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-67889e63-ffca-4381-84bb-ab7fa4a5e962 tempest-VolumeQuotasAdminTestJSON-617939521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1edc8e2a-c6ff-47fa-9b1c-3e75bd1e293d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:47:19 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-67889e63-ffca-4381-84bb-ab7fa4a5e962 tempest-VolumeQuotasAdminTestJSON-617939521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2b9a470-8ef1-447b-9a83-beac640225d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:47:19 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-67889e63-ffca-4381-84bb-ab7fa4a5e962 tempest-VolumeQuotasAdminTestJSON-617939521 None] Volume c96f4635-ce47-4dcf-b2e5-5b45a8a98fa9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c96f4635-ce47-4dcf-b2e5-5b45a8a98fa9', 'volume_size': 1} Sep 22 15:47:19 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-67889e63-ffca-4381-84bb-ab7fa4a5e962 tempest-VolumeQuotasAdminTestJSON-617939521 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:47:19 devstack sudo[97102]: pam_unix(sudo:session): session closed for user root Sep 22 15:47:19 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-e6e3eab8-a515-45d3-a8f8-abc94476038a tempest-VolumesServicesTestJSON-893684327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-1d9227e3-f112-4f69-94cb-a8015220329e" returned: 0 in 0.283s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:47:19 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-e6e3eab8-a515-45d3-a8f8-abc94476038a tempest-VolumesServicesTestJSON-893684327 None] Lock "cinder-quobyte-1d9227e3-f112-4f69-94cb-a8015220329e" released by "delete_volume" :: held 0.943s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:47:19 devstack cinder-volume[86212]: DEBUG cinder.quota [None req-e6e3eab8-a515-45d3-a8f8-abc94476038a tempest-VolumesServicesTestJSON-893684327 None] Created reservations ['40659362-358c-4139-8501-2dca8019efb0', '4c06377f-384c-40c9-996c-b7ded7274271', '10862a56-1a64-4674-9108-25c6dd83e8d4', 'f11a2ef7-60f9-49d4-ab5f-b29148d9ae6c'] {{(pid=86212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 15:47:19 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-e6e3eab8-a515-45d3-a8f8-abc94476038a tempest-VolumesServicesTestJSON-893684327 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:47:19 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-e6e3eab8-a515-45d3-a8f8-abc94476038a tempest-VolumesServicesTestJSON-893684327 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:47:19 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-e6e3eab8-a515-45d3-a8f8-abc94476038a tempest-VolumesServicesTestJSON-893684327 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:47:19 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-e6e3eab8-a515-45d3-a8f8-abc94476038a tempest-VolumesServicesTestJSON-893684327 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:47:19 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-e6e3eab8-a515-45d3-a8f8-abc94476038a tempest-VolumesServicesTestJSON-893684327 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:47:19 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-e6e3eab8-a515-45d3-a8f8-abc94476038a tempest-VolumesServicesTestJSON-893684327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:47:19 devstack sudo[97109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc Sep 22 15:47:19 devstack sudo[97109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:47:19 devstack sudo[97100]: pam_unix(sudo:session): session closed for user root Sep 22 15:47:19 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-d9d28205-e7b1-444e-b427-0a27cea2abc6 tempest-VolumesSnapshotTestJSON-1852940089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-42581491-9b0a-4012-9b92-6c0be5239ad1 1073741824" returned: 0 in 0.560s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:47:19 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-d9d28205-e7b1-444e-b427-0a27cea2abc6 tempest-VolumesSnapshotTestJSON-1852940089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-42581491-9b0a-4012-9b92-6c0be5239ad1 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:47:19 devstack sudo[97111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-42581491-9b0a-4012-9b92-6c0be5239ad1 Sep 22 15:47:19 devstack sudo[97111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:47:20 devstack sudo[97109]: pam_unix(sudo:session): session closed for user root Sep 22 15:47:20 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-e6e3eab8-a515-45d3-a8f8-abc94476038a tempest-VolumesServicesTestJSON-893684327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc" returned: 0 in 0.303s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:47:20 devstack cinder-volume[86212]: DEBUG cinder.manager [None req-e6e3eab8-a515-45d3-a8f8-abc94476038a tempest-VolumesServicesTestJSON-893684327 None] Notifying Schedulers of capabilities ... {{(pid=86212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 15:47:20 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-e6e3eab8-a515-45d3-a8f8-abc94476038a tempest-VolumesServicesTestJSON-893684327 None] Deleted volume successfully. Sep 22 15:47:20 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-e6e3eab8-a515-45d3-a8f8-abc94476038a tempest-VolumesServicesTestJSON-893684327 None] Lock "cinder-1d9227e3-f112-4f69-94cb-a8015220329e-delete_volume" released by "delete_volume" :: held 1.529s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:47:20 devstack sudo[97111]: pam_unix(sudo:session): session closed for user root Sep 22 15:47:20 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-d9d28205-e7b1-444e-b427-0a27cea2abc6 tempest-VolumesSnapshotTestJSON-1852940089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-42581491-9b0a-4012-9b92-6c0be5239ad1" returned: 0 in 0.321s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:47:20 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-d9d28205-e7b1-444e-b427-0a27cea2abc6 tempest-VolumesSnapshotTestJSON-1852940089 None] <== create_volume: return (933ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'} {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 15:47:20 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-d9d28205-e7b1-444e-b427-0a27cea2abc6 tempest-VolumesSnapshotTestJSON-1852940089 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.936s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:47:20 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-67889e63-ffca-4381-84bb-ab7fa4a5e962 tempest-VolumeQuotasAdminTestJSON-617939521 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.770s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:47:20 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-67889e63-ffca-4381-84bb-ab7fa4a5e962 tempest-VolumeQuotasAdminTestJSON-617939521 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:47:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-153648646',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c96f4635-ce47-4dcf-b2e5-5b45a8a98fa9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a6bdfd6d21c4d95b55a9ebb42d7d1d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:47:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:47:19Z,use_quota=True,user_id='98e3fd1627e0415a9d9b2b1bcf8fa03e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)}" {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 15:47:20 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-67889e63-ffca-4381-84bb-ab7fa4a5e962 tempest-VolumeQuotasAdminTestJSON-617939521 None] Creating volume c96f4635-ce47-4dcf-b2e5-5b45a8a98fa9 {{(pid=86212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 15:47:20 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-67889e63-ffca-4381-84bb-ab7fa4a5e962 tempest-VolumeQuotasAdminTestJSON-617939521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:47:20 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-67889e63-ffca-4381-84bb-ab7fa4a5e962 tempest-VolumeQuotasAdminTestJSON-617939521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:47:20 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-67889e63-ffca-4381-84bb-ab7fa4a5e962 tempest-VolumeQuotasAdminTestJSON-617939521 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:47:20 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-67889e63-ffca-4381-84bb-ab7fa4a5e962 tempest-VolumeQuotasAdminTestJSON-617939521 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:47:20 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-67889e63-ffca-4381-84bb-ab7fa4a5e962 tempest-VolumeQuotasAdminTestJSON-617939521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:47:20 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-67889e63-ffca-4381-84bb-ab7fa4a5e962 tempest-VolumeQuotasAdminTestJSON-617939521 None] Selected osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 as target Quobyte volume. {{(pid=86212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 15:47:20 devstack cinder-volume[86212]: INFO cinder.volume.drivers.remotefs [None req-67889e63-ffca-4381-84bb-ab7fa4a5e962 tempest-VolumeQuotasAdminTestJSON-617939521 None] casted to osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 Sep 22 15:47:20 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-67889e63-ffca-4381-84bb-ab7fa4a5e962 tempest-VolumeQuotasAdminTestJSON-617939521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-c96f4635-ce47-4dcf-b2e5-5b45a8a98fa9 1073741824 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:47:20 devstack sudo[97115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-c96f4635-ce47-4dcf-b2e5-5b45a8a98fa9 1073741824 Sep 22 15:47:20 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-d9d28205-e7b1-444e-b427-0a27cea2abc6 tempest-VolumesSnapshotTestJSON-1852940089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c783d80c-67c7-4c11-81bd-035d0fbc7e26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-42581491-9b0a-4012-9b92-6c0be5239ad1', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:47:20 devstack sudo[97115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:47:20 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-d9d28205-e7b1-444e-b427-0a27cea2abc6 tempest-VolumesSnapshotTestJSON-1852940089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f77ee53c-8577-4455-b9e6-a6e07d47fc23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:47:20 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-d9d28205-e7b1-444e-b427-0a27cea2abc6 tempest-VolumesSnapshotTestJSON-1852940089 None] Volume volume-42581491-9b0a-4012-9b92-6c0be5239ad1 (42581491-9b0a-4012-9b92-6c0be5239ad1): created successfully Sep 22 15:47:20 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-d9d28205-e7b1-444e-b427-0a27cea2abc6 tempest-VolumesSnapshotTestJSON-1852940089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f77ee53c-8577-4455-b9e6-a6e07d47fc23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:47:20 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-d9d28205-e7b1-444e-b427-0a27cea2abc6 tempest-VolumesSnapshotTestJSON-1852940089 None] Flow 'volume_create_manager' (1f00d96c-4cf0-4a45-8c2d-0162939c6e98) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:47:20 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-d9d28205-e7b1-444e-b427-0a27cea2abc6 tempest-VolumesSnapshotTestJSON-1852940089 None] Created volume successfully. Sep 22 15:47:20 devstack sudo[97115]: pam_unix(sudo:session): session closed for user root Sep 22 15:47:20 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-67889e63-ffca-4381-84bb-ab7fa4a5e962 tempest-VolumeQuotasAdminTestJSON-617939521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-c96f4635-ce47-4dcf-b2e5-5b45a8a98fa9 1073741824" returned: 0 in 0.456s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:47:20 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-67889e63-ffca-4381-84bb-ab7fa4a5e962 tempest-VolumeQuotasAdminTestJSON-617939521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-c96f4635-ce47-4dcf-b2e5-5b45a8a98fa9 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:47:20 devstack sudo[97121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-c96f4635-ce47-4dcf-b2e5-5b45a8a98fa9 Sep 22 15:47:20 devstack sudo[97121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:47:20 devstack sudo[97121]: pam_unix(sudo:session): session closed for user root Sep 22 15:47:20 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-67889e63-ffca-4381-84bb-ab7fa4a5e962 tempest-VolumeQuotasAdminTestJSON-617939521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-c96f4635-ce47-4dcf-b2e5-5b45a8a98fa9" returned: 0 in 0.283s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:47:20 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-67889e63-ffca-4381-84bb-ab7fa4a5e962 tempest-VolumeQuotasAdminTestJSON-617939521 None] <== create_volume: return (797ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'} {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 15:47:20 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-67889e63-ffca-4381-84bb-ab7fa4a5e962 tempest-VolumeQuotasAdminTestJSON-617939521 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.800s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:47:20 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-67889e63-ffca-4381-84bb-ab7fa4a5e962 tempest-VolumeQuotasAdminTestJSON-617939521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2b9a470-8ef1-447b-9a83-beac640225d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c96f4635-ce47-4dcf-b2e5-5b45a8a98fa9', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:47:20 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-67889e63-ffca-4381-84bb-ab7fa4a5e962 tempest-VolumeQuotasAdminTestJSON-617939521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6da60fc8-a1ee-43a9-bdce-b43afe6bc57a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:47:20 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-67889e63-ffca-4381-84bb-ab7fa4a5e962 tempest-VolumeQuotasAdminTestJSON-617939521 None] Volume volume-c96f4635-ce47-4dcf-b2e5-5b45a8a98fa9 (c96f4635-ce47-4dcf-b2e5-5b45a8a98fa9): created successfully Sep 22 15:47:20 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-67889e63-ffca-4381-84bb-ab7fa4a5e962 tempest-VolumeQuotasAdminTestJSON-617939521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6da60fc8-a1ee-43a9-bdce-b43afe6bc57a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:47:20 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-67889e63-ffca-4381-84bb-ab7fa4a5e962 tempest-VolumeQuotasAdminTestJSON-617939521 None] Flow 'volume_create_manager' (7dc4ed1a-45ec-49c9-9321-3cb1a09b8467) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:47:21 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-67889e63-ffca-4381-84bb-ab7fa4a5e962 tempest-VolumeQuotasAdminTestJSON-617939521 None] Created volume successfully. Sep 22 15:47:21 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-6aefffba-ca9e-4f8a-8808-d966386c361a tempest-VolumesSnapshotTestJSON-1852940089 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:47:21 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-6aefffba-ca9e-4f8a-8808-d966386c361a tempest-VolumesSnapshotTestJSON-1852940089 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:47:21 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-6aefffba-ca9e-4f8a-8808-d966386c361a tempest-VolumesSnapshotTestJSON-1852940089 None] Creating offline snapshot 54ac574d-c375-41d8-8980-2c6850e3497e of volume 42581491-9b0a-4012-9b92-6c0be5239ad1 {{(pid=86212) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 22 15:47:21 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[9afa4b24-d587-4262-b748-cba2dcc10173]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:47:21 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-6aefffba-ca9e-4f8a-8808-d966386c361a tempest-VolumesSnapshotTestJSON-1852940089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-42581491-9b0a-4012-9b92-6c0be5239ad1 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:47:21 devstack sudo[97124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-42581491-9b0a-4012-9b92-6c0be5239ad1 Sep 22 15:47:21 devstack sudo[97124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:47:22 devstack sudo[97124]: pam_unix(sudo:session): session closed for user root Sep 22 15:47:22 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-6aefffba-ca9e-4f8a-8808-d966386c361a tempest-VolumesSnapshotTestJSON-1852940089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-42581491-9b0a-4012-9b92-6c0be5239ad1" returned: 0 in 0.520s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:47:22 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-6aefffba-ca9e-4f8a-8808-d966386c361a tempest-VolumesSnapshotTestJSON-1852940089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-42581491-9b0a-4012-9b92-6c0be5239ad1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-42581491-9b0a-4012-9b92-6c0be5239ad1.54ac574d-c375-41d8-8980-2c6850e3497e 1G {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:47:22 devstack sudo[97130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-42581491-9b0a-4012-9b92-6c0be5239ad1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-42581491-9b0a-4012-9b92-6c0be5239ad1.54ac574d-c375-41d8-8980-2c6850e3497e 1G Sep 22 15:47:22 devstack sudo[97130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:47:22 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-534f1cee-f6be-46ab-9a9a-dbaa791deb9a tempest-VolumeQuotasAdminTestJSON-1314402745 None] Transfer volume completed successfully. Sep 22 15:47:22 devstack sudo[97130]: pam_unix(sudo:session): session closed for user root Sep 22 15:47:22 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-6aefffba-ca9e-4f8a-8808-d966386c361a tempest-VolumesSnapshotTestJSON-1852940089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-42581491-9b0a-4012-9b92-6c0be5239ad1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-42581491-9b0a-4012-9b92-6c0be5239ad1.54ac574d-c375-41d8-8980-2c6850e3497e 1G" returned: 0 in 0.577s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:47:22 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-6aefffba-ca9e-4f8a-8808-d966386c361a tempest-VolumesSnapshotTestJSON-1852940089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-42581491-9b0a-4012-9b92-6c0be5239ad1 -F qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-42581491-9b0a-4012-9b92-6c0be5239ad1.54ac574d-c375-41d8-8980-2c6850e3497e {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:47:22 devstack sudo[97137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-42581491-9b0a-4012-9b92-6c0be5239ad1 -F qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-42581491-9b0a-4012-9b92-6c0be5239ad1.54ac574d-c375-41d8-8980-2c6850e3497e Sep 22 15:47:22 devstack sudo[97137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:47:23 devstack sudo[97137]: pam_unix(sudo:session): session closed for user root Sep 22 15:47:23 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-6aefffba-ca9e-4f8a-8808-d966386c361a tempest-VolumesSnapshotTestJSON-1852940089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-42581491-9b0a-4012-9b92-6c0be5239ad1 -F qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-42581491-9b0a-4012-9b92-6c0be5239ad1.54ac574d-c375-41d8-8980-2c6850e3497e" returned: 0 in 0.440s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:47:23 devstack cinder-volume[86212]: WARNING cinder.volume.drivers.remotefs [None req-6aefffba-ca9e-4f8a-8808-d966386c361a tempest-VolumesSnapshotTestJSON-1852940089 None] /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-42581491-9b0a-4012-9b92-6c0be5239ad1.54ac574d-c375-41d8-8980-2c6850e3497e is being set with open permissions: ugo+rw Sep 22 15:47:23 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-6aefffba-ca9e-4f8a-8808-d966386c361a tempest-VolumesSnapshotTestJSON-1852940089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-42581491-9b0a-4012-9b92-6c0be5239ad1.54ac574d-c375-41d8-8980-2c6850e3497e {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:47:23 devstack sudo[97142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-42581491-9b0a-4012-9b92-6c0be5239ad1.54ac574d-c375-41d8-8980-2c6850e3497e Sep 22 15:47:23 devstack sudo[97142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:47:23 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-be06aabb-6912-4a34-a9e0-89db6a483a17 tempest-VolumeQuotasAdminTestJSON-1735963699 None] Acquiring lock "cinder-c96f4635-ce47-4dcf-b2e5-5b45a8a98fa9-delete_volume" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:47:23 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-be06aabb-6912-4a34-a9e0-89db6a483a17 tempest-VolumeQuotasAdminTestJSON-1735963699 None] Lock "cinder-c96f4635-ce47-4dcf-b2e5-5b45a8a98fa9-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:47:23 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-be06aabb-6912-4a34-a9e0-89db6a483a17 tempest-VolumeQuotasAdminTestJSON-1735963699 None] Acquiring lock "cinder-quobyte-c96f4635-ce47-4dcf-b2e5-5b45a8a98fa9" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:47:23 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-be06aabb-6912-4a34-a9e0-89db6a483a17 tempest-VolumeQuotasAdminTestJSON-1735963699 None] Lock "cinder-quobyte-c96f4635-ce47-4dcf-b2e5-5b45a8a98fa9" acquired by "delete_volume" :: waited 0.019s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:47:23 devstack sudo[97142]: pam_unix(sudo:session): session closed for user root Sep 22 15:47:23 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-6aefffba-ca9e-4f8a-8808-d966386c361a tempest-VolumesSnapshotTestJSON-1852940089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-42581491-9b0a-4012-9b92-6c0be5239ad1.54ac574d-c375-41d8-8980-2c6850e3497e" returned: 0 in 0.341s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:47:23 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ea41947-659c-43d4-afc0-fbc1d4c10ee7]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:47:23 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-be06aabb-6912-4a34-a9e0-89db6a483a17 tempest-VolumeQuotasAdminTestJSON-1735963699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-c96f4635-ce47-4dcf-b2e5-5b45a8a98fa9 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:47:23 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-6aefffba-ca9e-4f8a-8808-d966386c361a tempest-VolumesSnapshotTestJSON-1852940089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-42581491-9b0a-4012-9b92-6c0be5239ad1.info {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:47:23 devstack sudo[97146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-42581491-9b0a-4012-9b92-6c0be5239ad1.info Sep 22 15:47:23 devstack sudo[97146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:47:23 devstack sudo[97145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-c96f4635-ce47-4dcf-b2e5-5b45a8a98fa9 Sep 22 15:47:23 devstack sudo[97145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:47:23 devstack sudo[97146]: pam_unix(sudo:session): session closed for user root Sep 22 15:47:23 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-6aefffba-ca9e-4f8a-8808-d966386c361a tempest-VolumesSnapshotTestJSON-1852940089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-42581491-9b0a-4012-9b92-6c0be5239ad1.info" returned: 0 in 0.403s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:47:23 devstack cinder-volume[86212]: WARNING cinder.volume.drivers.remotefs [None req-6aefffba-ca9e-4f8a-8808-d966386c361a tempest-VolumesSnapshotTestJSON-1852940089 None] /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-42581491-9b0a-4012-9b92-6c0be5239ad1.info is being set with open permissions: ugo+rw Sep 22 15:47:23 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-6aefffba-ca9e-4f8a-8808-d966386c361a tempest-VolumesSnapshotTestJSON-1852940089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-42581491-9b0a-4012-9b92-6c0be5239ad1.info {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:47:23 devstack sudo[97150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-42581491-9b0a-4012-9b92-6c0be5239ad1.info Sep 22 15:47:23 devstack sudo[97150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:47:24 devstack sudo[97145]: pam_unix(sudo:session): session closed for user root Sep 22 15:47:24 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-be06aabb-6912-4a34-a9e0-89db6a483a17 tempest-VolumeQuotasAdminTestJSON-1735963699 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-c96f4635-ce47-4dcf-b2e5-5b45a8a98fa9" returned: 0 in 0.629s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:47:24 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-be06aabb-6912-4a34-a9e0-89db6a483a17 tempest-VolumeQuotasAdminTestJSON-1735963699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-c96f4635-ce47-4dcf-b2e5-5b45a8a98fa9 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:47:24 devstack sudo[97155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-c96f4635-ce47-4dcf-b2e5-5b45a8a98fa9 Sep 22 15:47:24 devstack sudo[97155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:47:24 devstack sudo[97150]: pam_unix(sudo:session): session closed for user root Sep 22 15:47:24 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-6aefffba-ca9e-4f8a-8808-d966386c361a tempest-VolumesSnapshotTestJSON-1852940089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-42581491-9b0a-4012-9b92-6c0be5239ad1.info" returned: 0 in 0.344s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:47:24 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-6aefffba-ca9e-4f8a-8808-d966386c361a tempest-VolumesSnapshotTestJSON-1852940089 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.786s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:47:24 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-6aefffba-ca9e-4f8a-8808-d966386c361a tempest-VolumesSnapshotTestJSON-1852940089 None] Create snapshot completed successfully Sep 22 15:47:24 devstack sudo[97155]: pam_unix(sudo:session): session closed for user root Sep 22 15:47:24 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-be06aabb-6912-4a34-a9e0-89db6a483a17 tempest-VolumeQuotasAdminTestJSON-1735963699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-c96f4635-ce47-4dcf-b2e5-5b45a8a98fa9" returned: 0 in 0.313s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:47:24 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-be06aabb-6912-4a34-a9e0-89db6a483a17 tempest-VolumeQuotasAdminTestJSON-1735963699 None] Lock "cinder-quobyte-c96f4635-ce47-4dcf-b2e5-5b45a8a98fa9" released by "delete_volume" :: held 1.008s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:47:24 devstack cinder-volume[86212]: DEBUG cinder.quota [None req-be06aabb-6912-4a34-a9e0-89db6a483a17 tempest-VolumeQuotasAdminTestJSON-1735963699 None] Created reservations ['9bd15c96-64ad-465b-ad3c-92f6da81a8b2', '437a2629-5145-4563-aeb2-611b8b1351ad', '4fdbdadf-1cd9-4998-9d6f-69c431a4b35f', '07c2c062-5a08-4201-b3c6-cb43a5a3d287'] {{(pid=86212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 15:47:24 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-be06aabb-6912-4a34-a9e0-89db6a483a17 tempest-VolumeQuotasAdminTestJSON-1735963699 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:47:24 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-be06aabb-6912-4a34-a9e0-89db6a483a17 tempest-VolumeQuotasAdminTestJSON-1735963699 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:47:24 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-be06aabb-6912-4a34-a9e0-89db6a483a17 tempest-VolumeQuotasAdminTestJSON-1735963699 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:47:24 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-be06aabb-6912-4a34-a9e0-89db6a483a17 tempest-VolumeQuotasAdminTestJSON-1735963699 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:47:24 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-be06aabb-6912-4a34-a9e0-89db6a483a17 tempest-VolumeQuotasAdminTestJSON-1735963699 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:47:24 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-be06aabb-6912-4a34-a9e0-89db6a483a17 tempest-VolumeQuotasAdminTestJSON-1735963699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:47:24 devstack sudo[97159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc Sep 22 15:47:24 devstack sudo[97159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:47:24 devstack sudo[97159]: pam_unix(sudo:session): session closed for user root Sep 22 15:47:24 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-be06aabb-6912-4a34-a9e0-89db6a483a17 tempest-VolumeQuotasAdminTestJSON-1735963699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc" returned: 0 in 0.347s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:47:24 devstack cinder-volume[86212]: DEBUG cinder.manager [None req-be06aabb-6912-4a34-a9e0-89db6a483a17 tempest-VolumeQuotasAdminTestJSON-1735963699 None] Notifying Schedulers of capabilities ... {{(pid=86212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 15:47:24 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-be06aabb-6912-4a34-a9e0-89db6a483a17 tempest-VolumeQuotasAdminTestJSON-1735963699 None] Deleted volume successfully. Sep 22 15:47:24 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-be06aabb-6912-4a34-a9e0-89db6a483a17 tempest-VolumeQuotasAdminTestJSON-1735963699 None] Lock "cinder-c96f4635-ce47-4dcf-b2e5-5b45a8a98fa9-delete_volume" released by "delete_volume" :: held 1.700s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:47:25 devstack cinder-volume[86212]: DEBUG cinder.volume.flows.manager.create_volume [None req-daa44ece-ffdc-46fc-b35e-53a190df7e3f tempest-TestServerVolumeAttachmentScenario-1578422816 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 15:47:25 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-daa44ece-ffdc-46fc-b35e-53a190df7e3f tempest-TestServerVolumeAttachmentScenario-1578422816 None] Flow 'volume_create_manager' (5da0e143-cd24-4d31-b90e-4eb7d218479c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:47:25 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-daa44ece-ffdc-46fc-b35e-53a190df7e3f tempest-TestServerVolumeAttachmentScenario-1578422816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5207c17d-3c9e-41f9-a70d-77183d612ea5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:47:25 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-daa44ece-ffdc-46fc-b35e-53a190df7e3f tempest-TestServerVolumeAttachmentScenario-1578422816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5207c17d-3c9e-41f9-a70d-77183d612ea5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:47:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1625301817',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8616712-676c-475f-9bce-b2189d11b318,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f27df199c05948178f02555b8e60aa11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:47:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:47:25Z,use_quota=True,user_id='3ac4a6570b9d4449bff8fa94129b6662',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:47:25 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-daa44ece-ffdc-46fc-b35e-53a190df7e3f tempest-TestServerVolumeAttachmentScenario-1578422816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9e72ade-534b-41c8-b8be-3793b375ce0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:47:25 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-daa44ece-ffdc-46fc-b35e-53a190df7e3f tempest-TestServerVolumeAttachmentScenario-1578422816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9e72ade-534b-41c8-b8be-3793b375ce0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:47:25 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-daa44ece-ffdc-46fc-b35e-53a190df7e3f tempest-TestServerVolumeAttachmentScenario-1578422816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25dc844a-71bd-40f8-8398-e30ef88d52ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:47:25 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-daa44ece-ffdc-46fc-b35e-53a190df7e3f tempest-TestServerVolumeAttachmentScenario-1578422816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25dc844a-71bd-40f8-8398-e30ef88d52ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd8616712-676c-475f-9bce-b2189d11b318', 'volume_name': 'volume-d8616712-676c-475f-9bce-b2189d11b318', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:47:25 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-daa44ece-ffdc-46fc-b35e-53a190df7e3f tempest-TestServerVolumeAttachmentScenario-1578422816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08d136d8-dbda-4e76-8e2b-8c606249e11c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:47:25 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-daa44ece-ffdc-46fc-b35e-53a190df7e3f tempest-TestServerVolumeAttachmentScenario-1578422816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08d136d8-dbda-4e76-8e2b-8c606249e11c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:47:25 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-daa44ece-ffdc-46fc-b35e-53a190df7e3f tempest-TestServerVolumeAttachmentScenario-1578422816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68381816-027d-4011-95f2-7adbeda0b472) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:47:25 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-daa44ece-ffdc-46fc-b35e-53a190df7e3f tempest-TestServerVolumeAttachmentScenario-1578422816 None] Volume d8616712-676c-475f-9bce-b2189d11b318: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d8616712-676c-475f-9bce-b2189d11b318', 'volume_size': 1} Sep 22 15:47:25 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-daa44ece-ffdc-46fc-b35e-53a190df7e3f tempest-TestServerVolumeAttachmentScenario-1578422816 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:47:25 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-daa44ece-ffdc-46fc-b35e-53a190df7e3f tempest-TestServerVolumeAttachmentScenario-1578422816 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:47:25 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-daa44ece-ffdc-46fc-b35e-53a190df7e3f tempest-TestServerVolumeAttachmentScenario-1578422816 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:47:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1625301817',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8616712-676c-475f-9bce-b2189d11b318,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f27df199c05948178f02555b8e60aa11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:47:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:47:25Z,use_quota=True,user_id='3ac4a6570b9d4449bff8fa94129b6662',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)}" {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 15:47:25 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-daa44ece-ffdc-46fc-b35e-53a190df7e3f tempest-TestServerVolumeAttachmentScenario-1578422816 None] Creating volume d8616712-676c-475f-9bce-b2189d11b318 {{(pid=86212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 15:47:25 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-daa44ece-ffdc-46fc-b35e-53a190df7e3f tempest-TestServerVolumeAttachmentScenario-1578422816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:47:25 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-daa44ece-ffdc-46fc-b35e-53a190df7e3f tempest-TestServerVolumeAttachmentScenario-1578422816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:47:25 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-daa44ece-ffdc-46fc-b35e-53a190df7e3f tempest-TestServerVolumeAttachmentScenario-1578422816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:47:25 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-daa44ece-ffdc-46fc-b35e-53a190df7e3f tempest-TestServerVolumeAttachmentScenario-1578422816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:47:25 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-daa44ece-ffdc-46fc-b35e-53a190df7e3f tempest-TestServerVolumeAttachmentScenario-1578422816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:47:25 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-daa44ece-ffdc-46fc-b35e-53a190df7e3f tempest-TestServerVolumeAttachmentScenario-1578422816 None] Selected osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 as target Quobyte volume. {{(pid=86212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 15:47:25 devstack cinder-volume[86212]: INFO cinder.volume.drivers.remotefs [None req-daa44ece-ffdc-46fc-b35e-53a190df7e3f tempest-TestServerVolumeAttachmentScenario-1578422816 None] casted to osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 Sep 22 15:47:25 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-daa44ece-ffdc-46fc-b35e-53a190df7e3f tempest-TestServerVolumeAttachmentScenario-1578422816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-d8616712-676c-475f-9bce-b2189d11b318 1073741824 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:47:25 devstack sudo[97165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-d8616712-676c-475f-9bce-b2189d11b318 1073741824 Sep 22 15:47:25 devstack sudo[97165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:47:25 devstack cinder-volume[86212]: DEBUG cinder.volume.flows.manager.create_volume [None req-663ea679-18b2-4c25-b58d-f6059963e7bb tempest-VolumesSnapshotTestJSON-1852940089 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 15:47:25 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-663ea679-18b2-4c25-b58d-f6059963e7bb tempest-VolumesSnapshotTestJSON-1852940089 None] Flow 'volume_create_manager' (677ac528-c6bd-4781-9e0c-9bb6d217686f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:47:25 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-663ea679-18b2-4c25-b58d-f6059963e7bb tempest-VolumesSnapshotTestJSON-1852940089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55dee956-f74c-465a-9f01-3acf53d57417) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:47:25 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-663ea679-18b2-4c25-b58d-f6059963e7bb tempest-VolumesSnapshotTestJSON-1852940089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55dee956-f74c-465a-9f01-3acf53d57417) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:47:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1889295053',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=511735b9-e1b7-4730-b0b3-02a886d80351,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6705e2e1e5874f378f80abd1ee561d94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:47:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=54ac574d-c375-41d8-8980-2c6850e3497e,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:47:25Z,use_quota=True,user_id='92fadb836e974dcb9aae676729372d23',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:47:25 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-663ea679-18b2-4c25-b58d-f6059963e7bb tempest-VolumesSnapshotTestJSON-1852940089 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bebc3a6b-46af-4dc3-aaed-b9c5a3677e3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:47:25 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-663ea679-18b2-4c25-b58d-f6059963e7bb tempest-VolumesSnapshotTestJSON-1852940089 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bebc3a6b-46af-4dc3-aaed-b9c5a3677e3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:47:25 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-663ea679-18b2-4c25-b58d-f6059963e7bb tempest-VolumesSnapshotTestJSON-1852940089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7901625-6a79-4f85-8a53-c546905c43cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:47:25 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-663ea679-18b2-4c25-b58d-f6059963e7bb tempest-VolumesSnapshotTestJSON-1852940089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7901625-6a79-4f85-8a53-c546905c43cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '511735b9-e1b7-4730-b0b3-02a886d80351', 'volume_name': 'volume-511735b9-e1b7-4730-b0b3-02a886d80351', 'volume_size': 1, 'snapshot_id': '54ac574d-c375-41d8-8980-2c6850e3497e'}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:47:25 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-663ea679-18b2-4c25-b58d-f6059963e7bb tempest-VolumesSnapshotTestJSON-1852940089 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee88da68-7550-4700-a372-2c95e6e9eb9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:47:25 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-663ea679-18b2-4c25-b58d-f6059963e7bb tempest-VolumesSnapshotTestJSON-1852940089 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee88da68-7550-4700-a372-2c95e6e9eb9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:47:25 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-663ea679-18b2-4c25-b58d-f6059963e7bb tempest-VolumesSnapshotTestJSON-1852940089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e56263a2-36ce-4953-8ce9-2b08936c81bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:47:25 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-663ea679-18b2-4c25-b58d-f6059963e7bb tempest-VolumesSnapshotTestJSON-1852940089 None] Volume 511735b9-e1b7-4730-b0b3-02a886d80351: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-511735b9-e1b7-4730-b0b3-02a886d80351', 'volume_size': 1, 'snapshot_id': '54ac574d-c375-41d8-8980-2c6850e3497e'} Sep 22 15:47:25 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-663ea679-18b2-4c25-b58d-f6059963e7bb tempest-VolumesSnapshotTestJSON-1852940089 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:47:25 devstack cinder-volume[86212]: DEBUG cinder.volume.flows.manager.create_volume [None req-42bd0bab-7792-4e12-9772-75e357514b22 tempest-TestServerVolumeAttachmentScenario-1578422816 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 15:47:25 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-42bd0bab-7792-4e12-9772-75e357514b22 tempest-TestServerVolumeAttachmentScenario-1578422816 None] Flow 'volume_create_manager' (d63bf8a7-1425-41ce-9276-4b13e3b2d67a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:47:25 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-42bd0bab-7792-4e12-9772-75e357514b22 tempest-TestServerVolumeAttachmentScenario-1578422816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36f44368-188f-4e1b-b7b5-86b2793d79f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:47:25 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-42bd0bab-7792-4e12-9772-75e357514b22 tempest-TestServerVolumeAttachmentScenario-1578422816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36f44368-188f-4e1b-b7b5-86b2793d79f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:47:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1358273320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc4944d5-77f1-4d63-8e0c-35585b7a43f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f27df199c05948178f02555b8e60aa11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:47:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:47:26Z,use_quota=True,user_id='3ac4a6570b9d4449bff8fa94129b6662',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:47:25 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-42bd0bab-7792-4e12-9772-75e357514b22 tempest-TestServerVolumeAttachmentScenario-1578422816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e1e7877-13a3-449d-8763-3cdeda4d6a0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:47:25 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-42bd0bab-7792-4e12-9772-75e357514b22 tempest-TestServerVolumeAttachmentScenario-1578422816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e1e7877-13a3-449d-8763-3cdeda4d6a0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:47:25 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-42bd0bab-7792-4e12-9772-75e357514b22 tempest-TestServerVolumeAttachmentScenario-1578422816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35315814-e80b-43c7-a146-d73589103f1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:47:25 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-42bd0bab-7792-4e12-9772-75e357514b22 tempest-TestServerVolumeAttachmentScenario-1578422816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35315814-e80b-43c7-a146-d73589103f1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bc4944d5-77f1-4d63-8e0c-35585b7a43f6', 'volume_name': 'volume-bc4944d5-77f1-4d63-8e0c-35585b7a43f6', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:47:25 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-42bd0bab-7792-4e12-9772-75e357514b22 tempest-TestServerVolumeAttachmentScenario-1578422816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f707daf4-6096-4811-baba-5d2cca860a02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:47:25 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-42bd0bab-7792-4e12-9772-75e357514b22 tempest-TestServerVolumeAttachmentScenario-1578422816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f707daf4-6096-4811-baba-5d2cca860a02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:47:25 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-42bd0bab-7792-4e12-9772-75e357514b22 tempest-TestServerVolumeAttachmentScenario-1578422816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9820e7a0-c8b5-49dd-9db0-45532dc39066) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:47:25 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-42bd0bab-7792-4e12-9772-75e357514b22 tempest-TestServerVolumeAttachmentScenario-1578422816 None] Volume bc4944d5-77f1-4d63-8e0c-35585b7a43f6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bc4944d5-77f1-4d63-8e0c-35585b7a43f6', 'volume_size': 1} Sep 22 15:47:25 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-42bd0bab-7792-4e12-9772-75e357514b22 tempest-TestServerVolumeAttachmentScenario-1578422816 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:47:26 devstack sudo[97165]: pam_unix(sudo:session): session closed for user root Sep 22 15:47:26 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-daa44ece-ffdc-46fc-b35e-53a190df7e3f tempest-TestServerVolumeAttachmentScenario-1578422816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-d8616712-676c-475f-9bce-b2189d11b318 1073741824" returned: 0 in 0.774s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:47:26 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-daa44ece-ffdc-46fc-b35e-53a190df7e3f tempest-TestServerVolumeAttachmentScenario-1578422816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-d8616712-676c-475f-9bce-b2189d11b318 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:47:26 devstack sudo[97171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-d8616712-676c-475f-9bce-b2189d11b318 Sep 22 15:47:26 devstack sudo[97171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:47:26 devstack sudo[97171]: pam_unix(sudo:session): session closed for user root Sep 22 15:47:26 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-daa44ece-ffdc-46fc-b35e-53a190df7e3f tempest-TestServerVolumeAttachmentScenario-1578422816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-d8616712-676c-475f-9bce-b2189d11b318" returned: 0 in 0.316s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:47:26 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-daa44ece-ffdc-46fc-b35e-53a190df7e3f tempest-TestServerVolumeAttachmentScenario-1578422816 None] <== create_volume: return (1156ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'} {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 15:47:26 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-daa44ece-ffdc-46fc-b35e-53a190df7e3f tempest-TestServerVolumeAttachmentScenario-1578422816 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.160s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:47:26 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-663ea679-18b2-4c25-b58d-f6059963e7bb tempest-VolumesSnapshotTestJSON-1852940089 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.777s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:47:26 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-663ea679-18b2-4c25-b58d-f6059963e7bb tempest-VolumesSnapshotTestJSON-1852940089 None] Acquiring lock "cinder-quobyte-54ac574d-c375-41d8-8980-2c6850e3497e-511735b9-e1b7-4730-b0b3-02a886d80351" by "_create_volume_from_snapshot" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:47:26 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-daa44ece-ffdc-46fc-b35e-53a190df7e3f tempest-TestServerVolumeAttachmentScenario-1578422816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68381816-027d-4011-95f2-7adbeda0b472) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d8616712-676c-475f-9bce-b2189d11b318', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:47:26 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-daa44ece-ffdc-46fc-b35e-53a190df7e3f tempest-TestServerVolumeAttachmentScenario-1578422816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (deeaa209-9c2e-49ac-b6aa-b1d76d945e39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:47:26 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-663ea679-18b2-4c25-b58d-f6059963e7bb tempest-VolumesSnapshotTestJSON-1852940089 None] Lock "cinder-quobyte-54ac574d-c375-41d8-8980-2c6850e3497e-511735b9-e1b7-4730-b0b3-02a886d80351" acquired by "_create_volume_from_snapshot" :: waited 0.049s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:47:26 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-663ea679-18b2-4c25-b58d-f6059963e7bb tempest-VolumesSnapshotTestJSON-1852940089 None] Creating volume 511735b9-e1b7-4730-b0b3-02a886d80351 from snapshot 54ac574d-c375-41d8-8980-2c6850e3497e {{(pid=86212) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 22 15:47:26 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-663ea679-18b2-4c25-b58d-f6059963e7bb tempest-VolumesSnapshotTestJSON-1852940089 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:47:26 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-663ea679-18b2-4c25-b58d-f6059963e7bb tempest-VolumesSnapshotTestJSON-1852940089 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:47:26 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-663ea679-18b2-4c25-b58d-f6059963e7bb tempest-VolumesSnapshotTestJSON-1852940089 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:47:26 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-663ea679-18b2-4c25-b58d-f6059963e7bb tempest-VolumesSnapshotTestJSON-1852940089 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:47:26 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-663ea679-18b2-4c25-b58d-f6059963e7bb tempest-VolumesSnapshotTestJSON-1852940089 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:47:26 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-663ea679-18b2-4c25-b58d-f6059963e7bb tempest-VolumesSnapshotTestJSON-1852940089 None] Selected osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 as target Quobyte volume. {{(pid=86212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 15:47:26 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-663ea679-18b2-4c25-b58d-f6059963e7bb tempest-VolumesSnapshotTestJSON-1852940089 None] Acquiring lock "cinder-quobyte-511735b9-e1b7-4730-b0b3-02a886d80351" by "_copy_volume_from_snapshot" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:47:26 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-daa44ece-ffdc-46fc-b35e-53a190df7e3f tempest-TestServerVolumeAttachmentScenario-1578422816 None] Volume volume-d8616712-676c-475f-9bce-b2189d11b318 (d8616712-676c-475f-9bce-b2189d11b318): created successfully Sep 22 15:47:26 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-daa44ece-ffdc-46fc-b35e-53a190df7e3f tempest-TestServerVolumeAttachmentScenario-1578422816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (deeaa209-9c2e-49ac-b6aa-b1d76d945e39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:47:26 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-daa44ece-ffdc-46fc-b35e-53a190df7e3f tempest-TestServerVolumeAttachmentScenario-1578422816 None] Flow 'volume_create_manager' (5da0e143-cd24-4d31-b90e-4eb7d218479c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:47:26 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-663ea679-18b2-4c25-b58d-f6059963e7bb tempest-VolumesSnapshotTestJSON-1852940089 None] Lock "cinder-quobyte-511735b9-e1b7-4730-b0b3-02a886d80351" acquired by "_copy_volume_from_snapshot" :: waited 0.050s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:47:26 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-663ea679-18b2-4c25-b58d-f6059963e7bb tempest-VolumesSnapshotTestJSON-1852940089 None] snapshot: 54ac574d-c375-41d8-8980-2c6850e3497e, volume: 511735b9-e1b7-4730-b0b3-02a886d80351, {{(pid=86212) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 22 15:47:26 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-663ea679-18b2-4c25-b58d-f6059963e7bb tempest-VolumesSnapshotTestJSON-1852940089 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:47:26 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-663ea679-18b2-4c25-b58d-f6059963e7bb tempest-VolumesSnapshotTestJSON-1852940089 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:47:26 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-663ea679-18b2-4c25-b58d-f6059963e7bb tempest-VolumesSnapshotTestJSON-1852940089 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:47:26 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-663ea679-18b2-4c25-b58d-f6059963e7bb tempest-VolumesSnapshotTestJSON-1852940089 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:47:26 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-663ea679-18b2-4c25-b58d-f6059963e7bb tempest-VolumesSnapshotTestJSON-1852940089 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:47:26 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-daa44ece-ffdc-46fc-b35e-53a190df7e3f tempest-TestServerVolumeAttachmentScenario-1578422816 None] Created volume successfully. Sep 22 15:47:26 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[12f7c5e4-d341-4021-8cb7-eb6c49f35374]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:47:26 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-663ea679-18b2-4c25-b58d-f6059963e7bb tempest-VolumesSnapshotTestJSON-1852940089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-42581491-9b0a-4012-9b92-6c0be5239ad1.54ac574d-c375-41d8-8980-2c6850e3497e {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:47:27 devstack sudo[97174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-42581491-9b0a-4012-9b92-6c0be5239ad1.54ac574d-c375-41d8-8980-2c6850e3497e Sep 22 15:47:27 devstack sudo[97174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:47:27 devstack sudo[97174]: pam_unix(sudo:session): session closed for user root Sep 22 15:47:27 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-663ea679-18b2-4c25-b58d-f6059963e7bb tempest-VolumesSnapshotTestJSON-1852940089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-42581491-9b0a-4012-9b92-6c0be5239ad1.54ac574d-c375-41d8-8980-2c6850e3497e" returned: 0 in 0.510s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:47:27 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-663ea679-18b2-4c25-b58d-f6059963e7bb tempest-VolumesSnapshotTestJSON-1852940089 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-42581491-9b0a-4012-9b92-6c0be5239ad1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86212) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 22 15:47:27 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[f34d7687-3e48-4177-add2-7acef165395f]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:47:27 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-663ea679-18b2-4c25-b58d-f6059963e7bb tempest-VolumesSnapshotTestJSON-1852940089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-42581491-9b0a-4012-9b92-6c0be5239ad1 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:47:27 devstack sudo[97179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-42581491-9b0a-4012-9b92-6c0be5239ad1 Sep 22 15:47:27 devstack sudo[97179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:47:27 devstack sudo[97179]: pam_unix(sudo:session): session closed for user root Sep 22 15:47:27 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-663ea679-18b2-4c25-b58d-f6059963e7bb tempest-VolumesSnapshotTestJSON-1852940089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-42581491-9b0a-4012-9b92-6c0be5239ad1" returned: 0 in 0.456s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:47:27 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-663ea679-18b2-4c25-b58d-f6059963e7bb tempest-VolumesSnapshotTestJSON-1852940089 None] will copy from snapshot at /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-42581491-9b0a-4012-9b92-6c0be5239ad1 {{(pid=86212) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 22 15:47:27 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-663ea679-18b2-4c25-b58d-f6059963e7bb tempest-VolumesSnapshotTestJSON-1852940089 None] Creating direct copy from snapshot {{(pid=86212) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 22 15:47:27 devstack cinder-volume[86212]: DEBUG cinder.utils [None req-663ea679-18b2-4c25-b58d-f6059963e7bb tempest-VolumesSnapshotTestJSON-1852940089 None] Path /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-511735b9-e1b7-4730-b0b3-02a886d80351 not found in is_blk_device check {{(pid=86212) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 22 15:47:27 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-663ea679-18b2-4c25-b58d-f6059963e7bb tempest-VolumesSnapshotTestJSON-1852940089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-42581491-9b0a-4012-9b92-6c0be5239ad1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-511735b9-e1b7-4730-b0b3-02a886d80351 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:47:27 devstack sudo[97185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-42581491-9b0a-4012-9b92-6c0be5239ad1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-511735b9-e1b7-4730-b0b3-02a886d80351 Sep 22 15:47:27 devstack sudo[97185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:47:29 devstack cinder-volume[86212]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b21116d-acd2-41e3-9e55-e91a602b1648 tempest-VolumesListAdminTestJSON-1693520119 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 15:47:29 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-3b21116d-acd2-41e3-9e55-e91a602b1648 tempest-VolumesListAdminTestJSON-1693520119 None] Flow 'volume_create_manager' (751a71ce-07fc-4593-9997-602c60fad9b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:47:29 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-3b21116d-acd2-41e3-9e55-e91a602b1648 tempest-VolumesListAdminTestJSON-1693520119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57fcf1dc-69de-45e6-ad80-3e9e68ed6f07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:47:29 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-3b21116d-acd2-41e3-9e55-e91a602b1648 tempest-VolumesListAdminTestJSON-1693520119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57fcf1dc-69de-45e6-ad80-3e9e68ed6f07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:47:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1650349733',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=efcdbc2b-21b5-4c78-b043-5d43fa28a004,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3746c43b35604ba3abbcb85c7e719d8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:47:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:47:29Z,use_quota=True,user_id='dc44c9592ab44bde963c08de84b8b06e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:47:29 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-3b21116d-acd2-41e3-9e55-e91a602b1648 tempest-VolumesListAdminTestJSON-1693520119 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b68b869f-bd59-4131-91f1-c5f29aeef7e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:47:29 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-3b21116d-acd2-41e3-9e55-e91a602b1648 tempest-VolumesListAdminTestJSON-1693520119 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b68b869f-bd59-4131-91f1-c5f29aeef7e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:47:29 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-3b21116d-acd2-41e3-9e55-e91a602b1648 tempest-VolumesListAdminTestJSON-1693520119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2de6a0ef-f3e9-4564-9198-23a14e9791a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:47:29 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-3b21116d-acd2-41e3-9e55-e91a602b1648 tempest-VolumesListAdminTestJSON-1693520119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2de6a0ef-f3e9-4564-9198-23a14e9791a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'efcdbc2b-21b5-4c78-b043-5d43fa28a004', 'volume_name': 'volume-efcdbc2b-21b5-4c78-b043-5d43fa28a004', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:47:29 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-3b21116d-acd2-41e3-9e55-e91a602b1648 tempest-VolumesListAdminTestJSON-1693520119 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8a850c2-3366-4252-9011-6193ad83c4bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:47:29 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-3b21116d-acd2-41e3-9e55-e91a602b1648 tempest-VolumesListAdminTestJSON-1693520119 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8a850c2-3366-4252-9011-6193ad83c4bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:47:29 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-3b21116d-acd2-41e3-9e55-e91a602b1648 tempest-VolumesListAdminTestJSON-1693520119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa697bc0-babf-46b0-977d-712d1ce8ae97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:47:29 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-3b21116d-acd2-41e3-9e55-e91a602b1648 tempest-VolumesListAdminTestJSON-1693520119 None] Volume efcdbc2b-21b5-4c78-b043-5d43fa28a004: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-efcdbc2b-21b5-4c78-b043-5d43fa28a004', 'volume_size': 1} Sep 22 15:47:29 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-3b21116d-acd2-41e3-9e55-e91a602b1648 tempest-VolumesListAdminTestJSON-1693520119 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:47:37 devstack sudo[97185]: pam_unix(sudo:session): session closed for user root Sep 22 15:47:37 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-663ea679-18b2-4c25-b58d-f6059963e7bb tempest-VolumesSnapshotTestJSON-1852940089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-42581491-9b0a-4012-9b92-6c0be5239ad1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-511735b9-e1b7-4730-b0b3-02a886d80351" returned: 0 in 9.546s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:47:37 devstack cinder-volume[86212]: DEBUG cinder.image.image_utils [None req-663ea679-18b2-4c25-b58d-f6059963e7bb tempest-VolumesSnapshotTestJSON-1852940089 None] Image conversion details: src /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-42581491-9b0a-4012-9b92-6c0be5239ad1, size 1024.00 MB, duration 9.55 sec, destination /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-511735b9-e1b7-4730-b0b3-02a886d80351 {{(pid=86212) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 22 15:47:37 devstack cinder-volume[86212]: INFO cinder.image.image_utils [None req-663ea679-18b2-4c25-b58d-f6059963e7bb tempest-VolumesSnapshotTestJSON-1852940089 None] Converted 1024.00 MB image at 107.26 MB/s Sep 22 15:47:37 devstack cinder-volume[86212]: WARNING cinder.volume.drivers.remotefs [None req-663ea679-18b2-4c25-b58d-f6059963e7bb tempest-VolumesSnapshotTestJSON-1852940089 None] /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-511735b9-e1b7-4730-b0b3-02a886d80351 is being set with open permissions: ugo+rw Sep 22 15:47:37 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-663ea679-18b2-4c25-b58d-f6059963e7bb tempest-VolumesSnapshotTestJSON-1852940089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-511735b9-e1b7-4730-b0b3-02a886d80351 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:47:37 devstack sudo[97233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-511735b9-e1b7-4730-b0b3-02a886d80351 Sep 22 15:47:37 devstack sudo[97233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:47:37 devstack sudo[97233]: pam_unix(sudo:session): session closed for user root Sep 22 15:47:37 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-663ea679-18b2-4c25-b58d-f6059963e7bb tempest-VolumesSnapshotTestJSON-1852940089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-511735b9-e1b7-4730-b0b3-02a886d80351" returned: 0 in 0.351s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:47:37 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-663ea679-18b2-4c25-b58d-f6059963e7bb tempest-VolumesSnapshotTestJSON-1852940089 None] Lock "cinder-quobyte-511735b9-e1b7-4730-b0b3-02a886d80351" released by "_copy_volume_from_snapshot" :: held 11.037s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:47:37 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-663ea679-18b2-4c25-b58d-f6059963e7bb tempest-VolumesSnapshotTestJSON-1852940089 None] Lock "cinder-quobyte-54ac574d-c375-41d8-8980-2c6850e3497e-511735b9-e1b7-4730-b0b3-02a886d80351" released by "_create_volume_from_snapshot" :: held 11.163s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:47:37 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-663ea679-18b2-4c25-b58d-f6059963e7bb tempest-VolumesSnapshotTestJSON-1852940089 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.215s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:47:37 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-42bd0bab-7792-4e12-9772-75e357514b22 tempest-TestServerVolumeAttachmentScenario-1578422816 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.851s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:47:37 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-42bd0bab-7792-4e12-9772-75e357514b22 tempest-TestServerVolumeAttachmentScenario-1578422816 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:47:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1358273320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc4944d5-77f1-4d63-8e0c-35585b7a43f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f27df199c05948178f02555b8e60aa11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:47:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:47:26Z,use_quota=True,user_id='3ac4a6570b9d4449bff8fa94129b6662',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)}" {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 15:47:37 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-42bd0bab-7792-4e12-9772-75e357514b22 tempest-TestServerVolumeAttachmentScenario-1578422816 None] Creating volume bc4944d5-77f1-4d63-8e0c-35585b7a43f6 {{(pid=86212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 15:47:37 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-42bd0bab-7792-4e12-9772-75e357514b22 tempest-TestServerVolumeAttachmentScenario-1578422816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:47:37 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-42bd0bab-7792-4e12-9772-75e357514b22 tempest-TestServerVolumeAttachmentScenario-1578422816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:47:37 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-42bd0bab-7792-4e12-9772-75e357514b22 tempest-TestServerVolumeAttachmentScenario-1578422816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:47:37 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-42bd0bab-7792-4e12-9772-75e357514b22 tempest-TestServerVolumeAttachmentScenario-1578422816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:47:37 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-42bd0bab-7792-4e12-9772-75e357514b22 tempest-TestServerVolumeAttachmentScenario-1578422816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:47:37 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-42bd0bab-7792-4e12-9772-75e357514b22 tempest-TestServerVolumeAttachmentScenario-1578422816 None] Selected osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 as target Quobyte volume. {{(pid=86212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 15:47:37 devstack cinder-volume[86212]: INFO cinder.volume.drivers.remotefs [None req-42bd0bab-7792-4e12-9772-75e357514b22 tempest-TestServerVolumeAttachmentScenario-1578422816 None] casted to osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 Sep 22 15:47:37 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-42bd0bab-7792-4e12-9772-75e357514b22 tempest-TestServerVolumeAttachmentScenario-1578422816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-bc4944d5-77f1-4d63-8e0c-35585b7a43f6 1073741824 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:47:37 devstack sudo[97259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-bc4944d5-77f1-4d63-8e0c-35585b7a43f6 1073741824 Sep 22 15:47:37 devstack sudo[97259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:47:37 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-663ea679-18b2-4c25-b58d-f6059963e7bb tempest-VolumesSnapshotTestJSON-1852940089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e56263a2-36ce-4953-8ce9-2b08936c81bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-511735b9-e1b7-4730-b0b3-02a886d80351', 'volume_size': 1, 'snapshot_id': '54ac574d-c375-41d8-8980-2c6850e3497e'}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:47:37 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-663ea679-18b2-4c25-b58d-f6059963e7bb tempest-VolumesSnapshotTestJSON-1852940089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85c92053-fb91-4014-8eaf-cb856c54eb4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:47:37 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-663ea679-18b2-4c25-b58d-f6059963e7bb tempest-VolumesSnapshotTestJSON-1852940089 None] Volume volume-511735b9-e1b7-4730-b0b3-02a886d80351 (511735b9-e1b7-4730-b0b3-02a886d80351): created successfully Sep 22 15:47:37 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-663ea679-18b2-4c25-b58d-f6059963e7bb tempest-VolumesSnapshotTestJSON-1852940089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85c92053-fb91-4014-8eaf-cb856c54eb4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:47:37 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-663ea679-18b2-4c25-b58d-f6059963e7bb tempest-VolumesSnapshotTestJSON-1852940089 None] Flow 'volume_create_manager' (677ac528-c6bd-4781-9e0c-9bb6d217686f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:47:37 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-663ea679-18b2-4c25-b58d-f6059963e7bb tempest-VolumesSnapshotTestJSON-1852940089 None] Created volume successfully. Sep 22 15:47:38 devstack sudo[97259]: pam_unix(sudo:session): session closed for user root Sep 22 15:47:38 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-42bd0bab-7792-4e12-9772-75e357514b22 tempest-TestServerVolumeAttachmentScenario-1578422816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-bc4944d5-77f1-4d63-8e0c-35585b7a43f6 1073741824" returned: 0 in 0.592s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:47:38 devstack cinder-volume[86212]: DEBUG oslo_service.periodic_task [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86212) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 22 15:47:38 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:47:38 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:47:38 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:47:38 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:47:38 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:47:38 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:47:38 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-42bd0bab-7792-4e12-9772-75e357514b22 tempest-TestServerVolumeAttachmentScenario-1578422816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-bc4944d5-77f1-4d63-8e0c-35585b7a43f6 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:47:38 devstack sudo[97266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc Sep 22 15:47:38 devstack sudo[97266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:47:38 devstack sudo[97268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-bc4944d5-77f1-4d63-8e0c-35585b7a43f6 Sep 22 15:47:38 devstack sudo[97268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:47:38 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-f6a31c21-f63e-49d2-8775-b8cc2a8c655f tempest-VolumesSnapshotTestJSON-1852940089 None] Acquiring lock "cinder-511735b9-e1b7-4730-b0b3-02a886d80351-delete_volume" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:47:38 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-f6a31c21-f63e-49d2-8775-b8cc2a8c655f tempest-VolumesSnapshotTestJSON-1852940089 None] Lock "cinder-511735b9-e1b7-4730-b0b3-02a886d80351-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:47:38 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-f6a31c21-f63e-49d2-8775-b8cc2a8c655f tempest-VolumesSnapshotTestJSON-1852940089 None] Acquiring lock "cinder-quobyte-511735b9-e1b7-4730-b0b3-02a886d80351" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:47:38 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-f6a31c21-f63e-49d2-8775-b8cc2a8c655f tempest-VolumesSnapshotTestJSON-1852940089 None] Lock "cinder-quobyte-511735b9-e1b7-4730-b0b3-02a886d80351" acquired by "delete_volume" :: waited 0.023s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:47:38 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[369395e0-ef69-4940-8c17-c5166ea229fb]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:47:38 devstack sudo[97268]: pam_unix(sudo:session): session closed for user root Sep 22 15:47:38 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-f6a31c21-f63e-49d2-8775-b8cc2a8c655f tempest-VolumesSnapshotTestJSON-1852940089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-511735b9-e1b7-4730-b0b3-02a886d80351 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:47:38 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-42bd0bab-7792-4e12-9772-75e357514b22 tempest-TestServerVolumeAttachmentScenario-1578422816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-bc4944d5-77f1-4d63-8e0c-35585b7a43f6" returned: 0 in 0.487s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:47:39 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-42bd0bab-7792-4e12-9772-75e357514b22 tempest-TestServerVolumeAttachmentScenario-1578422816 None] <== create_volume: return (1168ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'} {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 15:47:39 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-42bd0bab-7792-4e12-9772-75e357514b22 tempest-TestServerVolumeAttachmentScenario-1578422816 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.179s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:47:39 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-3b21116d-acd2-41e3-9e55-e91a602b1648 tempest-VolumesListAdminTestJSON-1693520119 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.729s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:47:39 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-3b21116d-acd2-41e3-9e55-e91a602b1648 tempest-VolumesListAdminTestJSON-1693520119 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:47:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1650349733',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=efcdbc2b-21b5-4c78-b043-5d43fa28a004,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3746c43b35604ba3abbcb85c7e719d8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:47:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:47:29Z,use_quota=True,user_id='dc44c9592ab44bde963c08de84b8b06e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)}" {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 15:47:39 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-3b21116d-acd2-41e3-9e55-e91a602b1648 tempest-VolumesListAdminTestJSON-1693520119 None] Creating volume efcdbc2b-21b5-4c78-b043-5d43fa28a004 {{(pid=86212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 15:47:39 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-3b21116d-acd2-41e3-9e55-e91a602b1648 tempest-VolumesListAdminTestJSON-1693520119 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:47:39 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-3b21116d-acd2-41e3-9e55-e91a602b1648 tempest-VolumesListAdminTestJSON-1693520119 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:47:39 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-3b21116d-acd2-41e3-9e55-e91a602b1648 tempest-VolumesListAdminTestJSON-1693520119 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:47:39 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-3b21116d-acd2-41e3-9e55-e91a602b1648 tempest-VolumesListAdminTestJSON-1693520119 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:47:39 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-3b21116d-acd2-41e3-9e55-e91a602b1648 tempest-VolumesListAdminTestJSON-1693520119 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:47:39 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-3b21116d-acd2-41e3-9e55-e91a602b1648 tempest-VolumesListAdminTestJSON-1693520119 None] Selected osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 as target Quobyte volume. {{(pid=86212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 15:47:39 devstack cinder-volume[86212]: INFO cinder.volume.drivers.remotefs [None req-3b21116d-acd2-41e3-9e55-e91a602b1648 tempest-VolumesListAdminTestJSON-1693520119 None] casted to osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 Sep 22 15:47:39 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-3b21116d-acd2-41e3-9e55-e91a602b1648 tempest-VolumesListAdminTestJSON-1693520119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-efcdbc2b-21b5-4c78-b043-5d43fa28a004 1073741824 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:47:39 devstack sudo[97273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-efcdbc2b-21b5-4c78-b043-5d43fa28a004 1073741824 Sep 22 15:47:39 devstack sudo[97273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:47:39 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-42bd0bab-7792-4e12-9772-75e357514b22 tempest-TestServerVolumeAttachmentScenario-1578422816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9820e7a0-c8b5-49dd-9db0-45532dc39066) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc4944d5-77f1-4d63-8e0c-35585b7a43f6', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:47:39 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-42bd0bab-7792-4e12-9772-75e357514b22 tempest-TestServerVolumeAttachmentScenario-1578422816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (576a1e25-b16a-4d02-8fc0-2a068e5b0fca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:47:39 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-42bd0bab-7792-4e12-9772-75e357514b22 tempest-TestServerVolumeAttachmentScenario-1578422816 None] Volume volume-bc4944d5-77f1-4d63-8e0c-35585b7a43f6 (bc4944d5-77f1-4d63-8e0c-35585b7a43f6): created successfully Sep 22 15:47:39 devstack sudo[97266]: pam_unix(sudo:session): session closed for user root Sep 22 15:47:39 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-42bd0bab-7792-4e12-9772-75e357514b22 tempest-TestServerVolumeAttachmentScenario-1578422816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (576a1e25-b16a-4d02-8fc0-2a068e5b0fca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:47:39 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-42bd0bab-7792-4e12-9772-75e357514b22 tempest-TestServerVolumeAttachmentScenario-1578422816 None] Flow 'volume_create_manager' (d63bf8a7-1425-41ce-9276-4b13e3b2d67a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:47:39 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc" returned: 0 in 0.726s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:47:39 devstack cinder-volume[86212]: DEBUG cinder.manager [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] Notifying Schedulers of capabilities ... {{(pid=86212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 15:47:39 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-42bd0bab-7792-4e12-9772-75e357514b22 tempest-TestServerVolumeAttachmentScenario-1578422816 None] Created volume successfully. Sep 22 15:47:39 devstack sudo[97272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-511735b9-e1b7-4730-b0b3-02a886d80351 Sep 22 15:47:39 devstack sudo[97272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:47:39 devstack cinder-volume[86212]: DEBUG oslo_service.periodic_task [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] Running periodic task VolumeManager._thread_info {{(pid=86212) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 22 15:47:39 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] thread count: 28 {{(pid=86212) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 22 15:47:39 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] thread info: [<_MainThread(MainThread, started 136163191222400)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86212) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 22 15:47:39 devstack cinder-volume[86212]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b8f2882-55e3-41d7-b057-0742568f886b tempest-VolumeQuotasNegativeTestJSON-1103989567 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 15:47:39 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-0b8f2882-55e3-41d7-b057-0742568f886b tempest-VolumeQuotasNegativeTestJSON-1103989567 None] Flow 'volume_create_manager' (27459c49-b52a-4a4a-a63c-4fec5651c956) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:47:39 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-0b8f2882-55e3-41d7-b057-0742568f886b tempest-VolumeQuotasNegativeTestJSON-1103989567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a16218ba-7172-4239-9125-17221543c083) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:47:39 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-0b8f2882-55e3-41d7-b057-0742568f886b tempest-VolumeQuotasNegativeTestJSON-1103989567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a16218ba-7172-4239-9125-17221543c083) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:47:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-281741976',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9d541b0-0556-477d-81c1-7f4b7125f68a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce74a78cfebc478ab024f9032e5896c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:47:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:47:39Z,use_quota=True,user_id='f92d58edd1264362a9e144d102954695',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:47:39 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-0b8f2882-55e3-41d7-b057-0742568f886b tempest-VolumeQuotasNegativeTestJSON-1103989567 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc763630-0133-45a5-9ccd-28a1eb8e3de1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:47:39 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-0b8f2882-55e3-41d7-b057-0742568f886b tempest-VolumeQuotasNegativeTestJSON-1103989567 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc763630-0133-45a5-9ccd-28a1eb8e3de1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:47:39 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-0b8f2882-55e3-41d7-b057-0742568f886b tempest-VolumeQuotasNegativeTestJSON-1103989567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cee66f6b-2ad4-47fa-9952-aaa59b4d621a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:47:39 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-0b8f2882-55e3-41d7-b057-0742568f886b tempest-VolumeQuotasNegativeTestJSON-1103989567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cee66f6b-2ad4-47fa-9952-aaa59b4d621a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b9d541b0-0556-477d-81c1-7f4b7125f68a', 'volume_name': 'volume-b9d541b0-0556-477d-81c1-7f4b7125f68a', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:47:39 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-0b8f2882-55e3-41d7-b057-0742568f886b tempest-VolumeQuotasNegativeTestJSON-1103989567 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3cbb54c4-2d8d-41d4-8eb2-9328e1450e08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:47:39 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-0b8f2882-55e3-41d7-b057-0742568f886b tempest-VolumeQuotasNegativeTestJSON-1103989567 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3cbb54c4-2d8d-41d4-8eb2-9328e1450e08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:47:39 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-0b8f2882-55e3-41d7-b057-0742568f886b tempest-VolumeQuotasNegativeTestJSON-1103989567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dac90203-52d3-4e25-b053-e3586a0732ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:47:39 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-0b8f2882-55e3-41d7-b057-0742568f886b tempest-VolumeQuotasNegativeTestJSON-1103989567 None] Volume b9d541b0-0556-477d-81c1-7f4b7125f68a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b9d541b0-0556-477d-81c1-7f4b7125f68a', 'volume_size': 1} Sep 22 15:47:39 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-0b8f2882-55e3-41d7-b057-0742568f886b tempest-VolumeQuotasNegativeTestJSON-1103989567 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:47:39 devstack sudo[97272]: pam_unix(sudo:session): session closed for user root Sep 22 15:47:39 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-f6a31c21-f63e-49d2-8775-b8cc2a8c655f tempest-VolumesSnapshotTestJSON-1852940089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-511735b9-e1b7-4730-b0b3-02a886d80351" returned: 0 in 0.643s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:47:39 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-f6a31c21-f63e-49d2-8775-b8cc2a8c655f tempest-VolumesSnapshotTestJSON-1852940089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-511735b9-e1b7-4730-b0b3-02a886d80351 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:47:39 devstack sudo[97284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-511735b9-e1b7-4730-b0b3-02a886d80351 Sep 22 15:47:39 devstack sudo[97284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:47:39 devstack sudo[97273]: pam_unix(sudo:session): session closed for user root Sep 22 15:47:39 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-3b21116d-acd2-41e3-9e55-e91a602b1648 tempest-VolumesListAdminTestJSON-1693520119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-efcdbc2b-21b5-4c78-b043-5d43fa28a004 1073741824" returned: 0 in 0.825s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:47:39 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-3b21116d-acd2-41e3-9e55-e91a602b1648 tempest-VolumesListAdminTestJSON-1693520119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-efcdbc2b-21b5-4c78-b043-5d43fa28a004 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:47:39 devstack sudo[97304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-efcdbc2b-21b5-4c78-b043-5d43fa28a004 Sep 22 15:47:39 devstack sudo[97304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:47:40 devstack sudo[97284]: pam_unix(sudo:session): session closed for user root Sep 22 15:47:40 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-f6a31c21-f63e-49d2-8775-b8cc2a8c655f tempest-VolumesSnapshotTestJSON-1852940089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-511735b9-e1b7-4730-b0b3-02a886d80351" returned: 0 in 0.640s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:47:40 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-f6a31c21-f63e-49d2-8775-b8cc2a8c655f tempest-VolumesSnapshotTestJSON-1852940089 None] Lock "cinder-quobyte-511735b9-e1b7-4730-b0b3-02a886d80351" released by "delete_volume" :: held 1.397s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:47:40 devstack sudo[97304]: pam_unix(sudo:session): session closed for user root Sep 22 15:47:40 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-3b21116d-acd2-41e3-9e55-e91a602b1648 tempest-VolumesListAdminTestJSON-1693520119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-efcdbc2b-21b5-4c78-b043-5d43fa28a004" returned: 0 in 0.464s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:47:40 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-3b21116d-acd2-41e3-9e55-e91a602b1648 tempest-VolumesListAdminTestJSON-1693520119 None] <== create_volume: return (1366ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'} {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 15:47:40 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-3b21116d-acd2-41e3-9e55-e91a602b1648 tempest-VolumesListAdminTestJSON-1693520119 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.377s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:47:40 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-0b8f2882-55e3-41d7-b057-0742568f886b tempest-VolumeQuotasNegativeTestJSON-1103989567 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.916s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:47:40 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-0b8f2882-55e3-41d7-b057-0742568f886b tempest-VolumeQuotasNegativeTestJSON-1103989567 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:47:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-281741976',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9d541b0-0556-477d-81c1-7f4b7125f68a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce74a78cfebc478ab024f9032e5896c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:47:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:47:39Z,use_quota=True,user_id='f92d58edd1264362a9e144d102954695',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)}" {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 15:47:40 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-0b8f2882-55e3-41d7-b057-0742568f886b tempest-VolumeQuotasNegativeTestJSON-1103989567 None] Creating volume b9d541b0-0556-477d-81c1-7f4b7125f68a {{(pid=86212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 15:47:40 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-0b8f2882-55e3-41d7-b057-0742568f886b tempest-VolumeQuotasNegativeTestJSON-1103989567 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:47:40 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-0b8f2882-55e3-41d7-b057-0742568f886b tempest-VolumeQuotasNegativeTestJSON-1103989567 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:47:40 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-0b8f2882-55e3-41d7-b057-0742568f886b tempest-VolumeQuotasNegativeTestJSON-1103989567 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:47:40 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-0b8f2882-55e3-41d7-b057-0742568f886b tempest-VolumeQuotasNegativeTestJSON-1103989567 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:47:40 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-0b8f2882-55e3-41d7-b057-0742568f886b tempest-VolumeQuotasNegativeTestJSON-1103989567 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:47:40 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-0b8f2882-55e3-41d7-b057-0742568f886b tempest-VolumeQuotasNegativeTestJSON-1103989567 None] Selected osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 as target Quobyte volume. {{(pid=86212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 15:47:40 devstack cinder-volume[86212]: INFO cinder.volume.drivers.remotefs [None req-0b8f2882-55e3-41d7-b057-0742568f886b tempest-VolumeQuotasNegativeTestJSON-1103989567 None] casted to osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 Sep 22 15:47:40 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-0b8f2882-55e3-41d7-b057-0742568f886b tempest-VolumeQuotasNegativeTestJSON-1103989567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b9d541b0-0556-477d-81c1-7f4b7125f68a 1073741824 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:47:40 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-3b21116d-acd2-41e3-9e55-e91a602b1648 tempest-VolumesListAdminTestJSON-1693520119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa697bc0-babf-46b0-977d-712d1ce8ae97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-efcdbc2b-21b5-4c78-b043-5d43fa28a004', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:47:40 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-3b21116d-acd2-41e3-9e55-e91a602b1648 tempest-VolumesListAdminTestJSON-1693520119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a378d38-1bc4-4fed-a3ab-aa3af561111a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:47:40 devstack cinder-volume[86212]: DEBUG cinder.quota [None req-f6a31c21-f63e-49d2-8775-b8cc2a8c655f tempest-VolumesSnapshotTestJSON-1852940089 None] Created reservations ['bb00a483-8557-40a8-aabb-ab3575691687', '663265ca-83eb-4a27-9446-b1c966916bea', '8c15c3dc-6a18-4172-83d2-ff8fbdafda3e', '147a0b33-1c88-4ea0-81ac-f5faa5ec6aa4'] {{(pid=86212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 15:47:40 devstack sudo[97344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b9d541b0-0556-477d-81c1-7f4b7125f68a 1073741824 Sep 22 15:47:40 devstack sudo[97344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:47:40 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-3b21116d-acd2-41e3-9e55-e91a602b1648 tempest-VolumesListAdminTestJSON-1693520119 None] Volume volume-efcdbc2b-21b5-4c78-b043-5d43fa28a004 (efcdbc2b-21b5-4c78-b043-5d43fa28a004): created successfully Sep 22 15:47:40 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-3b21116d-acd2-41e3-9e55-e91a602b1648 tempest-VolumesListAdminTestJSON-1693520119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a378d38-1bc4-4fed-a3ab-aa3af561111a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:47:40 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-3b21116d-acd2-41e3-9e55-e91a602b1648 tempest-VolumesListAdminTestJSON-1693520119 None] Flow 'volume_create_manager' (751a71ce-07fc-4593-9997-602c60fad9b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:47:40 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-3b21116d-acd2-41e3-9e55-e91a602b1648 tempest-VolumesListAdminTestJSON-1693520119 None] Created volume successfully. Sep 22 15:47:40 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-f6a31c21-f63e-49d2-8775-b8cc2a8c655f tempest-VolumesSnapshotTestJSON-1852940089 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:47:40 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-f6a31c21-f63e-49d2-8775-b8cc2a8c655f tempest-VolumesSnapshotTestJSON-1852940089 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:47:40 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-f6a31c21-f63e-49d2-8775-b8cc2a8c655f tempest-VolumesSnapshotTestJSON-1852940089 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:47:40 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-f6a31c21-f63e-49d2-8775-b8cc2a8c655f tempest-VolumesSnapshotTestJSON-1852940089 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:47:40 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-f6a31c21-f63e-49d2-8775-b8cc2a8c655f tempest-VolumesSnapshotTestJSON-1852940089 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:47:40 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-f6a31c21-f63e-49d2-8775-b8cc2a8c655f tempest-VolumesSnapshotTestJSON-1852940089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:47:40 devstack sudo[97352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc Sep 22 15:47:40 devstack sudo[97352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:47:41 devstack sudo[97352]: pam_unix(sudo:session): session closed for user root Sep 22 15:47:41 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-f6a31c21-f63e-49d2-8775-b8cc2a8c655f tempest-VolumesSnapshotTestJSON-1852940089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc" returned: 0 in 0.460s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:47:41 devstack cinder-volume[86212]: DEBUG cinder.manager [None req-f6a31c21-f63e-49d2-8775-b8cc2a8c655f tempest-VolumesSnapshotTestJSON-1852940089 None] Notifying Schedulers of capabilities ... {{(pid=86212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 15:47:41 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-f6a31c21-f63e-49d2-8775-b8cc2a8c655f tempest-VolumesSnapshotTestJSON-1852940089 None] Deleted volume successfully. Sep 22 15:47:41 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-f6a31c21-f63e-49d2-8775-b8cc2a8c655f tempest-VolumesSnapshotTestJSON-1852940089 None] Lock "cinder-511735b9-e1b7-4730-b0b3-02a886d80351-delete_volume" released by "delete_volume" :: held 2.386s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:47:41 devstack sudo[97344]: pam_unix(sudo:session): session closed for user root Sep 22 15:47:41 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-0b8f2882-55e3-41d7-b057-0742568f886b tempest-VolumeQuotasNegativeTestJSON-1103989567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b9d541b0-0556-477d-81c1-7f4b7125f68a 1073741824" returned: 0 in 0.870s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:47:41 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-0b8f2882-55e3-41d7-b057-0742568f886b tempest-VolumeQuotasNegativeTestJSON-1103989567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b9d541b0-0556-477d-81c1-7f4b7125f68a {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:47:41 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-28b2b8b3-8c88-4a91-8a1f-24aa351e967d tempest-VolumesSnapshotTestJSON-1852940089 None] Acquiring lock "cinder-54ac574d-c375-41d8-8980-2c6850e3497e-delete_snapshot" by "delete_snapshot" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:47:41 devstack sudo[97364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b9d541b0-0556-477d-81c1-7f4b7125f68a Sep 22 15:47:41 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-28b2b8b3-8c88-4a91-8a1f-24aa351e967d tempest-VolumesSnapshotTestJSON-1852940089 None] Lock "cinder-54ac574d-c375-41d8-8980-2c6850e3497e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:47:41 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-28b2b8b3-8c88-4a91-8a1f-24aa351e967d tempest-VolumesSnapshotTestJSON-1852940089 None] Acquiring lock "cinder-quobyte-42581491-9b0a-4012-9b92-6c0be5239ad1" by "delete_snapshot" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:47:41 devstack sudo[97364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:47:41 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-28b2b8b3-8c88-4a91-8a1f-24aa351e967d tempest-VolumesSnapshotTestJSON-1852940089 None] Lock "cinder-quobyte-42581491-9b0a-4012-9b92-6c0be5239ad1" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:47:41 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-28b2b8b3-8c88-4a91-8a1f-24aa351e967d tempest-VolumesSnapshotTestJSON-1852940089 None] Acquiring lock "cinder-quobyte-54ac574d-c375-41d8-8980-2c6850e3497e" by "_delete_snapshot" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:47:41 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-28b2b8b3-8c88-4a91-8a1f-24aa351e967d tempest-VolumesSnapshotTestJSON-1852940089 None] Lock "cinder-quobyte-54ac574d-c375-41d8-8980-2c6850e3497e" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:47:41 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-28b2b8b3-8c88-4a91-8a1f-24aa351e967d tempest-VolumesSnapshotTestJSON-1852940089 None] Deleting offline snapshot 54ac574d-c375-41d8-8980-2c6850e3497e of volume 42581491-9b0a-4012-9b92-6c0be5239ad1 {{(pid=86212) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 22 15:47:41 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-28b2b8b3-8c88-4a91-8a1f-24aa351e967d tempest-VolumesSnapshotTestJSON-1852940089 None] snapshot_file for this snap is: volume-42581491-9b0a-4012-9b92-6c0be5239ad1.54ac574d-c375-41d8-8980-2c6850e3497e {{(pid=86212) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 22 15:47:41 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca5e48cd-915b-4c07-a348-89641bd36363]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:47:41 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-28b2b8b3-8c88-4a91-8a1f-24aa351e967d tempest-VolumesSnapshotTestJSON-1852940089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-42581491-9b0a-4012-9b92-6c0be5239ad1.54ac574d-c375-41d8-8980-2c6850e3497e {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:47:41 devstack sudo[97368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-42581491-9b0a-4012-9b92-6c0be5239ad1.54ac574d-c375-41d8-8980-2c6850e3497e Sep 22 15:47:41 devstack sudo[97368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:47:41 devstack sudo[97364]: pam_unix(sudo:session): session closed for user root Sep 22 15:47:41 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-0b8f2882-55e3-41d7-b057-0742568f886b tempest-VolumeQuotasNegativeTestJSON-1103989567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b9d541b0-0556-477d-81c1-7f4b7125f68a" returned: 0 in 0.510s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:47:41 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-0b8f2882-55e3-41d7-b057-0742568f886b tempest-VolumeQuotasNegativeTestJSON-1103989567 None] <== create_volume: return (1440ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'} {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 15:47:41 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-0b8f2882-55e3-41d7-b057-0742568f886b tempest-VolumeQuotasNegativeTestJSON-1103989567 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.445s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:47:41 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-0b8f2882-55e3-41d7-b057-0742568f886b tempest-VolumeQuotasNegativeTestJSON-1103989567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dac90203-52d3-4e25-b053-e3586a0732ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9d541b0-0556-477d-81c1-7f4b7125f68a', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:47:41 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-0b8f2882-55e3-41d7-b057-0742568f886b tempest-VolumeQuotasNegativeTestJSON-1103989567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d27bcd1-7a32-40a8-8e78-dd2c3ed9c5c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:47:41 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-0b8f2882-55e3-41d7-b057-0742568f886b tempest-VolumeQuotasNegativeTestJSON-1103989567 None] Volume volume-b9d541b0-0556-477d-81c1-7f4b7125f68a (b9d541b0-0556-477d-81c1-7f4b7125f68a): created successfully Sep 22 15:47:41 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-0b8f2882-55e3-41d7-b057-0742568f886b tempest-VolumeQuotasNegativeTestJSON-1103989567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d27bcd1-7a32-40a8-8e78-dd2c3ed9c5c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:47:41 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-0b8f2882-55e3-41d7-b057-0742568f886b tempest-VolumeQuotasNegativeTestJSON-1103989567 None] Flow 'volume_create_manager' (27459c49-b52a-4a4a-a63c-4fec5651c956) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:47:41 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-0b8f2882-55e3-41d7-b057-0742568f886b tempest-VolumeQuotasNegativeTestJSON-1103989567 None] Created volume successfully. Sep 22 15:47:42 devstack sudo[97368]: pam_unix(sudo:session): session closed for user root Sep 22 15:47:42 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-28b2b8b3-8c88-4a91-8a1f-24aa351e967d tempest-VolumesSnapshotTestJSON-1852940089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-42581491-9b0a-4012-9b92-6c0be5239ad1.54ac574d-c375-41d8-8980-2c6850e3497e" returned: 0 in 0.555s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:47:42 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-28b2b8b3-8c88-4a91-8a1f-24aa351e967d tempest-VolumesSnapshotTestJSON-1852940089 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-42581491-9b0a-4012-9b92-6c0be5239ad1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86212) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 22 15:47:42 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[199425d5-753a-4aa8-85e1-c39878bb80ec]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:47:42 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-28b2b8b3-8c88-4a91-8a1f-24aa351e967d tempest-VolumesSnapshotTestJSON-1852940089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-42581491-9b0a-4012-9b92-6c0be5239ad1 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:47:42 devstack sudo[97375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-42581491-9b0a-4012-9b92-6c0be5239ad1 Sep 22 15:47:42 devstack sudo[97375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:47:42 devstack cinder-volume[86212]: DEBUG cinder.volume.flows.manager.create_volume [None req-a52e617a-e94d-4085-bc73-0cd28ba44d9f tempest-VolumesListAdminTestJSON-1693520119 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 15:47:42 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-a52e617a-e94d-4085-bc73-0cd28ba44d9f tempest-VolumesListAdminTestJSON-1693520119 None] Flow 'volume_create_manager' (10f03872-4fda-4eb3-ba37-906107fefdf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:47:42 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-a52e617a-e94d-4085-bc73-0cd28ba44d9f tempest-VolumesListAdminTestJSON-1693520119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d33acdd6-dd8c-47ba-9c20-e647ce8a2de6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:47:42 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-a52e617a-e94d-4085-bc73-0cd28ba44d9f tempest-VolumesListAdminTestJSON-1693520119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d33acdd6-dd8c-47ba-9c20-e647ce8a2de6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:47:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1004461220',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af2ed752-f7af-496c-9833-b930f7e8918f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3746c43b35604ba3abbcb85c7e719d8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:47:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:47:42Z,use_quota=True,user_id='dc44c9592ab44bde963c08de84b8b06e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:47:42 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-a52e617a-e94d-4085-bc73-0cd28ba44d9f tempest-VolumesListAdminTestJSON-1693520119 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db982f87-e85a-468d-9528-343dde81ed91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:47:42 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-a52e617a-e94d-4085-bc73-0cd28ba44d9f tempest-VolumesListAdminTestJSON-1693520119 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db982f87-e85a-468d-9528-343dde81ed91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:47:42 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-a52e617a-e94d-4085-bc73-0cd28ba44d9f tempest-VolumesListAdminTestJSON-1693520119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c363418c-57c5-41d9-940e-93a2b74866e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:47:42 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-a52e617a-e94d-4085-bc73-0cd28ba44d9f tempest-VolumesListAdminTestJSON-1693520119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c363418c-57c5-41d9-940e-93a2b74866e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'af2ed752-f7af-496c-9833-b930f7e8918f', 'volume_name': 'volume-af2ed752-f7af-496c-9833-b930f7e8918f', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:47:42 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-a52e617a-e94d-4085-bc73-0cd28ba44d9f tempest-VolumesListAdminTestJSON-1693520119 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (521e00ac-bf85-416e-8fd6-1610af7156b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:47:42 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-a52e617a-e94d-4085-bc73-0cd28ba44d9f tempest-VolumesListAdminTestJSON-1693520119 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (521e00ac-bf85-416e-8fd6-1610af7156b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:47:42 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-a52e617a-e94d-4085-bc73-0cd28ba44d9f tempest-VolumesListAdminTestJSON-1693520119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfcedafc-6a90-415d-8605-ee6b7f160313) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:47:42 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-a52e617a-e94d-4085-bc73-0cd28ba44d9f tempest-VolumesListAdminTestJSON-1693520119 None] Volume af2ed752-f7af-496c-9833-b930f7e8918f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-af2ed752-f7af-496c-9833-b930f7e8918f', 'volume_size': 1} Sep 22 15:47:42 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-a52e617a-e94d-4085-bc73-0cd28ba44d9f tempest-VolumesListAdminTestJSON-1693520119 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:47:42 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-a52e617a-e94d-4085-bc73-0cd28ba44d9f tempest-VolumesListAdminTestJSON-1693520119 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:47:42 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-a52e617a-e94d-4085-bc73-0cd28ba44d9f tempest-VolumesListAdminTestJSON-1693520119 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:47:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1004461220',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af2ed752-f7af-496c-9833-b930f7e8918f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3746c43b35604ba3abbcb85c7e719d8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:47:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:47:42Z,use_quota=True,user_id='dc44c9592ab44bde963c08de84b8b06e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)}" {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 15:47:42 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-a52e617a-e94d-4085-bc73-0cd28ba44d9f tempest-VolumesListAdminTestJSON-1693520119 None] Creating volume af2ed752-f7af-496c-9833-b930f7e8918f {{(pid=86212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 15:47:42 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-a52e617a-e94d-4085-bc73-0cd28ba44d9f tempest-VolumesListAdminTestJSON-1693520119 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:47:42 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-a52e617a-e94d-4085-bc73-0cd28ba44d9f tempest-VolumesListAdminTestJSON-1693520119 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:47:42 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-a52e617a-e94d-4085-bc73-0cd28ba44d9f tempest-VolumesListAdminTestJSON-1693520119 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:47:42 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-a52e617a-e94d-4085-bc73-0cd28ba44d9f tempest-VolumesListAdminTestJSON-1693520119 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:47:42 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-a52e617a-e94d-4085-bc73-0cd28ba44d9f tempest-VolumesListAdminTestJSON-1693520119 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:47:42 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-a52e617a-e94d-4085-bc73-0cd28ba44d9f tempest-VolumesListAdminTestJSON-1693520119 None] Selected osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 as target Quobyte volume. {{(pid=86212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 15:47:42 devstack cinder-volume[86212]: INFO cinder.volume.drivers.remotefs [None req-a52e617a-e94d-4085-bc73-0cd28ba44d9f tempest-VolumesListAdminTestJSON-1693520119 None] casted to osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 Sep 22 15:47:42 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-a52e617a-e94d-4085-bc73-0cd28ba44d9f tempest-VolumesListAdminTestJSON-1693520119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-af2ed752-f7af-496c-9833-b930f7e8918f 1073741824 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:47:42 devstack sudo[97377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-af2ed752-f7af-496c-9833-b930f7e8918f 1073741824 Sep 22 15:47:42 devstack sudo[97377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:47:43 devstack sudo[97375]: pam_unix(sudo:session): session closed for user root Sep 22 15:47:43 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-28b2b8b3-8c88-4a91-8a1f-24aa351e967d tempest-VolumesSnapshotTestJSON-1852940089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-42581491-9b0a-4012-9b92-6c0be5239ad1" returned: 0 in 0.977s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:47:43 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-28b2b8b3-8c88-4a91-8a1f-24aa351e967d tempest-VolumesSnapshotTestJSON-1852940089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-42581491-9b0a-4012-9b92-6c0be5239ad1.54ac574d-c375-41d8-8980-2c6850e3497e {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:47:43 devstack sudo[97385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-42581491-9b0a-4012-9b92-6c0be5239ad1.54ac574d-c375-41d8-8980-2c6850e3497e Sep 22 15:47:43 devstack sudo[97385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:47:43 devstack sudo[97377]: pam_unix(sudo:session): session closed for user root Sep 22 15:47:43 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-a52e617a-e94d-4085-bc73-0cd28ba44d9f tempest-VolumesListAdminTestJSON-1693520119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-af2ed752-f7af-496c-9833-b930f7e8918f 1073741824" returned: 0 in 0.622s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:47:43 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-a52e617a-e94d-4085-bc73-0cd28ba44d9f tempest-VolumesListAdminTestJSON-1693520119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-af2ed752-f7af-496c-9833-b930f7e8918f {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:47:43 devstack sudo[97387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-af2ed752-f7af-496c-9833-b930f7e8918f Sep 22 15:47:43 devstack sudo[97387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:47:43 devstack sudo[97385]: pam_unix(sudo:session): session closed for user root Sep 22 15:47:43 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-28b2b8b3-8c88-4a91-8a1f-24aa351e967d tempest-VolumesSnapshotTestJSON-1852940089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-42581491-9b0a-4012-9b92-6c0be5239ad1.54ac574d-c375-41d8-8980-2c6850e3497e" returned: 0 in 0.658s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:47:43 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-28b2b8b3-8c88-4a91-8a1f-24aa351e967d tempest-VolumesSnapshotTestJSON-1852940089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-42581491-9b0a-4012-9b92-6c0be5239ad1.54ac574d-c375-41d8-8980-2c6850e3497e {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:47:43 devstack sudo[97387]: pam_unix(sudo:session): session closed for user root Sep 22 15:47:43 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-a52e617a-e94d-4085-bc73-0cd28ba44d9f tempest-VolumesListAdminTestJSON-1693520119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-af2ed752-f7af-496c-9833-b930f7e8918f" returned: 0 in 0.491s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:47:43 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-a52e617a-e94d-4085-bc73-0cd28ba44d9f tempest-VolumesListAdminTestJSON-1693520119 None] <== create_volume: return (1211ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'} {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 15:47:43 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-a52e617a-e94d-4085-bc73-0cd28ba44d9f tempest-VolumesListAdminTestJSON-1693520119 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.214s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:47:43 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-a52e617a-e94d-4085-bc73-0cd28ba44d9f tempest-VolumesListAdminTestJSON-1693520119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfcedafc-6a90-415d-8605-ee6b7f160313) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af2ed752-f7af-496c-9833-b930f7e8918f', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:47:43 devstack sudo[97394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-42581491-9b0a-4012-9b92-6c0be5239ad1.54ac574d-c375-41d8-8980-2c6850e3497e Sep 22 15:47:43 devstack sudo[97394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:47:43 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-a52e617a-e94d-4085-bc73-0cd28ba44d9f tempest-VolumesListAdminTestJSON-1693520119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (540a7dac-e9d1-4daf-ae5e-99be79f48d54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:47:43 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-a52e617a-e94d-4085-bc73-0cd28ba44d9f tempest-VolumesListAdminTestJSON-1693520119 None] Volume volume-af2ed752-f7af-496c-9833-b930f7e8918f (af2ed752-f7af-496c-9833-b930f7e8918f): created successfully Sep 22 15:47:43 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-a52e617a-e94d-4085-bc73-0cd28ba44d9f tempest-VolumesListAdminTestJSON-1693520119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (540a7dac-e9d1-4daf-ae5e-99be79f48d54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:47:43 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-a52e617a-e94d-4085-bc73-0cd28ba44d9f tempest-VolumesListAdminTestJSON-1693520119 None] Flow 'volume_create_manager' (10f03872-4fda-4eb3-ba37-906107fefdf5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:47:43 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-a52e617a-e94d-4085-bc73-0cd28ba44d9f tempest-VolumesListAdminTestJSON-1693520119 None] Created volume successfully. Sep 22 15:47:44 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-a192bdd4-6cc7-4784-aba3-b1e5971bddfc tempest-VolumeQuotasNegativeTestJSON-1103989567 None] Acquiring lock "cinder-b9d541b0-0556-477d-81c1-7f4b7125f68a-delete_volume" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:47:44 devstack sudo[97394]: pam_unix(sudo:session): session closed for user root Sep 22 15:47:44 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-a192bdd4-6cc7-4784-aba3-b1e5971bddfc tempest-VolumeQuotasNegativeTestJSON-1103989567 None] Lock "cinder-b9d541b0-0556-477d-81c1-7f4b7125f68a-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:47:44 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-28b2b8b3-8c88-4a91-8a1f-24aa351e967d tempest-VolumesSnapshotTestJSON-1852940089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-42581491-9b0a-4012-9b92-6c0be5239ad1.54ac574d-c375-41d8-8980-2c6850e3497e" returned: 0 in 0.463s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:47:44 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-a192bdd4-6cc7-4784-aba3-b1e5971bddfc tempest-VolumeQuotasNegativeTestJSON-1103989567 None] Acquiring lock "cinder-quobyte-b9d541b0-0556-477d-81c1-7f4b7125f68a" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:47:44 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-28b2b8b3-8c88-4a91-8a1f-24aa351e967d tempest-VolumesSnapshotTestJSON-1852940089 None] Lock "cinder-quobyte-54ac574d-c375-41d8-8980-2c6850e3497e" released by "_delete_snapshot" :: held 2.832s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:47:44 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-28b2b8b3-8c88-4a91-8a1f-24aa351e967d tempest-VolumesSnapshotTestJSON-1852940089 None] Lock "cinder-quobyte-42581491-9b0a-4012-9b92-6c0be5239ad1" released by "delete_snapshot" :: held 2.865s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:47:44 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-a192bdd4-6cc7-4784-aba3-b1e5971bddfc tempest-VolumeQuotasNegativeTestJSON-1103989567 None] Lock "cinder-quobyte-b9d541b0-0556-477d-81c1-7f4b7125f68a" acquired by "delete_volume" :: waited 0.028s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:47:44 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4c3c1e7-60e0-491c-bf76-d87b6158b6de]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:47:44 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-a192bdd4-6cc7-4784-aba3-b1e5971bddfc tempest-VolumeQuotasNegativeTestJSON-1103989567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b9d541b0-0556-477d-81c1-7f4b7125f68a {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:47:44 devstack cinder-volume[86212]: DEBUG cinder.quota [None req-28b2b8b3-8c88-4a91-8a1f-24aa351e967d tempest-VolumesSnapshotTestJSON-1852940089 None] Created reservations ['226eee61-ba50-4946-bbb5-abe7de09e4a6', '34197144-e4c6-4c28-a036-81f38271ef6e', '5aea790a-6041-4c6e-9d9c-477023cc0cb6', 'dbddabcc-7423-4993-8f88-fc24a24590c6'] {{(pid=86212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 15:47:44 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-28b2b8b3-8c88-4a91-8a1f-24aa351e967d tempest-VolumesSnapshotTestJSON-1852940089 None] Delete snapshot completed successfully. Sep 22 15:47:44 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-28b2b8b3-8c88-4a91-8a1f-24aa351e967d tempest-VolumesSnapshotTestJSON-1852940089 None] Lock "cinder-54ac574d-c375-41d8-8980-2c6850e3497e-delete_snapshot" released by "delete_snapshot" :: held 3.128s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:47:44 devstack sudo[97398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b9d541b0-0556-477d-81c1-7f4b7125f68a Sep 22 15:47:44 devstack sudo[97398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:47:44 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-1e5911f9-139d-461d-be6f-6ebacc0d6b62 tempest-VolumesSnapshotTestJSON-1852940089 None] Acquiring lock "cinder-42581491-9b0a-4012-9b92-6c0be5239ad1-delete_volume" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:47:44 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-1e5911f9-139d-461d-be6f-6ebacc0d6b62 tempest-VolumesSnapshotTestJSON-1852940089 None] Lock "cinder-42581491-9b0a-4012-9b92-6c0be5239ad1-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:47:44 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-1e5911f9-139d-461d-be6f-6ebacc0d6b62 tempest-VolumesSnapshotTestJSON-1852940089 None] Acquiring lock "cinder-quobyte-42581491-9b0a-4012-9b92-6c0be5239ad1" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:47:44 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-1e5911f9-139d-461d-be6f-6ebacc0d6b62 tempest-VolumesSnapshotTestJSON-1852940089 None] Lock "cinder-quobyte-42581491-9b0a-4012-9b92-6c0be5239ad1" acquired by "delete_volume" :: waited 0.023s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:47:45 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e826753-d567-4c0e-8dc3-a3057c1d6d90]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:47:45 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-1e5911f9-139d-461d-be6f-6ebacc0d6b62 tempest-VolumesSnapshotTestJSON-1852940089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-42581491-9b0a-4012-9b92-6c0be5239ad1 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:47:45 devstack sudo[97398]: pam_unix(sudo:session): session closed for user root Sep 22 15:47:45 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-a192bdd4-6cc7-4784-aba3-b1e5971bddfc tempest-VolumeQuotasNegativeTestJSON-1103989567 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b9d541b0-0556-477d-81c1-7f4b7125f68a" returned: 0 in 0.686s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:47:45 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-a192bdd4-6cc7-4784-aba3-b1e5971bddfc tempest-VolumeQuotasNegativeTestJSON-1103989567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b9d541b0-0556-477d-81c1-7f4b7125f68a {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:47:45 devstack sudo[97405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b9d541b0-0556-477d-81c1-7f4b7125f68a Sep 22 15:47:45 devstack sudo[97405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:47:45 devstack sudo[97404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-42581491-9b0a-4012-9b92-6c0be5239ad1 Sep 22 15:47:45 devstack sudo[97404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:47:45 devstack sudo[97405]: pam_unix(sudo:session): session closed for user root Sep 22 15:47:45 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-a192bdd4-6cc7-4784-aba3-b1e5971bddfc tempest-VolumeQuotasNegativeTestJSON-1103989567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b9d541b0-0556-477d-81c1-7f4b7125f68a" returned: 0 in 0.481s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:47:45 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-a192bdd4-6cc7-4784-aba3-b1e5971bddfc tempest-VolumeQuotasNegativeTestJSON-1103989567 None] Lock "cinder-quobyte-b9d541b0-0556-477d-81c1-7f4b7125f68a" released by "delete_volume" :: held 1.233s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:47:45 devstack sudo[97404]: pam_unix(sudo:session): session closed for user root Sep 22 15:47:45 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-1e5911f9-139d-461d-be6f-6ebacc0d6b62 tempest-VolumesSnapshotTestJSON-1852940089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-42581491-9b0a-4012-9b92-6c0be5239ad1" returned: 0 in 0.653s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:47:45 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-1e5911f9-139d-461d-be6f-6ebacc0d6b62 tempest-VolumesSnapshotTestJSON-1852940089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-42581491-9b0a-4012-9b92-6c0be5239ad1 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:47:45 devstack cinder-volume[86212]: DEBUG cinder.volume.flows.manager.create_volume [None req-c315c5bd-a0c8-44f7-9f36-68082b425b7a tempest-VolumesListAdminTestJSON-1693520119 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 15:47:45 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-c315c5bd-a0c8-44f7-9f36-68082b425b7a tempest-VolumesListAdminTestJSON-1693520119 None] Flow 'volume_create_manager' (21c64632-119e-4eba-ac7b-f00410e0f9a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:47:45 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-c315c5bd-a0c8-44f7-9f36-68082b425b7a tempest-VolumesListAdminTestJSON-1693520119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92f70e29-254e-49d0-a4db-c67fa3fd527f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:47:45 devstack cinder-volume[86212]: DEBUG cinder.quota [None req-a192bdd4-6cc7-4784-aba3-b1e5971bddfc tempest-VolumeQuotasNegativeTestJSON-1103989567 None] Created reservations ['21b85779-2d60-4ce9-a844-7994aa20171e', '61269d6f-a39f-4421-86fa-22494187020e', 'a7519e7a-046d-40aa-b3a4-2e09fcf21484', 'c3a4a684-e253-4609-a2fb-25b84cc28f1e'] {{(pid=86212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 15:47:45 devstack sudo[97412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-42581491-9b0a-4012-9b92-6c0be5239ad1 Sep 22 15:47:45 devstack sudo[97412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:47:45 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-c315c5bd-a0c8-44f7-9f36-68082b425b7a tempest-VolumesListAdminTestJSON-1693520119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92f70e29-254e-49d0-a4db-c67fa3fd527f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:47:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2105601128',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21f7568b-7e2a-4118-9028-e246d710730f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3746c43b35604ba3abbcb85c7e719d8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:47:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:47:46Z,use_quota=True,user_id='dc44c9592ab44bde963c08de84b8b06e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:47:45 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-c315c5bd-a0c8-44f7-9f36-68082b425b7a tempest-VolumesListAdminTestJSON-1693520119 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04da9940-7b3f-438f-adbc-449bf6e6f816) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:47:45 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-c315c5bd-a0c8-44f7-9f36-68082b425b7a tempest-VolumesListAdminTestJSON-1693520119 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04da9940-7b3f-438f-adbc-449bf6e6f816) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:47:45 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-c315c5bd-a0c8-44f7-9f36-68082b425b7a tempest-VolumesListAdminTestJSON-1693520119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31cbafec-2dfa-46d1-97cb-e18221ce2bc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:47:45 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-c315c5bd-a0c8-44f7-9f36-68082b425b7a tempest-VolumesListAdminTestJSON-1693520119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31cbafec-2dfa-46d1-97cb-e18221ce2bc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '21f7568b-7e2a-4118-9028-e246d710730f', 'volume_name': 'volume-21f7568b-7e2a-4118-9028-e246d710730f', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:47:45 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-c315c5bd-a0c8-44f7-9f36-68082b425b7a tempest-VolumesListAdminTestJSON-1693520119 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68e50af5-8285-4423-9961-bfc24ef7bb35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:47:45 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-c315c5bd-a0c8-44f7-9f36-68082b425b7a tempest-VolumesListAdminTestJSON-1693520119 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68e50af5-8285-4423-9961-bfc24ef7bb35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:47:45 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-c315c5bd-a0c8-44f7-9f36-68082b425b7a tempest-VolumesListAdminTestJSON-1693520119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac6d3d47-f48c-46c4-8727-868f2fa90307) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:47:45 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-c315c5bd-a0c8-44f7-9f36-68082b425b7a tempest-VolumesListAdminTestJSON-1693520119 None] Volume 21f7568b-7e2a-4118-9028-e246d710730f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-21f7568b-7e2a-4118-9028-e246d710730f', 'volume_size': 1} Sep 22 15:47:45 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-c315c5bd-a0c8-44f7-9f36-68082b425b7a tempest-VolumesListAdminTestJSON-1693520119 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:47:45 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-c315c5bd-a0c8-44f7-9f36-68082b425b7a tempest-VolumesListAdminTestJSON-1693520119 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:47:45 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-c315c5bd-a0c8-44f7-9f36-68082b425b7a tempest-VolumesListAdminTestJSON-1693520119 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:47:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2105601128',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21f7568b-7e2a-4118-9028-e246d710730f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3746c43b35604ba3abbcb85c7e719d8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:47:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:47:46Z,use_quota=True,user_id='dc44c9592ab44bde963c08de84b8b06e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)}" {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 15:47:45 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-c315c5bd-a0c8-44f7-9f36-68082b425b7a tempest-VolumesListAdminTestJSON-1693520119 None] Creating volume 21f7568b-7e2a-4118-9028-e246d710730f {{(pid=86212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 15:47:45 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-c315c5bd-a0c8-44f7-9f36-68082b425b7a tempest-VolumesListAdminTestJSON-1693520119 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:47:45 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-c315c5bd-a0c8-44f7-9f36-68082b425b7a tempest-VolumesListAdminTestJSON-1693520119 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:47:45 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-c315c5bd-a0c8-44f7-9f36-68082b425b7a tempest-VolumesListAdminTestJSON-1693520119 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:47:45 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-c315c5bd-a0c8-44f7-9f36-68082b425b7a tempest-VolumesListAdminTestJSON-1693520119 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:47:45 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-c315c5bd-a0c8-44f7-9f36-68082b425b7a tempest-VolumesListAdminTestJSON-1693520119 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:47:45 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-c315c5bd-a0c8-44f7-9f36-68082b425b7a tempest-VolumesListAdminTestJSON-1693520119 None] Selected osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 as target Quobyte volume. {{(pid=86212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 15:47:45 devstack cinder-volume[86212]: INFO cinder.volume.drivers.remotefs [None req-c315c5bd-a0c8-44f7-9f36-68082b425b7a tempest-VolumesListAdminTestJSON-1693520119 None] casted to osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 Sep 22 15:47:45 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-c315c5bd-a0c8-44f7-9f36-68082b425b7a tempest-VolumesListAdminTestJSON-1693520119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-21f7568b-7e2a-4118-9028-e246d710730f 1073741824 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:47:45 devstack sudo[97414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-21f7568b-7e2a-4118-9028-e246d710730f 1073741824 Sep 22 15:47:45 devstack sudo[97414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:47:45 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-a192bdd4-6cc7-4784-aba3-b1e5971bddfc tempest-VolumeQuotasNegativeTestJSON-1103989567 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:47:45 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-a192bdd4-6cc7-4784-aba3-b1e5971bddfc tempest-VolumeQuotasNegativeTestJSON-1103989567 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:47:45 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-a192bdd4-6cc7-4784-aba3-b1e5971bddfc tempest-VolumeQuotasNegativeTestJSON-1103989567 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:47:45 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-a192bdd4-6cc7-4784-aba3-b1e5971bddfc tempest-VolumeQuotasNegativeTestJSON-1103989567 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:47:45 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-a192bdd4-6cc7-4784-aba3-b1e5971bddfc tempest-VolumeQuotasNegativeTestJSON-1103989567 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:47:45 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-a192bdd4-6cc7-4784-aba3-b1e5971bddfc tempest-VolumeQuotasNegativeTestJSON-1103989567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:47:45 devstack sudo[97416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc Sep 22 15:47:45 devstack sudo[97416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:47:46 devstack sudo[97412]: pam_unix(sudo:session): session closed for user root Sep 22 15:47:46 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-1e5911f9-139d-461d-be6f-6ebacc0d6b62 tempest-VolumesSnapshotTestJSON-1852940089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-42581491-9b0a-4012-9b92-6c0be5239ad1" returned: 0 in 0.382s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:47:46 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-1e5911f9-139d-461d-be6f-6ebacc0d6b62 tempest-VolumesSnapshotTestJSON-1852940089 None] Lock "cinder-quobyte-42581491-9b0a-4012-9b92-6c0be5239ad1" released by "delete_volume" :: held 1.118s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:47:46 devstack cinder-volume[86212]: DEBUG cinder.quota [None req-1e5911f9-139d-461d-be6f-6ebacc0d6b62 tempest-VolumesSnapshotTestJSON-1852940089 None] Created reservations ['01739324-0ab3-4f50-88dd-ae78854698cc', 'b8426e36-994c-450d-8cc9-a254b000d72c', 'de0fe188-9431-4b94-8117-d7974844b087', 'd1407476-ceec-4dc3-b229-d7526df6538c'] {{(pid=86212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 15:47:46 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-1e5911f9-139d-461d-be6f-6ebacc0d6b62 tempest-VolumesSnapshotTestJSON-1852940089 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:47:46 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-1e5911f9-139d-461d-be6f-6ebacc0d6b62 tempest-VolumesSnapshotTestJSON-1852940089 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:47:46 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-1e5911f9-139d-461d-be6f-6ebacc0d6b62 tempest-VolumesSnapshotTestJSON-1852940089 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:47:46 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-1e5911f9-139d-461d-be6f-6ebacc0d6b62 tempest-VolumesSnapshotTestJSON-1852940089 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:47:46 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-1e5911f9-139d-461d-be6f-6ebacc0d6b62 tempest-VolumesSnapshotTestJSON-1852940089 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:47:46 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-1e5911f9-139d-461d-be6f-6ebacc0d6b62 tempest-VolumesSnapshotTestJSON-1852940089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:47:46 devstack sudo[97424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc Sep 22 15:47:46 devstack sudo[97424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:47:46 devstack sudo[97416]: pam_unix(sudo:session): session closed for user root Sep 22 15:47:46 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-a192bdd4-6cc7-4784-aba3-b1e5971bddfc tempest-VolumeQuotasNegativeTestJSON-1103989567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc" returned: 0 in 0.362s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:47:46 devstack cinder-volume[86212]: DEBUG cinder.manager [None req-a192bdd4-6cc7-4784-aba3-b1e5971bddfc tempest-VolumeQuotasNegativeTestJSON-1103989567 None] Notifying Schedulers of capabilities ... {{(pid=86212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 15:47:46 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-a192bdd4-6cc7-4784-aba3-b1e5971bddfc tempest-VolumeQuotasNegativeTestJSON-1103989567 None] Deleted volume successfully. Sep 22 15:47:46 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-a192bdd4-6cc7-4784-aba3-b1e5971bddfc tempest-VolumeQuotasNegativeTestJSON-1103989567 None] Lock "cinder-b9d541b0-0556-477d-81c1-7f4b7125f68a-delete_volume" released by "delete_volume" :: held 2.100s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:47:46 devstack sudo[97414]: pam_unix(sudo:session): session closed for user root Sep 22 15:47:46 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-c315c5bd-a0c8-44f7-9f36-68082b425b7a tempest-VolumesListAdminTestJSON-1693520119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-21f7568b-7e2a-4118-9028-e246d710730f 1073741824" returned: 0 in 0.545s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:47:46 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-c315c5bd-a0c8-44f7-9f36-68082b425b7a tempest-VolumesListAdminTestJSON-1693520119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-21f7568b-7e2a-4118-9028-e246d710730f {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:47:46 devstack sudo[97426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-21f7568b-7e2a-4118-9028-e246d710730f Sep 22 15:47:46 devstack sudo[97426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:47:46 devstack sudo[97424]: pam_unix(sudo:session): session closed for user root Sep 22 15:47:46 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-1e5911f9-139d-461d-be6f-6ebacc0d6b62 tempest-VolumesSnapshotTestJSON-1852940089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc" returned: 0 in 0.338s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:47:46 devstack cinder-volume[86212]: DEBUG cinder.manager [None req-1e5911f9-139d-461d-be6f-6ebacc0d6b62 tempest-VolumesSnapshotTestJSON-1852940089 None] Notifying Schedulers of capabilities ... {{(pid=86212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 15:47:46 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-1e5911f9-139d-461d-be6f-6ebacc0d6b62 tempest-VolumesSnapshotTestJSON-1852940089 None] Deleted volume successfully. Sep 22 15:47:46 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-1e5911f9-139d-461d-be6f-6ebacc0d6b62 tempest-VolumesSnapshotTestJSON-1852940089 None] Lock "cinder-42581491-9b0a-4012-9b92-6c0be5239ad1-delete_volume" released by "delete_volume" :: held 1.773s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:47:46 devstack sudo[97426]: pam_unix(sudo:session): session closed for user root Sep 22 15:47:46 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-c315c5bd-a0c8-44f7-9f36-68082b425b7a tempest-VolumesListAdminTestJSON-1693520119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-21f7568b-7e2a-4118-9028-e246d710730f" returned: 0 in 0.292s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:47:46 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-c315c5bd-a0c8-44f7-9f36-68082b425b7a tempest-VolumesListAdminTestJSON-1693520119 None] <== create_volume: return (878ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'} {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 15:47:46 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-c315c5bd-a0c8-44f7-9f36-68082b425b7a tempest-VolumesListAdminTestJSON-1693520119 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.880s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:47:46 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-c315c5bd-a0c8-44f7-9f36-68082b425b7a tempest-VolumesListAdminTestJSON-1693520119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac6d3d47-f48c-46c4-8727-868f2fa90307) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-21f7568b-7e2a-4118-9028-e246d710730f', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:47:46 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-c315c5bd-a0c8-44f7-9f36-68082b425b7a tempest-VolumesListAdminTestJSON-1693520119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1566df0e-88b1-4783-bd05-e5e11428a6a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:47:46 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-c315c5bd-a0c8-44f7-9f36-68082b425b7a tempest-VolumesListAdminTestJSON-1693520119 None] Volume volume-21f7568b-7e2a-4118-9028-e246d710730f (21f7568b-7e2a-4118-9028-e246d710730f): created successfully Sep 22 15:47:46 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-c315c5bd-a0c8-44f7-9f36-68082b425b7a tempest-VolumesListAdminTestJSON-1693520119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1566df0e-88b1-4783-bd05-e5e11428a6a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:47:46 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-c315c5bd-a0c8-44f7-9f36-68082b425b7a tempest-VolumesListAdminTestJSON-1693520119 None] Flow 'volume_create_manager' (21c64632-119e-4eba-ac7b-f00410e0f9a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:47:46 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-c315c5bd-a0c8-44f7-9f36-68082b425b7a tempest-VolumesListAdminTestJSON-1693520119 None] Created volume successfully. Sep 22 15:47:47 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-7e711c41-b2cc-45f8-8635-a5495bc94b09 tempest-VolumesSnapshotTestJSON-1852940089 None] Acquiring lock "cinder-2c475acc-bd33-49e6-a138-3b7cf95f5ee3-delete_volume" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:47:47 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-7e711c41-b2cc-45f8-8635-a5495bc94b09 tempest-VolumesSnapshotTestJSON-1852940089 None] Lock "cinder-2c475acc-bd33-49e6-a138-3b7cf95f5ee3-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:47:47 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-7e711c41-b2cc-45f8-8635-a5495bc94b09 tempest-VolumesSnapshotTestJSON-1852940089 None] Acquiring lock "cinder-quobyte-2c475acc-bd33-49e6-a138-3b7cf95f5ee3" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:47:47 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-7e711c41-b2cc-45f8-8635-a5495bc94b09 tempest-VolumesSnapshotTestJSON-1852940089 None] Lock "cinder-quobyte-2c475acc-bd33-49e6-a138-3b7cf95f5ee3" acquired by "delete_volume" :: waited 0.028s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:47:47 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[f34dabeb-fc88-4a71-995a-ca3f946f01d3]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:47:47 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-7e711c41-b2cc-45f8-8635-a5495bc94b09 tempest-VolumesSnapshotTestJSON-1852940089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2c475acc-bd33-49e6-a138-3b7cf95f5ee3 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:47:47 devstack sudo[97430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2c475acc-bd33-49e6-a138-3b7cf95f5ee3 Sep 22 15:47:47 devstack sudo[97430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:47:47 devstack sudo[97430]: pam_unix(sudo:session): session closed for user root Sep 22 15:47:47 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-7e711c41-b2cc-45f8-8635-a5495bc94b09 tempest-VolumesSnapshotTestJSON-1852940089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2c475acc-bd33-49e6-a138-3b7cf95f5ee3" returned: 0 in 0.462s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:47:47 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-7e711c41-b2cc-45f8-8635-a5495bc94b09 tempest-VolumesSnapshotTestJSON-1852940089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2c475acc-bd33-49e6-a138-3b7cf95f5ee3 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:47:47 devstack sudo[97436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2c475acc-bd33-49e6-a138-3b7cf95f5ee3 Sep 22 15:47:47 devstack sudo[97436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:47:48 devstack sudo[97436]: pam_unix(sudo:session): session closed for user root Sep 22 15:47:48 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-7e711c41-b2cc-45f8-8635-a5495bc94b09 tempest-VolumesSnapshotTestJSON-1852940089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2c475acc-bd33-49e6-a138-3b7cf95f5ee3" returned: 0 in 0.355s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:47:48 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-7e711c41-b2cc-45f8-8635-a5495bc94b09 tempest-VolumesSnapshotTestJSON-1852940089 None] Lock "cinder-quobyte-2c475acc-bd33-49e6-a138-3b7cf95f5ee3" released by "delete_volume" :: held 0.925s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:47:48 devstack cinder-volume[86212]: DEBUG cinder.quota [None req-7e711c41-b2cc-45f8-8635-a5495bc94b09 tempest-VolumesSnapshotTestJSON-1852940089 None] Created reservations ['b683dee3-32b8-4329-9994-8247e67e6469', '3f55a201-01b3-4171-9e62-6fa99463d53a', '4931c362-a18f-49b1-86fa-22299138beae', 'f2c36d69-9530-49da-88c4-978790a3272c'] {{(pid=86212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 15:47:48 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-7e711c41-b2cc-45f8-8635-a5495bc94b09 tempest-VolumesSnapshotTestJSON-1852940089 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:47:48 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-7e711c41-b2cc-45f8-8635-a5495bc94b09 tempest-VolumesSnapshotTestJSON-1852940089 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:47:48 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-7e711c41-b2cc-45f8-8635-a5495bc94b09 tempest-VolumesSnapshotTestJSON-1852940089 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:47:48 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-7e711c41-b2cc-45f8-8635-a5495bc94b09 tempest-VolumesSnapshotTestJSON-1852940089 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:47:48 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-7e711c41-b2cc-45f8-8635-a5495bc94b09 tempest-VolumesSnapshotTestJSON-1852940089 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:47:48 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-7e711c41-b2cc-45f8-8635-a5495bc94b09 tempest-VolumesSnapshotTestJSON-1852940089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:47:48 devstack sudo[97439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc Sep 22 15:47:48 devstack sudo[97439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:47:49 devstack cinder-volume[86212]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad417ad7-66cc-4b26-9671-5e39a3728e27 tempest-VolumesListAdminTestJSON-2122062525 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 15:47:49 devstack sudo[97439]: pam_unix(sudo:session): session closed for user root Sep 22 15:47:49 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-ad417ad7-66cc-4b26-9671-5e39a3728e27 tempest-VolumesListAdminTestJSON-2122062525 None] Flow 'volume_create_manager' (507c1d0e-7114-4148-9e4c-f5492804c7db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:47:49 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-ad417ad7-66cc-4b26-9671-5e39a3728e27 tempest-VolumesListAdminTestJSON-2122062525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf1dea9a-27a8-402c-a722-3b170cd28507) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:47:49 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-7e711c41-b2cc-45f8-8635-a5495bc94b09 tempest-VolumesSnapshotTestJSON-1852940089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc" returned: 0 in 0.643s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:47:49 devstack cinder-volume[86212]: DEBUG cinder.manager [None req-7e711c41-b2cc-45f8-8635-a5495bc94b09 tempest-VolumesSnapshotTestJSON-1852940089 None] Notifying Schedulers of capabilities ... {{(pid=86212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 15:47:49 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-7e711c41-b2cc-45f8-8635-a5495bc94b09 tempest-VolumesSnapshotTestJSON-1852940089 None] Deleted volume successfully. Sep 22 15:47:49 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-ad417ad7-66cc-4b26-9671-5e39a3728e27 tempest-VolumesListAdminTestJSON-2122062525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf1dea9a-27a8-402c-a722-3b170cd28507) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:47:48Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=462ae53d-47ef-4bad-86b8-30115e3e035f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b585ad7607c4ece81831272cc05c86b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:47:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:47:49Z,use_quota=True,user_id='5b37f2125f1c4308ab124e3793065f3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:47:49 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-ad417ad7-66cc-4b26-9671-5e39a3728e27 tempest-VolumesListAdminTestJSON-2122062525 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1bd0e1c4-50db-4c98-8508-0a710b4fe114) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:47:49 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-ad417ad7-66cc-4b26-9671-5e39a3728e27 tempest-VolumesListAdminTestJSON-2122062525 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1bd0e1c4-50db-4c98-8508-0a710b4fe114) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:47:49 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-ad417ad7-66cc-4b26-9671-5e39a3728e27 tempest-VolumesListAdminTestJSON-2122062525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20d9f334-f90e-4dd4-9ace-f9dcea171219) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:47:49 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-ad417ad7-66cc-4b26-9671-5e39a3728e27 tempest-VolumesListAdminTestJSON-2122062525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20d9f334-f90e-4dd4-9ace-f9dcea171219) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '462ae53d-47ef-4bad-86b8-30115e3e035f', 'volume_name': 'volume-462ae53d-47ef-4bad-86b8-30115e3e035f', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:47:49 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-ad417ad7-66cc-4b26-9671-5e39a3728e27 tempest-VolumesListAdminTestJSON-2122062525 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a95ea46c-b160-4bc4-80a1-938fb28e8159) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:47:49 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-ad417ad7-66cc-4b26-9671-5e39a3728e27 tempest-VolumesListAdminTestJSON-2122062525 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a95ea46c-b160-4bc4-80a1-938fb28e8159) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:47:49 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-ad417ad7-66cc-4b26-9671-5e39a3728e27 tempest-VolumesListAdminTestJSON-2122062525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb5bbc46-9557-4cfa-9ab8-1a017429a3dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:47:49 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-ad417ad7-66cc-4b26-9671-5e39a3728e27 tempest-VolumesListAdminTestJSON-2122062525 None] Volume 462ae53d-47ef-4bad-86b8-30115e3e035f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-462ae53d-47ef-4bad-86b8-30115e3e035f', 'volume_size': 1} Sep 22 15:47:49 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-ad417ad7-66cc-4b26-9671-5e39a3728e27 tempest-VolumesListAdminTestJSON-2122062525 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:47:49 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-ad417ad7-66cc-4b26-9671-5e39a3728e27 tempest-VolumesListAdminTestJSON-2122062525 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:47:49 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-ad417ad7-66cc-4b26-9671-5e39a3728e27 tempest-VolumesListAdminTestJSON-2122062525 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:47:48Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=462ae53d-47ef-4bad-86b8-30115e3e035f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b585ad7607c4ece81831272cc05c86b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:47:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:47:49Z,use_quota=True,user_id='5b37f2125f1c4308ab124e3793065f3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)}" {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 15:47:49 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-ad417ad7-66cc-4b26-9671-5e39a3728e27 tempest-VolumesListAdminTestJSON-2122062525 None] Creating volume 462ae53d-47ef-4bad-86b8-30115e3e035f {{(pid=86212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 15:47:49 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-ad417ad7-66cc-4b26-9671-5e39a3728e27 tempest-VolumesListAdminTestJSON-2122062525 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:47:49 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-ad417ad7-66cc-4b26-9671-5e39a3728e27 tempest-VolumesListAdminTestJSON-2122062525 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:47:49 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-ad417ad7-66cc-4b26-9671-5e39a3728e27 tempest-VolumesListAdminTestJSON-2122062525 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:47:49 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-ad417ad7-66cc-4b26-9671-5e39a3728e27 tempest-VolumesListAdminTestJSON-2122062525 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:47:49 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-ad417ad7-66cc-4b26-9671-5e39a3728e27 tempest-VolumesListAdminTestJSON-2122062525 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:47:49 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-ad417ad7-66cc-4b26-9671-5e39a3728e27 tempest-VolumesListAdminTestJSON-2122062525 None] Selected osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 as target Quobyte volume. {{(pid=86212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 15:47:49 devstack cinder-volume[86212]: INFO cinder.volume.drivers.remotefs [None req-ad417ad7-66cc-4b26-9671-5e39a3728e27 tempest-VolumesListAdminTestJSON-2122062525 None] casted to osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 Sep 22 15:47:49 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-ad417ad7-66cc-4b26-9671-5e39a3728e27 tempest-VolumesListAdminTestJSON-2122062525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-462ae53d-47ef-4bad-86b8-30115e3e035f 1073741824 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:47:49 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-7e711c41-b2cc-45f8-8635-a5495bc94b09 tempest-VolumesSnapshotTestJSON-1852940089 None] Lock "cinder-2c475acc-bd33-49e6-a138-3b7cf95f5ee3-delete_volume" released by "delete_volume" :: held 1.921s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:47:49 devstack sudo[97442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-462ae53d-47ef-4bad-86b8-30115e3e035f 1073741824 Sep 22 15:47:49 devstack sudo[97442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:47:49 devstack sudo[97442]: pam_unix(sudo:session): session closed for user root Sep 22 15:47:49 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-ad417ad7-66cc-4b26-9671-5e39a3728e27 tempest-VolumesListAdminTestJSON-2122062525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-462ae53d-47ef-4bad-86b8-30115e3e035f 1073741824" returned: 0 in 0.606s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:47:49 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-ad417ad7-66cc-4b26-9671-5e39a3728e27 tempest-VolumesListAdminTestJSON-2122062525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-462ae53d-47ef-4bad-86b8-30115e3e035f {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:47:49 devstack sudo[97448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-462ae53d-47ef-4bad-86b8-30115e3e035f Sep 22 15:47:49 devstack sudo[97448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:47:50 devstack sudo[97448]: pam_unix(sudo:session): session closed for user root Sep 22 15:47:50 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-ad417ad7-66cc-4b26-9671-5e39a3728e27 tempest-VolumesListAdminTestJSON-2122062525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-462ae53d-47ef-4bad-86b8-30115e3e035f" returned: 0 in 0.375s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:47:50 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-ad417ad7-66cc-4b26-9671-5e39a3728e27 tempest-VolumesListAdminTestJSON-2122062525 None] <== create_volume: return (1037ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'} {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 15:47:50 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-ad417ad7-66cc-4b26-9671-5e39a3728e27 tempest-VolumesListAdminTestJSON-2122062525 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.042s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:47:50 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-ad417ad7-66cc-4b26-9671-5e39a3728e27 tempest-VolumesListAdminTestJSON-2122062525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb5bbc46-9557-4cfa-9ab8-1a017429a3dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-462ae53d-47ef-4bad-86b8-30115e3e035f', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:47:50 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-ad417ad7-66cc-4b26-9671-5e39a3728e27 tempest-VolumesListAdminTestJSON-2122062525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f75a0a34-a57e-4cf4-ac6e-da96a14a0850) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:47:50 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-ad417ad7-66cc-4b26-9671-5e39a3728e27 tempest-VolumesListAdminTestJSON-2122062525 None] Volume volume-462ae53d-47ef-4bad-86b8-30115e3e035f (462ae53d-47ef-4bad-86b8-30115e3e035f): created successfully Sep 22 15:47:50 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-ad417ad7-66cc-4b26-9671-5e39a3728e27 tempest-VolumesListAdminTestJSON-2122062525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f75a0a34-a57e-4cf4-ac6e-da96a14a0850) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:47:50 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-ad417ad7-66cc-4b26-9671-5e39a3728e27 tempest-VolumesListAdminTestJSON-2122062525 None] Flow 'volume_create_manager' (507c1d0e-7114-4148-9e4c-f5492804c7db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:47:50 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-ad417ad7-66cc-4b26-9671-5e39a3728e27 tempest-VolumesListAdminTestJSON-2122062525 None] Created volume successfully. Sep 22 15:47:51 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-7ea2d91f-105e-46cb-9fb3-717b52a6bdf1 tempest-VolumesListAdminTestJSON-2122062525 None] Acquiring lock "cinder-462ae53d-47ef-4bad-86b8-30115e3e035f-delete_volume" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:47:51 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-7ea2d91f-105e-46cb-9fb3-717b52a6bdf1 tempest-VolumesListAdminTestJSON-2122062525 None] Lock "cinder-462ae53d-47ef-4bad-86b8-30115e3e035f-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:47:51 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-7ea2d91f-105e-46cb-9fb3-717b52a6bdf1 tempest-VolumesListAdminTestJSON-2122062525 None] Acquiring lock "cinder-quobyte-462ae53d-47ef-4bad-86b8-30115e3e035f" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:47:51 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-7ea2d91f-105e-46cb-9fb3-717b52a6bdf1 tempest-VolumesListAdminTestJSON-2122062525 None] Lock "cinder-quobyte-462ae53d-47ef-4bad-86b8-30115e3e035f" acquired by "delete_volume" :: waited 0.044s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:47:51 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[444bba71-9865-4645-b9f8-52ed3d5aaf6d]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:47:51 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-7ea2d91f-105e-46cb-9fb3-717b52a6bdf1 tempest-VolumesListAdminTestJSON-2122062525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-462ae53d-47ef-4bad-86b8-30115e3e035f {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:47:51 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-d0f8c9d8-b1ff-4b82-8492-a12612fd4122 tempest-VolumesListAdminTestJSON-1693520119 None] Acquiring lock "cinder-21f7568b-7e2a-4118-9028-e246d710730f-delete_volume" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:47:51 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-d0f8c9d8-b1ff-4b82-8492-a12612fd4122 tempest-VolumesListAdminTestJSON-1693520119 None] Lock "cinder-21f7568b-7e2a-4118-9028-e246d710730f-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:47:51 devstack sudo[97458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-462ae53d-47ef-4bad-86b8-30115e3e035f Sep 22 15:47:51 devstack sudo[97458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:47:51 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-d0f8c9d8-b1ff-4b82-8492-a12612fd4122 tempest-VolumesListAdminTestJSON-1693520119 None] Acquiring lock "cinder-quobyte-21f7568b-7e2a-4118-9028-e246d710730f" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:47:51 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-d0f8c9d8-b1ff-4b82-8492-a12612fd4122 tempest-VolumesListAdminTestJSON-1693520119 None] Lock "cinder-quobyte-21f7568b-7e2a-4118-9028-e246d710730f" acquired by "delete_volume" :: waited 0.042s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:47:51 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3d8a9d1-c807-458c-9e52-68d23a3028e8]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:47:51 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-d0f8c9d8-b1ff-4b82-8492-a12612fd4122 tempest-VolumesListAdminTestJSON-1693520119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-21f7568b-7e2a-4118-9028-e246d710730f {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:47:51 devstack sudo[97460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-21f7568b-7e2a-4118-9028-e246d710730f Sep 22 15:47:51 devstack sudo[97460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:47:52 devstack sudo[97458]: pam_unix(sudo:session): session closed for user root Sep 22 15:47:52 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-7ea2d91f-105e-46cb-9fb3-717b52a6bdf1 tempest-VolumesListAdminTestJSON-2122062525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-462ae53d-47ef-4bad-86b8-30115e3e035f" returned: 0 in 0.563s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:47:52 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-7ea2d91f-105e-46cb-9fb3-717b52a6bdf1 tempest-VolumesListAdminTestJSON-2122062525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-462ae53d-47ef-4bad-86b8-30115e3e035f {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:47:52 devstack sudo[97465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-462ae53d-47ef-4bad-86b8-30115e3e035f Sep 22 15:47:52 devstack sudo[97465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:47:52 devstack sudo[97460]: pam_unix(sudo:session): session closed for user root Sep 22 15:47:52 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-d0f8c9d8-b1ff-4b82-8492-a12612fd4122 tempest-VolumesListAdminTestJSON-1693520119 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-21f7568b-7e2a-4118-9028-e246d710730f" returned: 0 in 0.490s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:47:52 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-d0f8c9d8-b1ff-4b82-8492-a12612fd4122 tempest-VolumesListAdminTestJSON-1693520119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-21f7568b-7e2a-4118-9028-e246d710730f {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:47:52 devstack sudo[97470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-21f7568b-7e2a-4118-9028-e246d710730f Sep 22 15:47:52 devstack sudo[97470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:47:52 devstack sudo[97465]: pam_unix(sudo:session): session closed for user root Sep 22 15:47:52 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-7ea2d91f-105e-46cb-9fb3-717b52a6bdf1 tempest-VolumesListAdminTestJSON-2122062525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-462ae53d-47ef-4bad-86b8-30115e3e035f" returned: 0 in 0.495s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:47:52 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-7ea2d91f-105e-46cb-9fb3-717b52a6bdf1 tempest-VolumesListAdminTestJSON-2122062525 None] Lock "cinder-quobyte-462ae53d-47ef-4bad-86b8-30115e3e035f" released by "delete_volume" :: held 1.140s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:47:52 devstack sudo[97470]: pam_unix(sudo:session): session closed for user root Sep 22 15:47:52 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-d0f8c9d8-b1ff-4b82-8492-a12612fd4122 tempest-VolumesListAdminTestJSON-1693520119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-21f7568b-7e2a-4118-9028-e246d710730f" returned: 0 in 0.406s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:47:52 devstack cinder-volume[86212]: DEBUG cinder.quota [None req-7ea2d91f-105e-46cb-9fb3-717b52a6bdf1 tempest-VolumesListAdminTestJSON-2122062525 None] Created reservations ['cb2b0606-7f0c-493a-85c7-93568ee4542a', '9919ae40-385a-4ddf-9f71-65e758de4998', '87ef80d3-3cd9-4c56-8af1-f7cd7f319da9', '047205c1-7f0a-43e6-8938-e9ad36110cb7'] {{(pid=86212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 15:47:52 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-d0f8c9d8-b1ff-4b82-8492-a12612fd4122 tempest-VolumesListAdminTestJSON-1693520119 None] Lock "cinder-quobyte-21f7568b-7e2a-4118-9028-e246d710730f" released by "delete_volume" :: held 1.006s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:47:52 devstack cinder-volume[86212]: DEBUG cinder.quota [None req-d0f8c9d8-b1ff-4b82-8492-a12612fd4122 tempest-VolumesListAdminTestJSON-1693520119 None] Created reservations ['fc26fe65-bd28-47f9-b8fd-286012b60285', 'e3d9f05b-291d-4868-85ad-7ce88c54aef7', 'b50b2240-53ff-468a-9f0e-7386a87c0c9c', '5a11ba1d-e553-4101-aafd-5b0cfd8358e9'] {{(pid=86212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 15:47:52 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-7ea2d91f-105e-46cb-9fb3-717b52a6bdf1 tempest-VolumesListAdminTestJSON-2122062525 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:47:52 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-7ea2d91f-105e-46cb-9fb3-717b52a6bdf1 tempest-VolumesListAdminTestJSON-2122062525 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:47:52 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-7ea2d91f-105e-46cb-9fb3-717b52a6bdf1 tempest-VolumesListAdminTestJSON-2122062525 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:47:52 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-7ea2d91f-105e-46cb-9fb3-717b52a6bdf1 tempest-VolumesListAdminTestJSON-2122062525 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:47:52 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-7ea2d91f-105e-46cb-9fb3-717b52a6bdf1 tempest-VolumesListAdminTestJSON-2122062525 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:47:52 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-7ea2d91f-105e-46cb-9fb3-717b52a6bdf1 tempest-VolumesListAdminTestJSON-2122062525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:47:52 devstack sudo[97474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc Sep 22 15:47:52 devstack sudo[97474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:47:52 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-d0f8c9d8-b1ff-4b82-8492-a12612fd4122 tempest-VolumesListAdminTestJSON-1693520119 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:47:53 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-d0f8c9d8-b1ff-4b82-8492-a12612fd4122 tempest-VolumesListAdminTestJSON-1693520119 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:47:53 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-d0f8c9d8-b1ff-4b82-8492-a12612fd4122 tempest-VolumesListAdminTestJSON-1693520119 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:47:53 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-d0f8c9d8-b1ff-4b82-8492-a12612fd4122 tempest-VolumesListAdminTestJSON-1693520119 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:47:53 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-d0f8c9d8-b1ff-4b82-8492-a12612fd4122 tempest-VolumesListAdminTestJSON-1693520119 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:47:53 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-d0f8c9d8-b1ff-4b82-8492-a12612fd4122 tempest-VolumesListAdminTestJSON-1693520119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:47:53 devstack sudo[97476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc Sep 22 15:47:53 devstack sudo[97476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:47:53 devstack sudo[97474]: pam_unix(sudo:session): session closed for user root Sep 22 15:47:53 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-7ea2d91f-105e-46cb-9fb3-717b52a6bdf1 tempest-VolumesListAdminTestJSON-2122062525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc" returned: 0 in 0.464s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:47:53 devstack cinder-volume[86212]: DEBUG cinder.manager [None req-7ea2d91f-105e-46cb-9fb3-717b52a6bdf1 tempest-VolumesListAdminTestJSON-2122062525 None] Notifying Schedulers of capabilities ... {{(pid=86212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 15:47:53 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-7ea2d91f-105e-46cb-9fb3-717b52a6bdf1 tempest-VolumesListAdminTestJSON-2122062525 None] Deleted volume successfully. Sep 22 15:47:53 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-7ea2d91f-105e-46cb-9fb3-717b52a6bdf1 tempest-VolumesListAdminTestJSON-2122062525 None] Lock "cinder-462ae53d-47ef-4bad-86b8-30115e3e035f-delete_volume" released by "delete_volume" :: held 2.099s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:47:53 devstack sudo[97476]: pam_unix(sudo:session): session closed for user root Sep 22 15:47:53 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-d0f8c9d8-b1ff-4b82-8492-a12612fd4122 tempest-VolumesListAdminTestJSON-1693520119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc" returned: 0 in 0.522s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:47:53 devstack cinder-volume[86212]: DEBUG cinder.manager [None req-d0f8c9d8-b1ff-4b82-8492-a12612fd4122 tempest-VolumesListAdminTestJSON-1693520119 None] Notifying Schedulers of capabilities ... {{(pid=86212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 15:47:53 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-d0f8c9d8-b1ff-4b82-8492-a12612fd4122 tempest-VolumesListAdminTestJSON-1693520119 None] Deleted volume successfully. Sep 22 15:47:53 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-d0f8c9d8-b1ff-4b82-8492-a12612fd4122 tempest-VolumesListAdminTestJSON-1693520119 None] Lock "cinder-21f7568b-7e2a-4118-9028-e246d710730f-delete_volume" released by "delete_volume" :: held 1.981s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:47:53 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-4fbedce5-4832-41f9-82d2-32810812a006 tempest-VolumesListAdminTestJSON-1693520119 None] Acquiring lock "cinder-af2ed752-f7af-496c-9833-b930f7e8918f-delete_volume" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:47:53 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-4fbedce5-4832-41f9-82d2-32810812a006 tempest-VolumesListAdminTestJSON-1693520119 None] Lock "cinder-af2ed752-f7af-496c-9833-b930f7e8918f-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:47:54 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-4fbedce5-4832-41f9-82d2-32810812a006 tempest-VolumesListAdminTestJSON-1693520119 None] Acquiring lock "cinder-quobyte-af2ed752-f7af-496c-9833-b930f7e8918f" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:47:54 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-4fbedce5-4832-41f9-82d2-32810812a006 tempest-VolumesListAdminTestJSON-1693520119 None] Lock "cinder-quobyte-af2ed752-f7af-496c-9833-b930f7e8918f" acquired by "delete_volume" :: waited 0.024s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:47:54 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa169957-c812-4fd3-9569-63da4bf2d3a7]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:47:54 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-4fbedce5-4832-41f9-82d2-32810812a006 tempest-VolumesListAdminTestJSON-1693520119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-af2ed752-f7af-496c-9833-b930f7e8918f {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:47:54 devstack sudo[97480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-af2ed752-f7af-496c-9833-b930f7e8918f Sep 22 15:47:54 devstack sudo[97480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:47:54 devstack sudo[97480]: pam_unix(sudo:session): session closed for user root Sep 22 15:47:54 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-4fbedce5-4832-41f9-82d2-32810812a006 tempest-VolumesListAdminTestJSON-1693520119 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-af2ed752-f7af-496c-9833-b930f7e8918f" returned: 0 in 0.625s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:47:54 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-4fbedce5-4832-41f9-82d2-32810812a006 tempest-VolumesListAdminTestJSON-1693520119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-af2ed752-f7af-496c-9833-b930f7e8918f {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:47:54 devstack sudo[97528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-af2ed752-f7af-496c-9833-b930f7e8918f Sep 22 15:47:54 devstack sudo[97528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:47:55 devstack sudo[97528]: pam_unix(sudo:session): session closed for user root Sep 22 15:47:55 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-4fbedce5-4832-41f9-82d2-32810812a006 tempest-VolumesListAdminTestJSON-1693520119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-af2ed752-f7af-496c-9833-b930f7e8918f" returned: 0 in 0.374s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:47:55 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-4fbedce5-4832-41f9-82d2-32810812a006 tempest-VolumesListAdminTestJSON-1693520119 None] Lock "cinder-quobyte-af2ed752-f7af-496c-9833-b930f7e8918f" released by "delete_volume" :: held 1.057s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:47:55 devstack cinder-volume[86212]: DEBUG cinder.quota [None req-4fbedce5-4832-41f9-82d2-32810812a006 tempest-VolumesListAdminTestJSON-1693520119 None] Created reservations ['3c446e1e-de3f-4a65-a602-83f861c4fb0f', '766c7691-7603-4288-88b8-e066dc1d056d', '5bd42ed0-9393-4c7e-b00b-bfdd4376d8c2', 'e5416010-5f7a-47cc-8dbe-b3d2949006f0'] {{(pid=86212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 15:47:55 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-4fbedce5-4832-41f9-82d2-32810812a006 tempest-VolumesListAdminTestJSON-1693520119 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:47:55 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-4fbedce5-4832-41f9-82d2-32810812a006 tempest-VolumesListAdminTestJSON-1693520119 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:47:55 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-4fbedce5-4832-41f9-82d2-32810812a006 tempest-VolumesListAdminTestJSON-1693520119 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:47:55 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-4fbedce5-4832-41f9-82d2-32810812a006 tempest-VolumesListAdminTestJSON-1693520119 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:47:55 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-4fbedce5-4832-41f9-82d2-32810812a006 tempest-VolumesListAdminTestJSON-1693520119 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:47:55 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-4fbedce5-4832-41f9-82d2-32810812a006 tempest-VolumesListAdminTestJSON-1693520119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:47:55 devstack sudo[97531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc Sep 22 15:47:55 devstack sudo[97531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:47:55 devstack sudo[97531]: pam_unix(sudo:session): session closed for user root Sep 22 15:47:55 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-4fbedce5-4832-41f9-82d2-32810812a006 tempest-VolumesListAdminTestJSON-1693520119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc" returned: 0 in 0.303s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:47:55 devstack cinder-volume[86212]: DEBUG cinder.manager [None req-4fbedce5-4832-41f9-82d2-32810812a006 tempest-VolumesListAdminTestJSON-1693520119 None] Notifying Schedulers of capabilities ... {{(pid=86212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 15:47:55 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-4fbedce5-4832-41f9-82d2-32810812a006 tempest-VolumesListAdminTestJSON-1693520119 None] Deleted volume successfully. Sep 22 15:47:55 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-4fbedce5-4832-41f9-82d2-32810812a006 tempest-VolumesListAdminTestJSON-1693520119 None] Lock "cinder-af2ed752-f7af-496c-9833-b930f7e8918f-delete_volume" released by "delete_volume" :: held 1.644s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:47:56 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-3e6db262-a90a-4d06-9e9e-04e647c8fe15 tempest-VolumesListAdminTestJSON-1693520119 None] Acquiring lock "cinder-efcdbc2b-21b5-4c78-b043-5d43fa28a004-delete_volume" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:47:56 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-3e6db262-a90a-4d06-9e9e-04e647c8fe15 tempest-VolumesListAdminTestJSON-1693520119 None] Lock "cinder-efcdbc2b-21b5-4c78-b043-5d43fa28a004-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:47:56 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-3e6db262-a90a-4d06-9e9e-04e647c8fe15 tempest-VolumesListAdminTestJSON-1693520119 None] Acquiring lock "cinder-quobyte-efcdbc2b-21b5-4c78-b043-5d43fa28a004" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:47:56 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-3e6db262-a90a-4d06-9e9e-04e647c8fe15 tempest-VolumesListAdminTestJSON-1693520119 None] Lock "cinder-quobyte-efcdbc2b-21b5-4c78-b043-5d43fa28a004" acquired by "delete_volume" :: waited 0.015s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:47:56 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f4370e0-b8e3-4c99-8b10-b29043dfa019]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:47:56 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-3e6db262-a90a-4d06-9e9e-04e647c8fe15 tempest-VolumesListAdminTestJSON-1693520119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-efcdbc2b-21b5-4c78-b043-5d43fa28a004 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:47:56 devstack sudo[97535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-efcdbc2b-21b5-4c78-b043-5d43fa28a004 Sep 22 15:47:56 devstack sudo[97535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:47:56 devstack sudo[97535]: pam_unix(sudo:session): session closed for user root Sep 22 15:47:56 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-3e6db262-a90a-4d06-9e9e-04e647c8fe15 tempest-VolumesListAdminTestJSON-1693520119 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-efcdbc2b-21b5-4c78-b043-5d43fa28a004" returned: 0 in 0.462s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:47:56 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-3e6db262-a90a-4d06-9e9e-04e647c8fe15 tempest-VolumesListAdminTestJSON-1693520119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-efcdbc2b-21b5-4c78-b043-5d43fa28a004 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:47:56 devstack sudo[97540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-efcdbc2b-21b5-4c78-b043-5d43fa28a004 Sep 22 15:47:56 devstack sudo[97540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:47:57 devstack sudo[97540]: pam_unix(sudo:session): session closed for user root Sep 22 15:47:57 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-3e6db262-a90a-4d06-9e9e-04e647c8fe15 tempest-VolumesListAdminTestJSON-1693520119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-efcdbc2b-21b5-4c78-b043-5d43fa28a004" returned: 0 in 0.274s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:47:57 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-3e6db262-a90a-4d06-9e9e-04e647c8fe15 tempest-VolumesListAdminTestJSON-1693520119 None] Lock "cinder-quobyte-efcdbc2b-21b5-4c78-b043-5d43fa28a004" released by "delete_volume" :: held 0.793s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:47:57 devstack cinder-volume[86212]: DEBUG cinder.quota [None req-3e6db262-a90a-4d06-9e9e-04e647c8fe15 tempest-VolumesListAdminTestJSON-1693520119 None] Created reservations ['7f913433-958d-46ee-854b-06df2046fd46', 'cc941983-23af-4b2a-9f10-add747a55b40', 'cb701adf-e551-43f3-8286-4b27cabccefb', '0c43eb31-1a29-474f-b54a-e029e3832cda'] {{(pid=86212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 15:47:57 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-3e6db262-a90a-4d06-9e9e-04e647c8fe15 tempest-VolumesListAdminTestJSON-1693520119 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:47:57 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-3e6db262-a90a-4d06-9e9e-04e647c8fe15 tempest-VolumesListAdminTestJSON-1693520119 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:47:57 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-3e6db262-a90a-4d06-9e9e-04e647c8fe15 tempest-VolumesListAdminTestJSON-1693520119 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:47:57 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-3e6db262-a90a-4d06-9e9e-04e647c8fe15 tempest-VolumesListAdminTestJSON-1693520119 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:47:57 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-3e6db262-a90a-4d06-9e9e-04e647c8fe15 tempest-VolumesListAdminTestJSON-1693520119 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:47:57 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-3e6db262-a90a-4d06-9e9e-04e647c8fe15 tempest-VolumesListAdminTestJSON-1693520119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:47:57 devstack sudo[97543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc Sep 22 15:47:57 devstack sudo[97543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:47:57 devstack sudo[97543]: pam_unix(sudo:session): session closed for user root Sep 22 15:47:57 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-3e6db262-a90a-4d06-9e9e-04e647c8fe15 tempest-VolumesListAdminTestJSON-1693520119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc" returned: 0 in 0.318s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:47:57 devstack cinder-volume[86212]: DEBUG cinder.manager [None req-3e6db262-a90a-4d06-9e9e-04e647c8fe15 tempest-VolumesListAdminTestJSON-1693520119 None] Notifying Schedulers of capabilities ... {{(pid=86212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 15:47:57 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-3e6db262-a90a-4d06-9e9e-04e647c8fe15 tempest-VolumesListAdminTestJSON-1693520119 None] Deleted volume successfully. Sep 22 15:47:57 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-3e6db262-a90a-4d06-9e9e-04e647c8fe15 tempest-VolumesListAdminTestJSON-1693520119 None] Lock "cinder-efcdbc2b-21b5-4c78-b043-5d43fa28a004-delete_volume" released by "delete_volume" :: held 1.382s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:48:00 devstack cinder-volume[86212]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a60f7b2-220b-481e-931e-43adfc6ab248 tempest-VolumesSnapshotNegativeTestJSON-436486563 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 15:48:00 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-6a60f7b2-220b-481e-931e-43adfc6ab248 tempest-VolumesSnapshotNegativeTestJSON-436486563 None] Flow 'volume_create_manager' (27556ddb-41b0-405b-8563-66a3b15b776d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:48:00 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-6a60f7b2-220b-481e-931e-43adfc6ab248 tempest-VolumesSnapshotNegativeTestJSON-436486563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f324123-efb9-4f46-b662-afd47e638928) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:48:00 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-6a60f7b2-220b-481e-931e-43adfc6ab248 tempest-VolumesSnapshotNegativeTestJSON-436486563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f324123-efb9-4f46-b662-afd47e638928) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:48:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-528191928',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=365a2043-200f-419f-bfc3-1e677a5c2ee0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54f19f4152a74c9db8da761101f23954',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:48:00Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:48:00Z,use_quota=True,user_id='47e0792736a24d068ad8b93cdce863b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:48:00 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-6a60f7b2-220b-481e-931e-43adfc6ab248 tempest-VolumesSnapshotNegativeTestJSON-436486563 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (649a005d-2caa-4218-8c05-abdcb96bfd97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:48:00 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-6a60f7b2-220b-481e-931e-43adfc6ab248 tempest-VolumesSnapshotNegativeTestJSON-436486563 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (649a005d-2caa-4218-8c05-abdcb96bfd97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:48:00 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-6a60f7b2-220b-481e-931e-43adfc6ab248 tempest-VolumesSnapshotNegativeTestJSON-436486563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae036716-6c25-4bab-8f96-77470b0bb724) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:48:00 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-6a60f7b2-220b-481e-931e-43adfc6ab248 tempest-VolumesSnapshotNegativeTestJSON-436486563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae036716-6c25-4bab-8f96-77470b0bb724) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '365a2043-200f-419f-bfc3-1e677a5c2ee0', 'volume_name': 'volume-365a2043-200f-419f-bfc3-1e677a5c2ee0', 'volume_size': 2}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:48:00 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-6a60f7b2-220b-481e-931e-43adfc6ab248 tempest-VolumesSnapshotNegativeTestJSON-436486563 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40f6e7f8-7b91-427f-82d3-f4181c689c39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:48:00 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-6a60f7b2-220b-481e-931e-43adfc6ab248 tempest-VolumesSnapshotNegativeTestJSON-436486563 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40f6e7f8-7b91-427f-82d3-f4181c689c39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:48:00 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-6a60f7b2-220b-481e-931e-43adfc6ab248 tempest-VolumesSnapshotNegativeTestJSON-436486563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3bf3c703-8dc9-4c71-bc8f-ace3f5459468) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:48:00 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-6a60f7b2-220b-481e-931e-43adfc6ab248 tempest-VolumesSnapshotNegativeTestJSON-436486563 None] Volume 365a2043-200f-419f-bfc3-1e677a5c2ee0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-365a2043-200f-419f-bfc3-1e677a5c2ee0', 'volume_size': 2} Sep 22 15:48:00 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-6a60f7b2-220b-481e-931e-43adfc6ab248 tempest-VolumesSnapshotNegativeTestJSON-436486563 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:48:00 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-6a60f7b2-220b-481e-931e-43adfc6ab248 tempest-VolumesSnapshotNegativeTestJSON-436486563 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:48:00 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-6a60f7b2-220b-481e-931e-43adfc6ab248 tempest-VolumesSnapshotNegativeTestJSON-436486563 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:48:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-528191928',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=365a2043-200f-419f-bfc3-1e677a5c2ee0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54f19f4152a74c9db8da761101f23954',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:48:00Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:48:00Z,use_quota=True,user_id='47e0792736a24d068ad8b93cdce863b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)}" {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 15:48:00 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-6a60f7b2-220b-481e-931e-43adfc6ab248 tempest-VolumesSnapshotNegativeTestJSON-436486563 None] Creating volume 365a2043-200f-419f-bfc3-1e677a5c2ee0 {{(pid=86212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 15:48:00 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-6a60f7b2-220b-481e-931e-43adfc6ab248 tempest-VolumesSnapshotNegativeTestJSON-436486563 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:48:00 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-6a60f7b2-220b-481e-931e-43adfc6ab248 tempest-VolumesSnapshotNegativeTestJSON-436486563 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:48:00 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-6a60f7b2-220b-481e-931e-43adfc6ab248 tempest-VolumesSnapshotNegativeTestJSON-436486563 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:48:00 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-6a60f7b2-220b-481e-931e-43adfc6ab248 tempest-VolumesSnapshotNegativeTestJSON-436486563 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:48:00 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-6a60f7b2-220b-481e-931e-43adfc6ab248 tempest-VolumesSnapshotNegativeTestJSON-436486563 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:48:00 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-6a60f7b2-220b-481e-931e-43adfc6ab248 tempest-VolumesSnapshotNegativeTestJSON-436486563 None] Selected osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 as target Quobyte volume. {{(pid=86212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 15:48:00 devstack cinder-volume[86212]: INFO cinder.volume.drivers.remotefs [None req-6a60f7b2-220b-481e-931e-43adfc6ab248 tempest-VolumesSnapshotNegativeTestJSON-436486563 None] casted to osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 Sep 22 15:48:00 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-6a60f7b2-220b-481e-931e-43adfc6ab248 tempest-VolumesSnapshotNegativeTestJSON-436486563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-365a2043-200f-419f-bfc3-1e677a5c2ee0 2147483648 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:48:00 devstack sudo[97547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-365a2043-200f-419f-bfc3-1e677a5c2ee0 2147483648 Sep 22 15:48:00 devstack sudo[97547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:48:00 devstack sudo[97547]: pam_unix(sudo:session): session closed for user root Sep 22 15:48:00 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-6a60f7b2-220b-481e-931e-43adfc6ab248 tempest-VolumesSnapshotNegativeTestJSON-436486563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-365a2043-200f-419f-bfc3-1e677a5c2ee0 2147483648" returned: 0 in 0.619s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:48:00 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-6a60f7b2-220b-481e-931e-43adfc6ab248 tempest-VolumesSnapshotNegativeTestJSON-436486563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-365a2043-200f-419f-bfc3-1e677a5c2ee0 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:48:01 devstack sudo[97553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-365a2043-200f-419f-bfc3-1e677a5c2ee0 Sep 22 15:48:01 devstack sudo[97553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:48:01 devstack sudo[97553]: pam_unix(sudo:session): session closed for user root Sep 22 15:48:01 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-6a60f7b2-220b-481e-931e-43adfc6ab248 tempest-VolumesSnapshotNegativeTestJSON-436486563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-365a2043-200f-419f-bfc3-1e677a5c2ee0" returned: 0 in 0.325s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:48:01 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-6a60f7b2-220b-481e-931e-43adfc6ab248 tempest-VolumesSnapshotNegativeTestJSON-436486563 None] <== create_volume: return (992ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'} {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 15:48:01 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-6a60f7b2-220b-481e-931e-43adfc6ab248 tempest-VolumesSnapshotNegativeTestJSON-436486563 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.994s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:48:01 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-6a60f7b2-220b-481e-931e-43adfc6ab248 tempest-VolumesSnapshotNegativeTestJSON-436486563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3bf3c703-8dc9-4c71-bc8f-ace3f5459468) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-365a2043-200f-419f-bfc3-1e677a5c2ee0', 'volume_size': 2}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:48:01 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-6a60f7b2-220b-481e-931e-43adfc6ab248 tempest-VolumesSnapshotNegativeTestJSON-436486563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9326d4c-b1fe-44ec-981e-38ec7486951f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:48:01 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-6a60f7b2-220b-481e-931e-43adfc6ab248 tempest-VolumesSnapshotNegativeTestJSON-436486563 None] Volume volume-365a2043-200f-419f-bfc3-1e677a5c2ee0 (365a2043-200f-419f-bfc3-1e677a5c2ee0): created successfully Sep 22 15:48:01 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-6a60f7b2-220b-481e-931e-43adfc6ab248 tempest-VolumesSnapshotNegativeTestJSON-436486563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9326d4c-b1fe-44ec-981e-38ec7486951f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:48:01 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-6a60f7b2-220b-481e-931e-43adfc6ab248 tempest-VolumesSnapshotNegativeTestJSON-436486563 None] Flow 'volume_create_manager' (27556ddb-41b0-405b-8563-66a3b15b776d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:48:01 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-6a60f7b2-220b-481e-931e-43adfc6ab248 tempest-VolumesSnapshotNegativeTestJSON-436486563 None] Created volume successfully. Sep 22 15:48:02 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-4b2a09d5-2b76-43f7-9429-e6b8263d7f17 tempest-VolumesSnapshotNegativeTestJSON-436486563 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:48:02 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-4b2a09d5-2b76-43f7-9429-e6b8263d7f17 tempest-VolumesSnapshotNegativeTestJSON-436486563 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:48:02 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-4b2a09d5-2b76-43f7-9429-e6b8263d7f17 tempest-VolumesSnapshotNegativeTestJSON-436486563 None] Creating offline snapshot fe9f633e-dc5f-46bc-ad11-ee45622c1fac of volume 365a2043-200f-419f-bfc3-1e677a5c2ee0 {{(pid=86212) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 22 15:48:02 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[aafd786f-cb4c-4e55-84f8-54f85554acce]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:48:02 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-4b2a09d5-2b76-43f7-9429-e6b8263d7f17 tempest-VolumesSnapshotNegativeTestJSON-436486563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-365a2043-200f-419f-bfc3-1e677a5c2ee0 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:48:02 devstack sudo[97556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-365a2043-200f-419f-bfc3-1e677a5c2ee0 Sep 22 15:48:02 devstack sudo[97556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:48:03 devstack sudo[97556]: pam_unix(sudo:session): session closed for user root Sep 22 15:48:03 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-4b2a09d5-2b76-43f7-9429-e6b8263d7f17 tempest-VolumesSnapshotNegativeTestJSON-436486563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-365a2043-200f-419f-bfc3-1e677a5c2ee0" returned: 0 in 0.473s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:48:03 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-4b2a09d5-2b76-43f7-9429-e6b8263d7f17 tempest-VolumesSnapshotNegativeTestJSON-436486563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-365a2043-200f-419f-bfc3-1e677a5c2ee0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-365a2043-200f-419f-bfc3-1e677a5c2ee0.fe9f633e-dc5f-46bc-ad11-ee45622c1fac 2G {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:48:03 devstack sudo[97561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-365a2043-200f-419f-bfc3-1e677a5c2ee0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-365a2043-200f-419f-bfc3-1e677a5c2ee0.fe9f633e-dc5f-46bc-ad11-ee45622c1fac 2G Sep 22 15:48:03 devstack sudo[97561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:48:03 devstack sudo[97561]: pam_unix(sudo:session): session closed for user root Sep 22 15:48:03 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-4b2a09d5-2b76-43f7-9429-e6b8263d7f17 tempest-VolumesSnapshotNegativeTestJSON-436486563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-365a2043-200f-419f-bfc3-1e677a5c2ee0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-365a2043-200f-419f-bfc3-1e677a5c2ee0.fe9f633e-dc5f-46bc-ad11-ee45622c1fac 2G" returned: 0 in 0.513s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:48:03 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-4b2a09d5-2b76-43f7-9429-e6b8263d7f17 tempest-VolumesSnapshotNegativeTestJSON-436486563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-365a2043-200f-419f-bfc3-1e677a5c2ee0 -F qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-365a2043-200f-419f-bfc3-1e677a5c2ee0.fe9f633e-dc5f-46bc-ad11-ee45622c1fac {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:48:03 devstack sudo[97567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-365a2043-200f-419f-bfc3-1e677a5c2ee0 -F qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-365a2043-200f-419f-bfc3-1e677a5c2ee0.fe9f633e-dc5f-46bc-ad11-ee45622c1fac Sep 22 15:48:03 devstack sudo[97567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:48:03 devstack sudo[97567]: pam_unix(sudo:session): session closed for user root Sep 22 15:48:03 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-4b2a09d5-2b76-43f7-9429-e6b8263d7f17 tempest-VolumesSnapshotNegativeTestJSON-436486563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-365a2043-200f-419f-bfc3-1e677a5c2ee0 -F qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-365a2043-200f-419f-bfc3-1e677a5c2ee0.fe9f633e-dc5f-46bc-ad11-ee45622c1fac" returned: 0 in 0.333s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:48:03 devstack cinder-volume[86212]: WARNING cinder.volume.drivers.remotefs [None req-4b2a09d5-2b76-43f7-9429-e6b8263d7f17 tempest-VolumesSnapshotNegativeTestJSON-436486563 None] /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-365a2043-200f-419f-bfc3-1e677a5c2ee0.fe9f633e-dc5f-46bc-ad11-ee45622c1fac is being set with open permissions: ugo+rw Sep 22 15:48:03 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-4b2a09d5-2b76-43f7-9429-e6b8263d7f17 tempest-VolumesSnapshotNegativeTestJSON-436486563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-365a2043-200f-419f-bfc3-1e677a5c2ee0.fe9f633e-dc5f-46bc-ad11-ee45622c1fac {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:48:03 devstack sudo[97572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-365a2043-200f-419f-bfc3-1e677a5c2ee0.fe9f633e-dc5f-46bc-ad11-ee45622c1fac Sep 22 15:48:03 devstack sudo[97572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:48:04 devstack sudo[97572]: pam_unix(sudo:session): session closed for user root Sep 22 15:48:04 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-4b2a09d5-2b76-43f7-9429-e6b8263d7f17 tempest-VolumesSnapshotNegativeTestJSON-436486563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-365a2043-200f-419f-bfc3-1e677a5c2ee0.fe9f633e-dc5f-46bc-ad11-ee45622c1fac" returned: 0 in 0.255s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:48:04 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-4b2a09d5-2b76-43f7-9429-e6b8263d7f17 tempest-VolumesSnapshotNegativeTestJSON-436486563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-365a2043-200f-419f-bfc3-1e677a5c2ee0.info {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:48:04 devstack sudo[97576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-365a2043-200f-419f-bfc3-1e677a5c2ee0.info Sep 22 15:48:04 devstack sudo[97576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:48:04 devstack sudo[97576]: pam_unix(sudo:session): session closed for user root Sep 22 15:48:04 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-4b2a09d5-2b76-43f7-9429-e6b8263d7f17 tempest-VolumesSnapshotNegativeTestJSON-436486563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-365a2043-200f-419f-bfc3-1e677a5c2ee0.info" returned: 0 in 0.330s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:48:04 devstack cinder-volume[86212]: WARNING cinder.volume.drivers.remotefs [None req-4b2a09d5-2b76-43f7-9429-e6b8263d7f17 tempest-VolumesSnapshotNegativeTestJSON-436486563 None] /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-365a2043-200f-419f-bfc3-1e677a5c2ee0.info is being set with open permissions: ugo+rw Sep 22 15:48:04 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-4b2a09d5-2b76-43f7-9429-e6b8263d7f17 tempest-VolumesSnapshotNegativeTestJSON-436486563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-365a2043-200f-419f-bfc3-1e677a5c2ee0.info {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:48:04 devstack sudo[97580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-365a2043-200f-419f-bfc3-1e677a5c2ee0.info Sep 22 15:48:04 devstack sudo[97580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:48:04 devstack sudo[97580]: pam_unix(sudo:session): session closed for user root Sep 22 15:48:04 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-4b2a09d5-2b76-43f7-9429-e6b8263d7f17 tempest-VolumesSnapshotNegativeTestJSON-436486563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-365a2043-200f-419f-bfc3-1e677a5c2ee0.info" returned: 0 in 0.297s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:48:04 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-4b2a09d5-2b76-43f7-9429-e6b8263d7f17 tempest-VolumesSnapshotNegativeTestJSON-436486563 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.345s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:48:04 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-4b2a09d5-2b76-43f7-9429-e6b8263d7f17 tempest-VolumesSnapshotNegativeTestJSON-436486563 None] Create snapshot completed successfully Sep 22 15:48:05 devstack cinder-volume[86212]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e7b866b-1c2d-4bc7-98d1-183563d33560 tempest-VolumesTransfersV357Test-583681116 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 15:48:05 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-9e7b866b-1c2d-4bc7-98d1-183563d33560 tempest-VolumesTransfersV357Test-583681116 None] Flow 'volume_create_manager' (29f08390-5229-42c9-904f-f4ab7caf3a06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:48:05 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-9e7b866b-1c2d-4bc7-98d1-183563d33560 tempest-VolumesTransfersV357Test-583681116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b71a419c-b168-4ed7-8ce8-bfce0c3a1f30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:48:05 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-9e7b866b-1c2d-4bc7-98d1-183563d33560 tempest-VolumesTransfersV357Test-583681116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b71a419c-b168-4ed7-8ce8-bfce0c3a1f30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:48:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-971312048',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f12fa6f8-1b10-4e7e-862e-5a7b3b51e368,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1e3a0e5a93e4a45b9b08db19f7d1e2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:48:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:48:05Z,use_quota=True,user_id='34bbf85cced64302b182971473ba4acc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:48:05 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-9e7b866b-1c2d-4bc7-98d1-183563d33560 tempest-VolumesTransfersV357Test-583681116 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b4cf222-1e15-4ee3-9636-699a3b8eaba7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:48:05 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-9e7b866b-1c2d-4bc7-98d1-183563d33560 tempest-VolumesTransfersV357Test-583681116 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b4cf222-1e15-4ee3-9636-699a3b8eaba7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:48:05 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-9e7b866b-1c2d-4bc7-98d1-183563d33560 tempest-VolumesTransfersV357Test-583681116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (074b70f9-9b8c-4735-b1d5-cc28fd359337) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:48:05 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-9e7b866b-1c2d-4bc7-98d1-183563d33560 tempest-VolumesTransfersV357Test-583681116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (074b70f9-9b8c-4735-b1d5-cc28fd359337) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f12fa6f8-1b10-4e7e-862e-5a7b3b51e368', 'volume_name': 'volume-f12fa6f8-1b10-4e7e-862e-5a7b3b51e368', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:48:05 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-9e7b866b-1c2d-4bc7-98d1-183563d33560 tempest-VolumesTransfersV357Test-583681116 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e24a7afb-6170-461b-a5c3-e8fc270bce9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:48:05 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-9e7b866b-1c2d-4bc7-98d1-183563d33560 tempest-VolumesTransfersV357Test-583681116 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e24a7afb-6170-461b-a5c3-e8fc270bce9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:48:05 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-9e7b866b-1c2d-4bc7-98d1-183563d33560 tempest-VolumesTransfersV357Test-583681116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5da48cd6-4745-4fed-a4a6-ce238cacdbd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:48:05 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-9e7b866b-1c2d-4bc7-98d1-183563d33560 tempest-VolumesTransfersV357Test-583681116 None] Volume f12fa6f8-1b10-4e7e-862e-5a7b3b51e368: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f12fa6f8-1b10-4e7e-862e-5a7b3b51e368', 'volume_size': 1} Sep 22 15:48:05 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-9e7b866b-1c2d-4bc7-98d1-183563d33560 tempest-VolumesTransfersV357Test-583681116 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:48:05 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-9e7b866b-1c2d-4bc7-98d1-183563d33560 tempest-VolumesTransfersV357Test-583681116 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:48:05 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-9e7b866b-1c2d-4bc7-98d1-183563d33560 tempest-VolumesTransfersV357Test-583681116 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:48:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-971312048',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f12fa6f8-1b10-4e7e-862e-5a7b3b51e368,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1e3a0e5a93e4a45b9b08db19f7d1e2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:48:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:48:05Z,use_quota=True,user_id='34bbf85cced64302b182971473ba4acc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)}" {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 15:48:05 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-9e7b866b-1c2d-4bc7-98d1-183563d33560 tempest-VolumesTransfersV357Test-583681116 None] Creating volume f12fa6f8-1b10-4e7e-862e-5a7b3b51e368 {{(pid=86212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 15:48:05 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-9e7b866b-1c2d-4bc7-98d1-183563d33560 tempest-VolumesTransfersV357Test-583681116 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:48:05 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-9e7b866b-1c2d-4bc7-98d1-183563d33560 tempest-VolumesTransfersV357Test-583681116 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:48:05 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-9e7b866b-1c2d-4bc7-98d1-183563d33560 tempest-VolumesTransfersV357Test-583681116 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:48:05 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-9e7b866b-1c2d-4bc7-98d1-183563d33560 tempest-VolumesTransfersV357Test-583681116 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:48:05 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-9e7b866b-1c2d-4bc7-98d1-183563d33560 tempest-VolumesTransfersV357Test-583681116 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:48:05 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-9e7b866b-1c2d-4bc7-98d1-183563d33560 tempest-VolumesTransfersV357Test-583681116 None] Selected osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 as target Quobyte volume. {{(pid=86212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 15:48:05 devstack cinder-volume[86212]: INFO cinder.volume.drivers.remotefs [None req-9e7b866b-1c2d-4bc7-98d1-183563d33560 tempest-VolumesTransfersV357Test-583681116 None] casted to osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 Sep 22 15:48:05 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-9e7b866b-1c2d-4bc7-98d1-183563d33560 tempest-VolumesTransfersV357Test-583681116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-f12fa6f8-1b10-4e7e-862e-5a7b3b51e368 1073741824 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:48:05 devstack sudo[97586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-f12fa6f8-1b10-4e7e-862e-5a7b3b51e368 1073741824 Sep 22 15:48:05 devstack sudo[97586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:48:05 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-fe1c34b8-2cab-4a9e-80bd-838b30a9ae4d tempest-VolumesSnapshotNegativeTestJSON-436486563 None] Acquiring lock "cinder-fe9f633e-dc5f-46bc-ad11-ee45622c1fac-delete_snapshot" by "delete_snapshot" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:48:05 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-fe1c34b8-2cab-4a9e-80bd-838b30a9ae4d tempest-VolumesSnapshotNegativeTestJSON-436486563 None] Lock "cinder-fe9f633e-dc5f-46bc-ad11-ee45622c1fac-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:48:05 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-fe1c34b8-2cab-4a9e-80bd-838b30a9ae4d tempest-VolumesSnapshotNegativeTestJSON-436486563 None] Acquiring lock "cinder-quobyte-365a2043-200f-419f-bfc3-1e677a5c2ee0" by "delete_snapshot" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:48:05 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-fe1c34b8-2cab-4a9e-80bd-838b30a9ae4d tempest-VolumesSnapshotNegativeTestJSON-436486563 None] Lock "cinder-quobyte-365a2043-200f-419f-bfc3-1e677a5c2ee0" acquired by "delete_snapshot" :: waited 0.040s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:48:05 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-fe1c34b8-2cab-4a9e-80bd-838b30a9ae4d tempest-VolumesSnapshotNegativeTestJSON-436486563 None] Acquiring lock "cinder-quobyte-fe9f633e-dc5f-46bc-ad11-ee45622c1fac" by "_delete_snapshot" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:48:06 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-fe1c34b8-2cab-4a9e-80bd-838b30a9ae4d tempest-VolumesSnapshotNegativeTestJSON-436486563 None] Lock "cinder-quobyte-fe9f633e-dc5f-46bc-ad11-ee45622c1fac" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:48:06 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-fe1c34b8-2cab-4a9e-80bd-838b30a9ae4d tempest-VolumesSnapshotNegativeTestJSON-436486563 None] Deleting offline snapshot fe9f633e-dc5f-46bc-ad11-ee45622c1fac of volume 365a2043-200f-419f-bfc3-1e677a5c2ee0 {{(pid=86212) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 22 15:48:06 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-fe1c34b8-2cab-4a9e-80bd-838b30a9ae4d tempest-VolumesSnapshotNegativeTestJSON-436486563 None] snapshot_file for this snap is: volume-365a2043-200f-419f-bfc3-1e677a5c2ee0.fe9f633e-dc5f-46bc-ad11-ee45622c1fac {{(pid=86212) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 22 15:48:06 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[11f8ce99-944b-4f18-9b32-71042050b9bc]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:48:06 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-fe1c34b8-2cab-4a9e-80bd-838b30a9ae4d tempest-VolumesSnapshotNegativeTestJSON-436486563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-365a2043-200f-419f-bfc3-1e677a5c2ee0.fe9f633e-dc5f-46bc-ad11-ee45622c1fac {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:48:06 devstack sudo[97591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-365a2043-200f-419f-bfc3-1e677a5c2ee0.fe9f633e-dc5f-46bc-ad11-ee45622c1fac Sep 22 15:48:06 devstack sudo[97591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:48:06 devstack sudo[97586]: pam_unix(sudo:session): session closed for user root Sep 22 15:48:06 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-9e7b866b-1c2d-4bc7-98d1-183563d33560 tempest-VolumesTransfersV357Test-583681116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-f12fa6f8-1b10-4e7e-862e-5a7b3b51e368 1073741824" returned: 0 in 0.693s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:48:06 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-9e7b866b-1c2d-4bc7-98d1-183563d33560 tempest-VolumesTransfersV357Test-583681116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-f12fa6f8-1b10-4e7e-862e-5a7b3b51e368 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:48:06 devstack sudo[97601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-f12fa6f8-1b10-4e7e-862e-5a7b3b51e368 Sep 22 15:48:06 devstack sudo[97601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:48:06 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [req-3d5a0f1d-c297-43f6-8ce8-f0dd81614ed1 req-4d4cb83f-f309-4ebd-895c-45a2edff0dbd tempest-TestServerVolumeAttachmentScenario-1578422816 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:48:06 devstack sudo[97591]: pam_unix(sudo:session): session closed for user root Sep 22 15:48:06 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-fe1c34b8-2cab-4a9e-80bd-838b30a9ae4d tempest-VolumesSnapshotNegativeTestJSON-436486563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-365a2043-200f-419f-bfc3-1e677a5c2ee0.fe9f633e-dc5f-46bc-ad11-ee45622c1fac" returned: 0 in 0.448s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:48:06 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-fe1c34b8-2cab-4a9e-80bd-838b30a9ae4d tempest-VolumesSnapshotNegativeTestJSON-436486563 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-365a2043-200f-419f-bfc3-1e677a5c2ee0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86212) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 22 15:48:06 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfab998d-e71b-4f21-af70-57c1f616ae85]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:48:06 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-fe1c34b8-2cab-4a9e-80bd-838b30a9ae4d tempest-VolumesSnapshotNegativeTestJSON-436486563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-365a2043-200f-419f-bfc3-1e677a5c2ee0 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:48:06 devstack sudo[97601]: pam_unix(sudo:session): session closed for user root Sep 22 15:48:06 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-9e7b866b-1c2d-4bc7-98d1-183563d33560 tempest-VolumesTransfersV357Test-583681116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-f12fa6f8-1b10-4e7e-862e-5a7b3b51e368" returned: 0 in 0.342s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:48:06 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-9e7b866b-1c2d-4bc7-98d1-183563d33560 tempest-VolumesTransfersV357Test-583681116 None] <== create_volume: return (1096ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'} {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 15:48:06 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-9e7b866b-1c2d-4bc7-98d1-183563d33560 tempest-VolumesTransfersV357Test-583681116 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.099s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:48:06 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [req-3d5a0f1d-c297-43f6-8ce8-f0dd81614ed1 req-4d4cb83f-f309-4ebd-895c-45a2edff0dbd tempest-TestServerVolumeAttachmentScenario-1578422816 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.265s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:48:06 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-9e7b866b-1c2d-4bc7-98d1-183563d33560 tempest-VolumesTransfersV357Test-583681116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5da48cd6-4745-4fed-a4a6-ce238cacdbd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f12fa6f8-1b10-4e7e-862e-5a7b3b51e368', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:48:06 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-9e7b866b-1c2d-4bc7-98d1-183563d33560 tempest-VolumesTransfersV357Test-583681116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22ca8bc0-adca-4bb6-befc-4a54738ef006) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:48:06 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [req-3d5a0f1d-c297-43f6-8ce8-f0dd81614ed1 req-4d4cb83f-f309-4ebd-895c-45a2edff0dbd tempest-TestServerVolumeAttachmentScenario-1578422816 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.041s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:48:06 devstack sudo[97607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-365a2043-200f-419f-bfc3-1e677a5c2ee0 Sep 22 15:48:06 devstack sudo[97607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:48:06 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-9e7b866b-1c2d-4bc7-98d1-183563d33560 tempest-VolumesTransfersV357Test-583681116 None] Volume volume-f12fa6f8-1b10-4e7e-862e-5a7b3b51e368 (f12fa6f8-1b10-4e7e-862e-5a7b3b51e368): created successfully Sep 22 15:48:06 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-9e7b866b-1c2d-4bc7-98d1-183563d33560 tempest-VolumesTransfersV357Test-583681116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22ca8bc0-adca-4bb6-befc-4a54738ef006) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:48:06 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-9e7b866b-1c2d-4bc7-98d1-183563d33560 tempest-VolumesTransfersV357Test-583681116 None] Flow 'volume_create_manager' (29f08390-5229-42c9-904f-f4ab7caf3a06) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:48:06 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-9e7b866b-1c2d-4bc7-98d1-183563d33560 tempest-VolumesTransfersV357Test-583681116 None] Created volume successfully. Sep 22 15:48:06 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [req-3d5a0f1d-c297-43f6-8ce8-f0dd81614ed1 req-4d4cb83f-f309-4ebd-895c-45a2edff0dbd tempest-TestServerVolumeAttachmentScenario-1578422816 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31', 'name': 'volume-d8616712-676c-475f-9bce-b2189d11b318', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0522b489-3518-440f-bb29-fd27308a97e4', 'enforce_multipath': True} {{(pid=86212) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 22 15:48:06 devstack cinder-volume[86212]: INFO cinder.volume.manager [req-3d5a0f1d-c297-43f6-8ce8-f0dd81614ed1 req-4d4cb83f-f309-4ebd-895c-45a2edff0dbd tempest-TestServerVolumeAttachmentScenario-1578422816 None] attachment_update completed successfully. Sep 22 15:48:06 devstack sudo[97607]: pam_unix(sudo:session): session closed for user root Sep 22 15:48:06 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-fe1c34b8-2cab-4a9e-80bd-838b30a9ae4d tempest-VolumesSnapshotNegativeTestJSON-436486563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-365a2043-200f-419f-bfc3-1e677a5c2ee0" returned: 0 in 0.451s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:48:06 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-fe1c34b8-2cab-4a9e-80bd-838b30a9ae4d tempest-VolumesSnapshotNegativeTestJSON-436486563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-365a2043-200f-419f-bfc3-1e677a5c2ee0.fe9f633e-dc5f-46bc-ad11-ee45622c1fac {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:48:07 devstack sudo[97706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-365a2043-200f-419f-bfc3-1e677a5c2ee0.fe9f633e-dc5f-46bc-ad11-ee45622c1fac Sep 22 15:48:07 devstack sudo[97706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:48:07 devstack sudo[97706]: pam_unix(sudo:session): session closed for user root Sep 22 15:48:07 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-fe1c34b8-2cab-4a9e-80bd-838b30a9ae4d tempest-VolumesSnapshotNegativeTestJSON-436486563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-365a2043-200f-419f-bfc3-1e677a5c2ee0.fe9f633e-dc5f-46bc-ad11-ee45622c1fac" returned: 0 in 0.481s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:48:07 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-fe1c34b8-2cab-4a9e-80bd-838b30a9ae4d tempest-VolumesSnapshotNegativeTestJSON-436486563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-365a2043-200f-419f-bfc3-1e677a5c2ee0.fe9f633e-dc5f-46bc-ad11-ee45622c1fac {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:48:07 devstack sudo[98032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-365a2043-200f-419f-bfc3-1e677a5c2ee0.fe9f633e-dc5f-46bc-ad11-ee45622c1fac Sep 22 15:48:07 devstack sudo[98032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:48:07 devstack sudo[98032]: pam_unix(sudo:session): session closed for user root Sep 22 15:48:07 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-fe1c34b8-2cab-4a9e-80bd-838b30a9ae4d tempest-VolumesSnapshotNegativeTestJSON-436486563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-365a2043-200f-419f-bfc3-1e677a5c2ee0.fe9f633e-dc5f-46bc-ad11-ee45622c1fac" returned: 0 in 0.371s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:48:07 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-fe1c34b8-2cab-4a9e-80bd-838b30a9ae4d tempest-VolumesSnapshotNegativeTestJSON-436486563 None] Lock "cinder-quobyte-fe9f633e-dc5f-46bc-ad11-ee45622c1fac" released by "_delete_snapshot" :: held 1.900s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:48:07 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-fe1c34b8-2cab-4a9e-80bd-838b30a9ae4d tempest-VolumesSnapshotNegativeTestJSON-436486563 None] Lock "cinder-quobyte-365a2043-200f-419f-bfc3-1e677a5c2ee0" released by "delete_snapshot" :: held 1.936s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:48:07 devstack cinder-volume[86212]: DEBUG cinder.quota [None req-fe1c34b8-2cab-4a9e-80bd-838b30a9ae4d tempest-VolumesSnapshotNegativeTestJSON-436486563 None] Created reservations ['6962aa71-a5cc-48b6-929e-0f559ab49e5d', 'adc8ca1a-2366-4367-841d-8cee47eb8d1c', 'dc70ceee-f69f-40bf-a85f-0d57320f0063', '65a91512-c1c0-4185-8fb3-4c28253e67b6'] {{(pid=86212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 15:48:08 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-fe1c34b8-2cab-4a9e-80bd-838b30a9ae4d tempest-VolumesSnapshotNegativeTestJSON-436486563 None] Delete snapshot completed successfully. Sep 22 15:48:08 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-fe1c34b8-2cab-4a9e-80bd-838b30a9ae4d tempest-VolumesSnapshotNegativeTestJSON-436486563 None] Lock "cinder-fe9f633e-dc5f-46bc-ad11-ee45622c1fac-delete_snapshot" released by "delete_snapshot" :: held 2.122s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:48:08 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-9482452a-d01d-4fa0-ae67-b648698da026 tempest-VolumesSnapshotNegativeTestJSON-436486563 None] Acquiring lock "cinder-365a2043-200f-419f-bfc3-1e677a5c2ee0-delete_volume" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:48:08 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-9482452a-d01d-4fa0-ae67-b648698da026 tempest-VolumesSnapshotNegativeTestJSON-436486563 None] Lock "cinder-365a2043-200f-419f-bfc3-1e677a5c2ee0-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:48:08 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-9482452a-d01d-4fa0-ae67-b648698da026 tempest-VolumesSnapshotNegativeTestJSON-436486563 None] Acquiring lock "cinder-quobyte-365a2043-200f-419f-bfc3-1e677a5c2ee0" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:48:08 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-9482452a-d01d-4fa0-ae67-b648698da026 tempest-VolumesSnapshotNegativeTestJSON-436486563 None] Lock "cinder-quobyte-365a2043-200f-419f-bfc3-1e677a5c2ee0" acquired by "delete_volume" :: waited 0.017s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:48:08 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[d845c424-a0ce-4921-9f6b-a819e4b5e72e]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:48:08 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-9482452a-d01d-4fa0-ae67-b648698da026 tempest-VolumesSnapshotNegativeTestJSON-436486563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-365a2043-200f-419f-bfc3-1e677a5c2ee0 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:48:08 devstack sudo[98036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-365a2043-200f-419f-bfc3-1e677a5c2ee0 Sep 22 15:48:08 devstack sudo[98036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:48:08 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-14b965fe-ce3e-4c72-8b3e-56fff1d00358 tempest-VolumesTransfersV357Test-189519640 None] Transfer volume completed successfully. Sep 22 15:48:08 devstack sudo[98036]: pam_unix(sudo:session): session closed for user root Sep 22 15:48:08 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-9482452a-d01d-4fa0-ae67-b648698da026 tempest-VolumesSnapshotNegativeTestJSON-436486563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-365a2043-200f-419f-bfc3-1e677a5c2ee0" returned: 0 in 0.514s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:48:08 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-9482452a-d01d-4fa0-ae67-b648698da026 tempest-VolumesSnapshotNegativeTestJSON-436486563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-365a2043-200f-419f-bfc3-1e677a5c2ee0 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:48:09 devstack sudo[98042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-365a2043-200f-419f-bfc3-1e677a5c2ee0 Sep 22 15:48:09 devstack sudo[98042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:48:09 devstack sudo[98042]: pam_unix(sudo:session): session closed for user root Sep 22 15:48:09 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-9482452a-d01d-4fa0-ae67-b648698da026 tempest-VolumesSnapshotNegativeTestJSON-436486563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-365a2043-200f-419f-bfc3-1e677a5c2ee0" returned: 0 in 0.309s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:48:09 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-9482452a-d01d-4fa0-ae67-b648698da026 tempest-VolumesSnapshotNegativeTestJSON-436486563 None] Lock "cinder-quobyte-365a2043-200f-419f-bfc3-1e677a5c2ee0" released by "delete_volume" :: held 0.929s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:48:09 devstack cinder-volume[86212]: DEBUG cinder.quota [None req-9482452a-d01d-4fa0-ae67-b648698da026 tempest-VolumesSnapshotNegativeTestJSON-436486563 None] Created reservations ['73b072ea-cd89-4a09-b47d-e92daab7f3e0', 'ebbc1974-5a04-495e-91aa-e0617c19cb20', '8d4162e7-190b-4311-8bc3-8b6dcb10c2f1', 'd96bdbee-2280-4652-bbc1-a71e6423ccc1'] {{(pid=86212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 15:48:09 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-9482452a-d01d-4fa0-ae67-b648698da026 tempest-VolumesSnapshotNegativeTestJSON-436486563 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:48:09 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-9482452a-d01d-4fa0-ae67-b648698da026 tempest-VolumesSnapshotNegativeTestJSON-436486563 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:48:09 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-9482452a-d01d-4fa0-ae67-b648698da026 tempest-VolumesSnapshotNegativeTestJSON-436486563 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:48:09 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-9482452a-d01d-4fa0-ae67-b648698da026 tempest-VolumesSnapshotNegativeTestJSON-436486563 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:48:09 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-9482452a-d01d-4fa0-ae67-b648698da026 tempest-VolumesSnapshotNegativeTestJSON-436486563 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:48:09 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-9482452a-d01d-4fa0-ae67-b648698da026 tempest-VolumesSnapshotNegativeTestJSON-436486563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:48:09 devstack sudo[98045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc Sep 22 15:48:09 devstack sudo[98045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:48:09 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-640ee5cf-49a3-4dbb-8422-22792a57042f tempest-VolumesTransfersV357Test-1621014335 None] Acquiring lock "cinder-f12fa6f8-1b10-4e7e-862e-5a7b3b51e368-delete_volume" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:48:09 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-640ee5cf-49a3-4dbb-8422-22792a57042f tempest-VolumesTransfersV357Test-1621014335 None] Lock "cinder-f12fa6f8-1b10-4e7e-862e-5a7b3b51e368-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:48:09 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-640ee5cf-49a3-4dbb-8422-22792a57042f tempest-VolumesTransfersV357Test-1621014335 None] Acquiring lock "cinder-quobyte-f12fa6f8-1b10-4e7e-862e-5a7b3b51e368" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:48:09 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-640ee5cf-49a3-4dbb-8422-22792a57042f tempest-VolumesTransfersV357Test-1621014335 None] Lock "cinder-quobyte-f12fa6f8-1b10-4e7e-862e-5a7b3b51e368" acquired by "delete_volume" :: waited 0.035s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:48:09 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[8110e818-fe84-48c6-8e3c-ef441599968f]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:48:09 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-640ee5cf-49a3-4dbb-8422-22792a57042f tempest-VolumesTransfersV357Test-1621014335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-f12fa6f8-1b10-4e7e-862e-5a7b3b51e368 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:48:09 devstack sudo[98045]: pam_unix(sudo:session): session closed for user root Sep 22 15:48:09 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-9482452a-d01d-4fa0-ae67-b648698da026 tempest-VolumesSnapshotNegativeTestJSON-436486563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc" returned: 0 in 0.372s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:48:09 devstack cinder-volume[86212]: DEBUG cinder.manager [None req-9482452a-d01d-4fa0-ae67-b648698da026 tempest-VolumesSnapshotNegativeTestJSON-436486563 None] Notifying Schedulers of capabilities ... {{(pid=86212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 15:48:09 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-9482452a-d01d-4fa0-ae67-b648698da026 tempest-VolumesSnapshotNegativeTestJSON-436486563 None] Deleted volume successfully. Sep 22 15:48:09 devstack sudo[98047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-f12fa6f8-1b10-4e7e-862e-5a7b3b51e368 Sep 22 15:48:09 devstack sudo[98047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:48:09 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-9482452a-d01d-4fa0-ae67-b648698da026 tempest-VolumesSnapshotNegativeTestJSON-436486563 None] Lock "cinder-365a2043-200f-419f-bfc3-1e677a5c2ee0-delete_volume" released by "delete_volume" :: held 1.583s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:48:10 devstack sudo[98047]: pam_unix(sudo:session): session closed for user root Sep 22 15:48:10 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-640ee5cf-49a3-4dbb-8422-22792a57042f tempest-VolumesTransfersV357Test-1621014335 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-f12fa6f8-1b10-4e7e-862e-5a7b3b51e368" returned: 0 in 0.429s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:48:10 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-640ee5cf-49a3-4dbb-8422-22792a57042f tempest-VolumesTransfersV357Test-1621014335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-f12fa6f8-1b10-4e7e-862e-5a7b3b51e368 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:48:10 devstack sudo[98054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-f12fa6f8-1b10-4e7e-862e-5a7b3b51e368 Sep 22 15:48:10 devstack sudo[98054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:48:10 devstack sudo[98054]: pam_unix(sudo:session): session closed for user root Sep 22 15:48:10 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-640ee5cf-49a3-4dbb-8422-22792a57042f tempest-VolumesTransfersV357Test-1621014335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-f12fa6f8-1b10-4e7e-862e-5a7b3b51e368" returned: 0 in 0.266s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:48:10 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-640ee5cf-49a3-4dbb-8422-22792a57042f tempest-VolumesTransfersV357Test-1621014335 None] Lock "cinder-quobyte-f12fa6f8-1b10-4e7e-862e-5a7b3b51e368" released by "delete_volume" :: held 0.785s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:48:10 devstack cinder-volume[86212]: DEBUG dbcounter [-] [86212] Writing DB stats cinder:SELECT=134,cinder:UPDATE=156,cinder:DELETE=21,cinder:INSERT=40 {{(pid=86212) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 22 15:48:10 devstack cinder-volume[86212]: DEBUG dbcounter [-] [86212] Writing DB stats cinder:SELECT=135,cinder:UPDATE=201,cinder:INSERT=45,cinder:DELETE=10 {{(pid=86212) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 22 15:48:10 devstack cinder-volume[86212]: DEBUG cinder.quota [None req-640ee5cf-49a3-4dbb-8422-22792a57042f tempest-VolumesTransfersV357Test-1621014335 None] Created reservations ['5f4c8095-dba5-4bee-ab22-2a67f92c4a3d', 'e1d369f1-5dd3-482c-8666-1a92d2436bd0', 'cd495b25-964f-48a1-9e20-772044359224', 'e3612a8a-5d5b-4f01-bb94-2fa20648a781'] {{(pid=86212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 15:48:10 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-640ee5cf-49a3-4dbb-8422-22792a57042f tempest-VolumesTransfersV357Test-1621014335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:48:10 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-640ee5cf-49a3-4dbb-8422-22792a57042f tempest-VolumesTransfersV357Test-1621014335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:48:10 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-640ee5cf-49a3-4dbb-8422-22792a57042f tempest-VolumesTransfersV357Test-1621014335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:48:10 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-640ee5cf-49a3-4dbb-8422-22792a57042f tempest-VolumesTransfersV357Test-1621014335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:48:10 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-640ee5cf-49a3-4dbb-8422-22792a57042f tempest-VolumesTransfersV357Test-1621014335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:48:10 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-640ee5cf-49a3-4dbb-8422-22792a57042f tempest-VolumesTransfersV357Test-1621014335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:48:10 devstack sudo[98057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc Sep 22 15:48:10 devstack sudo[98057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:48:10 devstack sudo[98057]: pam_unix(sudo:session): session closed for user root Sep 22 15:48:10 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-640ee5cf-49a3-4dbb-8422-22792a57042f tempest-VolumesTransfersV357Test-1621014335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc" returned: 0 in 0.304s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:48:10 devstack cinder-volume[86212]: DEBUG cinder.manager [None req-640ee5cf-49a3-4dbb-8422-22792a57042f tempest-VolumesTransfersV357Test-1621014335 None] Notifying Schedulers of capabilities ... {{(pid=86212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 15:48:10 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-640ee5cf-49a3-4dbb-8422-22792a57042f tempest-VolumesTransfersV357Test-1621014335 None] Deleted volume successfully. Sep 22 15:48:10 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-640ee5cf-49a3-4dbb-8422-22792a57042f tempest-VolumesTransfersV357Test-1621014335 None] Lock "cinder-f12fa6f8-1b10-4e7e-862e-5a7b3b51e368-delete_volume" released by "delete_volume" :: held 1.368s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:48:11 devstack cinder-volume[86212]: DEBUG cinder.volume.flows.manager.create_volume [None req-72289ea5-fd80-4d35-bfc8-c84352bf64c6 tempest-VolumesTransfersV355Test-1210712758 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 15:48:11 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-72289ea5-fd80-4d35-bfc8-c84352bf64c6 tempest-VolumesTransfersV355Test-1210712758 None] Flow 'volume_create_manager' (8d8908a6-52e2-49be-9bad-1254632e5ec2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:48:11 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-72289ea5-fd80-4d35-bfc8-c84352bf64c6 tempest-VolumesTransfersV355Test-1210712758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5dcc7cb0-4523-4f7a-b27c-69ca7e2a938e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:48:11 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-72289ea5-fd80-4d35-bfc8-c84352bf64c6 tempest-VolumesTransfersV355Test-1210712758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5dcc7cb0-4523-4f7a-b27c-69ca7e2a938e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:48:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1260110898',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3db48638-4cb1-4306-9d18-507a86065a3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34badc981c3046b59c438828ec213067',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:48:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:48:12Z,use_quota=True,user_id='ec411f18d157462ba37182b55b29a016',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:48:11 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-72289ea5-fd80-4d35-bfc8-c84352bf64c6 tempest-VolumesTransfersV355Test-1210712758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f7c619d-0b14-4279-9ed6-7d73b4420015) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:48:11 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-72289ea5-fd80-4d35-bfc8-c84352bf64c6 tempest-VolumesTransfersV355Test-1210712758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f7c619d-0b14-4279-9ed6-7d73b4420015) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:48:11 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-72289ea5-fd80-4d35-bfc8-c84352bf64c6 tempest-VolumesTransfersV355Test-1210712758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ead955f0-6143-402d-9f43-26c2d88ecf3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:48:11 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-72289ea5-fd80-4d35-bfc8-c84352bf64c6 tempest-VolumesTransfersV355Test-1210712758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ead955f0-6143-402d-9f43-26c2d88ecf3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3db48638-4cb1-4306-9d18-507a86065a3d', 'volume_name': 'volume-3db48638-4cb1-4306-9d18-507a86065a3d', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:48:11 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-72289ea5-fd80-4d35-bfc8-c84352bf64c6 tempest-VolumesTransfersV355Test-1210712758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35629fc6-c955-4626-8df2-1d3d8d29e257) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:48:11 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-72289ea5-fd80-4d35-bfc8-c84352bf64c6 tempest-VolumesTransfersV355Test-1210712758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35629fc6-c955-4626-8df2-1d3d8d29e257) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:48:11 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-72289ea5-fd80-4d35-bfc8-c84352bf64c6 tempest-VolumesTransfersV355Test-1210712758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2204f65-c8e9-4164-9a11-84bba6f3d671) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:48:11 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-72289ea5-fd80-4d35-bfc8-c84352bf64c6 tempest-VolumesTransfersV355Test-1210712758 None] Volume 3db48638-4cb1-4306-9d18-507a86065a3d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3db48638-4cb1-4306-9d18-507a86065a3d', 'volume_size': 1} Sep 22 15:48:11 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-72289ea5-fd80-4d35-bfc8-c84352bf64c6 tempest-VolumesTransfersV355Test-1210712758 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:48:11 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-72289ea5-fd80-4d35-bfc8-c84352bf64c6 tempest-VolumesTransfersV355Test-1210712758 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:48:11 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-72289ea5-fd80-4d35-bfc8-c84352bf64c6 tempest-VolumesTransfersV355Test-1210712758 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:48:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1260110898',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3db48638-4cb1-4306-9d18-507a86065a3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34badc981c3046b59c438828ec213067',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:48:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:48:12Z,use_quota=True,user_id='ec411f18d157462ba37182b55b29a016',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)}" {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 15:48:11 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-72289ea5-fd80-4d35-bfc8-c84352bf64c6 tempest-VolumesTransfersV355Test-1210712758 None] Creating volume 3db48638-4cb1-4306-9d18-507a86065a3d {{(pid=86212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 15:48:11 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-72289ea5-fd80-4d35-bfc8-c84352bf64c6 tempest-VolumesTransfersV355Test-1210712758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:48:11 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-72289ea5-fd80-4d35-bfc8-c84352bf64c6 tempest-VolumesTransfersV355Test-1210712758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:48:11 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-72289ea5-fd80-4d35-bfc8-c84352bf64c6 tempest-VolumesTransfersV355Test-1210712758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:48:11 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-72289ea5-fd80-4d35-bfc8-c84352bf64c6 tempest-VolumesTransfersV355Test-1210712758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:48:11 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-72289ea5-fd80-4d35-bfc8-c84352bf64c6 tempest-VolumesTransfersV355Test-1210712758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:48:11 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-72289ea5-fd80-4d35-bfc8-c84352bf64c6 tempest-VolumesTransfersV355Test-1210712758 None] Selected osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 as target Quobyte volume. {{(pid=86212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 15:48:11 devstack cinder-volume[86212]: INFO cinder.volume.drivers.remotefs [None req-72289ea5-fd80-4d35-bfc8-c84352bf64c6 tempest-VolumesTransfersV355Test-1210712758 None] casted to osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 Sep 22 15:48:11 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-72289ea5-fd80-4d35-bfc8-c84352bf64c6 tempest-VolumesTransfersV355Test-1210712758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-3db48638-4cb1-4306-9d18-507a86065a3d 1073741824 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:48:11 devstack sudo[98060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-3db48638-4cb1-4306-9d18-507a86065a3d 1073741824 Sep 22 15:48:11 devstack sudo[98060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:48:12 devstack cinder-volume[86212]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f19abca-3456-4978-936a-adcbcf8407e0 tempest-VolumesTransfersV357Test-583681116 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 15:48:12 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-1f19abca-3456-4978-936a-adcbcf8407e0 tempest-VolumesTransfersV357Test-583681116 None] Flow 'volume_create_manager' (7c2cbe22-775c-4e59-bc2f-49ed2e50f487) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:48:12 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-1f19abca-3456-4978-936a-adcbcf8407e0 tempest-VolumesTransfersV357Test-583681116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e72a5b13-637d-4313-9b68-5bf991613e05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:48:12 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-1f19abca-3456-4978-936a-adcbcf8407e0 tempest-VolumesTransfersV357Test-583681116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e72a5b13-637d-4313-9b68-5bf991613e05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:48:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1783520490',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45ee8645-cd52-4b27-b2f6-3f70044ebf83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1e3a0e5a93e4a45b9b08db19f7d1e2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:48:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:48:12Z,use_quota=True,user_id='34bbf85cced64302b182971473ba4acc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:48:12 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-1f19abca-3456-4978-936a-adcbcf8407e0 tempest-VolumesTransfersV357Test-583681116 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14ae1b67-08fe-4b7a-8dd2-f13552b474dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:48:12 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-1f19abca-3456-4978-936a-adcbcf8407e0 tempest-VolumesTransfersV357Test-583681116 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14ae1b67-08fe-4b7a-8dd2-f13552b474dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:48:12 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-1f19abca-3456-4978-936a-adcbcf8407e0 tempest-VolumesTransfersV357Test-583681116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ce808ba-927b-4019-8834-f84f03006ab0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:48:12 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-1f19abca-3456-4978-936a-adcbcf8407e0 tempest-VolumesTransfersV357Test-583681116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ce808ba-927b-4019-8834-f84f03006ab0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '45ee8645-cd52-4b27-b2f6-3f70044ebf83', 'volume_name': 'volume-45ee8645-cd52-4b27-b2f6-3f70044ebf83', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:48:12 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-1f19abca-3456-4978-936a-adcbcf8407e0 tempest-VolumesTransfersV357Test-583681116 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2b82ac0-9306-4b3d-97b8-2addeecdc6fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:48:12 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-1f19abca-3456-4978-936a-adcbcf8407e0 tempest-VolumesTransfersV357Test-583681116 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2b82ac0-9306-4b3d-97b8-2addeecdc6fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:48:12 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-1f19abca-3456-4978-936a-adcbcf8407e0 tempest-VolumesTransfersV357Test-583681116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09ebcee5-f4ef-4da6-8c21-bd56fa4f16b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:48:12 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-1f19abca-3456-4978-936a-adcbcf8407e0 tempest-VolumesTransfersV357Test-583681116 None] Volume 45ee8645-cd52-4b27-b2f6-3f70044ebf83: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-45ee8645-cd52-4b27-b2f6-3f70044ebf83', 'volume_size': 1} Sep 22 15:48:12 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-1f19abca-3456-4978-936a-adcbcf8407e0 tempest-VolumesTransfersV357Test-583681116 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:48:12 devstack sudo[98060]: pam_unix(sudo:session): session closed for user root Sep 22 15:48:12 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-72289ea5-fd80-4d35-bfc8-c84352bf64c6 tempest-VolumesTransfersV355Test-1210712758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-3db48638-4cb1-4306-9d18-507a86065a3d 1073741824" returned: 0 in 0.594s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:48:12 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-72289ea5-fd80-4d35-bfc8-c84352bf64c6 tempest-VolumesTransfersV355Test-1210712758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-3db48638-4cb1-4306-9d18-507a86065a3d {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:48:12 devstack sudo[98066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-3db48638-4cb1-4306-9d18-507a86065a3d Sep 22 15:48:12 devstack sudo[98066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:48:12 devstack sudo[98066]: pam_unix(sudo:session): session closed for user root Sep 22 15:48:12 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-72289ea5-fd80-4d35-bfc8-c84352bf64c6 tempest-VolumesTransfersV355Test-1210712758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-3db48638-4cb1-4306-9d18-507a86065a3d" returned: 0 in 0.288s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:48:12 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-72289ea5-fd80-4d35-bfc8-c84352bf64c6 tempest-VolumesTransfersV355Test-1210712758 None] <== create_volume: return (942ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'} {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 15:48:12 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-72289ea5-fd80-4d35-bfc8-c84352bf64c6 tempest-VolumesTransfersV355Test-1210712758 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.945s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:48:12 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-1f19abca-3456-4978-936a-adcbcf8407e0 tempest-VolumesTransfersV357Test-583681116 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.531s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:48:12 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-1f19abca-3456-4978-936a-adcbcf8407e0 tempest-VolumesTransfersV357Test-583681116 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:48:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1783520490',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45ee8645-cd52-4b27-b2f6-3f70044ebf83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1e3a0e5a93e4a45b9b08db19f7d1e2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:48:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:48:12Z,use_quota=True,user_id='34bbf85cced64302b182971473ba4acc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)}" {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 15:48:12 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-1f19abca-3456-4978-936a-adcbcf8407e0 tempest-VolumesTransfersV357Test-583681116 None] Creating volume 45ee8645-cd52-4b27-b2f6-3f70044ebf83 {{(pid=86212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 15:48:12 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-1f19abca-3456-4978-936a-adcbcf8407e0 tempest-VolumesTransfersV357Test-583681116 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:48:12 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-1f19abca-3456-4978-936a-adcbcf8407e0 tempest-VolumesTransfersV357Test-583681116 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:48:12 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-1f19abca-3456-4978-936a-adcbcf8407e0 tempest-VolumesTransfersV357Test-583681116 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:48:12 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-1f19abca-3456-4978-936a-adcbcf8407e0 tempest-VolumesTransfersV357Test-583681116 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:48:12 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-1f19abca-3456-4978-936a-adcbcf8407e0 tempest-VolumesTransfersV357Test-583681116 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:48:12 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-1f19abca-3456-4978-936a-adcbcf8407e0 tempest-VolumesTransfersV357Test-583681116 None] Selected osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 as target Quobyte volume. {{(pid=86212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 15:48:12 devstack cinder-volume[86212]: INFO cinder.volume.drivers.remotefs [None req-1f19abca-3456-4978-936a-adcbcf8407e0 tempest-VolumesTransfersV357Test-583681116 None] casted to osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 Sep 22 15:48:12 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-1f19abca-3456-4978-936a-adcbcf8407e0 tempest-VolumesTransfersV357Test-583681116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-45ee8645-cd52-4b27-b2f6-3f70044ebf83 1073741824 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:48:12 devstack sudo[98072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-45ee8645-cd52-4b27-b2f6-3f70044ebf83 1073741824 Sep 22 15:48:12 devstack sudo[98072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:48:12 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-72289ea5-fd80-4d35-bfc8-c84352bf64c6 tempest-VolumesTransfersV355Test-1210712758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2204f65-c8e9-4164-9a11-84bba6f3d671) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3db48638-4cb1-4306-9d18-507a86065a3d', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:48:12 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-72289ea5-fd80-4d35-bfc8-c84352bf64c6 tempest-VolumesTransfersV355Test-1210712758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72621c0a-d771-4998-994f-0a182ddfe231) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:48:12 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-72289ea5-fd80-4d35-bfc8-c84352bf64c6 tempest-VolumesTransfersV355Test-1210712758 None] Volume volume-3db48638-4cb1-4306-9d18-507a86065a3d (3db48638-4cb1-4306-9d18-507a86065a3d): created successfully Sep 22 15:48:12 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-72289ea5-fd80-4d35-bfc8-c84352bf64c6 tempest-VolumesTransfersV355Test-1210712758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72621c0a-d771-4998-994f-0a182ddfe231) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:48:12 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-72289ea5-fd80-4d35-bfc8-c84352bf64c6 tempest-VolumesTransfersV355Test-1210712758 None] Flow 'volume_create_manager' (8d8908a6-52e2-49be-9bad-1254632e5ec2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:48:12 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-72289ea5-fd80-4d35-bfc8-c84352bf64c6 tempest-VolumesTransfersV355Test-1210712758 None] Created volume successfully. Sep 22 15:48:13 devstack sudo[98072]: pam_unix(sudo:session): session closed for user root Sep 22 15:48:13 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-1f19abca-3456-4978-936a-adcbcf8407e0 tempest-VolumesTransfersV357Test-583681116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-45ee8645-cd52-4b27-b2f6-3f70044ebf83 1073741824" returned: 0 in 0.577s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:48:13 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-1f19abca-3456-4978-936a-adcbcf8407e0 tempest-VolumesTransfersV357Test-583681116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-45ee8645-cd52-4b27-b2f6-3f70044ebf83 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:48:13 devstack sudo[98086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-45ee8645-cd52-4b27-b2f6-3f70044ebf83 Sep 22 15:48:13 devstack sudo[98086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:48:13 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [req-16e5703a-9e8a-4709-90e9-026df574c1d9 req-c221a719-9ad5-4bde-9b3e-fc25baf8c8d2 tempest-TestServerVolumeAttachmentScenario-1578422816 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:48:13 devstack sudo[98086]: pam_unix(sudo:session): session closed for user root Sep 22 15:48:13 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-1f19abca-3456-4978-936a-adcbcf8407e0 tempest-VolumesTransfersV357Test-583681116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-45ee8645-cd52-4b27-b2f6-3f70044ebf83" returned: 0 in 0.346s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:48:13 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-1f19abca-3456-4978-936a-adcbcf8407e0 tempest-VolumesTransfersV357Test-583681116 None] <== create_volume: return (988ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'} {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 15:48:13 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-1f19abca-3456-4978-936a-adcbcf8407e0 tempest-VolumesTransfersV357Test-583681116 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.992s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:48:13 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [req-16e5703a-9e8a-4709-90e9-026df574c1d9 req-c221a719-9ad5-4bde-9b3e-fc25baf8c8d2 tempest-TestServerVolumeAttachmentScenario-1578422816 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.161s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:48:13 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-1f19abca-3456-4978-936a-adcbcf8407e0 tempest-VolumesTransfersV357Test-583681116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09ebcee5-f4ef-4da6-8c21-bd56fa4f16b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45ee8645-cd52-4b27-b2f6-3f70044ebf83', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:48:13 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-1f19abca-3456-4978-936a-adcbcf8407e0 tempest-VolumesTransfersV357Test-583681116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2a2b782-cb7e-4590-8475-f64cd02f66aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:48:13 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [req-16e5703a-9e8a-4709-90e9-026df574c1d9 req-c221a719-9ad5-4bde-9b3e-fc25baf8c8d2 tempest-TestServerVolumeAttachmentScenario-1578422816 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.032s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:48:13 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-1f19abca-3456-4978-936a-adcbcf8407e0 tempest-VolumesTransfersV357Test-583681116 None] Volume volume-45ee8645-cd52-4b27-b2f6-3f70044ebf83 (45ee8645-cd52-4b27-b2f6-3f70044ebf83): created successfully Sep 22 15:48:13 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-1f19abca-3456-4978-936a-adcbcf8407e0 tempest-VolumesTransfersV357Test-583681116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2a2b782-cb7e-4590-8475-f64cd02f66aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:48:13 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-1f19abca-3456-4978-936a-adcbcf8407e0 tempest-VolumesTransfersV357Test-583681116 None] Flow 'volume_create_manager' (7c2cbe22-775c-4e59-bc2f-49ed2e50f487) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:48:13 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-1f19abca-3456-4978-936a-adcbcf8407e0 tempest-VolumesTransfersV357Test-583681116 None] Created volume successfully. Sep 22 15:48:13 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [req-16e5703a-9e8a-4709-90e9-026df574c1d9 req-c221a719-9ad5-4bde-9b3e-fc25baf8c8d2 tempest-TestServerVolumeAttachmentScenario-1578422816 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31', 'name': 'volume-bc4944d5-77f1-4d63-8e0c-35585b7a43f6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b40e6121-8e96-4515-be73-e16fe455afb1', 'enforce_multipath': True} {{(pid=86212) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 22 15:48:13 devstack cinder-volume[86212]: INFO cinder.volume.manager [req-16e5703a-9e8a-4709-90e9-026df574c1d9 req-c221a719-9ad5-4bde-9b3e-fc25baf8c8d2 tempest-TestServerVolumeAttachmentScenario-1578422816 None] attachment_update completed successfully. Sep 22 15:48:14 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-db3a5727-162f-4ec4-862f-2a0488a56685 tempest-VolumesTransfersV355Test-2077733457 None] Transfer volume completed successfully. Sep 22 15:48:14 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-5221d0d6-a64a-49bf-8604-54ce670d0063 tempest-VolumesTransfersV357Test-1621014335 None] Acquiring lock "cinder-45ee8645-cd52-4b27-b2f6-3f70044ebf83-delete_volume" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:48:14 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-5221d0d6-a64a-49bf-8604-54ce670d0063 tempest-VolumesTransfersV357Test-1621014335 None] Lock "cinder-45ee8645-cd52-4b27-b2f6-3f70044ebf83-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:48:15 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-dad02104-8238-471d-92b9-cc5491acb3d2 tempest-VolumesTransfersV355Test-758329951 None] Acquiring lock "cinder-3db48638-4cb1-4306-9d18-507a86065a3d-delete_volume" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:48:15 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-5221d0d6-a64a-49bf-8604-54ce670d0063 tempest-VolumesTransfersV357Test-1621014335 None] Acquiring lock "cinder-quobyte-45ee8645-cd52-4b27-b2f6-3f70044ebf83" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:48:15 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-dad02104-8238-471d-92b9-cc5491acb3d2 tempest-VolumesTransfersV355Test-758329951 None] Lock "cinder-3db48638-4cb1-4306-9d18-507a86065a3d-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:48:15 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-5221d0d6-a64a-49bf-8604-54ce670d0063 tempest-VolumesTransfersV357Test-1621014335 None] Lock "cinder-quobyte-45ee8645-cd52-4b27-b2f6-3f70044ebf83" acquired by "delete_volume" :: waited 0.026s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:48:15 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9c3cc1e-e940-48b9-a965-5ffd42cbabe9]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:48:15 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-5221d0d6-a64a-49bf-8604-54ce670d0063 tempest-VolumesTransfersV357Test-1621014335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-45ee8645-cd52-4b27-b2f6-3f70044ebf83 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:48:15 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-dad02104-8238-471d-92b9-cc5491acb3d2 tempest-VolumesTransfersV355Test-758329951 None] Acquiring lock "cinder-quobyte-3db48638-4cb1-4306-9d18-507a86065a3d" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:48:15 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-dad02104-8238-471d-92b9-cc5491acb3d2 tempest-VolumesTransfersV355Test-758329951 None] Lock "cinder-quobyte-3db48638-4cb1-4306-9d18-507a86065a3d" acquired by "delete_volume" :: waited 0.019s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:48:15 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[d28dca35-d27c-4d8f-81ed-9e3944a176ad]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:48:15 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-dad02104-8238-471d-92b9-cc5491acb3d2 tempest-VolumesTransfersV355Test-758329951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-3db48638-4cb1-4306-9d18-507a86065a3d {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:48:15 devstack sudo[98091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-45ee8645-cd52-4b27-b2f6-3f70044ebf83 Sep 22 15:48:15 devstack sudo[98091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:48:15 devstack sudo[98092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-3db48638-4cb1-4306-9d18-507a86065a3d Sep 22 15:48:15 devstack sudo[98092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:48:15 devstack sudo[98091]: pam_unix(sudo:session): session closed for user root Sep 22 15:48:15 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-5221d0d6-a64a-49bf-8604-54ce670d0063 tempest-VolumesTransfersV357Test-1621014335 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-45ee8645-cd52-4b27-b2f6-3f70044ebf83" returned: 0 in 0.445s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:48:15 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-5221d0d6-a64a-49bf-8604-54ce670d0063 tempest-VolumesTransfersV357Test-1621014335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-45ee8645-cd52-4b27-b2f6-3f70044ebf83 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:48:15 devstack sudo[98101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-45ee8645-cd52-4b27-b2f6-3f70044ebf83 Sep 22 15:48:15 devstack sudo[98101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:48:15 devstack sudo[98092]: pam_unix(sudo:session): session closed for user root Sep 22 15:48:15 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-dad02104-8238-471d-92b9-cc5491acb3d2 tempest-VolumesTransfersV355Test-758329951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-3db48638-4cb1-4306-9d18-507a86065a3d" returned: 0 in 0.454s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:48:15 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-dad02104-8238-471d-92b9-cc5491acb3d2 tempest-VolumesTransfersV355Test-758329951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-3db48638-4cb1-4306-9d18-507a86065a3d {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:48:15 devstack sudo[98104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-3db48638-4cb1-4306-9d18-507a86065a3d Sep 22 15:48:15 devstack sudo[98104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:48:15 devstack sudo[98101]: pam_unix(sudo:session): session closed for user root Sep 22 15:48:15 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-5221d0d6-a64a-49bf-8604-54ce670d0063 tempest-VolumesTransfersV357Test-1621014335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-45ee8645-cd52-4b27-b2f6-3f70044ebf83" returned: 0 in 0.309s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:48:15 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-5221d0d6-a64a-49bf-8604-54ce670d0063 tempest-VolumesTransfersV357Test-1621014335 None] Lock "cinder-quobyte-45ee8645-cd52-4b27-b2f6-3f70044ebf83" released by "delete_volume" :: held 0.808s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:48:15 devstack cinder-volume[86212]: DEBUG cinder.quota [None req-5221d0d6-a64a-49bf-8604-54ce670d0063 tempest-VolumesTransfersV357Test-1621014335 None] Created reservations ['e8f2a459-f892-4cd9-83ab-cb878e113193', '5b2c6cfd-c2dc-4f1e-8784-14cbfc59a486', '5b46ec73-ef16-48b5-8747-3aafe2e1cc64', 'f9719964-bcee-419d-9bba-6d7035666c67'] {{(pid=86212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 15:48:15 devstack sudo[98104]: pam_unix(sudo:session): session closed for user root Sep 22 15:48:15 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-dad02104-8238-471d-92b9-cc5491acb3d2 tempest-VolumesTransfersV355Test-758329951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-3db48638-4cb1-4306-9d18-507a86065a3d" returned: 0 in 0.340s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:48:16 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-dad02104-8238-471d-92b9-cc5491acb3d2 tempest-VolumesTransfersV355Test-758329951 None] Lock "cinder-quobyte-3db48638-4cb1-4306-9d18-507a86065a3d" released by "delete_volume" :: held 0.861s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:48:16 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-5221d0d6-a64a-49bf-8604-54ce670d0063 tempest-VolumesTransfersV357Test-1621014335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:48:16 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-5221d0d6-a64a-49bf-8604-54ce670d0063 tempest-VolumesTransfersV357Test-1621014335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:48:16 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-5221d0d6-a64a-49bf-8604-54ce670d0063 tempest-VolumesTransfersV357Test-1621014335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:48:16 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-5221d0d6-a64a-49bf-8604-54ce670d0063 tempest-VolumesTransfersV357Test-1621014335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:48:16 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-5221d0d6-a64a-49bf-8604-54ce670d0063 tempest-VolumesTransfersV357Test-1621014335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:48:16 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-5221d0d6-a64a-49bf-8604-54ce670d0063 tempest-VolumesTransfersV357Test-1621014335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:48:16 devstack cinder-volume[86212]: DEBUG cinder.quota [None req-dad02104-8238-471d-92b9-cc5491acb3d2 tempest-VolumesTransfersV355Test-758329951 None] Created reservations ['0d910d0d-d2c6-4fc3-9504-73c24f92d52f', '3f551a6d-c78c-4ce4-bce7-0abbe0ed9b83', 'f7c827cc-1075-4193-9095-fc2604bb351b', '50e49c07-c12f-4e82-b284-d535af66081e'] {{(pid=86212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 15:48:16 devstack sudo[98108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc Sep 22 15:48:16 devstack sudo[98108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:48:16 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-dad02104-8238-471d-92b9-cc5491acb3d2 tempest-VolumesTransfersV355Test-758329951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:48:16 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-dad02104-8238-471d-92b9-cc5491acb3d2 tempest-VolumesTransfersV355Test-758329951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:48:16 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-dad02104-8238-471d-92b9-cc5491acb3d2 tempest-VolumesTransfersV355Test-758329951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:48:16 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-dad02104-8238-471d-92b9-cc5491acb3d2 tempest-VolumesTransfersV355Test-758329951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:48:16 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-dad02104-8238-471d-92b9-cc5491acb3d2 tempest-VolumesTransfersV355Test-758329951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:48:16 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-dad02104-8238-471d-92b9-cc5491acb3d2 tempest-VolumesTransfersV355Test-758329951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:48:16 devstack sudo[98110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc Sep 22 15:48:16 devstack sudo[98110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:48:16 devstack sudo[98108]: pam_unix(sudo:session): session closed for user root Sep 22 15:48:16 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-5221d0d6-a64a-49bf-8604-54ce670d0063 tempest-VolumesTransfersV357Test-1621014335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc" returned: 0 in 0.435s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:48:16 devstack cinder-volume[86212]: DEBUG cinder.manager [None req-5221d0d6-a64a-49bf-8604-54ce670d0063 tempest-VolumesTransfersV357Test-1621014335 None] Notifying Schedulers of capabilities ... {{(pid=86212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 15:48:16 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-5221d0d6-a64a-49bf-8604-54ce670d0063 tempest-VolumesTransfersV357Test-1621014335 None] Deleted volume successfully. Sep 22 15:48:16 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-5221d0d6-a64a-49bf-8604-54ce670d0063 tempest-VolumesTransfersV357Test-1621014335 None] Lock "cinder-45ee8645-cd52-4b27-b2f6-3f70044ebf83-delete_volume" released by "delete_volume" :: held 1.604s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:48:16 devstack sudo[98110]: pam_unix(sudo:session): session closed for user root Sep 22 15:48:16 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-dad02104-8238-471d-92b9-cc5491acb3d2 tempest-VolumesTransfersV355Test-758329951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc" returned: 0 in 0.396s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:48:16 devstack cinder-volume[86212]: DEBUG cinder.manager [None req-dad02104-8238-471d-92b9-cc5491acb3d2 tempest-VolumesTransfersV355Test-758329951 None] Notifying Schedulers of capabilities ... {{(pid=86212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 15:48:16 devstack cinder-volume[86212]: INFO cinder.volume.manager [req-d0e9f24d-0c5a-4332-83de-0ef6fb81bbcf req-872412d7-dcf5-43a0-b414-6680a46cf615 tempest-TestServerVolumeAttachmentScenario-1578422816 None] Terminate volume connection completed successfully. Sep 22 15:48:16 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [req-d0e9f24d-0c5a-4332-83de-0ef6fb81bbcf req-872412d7-dcf5-43a0-b414-6680a46cf615 tempest-TestServerVolumeAttachmentScenario-1578422816 None] Deleting attachment b40e6121-8e96-4515-be73-e16fe455afb1. {{(pid=86212) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 22 15:48:16 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-dad02104-8238-471d-92b9-cc5491acb3d2 tempest-VolumesTransfersV355Test-758329951 None] Deleted volume successfully. Sep 22 15:48:16 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-dad02104-8238-471d-92b9-cc5491acb3d2 tempest-VolumesTransfersV355Test-758329951 None] Lock "cinder-3db48638-4cb1-4306-9d18-507a86065a3d-delete_volume" released by "delete_volume" :: held 1.649s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:48:18 devstack cinder-volume[86212]: DEBUG cinder.volume.flows.manager.create_volume [None req-a19e88e0-8891-4940-9d7d-c07da3769b1a tempest-VolumesTransfersV355Test-1210712758 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 15:48:18 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-a19e88e0-8891-4940-9d7d-c07da3769b1a tempest-VolumesTransfersV355Test-1210712758 None] Flow 'volume_create_manager' (a3790bfb-cfae-4dab-9789-bbe6cb0ee71a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:48:18 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-a19e88e0-8891-4940-9d7d-c07da3769b1a tempest-VolumesTransfersV355Test-1210712758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c990bd1-c4ce-4323-854b-ec8d414d80f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:48:18 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-a19e88e0-8891-4940-9d7d-c07da3769b1a tempest-VolumesTransfersV355Test-1210712758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c990bd1-c4ce-4323-854b-ec8d414d80f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:48:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-187760930',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a842081d-1871-4709-a648-f99669c3b014,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34badc981c3046b59c438828ec213067',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:48:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:48:18Z,use_quota=True,user_id='ec411f18d157462ba37182b55b29a016',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:48:18 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-a19e88e0-8891-4940-9d7d-c07da3769b1a tempest-VolumesTransfersV355Test-1210712758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16452b0e-e520-4a3f-8287-4372b9093c1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:48:18 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-a19e88e0-8891-4940-9d7d-c07da3769b1a tempest-VolumesTransfersV355Test-1210712758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16452b0e-e520-4a3f-8287-4372b9093c1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:48:18 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-a19e88e0-8891-4940-9d7d-c07da3769b1a tempest-VolumesTransfersV355Test-1210712758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e01a34b-c64d-49e2-8865-c88305a5f20f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:48:18 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-a19e88e0-8891-4940-9d7d-c07da3769b1a tempest-VolumesTransfersV355Test-1210712758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e01a34b-c64d-49e2-8865-c88305a5f20f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a842081d-1871-4709-a648-f99669c3b014', 'volume_name': 'volume-a842081d-1871-4709-a648-f99669c3b014', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:48:18 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-a19e88e0-8891-4940-9d7d-c07da3769b1a tempest-VolumesTransfersV355Test-1210712758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b357298-7712-4ff2-ab1e-610a55803d5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:48:18 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-a19e88e0-8891-4940-9d7d-c07da3769b1a tempest-VolumesTransfersV355Test-1210712758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b357298-7712-4ff2-ab1e-610a55803d5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:48:18 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-a19e88e0-8891-4940-9d7d-c07da3769b1a tempest-VolumesTransfersV355Test-1210712758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c3dc967-3f5a-429e-9bae-92b716ebb1ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:48:18 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-a19e88e0-8891-4940-9d7d-c07da3769b1a tempest-VolumesTransfersV355Test-1210712758 None] Volume a842081d-1871-4709-a648-f99669c3b014: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a842081d-1871-4709-a648-f99669c3b014', 'volume_size': 1} Sep 22 15:48:18 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-a19e88e0-8891-4940-9d7d-c07da3769b1a tempest-VolumesTransfersV355Test-1210712758 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:48:18 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-a19e88e0-8891-4940-9d7d-c07da3769b1a tempest-VolumesTransfersV355Test-1210712758 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:48:18 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-a19e88e0-8891-4940-9d7d-c07da3769b1a tempest-VolumesTransfersV355Test-1210712758 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:48:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-187760930',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a842081d-1871-4709-a648-f99669c3b014,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34badc981c3046b59c438828ec213067',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:48:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:48:18Z,use_quota=True,user_id='ec411f18d157462ba37182b55b29a016',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)}" {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 15:48:18 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-a19e88e0-8891-4940-9d7d-c07da3769b1a tempest-VolumesTransfersV355Test-1210712758 None] Creating volume a842081d-1871-4709-a648-f99669c3b014 {{(pid=86212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 15:48:18 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-a19e88e0-8891-4940-9d7d-c07da3769b1a tempest-VolumesTransfersV355Test-1210712758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:48:18 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-a19e88e0-8891-4940-9d7d-c07da3769b1a tempest-VolumesTransfersV355Test-1210712758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:48:18 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-a19e88e0-8891-4940-9d7d-c07da3769b1a tempest-VolumesTransfersV355Test-1210712758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:48:18 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-a19e88e0-8891-4940-9d7d-c07da3769b1a tempest-VolumesTransfersV355Test-1210712758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:48:18 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-a19e88e0-8891-4940-9d7d-c07da3769b1a tempest-VolumesTransfersV355Test-1210712758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:48:18 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-a19e88e0-8891-4940-9d7d-c07da3769b1a tempest-VolumesTransfersV355Test-1210712758 None] Selected osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 as target Quobyte volume. {{(pid=86212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 15:48:18 devstack cinder-volume[86212]: INFO cinder.volume.drivers.remotefs [None req-a19e88e0-8891-4940-9d7d-c07da3769b1a tempest-VolumesTransfersV355Test-1210712758 None] casted to osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 Sep 22 15:48:18 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-a19e88e0-8891-4940-9d7d-c07da3769b1a tempest-VolumesTransfersV355Test-1210712758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a842081d-1871-4709-a648-f99669c3b014 1073741824 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:48:18 devstack sudo[98119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a842081d-1871-4709-a648-f99669c3b014 1073741824 Sep 22 15:48:18 devstack sudo[98119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:48:18 devstack cinder-volume[86212]: INFO cinder.volume.manager [req-c66e8060-afec-48c1-a2ff-0273e7f339f8 req-b283d9b3-51f7-4fad-b682-43672279a7af tempest-TestServerVolumeAttachmentScenario-1578422816 None] Terminate volume connection completed successfully. Sep 22 15:48:18 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [req-c66e8060-afec-48c1-a2ff-0273e7f339f8 req-b283d9b3-51f7-4fad-b682-43672279a7af tempest-TestServerVolumeAttachmentScenario-1578422816 None] Deleting attachment 0522b489-3518-440f-bb29-fd27308a97e4. {{(pid=86212) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 22 15:48:18 devstack sudo[98119]: pam_unix(sudo:session): session closed for user root Sep 22 15:48:18 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-a19e88e0-8891-4940-9d7d-c07da3769b1a tempest-VolumesTransfersV355Test-1210712758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a842081d-1871-4709-a648-f99669c3b014 1073741824" returned: 0 in 0.675s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:48:18 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-a19e88e0-8891-4940-9d7d-c07da3769b1a tempest-VolumesTransfersV355Test-1210712758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a842081d-1871-4709-a648-f99669c3b014 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:48:18 devstack sudo[98150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a842081d-1871-4709-a648-f99669c3b014 Sep 22 15:48:18 devstack sudo[98150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:48:19 devstack sudo[98150]: pam_unix(sudo:session): session closed for user root Sep 22 15:48:19 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-a19e88e0-8891-4940-9d7d-c07da3769b1a tempest-VolumesTransfersV355Test-1210712758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a842081d-1871-4709-a648-f99669c3b014" returned: 0 in 0.353s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:48:19 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-a19e88e0-8891-4940-9d7d-c07da3769b1a tempest-VolumesTransfersV355Test-1210712758 None] <== create_volume: return (1083ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'} {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 15:48:19 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-a19e88e0-8891-4940-9d7d-c07da3769b1a tempest-VolumesTransfersV355Test-1210712758 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.086s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:48:19 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-a19e88e0-8891-4940-9d7d-c07da3769b1a tempest-VolumesTransfersV355Test-1210712758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c3dc967-3f5a-429e-9bae-92b716ebb1ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a842081d-1871-4709-a648-f99669c3b014', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:48:19 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-a19e88e0-8891-4940-9d7d-c07da3769b1a tempest-VolumesTransfersV355Test-1210712758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1649c9ab-cd4f-4dfa-9215-9ab6b665007e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:48:19 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-a19e88e0-8891-4940-9d7d-c07da3769b1a tempest-VolumesTransfersV355Test-1210712758 None] Volume volume-a842081d-1871-4709-a648-f99669c3b014 (a842081d-1871-4709-a648-f99669c3b014): created successfully Sep 22 15:48:19 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-a19e88e0-8891-4940-9d7d-c07da3769b1a tempest-VolumesTransfersV355Test-1210712758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1649c9ab-cd4f-4dfa-9215-9ab6b665007e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:48:19 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-a19e88e0-8891-4940-9d7d-c07da3769b1a tempest-VolumesTransfersV355Test-1210712758 None] Flow 'volume_create_manager' (a3790bfb-cfae-4dab-9789-bbe6cb0ee71a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:48:19 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-a19e88e0-8891-4940-9d7d-c07da3769b1a tempest-VolumesTransfersV355Test-1210712758 None] Created volume successfully. Sep 22 15:48:20 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-e7963348-452f-4d0e-a7b2-79a44d11e244 tempest-VolumesTransfersV355Test-758329951 None] Acquiring lock "cinder-a842081d-1871-4709-a648-f99669c3b014-delete_volume" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:48:20 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-e7963348-452f-4d0e-a7b2-79a44d11e244 tempest-VolumesTransfersV355Test-758329951 None] Lock "cinder-a842081d-1871-4709-a648-f99669c3b014-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:48:20 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-e7963348-452f-4d0e-a7b2-79a44d11e244 tempest-VolumesTransfersV355Test-758329951 None] Acquiring lock "cinder-quobyte-a842081d-1871-4709-a648-f99669c3b014" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:48:20 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-e7963348-452f-4d0e-a7b2-79a44d11e244 tempest-VolumesTransfersV355Test-758329951 None] Lock "cinder-quobyte-a842081d-1871-4709-a648-f99669c3b014" acquired by "delete_volume" :: waited 0.022s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:48:20 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa9cb489-db38-486b-b967-34183793320f]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:48:20 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-e7963348-452f-4d0e-a7b2-79a44d11e244 tempest-VolumesTransfersV355Test-758329951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a842081d-1871-4709-a648-f99669c3b014 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:48:20 devstack sudo[98175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a842081d-1871-4709-a648-f99669c3b014 Sep 22 15:48:20 devstack sudo[98175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:48:21 devstack sudo[98175]: pam_unix(sudo:session): session closed for user root Sep 22 15:48:21 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-e7963348-452f-4d0e-a7b2-79a44d11e244 tempest-VolumesTransfersV355Test-758329951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a842081d-1871-4709-a648-f99669c3b014" returned: 0 in 0.453s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:48:21 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-e7963348-452f-4d0e-a7b2-79a44d11e244 tempest-VolumesTransfersV355Test-758329951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a842081d-1871-4709-a648-f99669c3b014 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:48:21 devstack sudo[98180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a842081d-1871-4709-a648-f99669c3b014 Sep 22 15:48:21 devstack sudo[98180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:48:21 devstack sudo[98180]: pam_unix(sudo:session): session closed for user root Sep 22 15:48:21 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-e7963348-452f-4d0e-a7b2-79a44d11e244 tempest-VolumesTransfersV355Test-758329951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a842081d-1871-4709-a648-f99669c3b014" returned: 0 in 0.289s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:48:21 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-e7963348-452f-4d0e-a7b2-79a44d11e244 tempest-VolumesTransfersV355Test-758329951 None] Lock "cinder-quobyte-a842081d-1871-4709-a648-f99669c3b014" released by "delete_volume" :: held 0.813s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:48:21 devstack cinder-volume[86212]: DEBUG cinder.quota [None req-e7963348-452f-4d0e-a7b2-79a44d11e244 tempest-VolumesTransfersV355Test-758329951 None] Created reservations ['7961c870-dbe1-45b1-8e41-ffb989c4489e', '97783217-56a2-4478-847d-9182687ddea4', '4f05d0f2-e442-4eba-9f1d-22917bb59cdb', '701f67a5-4a49-46d3-89f9-ff8990b69c87'] {{(pid=86212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 15:48:21 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-e7963348-452f-4d0e-a7b2-79a44d11e244 tempest-VolumesTransfersV355Test-758329951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:48:21 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-e7963348-452f-4d0e-a7b2-79a44d11e244 tempest-VolumesTransfersV355Test-758329951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:48:21 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-e7963348-452f-4d0e-a7b2-79a44d11e244 tempest-VolumesTransfersV355Test-758329951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:48:21 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-e7963348-452f-4d0e-a7b2-79a44d11e244 tempest-VolumesTransfersV355Test-758329951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:48:21 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-e7963348-452f-4d0e-a7b2-79a44d11e244 tempest-VolumesTransfersV355Test-758329951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:48:21 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-e7963348-452f-4d0e-a7b2-79a44d11e244 tempest-VolumesTransfersV355Test-758329951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:48:21 devstack sudo[98184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc Sep 22 15:48:21 devstack sudo[98184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:48:21 devstack sudo[98184]: pam_unix(sudo:session): session closed for user root Sep 22 15:48:21 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-e7963348-452f-4d0e-a7b2-79a44d11e244 tempest-VolumesTransfersV355Test-758329951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc" returned: 0 in 0.331s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:48:21 devstack cinder-volume[86212]: DEBUG cinder.manager [None req-e7963348-452f-4d0e-a7b2-79a44d11e244 tempest-VolumesTransfersV355Test-758329951 None] Notifying Schedulers of capabilities ... {{(pid=86212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 15:48:21 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-e7963348-452f-4d0e-a7b2-79a44d11e244 tempest-VolumesTransfersV355Test-758329951 None] Deleted volume successfully. Sep 22 15:48:22 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-e7963348-452f-4d0e-a7b2-79a44d11e244 tempest-VolumesTransfersV355Test-758329951 None] Lock "cinder-a842081d-1871-4709-a648-f99669c3b014-delete_volume" released by "delete_volume" :: held 1.433s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:48:27 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-ef1334ab-3fd6-4f96-9b51-70e28d293cd1 tempest-TestServerVolumeAttachmentScenario-1578422816 None] Acquiring lock "cinder-bc4944d5-77f1-4d63-8e0c-35585b7a43f6-delete_volume" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:48:27 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-ef1334ab-3fd6-4f96-9b51-70e28d293cd1 tempest-TestServerVolumeAttachmentScenario-1578422816 None] Lock "cinder-bc4944d5-77f1-4d63-8e0c-35585b7a43f6-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:48:27 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-ef1334ab-3fd6-4f96-9b51-70e28d293cd1 tempest-TestServerVolumeAttachmentScenario-1578422816 None] Acquiring lock "cinder-quobyte-bc4944d5-77f1-4d63-8e0c-35585b7a43f6" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:48:27 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-ef1334ab-3fd6-4f96-9b51-70e28d293cd1 tempest-TestServerVolumeAttachmentScenario-1578422816 None] Lock "cinder-quobyte-bc4944d5-77f1-4d63-8e0c-35585b7a43f6" acquired by "delete_volume" :: waited 0.019s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:48:27 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3e8d437-1da9-4586-bf32-f64eb2d0ae59]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:48:27 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-ef1334ab-3fd6-4f96-9b51-70e28d293cd1 tempest-TestServerVolumeAttachmentScenario-1578422816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-bc4944d5-77f1-4d63-8e0c-35585b7a43f6 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:48:27 devstack sudo[98192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-bc4944d5-77f1-4d63-8e0c-35585b7a43f6 Sep 22 15:48:27 devstack sudo[98192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:48:27 devstack sudo[98192]: pam_unix(sudo:session): session closed for user root Sep 22 15:48:27 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-ef1334ab-3fd6-4f96-9b51-70e28d293cd1 tempest-TestServerVolumeAttachmentScenario-1578422816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-bc4944d5-77f1-4d63-8e0c-35585b7a43f6" returned: 0 in 0.536s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:48:27 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-ef1334ab-3fd6-4f96-9b51-70e28d293cd1 tempest-TestServerVolumeAttachmentScenario-1578422816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-bc4944d5-77f1-4d63-8e0c-35585b7a43f6 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:48:27 devstack sudo[98199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-bc4944d5-77f1-4d63-8e0c-35585b7a43f6 Sep 22 15:48:27 devstack sudo[98199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:48:28 devstack sudo[98199]: pam_unix(sudo:session): session closed for user root Sep 22 15:48:28 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-ef1334ab-3fd6-4f96-9b51-70e28d293cd1 tempest-TestServerVolumeAttachmentScenario-1578422816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-bc4944d5-77f1-4d63-8e0c-35585b7a43f6" returned: 0 in 0.331s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:48:28 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-ef1334ab-3fd6-4f96-9b51-70e28d293cd1 tempest-TestServerVolumeAttachmentScenario-1578422816 None] Lock "cinder-quobyte-bc4944d5-77f1-4d63-8e0c-35585b7a43f6" released by "delete_volume" :: held 0.931s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:48:28 devstack cinder-volume[86212]: DEBUG cinder.quota [None req-ef1334ab-3fd6-4f96-9b51-70e28d293cd1 tempest-TestServerVolumeAttachmentScenario-1578422816 None] Created reservations ['9be92e91-c188-4e97-a017-ddeaaeb53873', '3788f9bb-0a7a-4e3e-8e9d-8c1d8d43a064', 'cb632c43-f411-4629-8cb5-45be0875ce72', '3c413e79-7b25-4bee-af9f-d32f8cf69ab7'] {{(pid=86212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 15:48:28 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-ef1334ab-3fd6-4f96-9b51-70e28d293cd1 tempest-TestServerVolumeAttachmentScenario-1578422816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:48:28 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-ef1334ab-3fd6-4f96-9b51-70e28d293cd1 tempest-TestServerVolumeAttachmentScenario-1578422816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:48:28 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-ef1334ab-3fd6-4f96-9b51-70e28d293cd1 tempest-TestServerVolumeAttachmentScenario-1578422816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:48:28 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-ef1334ab-3fd6-4f96-9b51-70e28d293cd1 tempest-TestServerVolumeAttachmentScenario-1578422816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:48:28 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-ef1334ab-3fd6-4f96-9b51-70e28d293cd1 tempest-TestServerVolumeAttachmentScenario-1578422816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:48:28 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-ef1334ab-3fd6-4f96-9b51-70e28d293cd1 tempest-TestServerVolumeAttachmentScenario-1578422816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:48:28 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-05764d76-f8b8-4ca5-9db2-950a86d2bee9 tempest-TestServerVolumeAttachmentScenario-1578422816 None] Acquiring lock "cinder-d8616712-676c-475f-9bce-b2189d11b318-delete_volume" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:48:28 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-05764d76-f8b8-4ca5-9db2-950a86d2bee9 tempest-TestServerVolumeAttachmentScenario-1578422816 None] Lock "cinder-d8616712-676c-475f-9bce-b2189d11b318-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:48:28 devstack sudo[98202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc Sep 22 15:48:28 devstack sudo[98202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:48:28 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-05764d76-f8b8-4ca5-9db2-950a86d2bee9 tempest-TestServerVolumeAttachmentScenario-1578422816 None] Acquiring lock "cinder-quobyte-d8616712-676c-475f-9bce-b2189d11b318" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:48:28 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-05764d76-f8b8-4ca5-9db2-950a86d2bee9 tempest-TestServerVolumeAttachmentScenario-1578422816 None] Lock "cinder-quobyte-d8616712-676c-475f-9bce-b2189d11b318" acquired by "delete_volume" :: waited 0.021s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:48:28 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[2edbd341-4486-413e-a6db-e6a4ea497d73]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:48:28 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-05764d76-f8b8-4ca5-9db2-950a86d2bee9 tempest-TestServerVolumeAttachmentScenario-1578422816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-d8616712-676c-475f-9bce-b2189d11b318 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:48:28 devstack sudo[98204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-d8616712-676c-475f-9bce-b2189d11b318 Sep 22 15:48:28 devstack sudo[98204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:48:28 devstack sudo[98202]: pam_unix(sudo:session): session closed for user root Sep 22 15:48:28 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-ef1334ab-3fd6-4f96-9b51-70e28d293cd1 tempest-TestServerVolumeAttachmentScenario-1578422816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc" returned: 0 in 0.520s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:48:28 devstack cinder-volume[86212]: DEBUG cinder.manager [None req-ef1334ab-3fd6-4f96-9b51-70e28d293cd1 tempest-TestServerVolumeAttachmentScenario-1578422816 None] Notifying Schedulers of capabilities ... {{(pid=86212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 15:48:28 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-ef1334ab-3fd6-4f96-9b51-70e28d293cd1 tempest-TestServerVolumeAttachmentScenario-1578422816 None] Deleted volume successfully. Sep 22 15:48:28 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-ef1334ab-3fd6-4f96-9b51-70e28d293cd1 tempest-TestServerVolumeAttachmentScenario-1578422816 None] Lock "cinder-bc4944d5-77f1-4d63-8e0c-35585b7a43f6-delete_volume" released by "delete_volume" :: held 1.813s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:48:29 devstack sudo[98204]: pam_unix(sudo:session): session closed for user root Sep 22 15:48:29 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-05764d76-f8b8-4ca5-9db2-950a86d2bee9 tempest-TestServerVolumeAttachmentScenario-1578422816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-d8616712-676c-475f-9bce-b2189d11b318" returned: 0 in 0.657s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:48:29 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-05764d76-f8b8-4ca5-9db2-950a86d2bee9 tempest-TestServerVolumeAttachmentScenario-1578422816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-d8616712-676c-475f-9bce-b2189d11b318 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:48:29 devstack sudo[98210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-d8616712-676c-475f-9bce-b2189d11b318 Sep 22 15:48:29 devstack sudo[98210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:48:29 devstack sudo[98210]: pam_unix(sudo:session): session closed for user root Sep 22 15:48:29 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-05764d76-f8b8-4ca5-9db2-950a86d2bee9 tempest-TestServerVolumeAttachmentScenario-1578422816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-d8616712-676c-475f-9bce-b2189d11b318" returned: 0 in 0.308s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:48:29 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-05764d76-f8b8-4ca5-9db2-950a86d2bee9 tempest-TestServerVolumeAttachmentScenario-1578422816 None] Lock "cinder-quobyte-d8616712-676c-475f-9bce-b2189d11b318" released by "delete_volume" :: held 1.056s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:48:29 devstack cinder-volume[86212]: DEBUG cinder.quota [None req-05764d76-f8b8-4ca5-9db2-950a86d2bee9 tempest-TestServerVolumeAttachmentScenario-1578422816 None] Created reservations ['70eb3fb0-42a2-45c2-8f81-9a243487a842', 'fd135161-165e-4ff8-a433-081c0ca844bf', '8c66a4cd-b5ca-4c95-adb6-e510e3a71e84', '84fbfe72-56c3-4347-96d5-0bc7267fec50'] {{(pid=86212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 15:48:29 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-05764d76-f8b8-4ca5-9db2-950a86d2bee9 tempest-TestServerVolumeAttachmentScenario-1578422816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:48:29 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-05764d76-f8b8-4ca5-9db2-950a86d2bee9 tempest-TestServerVolumeAttachmentScenario-1578422816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:48:29 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-05764d76-f8b8-4ca5-9db2-950a86d2bee9 tempest-TestServerVolumeAttachmentScenario-1578422816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:48:29 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-05764d76-f8b8-4ca5-9db2-950a86d2bee9 tempest-TestServerVolumeAttachmentScenario-1578422816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:48:29 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-05764d76-f8b8-4ca5-9db2-950a86d2bee9 tempest-TestServerVolumeAttachmentScenario-1578422816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:48:29 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-05764d76-f8b8-4ca5-9db2-950a86d2bee9 tempest-TestServerVolumeAttachmentScenario-1578422816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:48:29 devstack cinder-volume[86212]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad3eb7c1-0392-4221-9b39-01c7a57303dc tempest-VolumesNegativeTest-1392661253 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 15:48:29 devstack sudo[98213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc Sep 22 15:48:29 devstack sudo[98213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:48:29 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-ad3eb7c1-0392-4221-9b39-01c7a57303dc tempest-VolumesNegativeTest-1392661253 None] Flow 'volume_create_manager' (dc48ca95-faa5-438e-995e-7c2d206a60ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:48:29 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-ad3eb7c1-0392-4221-9b39-01c7a57303dc tempest-VolumesNegativeTest-1392661253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fa79a36-0cf7-410c-b974-10cd2e017b08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:48:29 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-ad3eb7c1-0392-4221-9b39-01c7a57303dc tempest-VolumesNegativeTest-1392661253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fa79a36-0cf7-410c-b974-10cd2e017b08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:48:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-193259040',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3ddb034-c551-4321-a9fd-164572a30565,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8adc510d7d6f436686da2454cf778b9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:48:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:48:30Z,use_quota=True,user_id='8280596b25134f1883291443573a9e8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:48:29 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-ad3eb7c1-0392-4221-9b39-01c7a57303dc tempest-VolumesNegativeTest-1392661253 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2bcc107b-d9ec-487f-9f14-7586fa5860d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:48:29 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-ad3eb7c1-0392-4221-9b39-01c7a57303dc tempest-VolumesNegativeTest-1392661253 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2bcc107b-d9ec-487f-9f14-7586fa5860d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:48:29 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-ad3eb7c1-0392-4221-9b39-01c7a57303dc tempest-VolumesNegativeTest-1392661253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e82995ec-9c0b-4937-9f59-a8a024c44060) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:48:29 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-ad3eb7c1-0392-4221-9b39-01c7a57303dc tempest-VolumesNegativeTest-1392661253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e82995ec-9c0b-4937-9f59-a8a024c44060) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd3ddb034-c551-4321-a9fd-164572a30565', 'volume_name': 'volume-d3ddb034-c551-4321-a9fd-164572a30565', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:48:29 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-ad3eb7c1-0392-4221-9b39-01c7a57303dc tempest-VolumesNegativeTest-1392661253 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e525c0d5-4a1c-4943-bcd3-34a5548922c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:48:29 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-ad3eb7c1-0392-4221-9b39-01c7a57303dc tempest-VolumesNegativeTest-1392661253 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e525c0d5-4a1c-4943-bcd3-34a5548922c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:48:29 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-ad3eb7c1-0392-4221-9b39-01c7a57303dc tempest-VolumesNegativeTest-1392661253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e498281-4034-4b21-b915-3f4766b691d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:48:29 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-ad3eb7c1-0392-4221-9b39-01c7a57303dc tempest-VolumesNegativeTest-1392661253 None] Volume d3ddb034-c551-4321-a9fd-164572a30565: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d3ddb034-c551-4321-a9fd-164572a30565', 'volume_size': 1} Sep 22 15:48:29 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-ad3eb7c1-0392-4221-9b39-01c7a57303dc tempest-VolumesNegativeTest-1392661253 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:48:29 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-ad3eb7c1-0392-4221-9b39-01c7a57303dc tempest-VolumesNegativeTest-1392661253 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:48:29 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-ad3eb7c1-0392-4221-9b39-01c7a57303dc tempest-VolumesNegativeTest-1392661253 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:48:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-193259040',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3ddb034-c551-4321-a9fd-164572a30565,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8adc510d7d6f436686da2454cf778b9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:48:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:48:30Z,use_quota=True,user_id='8280596b25134f1883291443573a9e8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)}" {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 15:48:29 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-ad3eb7c1-0392-4221-9b39-01c7a57303dc tempest-VolumesNegativeTest-1392661253 None] Creating volume d3ddb034-c551-4321-a9fd-164572a30565 {{(pid=86212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 15:48:29 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-ad3eb7c1-0392-4221-9b39-01c7a57303dc tempest-VolumesNegativeTest-1392661253 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:48:29 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-ad3eb7c1-0392-4221-9b39-01c7a57303dc tempest-VolumesNegativeTest-1392661253 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:48:29 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-ad3eb7c1-0392-4221-9b39-01c7a57303dc tempest-VolumesNegativeTest-1392661253 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:48:29 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-ad3eb7c1-0392-4221-9b39-01c7a57303dc tempest-VolumesNegativeTest-1392661253 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:48:29 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-ad3eb7c1-0392-4221-9b39-01c7a57303dc tempest-VolumesNegativeTest-1392661253 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:48:29 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-ad3eb7c1-0392-4221-9b39-01c7a57303dc tempest-VolumesNegativeTest-1392661253 None] Selected osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 as target Quobyte volume. {{(pid=86212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 15:48:29 devstack cinder-volume[86212]: INFO cinder.volume.drivers.remotefs [None req-ad3eb7c1-0392-4221-9b39-01c7a57303dc tempest-VolumesNegativeTest-1392661253 None] casted to osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 Sep 22 15:48:29 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-ad3eb7c1-0392-4221-9b39-01c7a57303dc tempest-VolumesNegativeTest-1392661253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-d3ddb034-c551-4321-a9fd-164572a30565 1073741824 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:48:29 devstack sudo[98215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-d3ddb034-c551-4321-a9fd-164572a30565 1073741824 Sep 22 15:48:29 devstack sudo[98215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:48:30 devstack sudo[98213]: pam_unix(sudo:session): session closed for user root Sep 22 15:48:30 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-05764d76-f8b8-4ca5-9db2-950a86d2bee9 tempest-TestServerVolumeAttachmentScenario-1578422816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc" returned: 0 in 0.294s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:48:30 devstack cinder-volume[86212]: DEBUG cinder.manager [None req-05764d76-f8b8-4ca5-9db2-950a86d2bee9 tempest-TestServerVolumeAttachmentScenario-1578422816 None] Notifying Schedulers of capabilities ... {{(pid=86212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 15:48:30 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-05764d76-f8b8-4ca5-9db2-950a86d2bee9 tempest-TestServerVolumeAttachmentScenario-1578422816 None] Deleted volume successfully. Sep 22 15:48:30 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-05764d76-f8b8-4ca5-9db2-950a86d2bee9 tempest-TestServerVolumeAttachmentScenario-1578422816 None] Lock "cinder-d8616712-676c-475f-9bce-b2189d11b318-delete_volume" released by "delete_volume" :: held 1.715s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:48:30 devstack sudo[98215]: pam_unix(sudo:session): session closed for user root Sep 22 15:48:30 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-ad3eb7c1-0392-4221-9b39-01c7a57303dc tempest-VolumesNegativeTest-1392661253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-d3ddb034-c551-4321-a9fd-164572a30565 1073741824" returned: 0 in 0.606s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:48:30 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-ad3eb7c1-0392-4221-9b39-01c7a57303dc tempest-VolumesNegativeTest-1392661253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-d3ddb034-c551-4321-a9fd-164572a30565 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:48:30 devstack sudo[98222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-d3ddb034-c551-4321-a9fd-164572a30565 Sep 22 15:48:30 devstack sudo[98222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:48:30 devstack sudo[98222]: pam_unix(sudo:session): session closed for user root Sep 22 15:48:30 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-ad3eb7c1-0392-4221-9b39-01c7a57303dc tempest-VolumesNegativeTest-1392661253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-d3ddb034-c551-4321-a9fd-164572a30565" returned: 0 in 0.331s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:48:30 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-ad3eb7c1-0392-4221-9b39-01c7a57303dc tempest-VolumesNegativeTest-1392661253 None] <== create_volume: return (991ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'} {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 15:48:30 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-ad3eb7c1-0392-4221-9b39-01c7a57303dc tempest-VolumesNegativeTest-1392661253 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.994s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:48:30 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-ad3eb7c1-0392-4221-9b39-01c7a57303dc tempest-VolumesNegativeTest-1392661253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e498281-4034-4b21-b915-3f4766b691d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d3ddb034-c551-4321-a9fd-164572a30565', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:48:30 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-ad3eb7c1-0392-4221-9b39-01c7a57303dc tempest-VolumesNegativeTest-1392661253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c9aa5d6-4b4d-4e96-900c-2a96b0b808b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:48:30 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-ad3eb7c1-0392-4221-9b39-01c7a57303dc tempest-VolumesNegativeTest-1392661253 None] Volume volume-d3ddb034-c551-4321-a9fd-164572a30565 (d3ddb034-c551-4321-a9fd-164572a30565): created successfully Sep 22 15:48:30 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-ad3eb7c1-0392-4221-9b39-01c7a57303dc tempest-VolumesNegativeTest-1392661253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c9aa5d6-4b4d-4e96-900c-2a96b0b808b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:48:30 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-ad3eb7c1-0392-4221-9b39-01c7a57303dc tempest-VolumesNegativeTest-1392661253 None] Flow 'volume_create_manager' (dc48ca95-faa5-438e-995e-7c2d206a60ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:48:31 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-ad3eb7c1-0392-4221-9b39-01c7a57303dc tempest-VolumesNegativeTest-1392661253 None] Created volume successfully. Sep 22 15:48:32 devstack cinder-volume[86212]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c8f7c17-63ed-492c-9aec-3c6558afe9e6 tempest-VolumesCloneTest-1820874323 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 15:48:32 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-8c8f7c17-63ed-492c-9aec-3c6558afe9e6 tempest-VolumesCloneTest-1820874323 None] Flow 'volume_create_manager' (0d53e19e-26ac-4396-8081-c1af22c79a0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:48:32 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-8c8f7c17-63ed-492c-9aec-3c6558afe9e6 tempest-VolumesCloneTest-1820874323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d96b339b-fe17-478f-9037-fe2b1bbc177c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:48:32 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-8c8f7c17-63ed-492c-9aec-3c6558afe9e6 tempest-VolumesCloneTest-1820874323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d96b339b-fe17-478f-9037-fe2b1bbc177c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:48:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1011142765',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2d6ccb8-26b5-413a-932d-9a139238251b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75fc43111481495f89a8455e957cdc39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:48:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:48:33Z,use_quota=True,user_id='74016ed422ec4111ae504745973c94c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:48:32 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-8c8f7c17-63ed-492c-9aec-3c6558afe9e6 tempest-VolumesCloneTest-1820874323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bcafcad-b8cb-48f6-ab4d-3f1a879acbe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:48:32 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-8c8f7c17-63ed-492c-9aec-3c6558afe9e6 tempest-VolumesCloneTest-1820874323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bcafcad-b8cb-48f6-ab4d-3f1a879acbe4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:48:32 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-8c8f7c17-63ed-492c-9aec-3c6558afe9e6 tempest-VolumesCloneTest-1820874323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb2665e5-5caa-4e0e-9b22-ff1fed0ff7a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:48:32 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-8c8f7c17-63ed-492c-9aec-3c6558afe9e6 tempest-VolumesCloneTest-1820874323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb2665e5-5caa-4e0e-9b22-ff1fed0ff7a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a2d6ccb8-26b5-413a-932d-9a139238251b', 'volume_name': 'volume-a2d6ccb8-26b5-413a-932d-9a139238251b', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:48:32 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-8c8f7c17-63ed-492c-9aec-3c6558afe9e6 tempest-VolumesCloneTest-1820874323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48f3a0a7-d8f5-4b23-921e-319df84753ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:48:32 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-8c8f7c17-63ed-492c-9aec-3c6558afe9e6 tempest-VolumesCloneTest-1820874323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48f3a0a7-d8f5-4b23-921e-319df84753ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:48:32 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-8c8f7c17-63ed-492c-9aec-3c6558afe9e6 tempest-VolumesCloneTest-1820874323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6673aed-3295-4f0d-a155-029db42eeb84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:48:32 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-8c8f7c17-63ed-492c-9aec-3c6558afe9e6 tempest-VolumesCloneTest-1820874323 None] Volume a2d6ccb8-26b5-413a-932d-9a139238251b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a2d6ccb8-26b5-413a-932d-9a139238251b', 'volume_size': 1} Sep 22 15:48:32 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-8c8f7c17-63ed-492c-9aec-3c6558afe9e6 tempest-VolumesCloneTest-1820874323 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:48:32 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-8c8f7c17-63ed-492c-9aec-3c6558afe9e6 tempest-VolumesCloneTest-1820874323 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:48:32 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-8c8f7c17-63ed-492c-9aec-3c6558afe9e6 tempest-VolumesCloneTest-1820874323 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:48:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1011142765',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2d6ccb8-26b5-413a-932d-9a139238251b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75fc43111481495f89a8455e957cdc39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:48:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:48:33Z,use_quota=True,user_id='74016ed422ec4111ae504745973c94c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)}" {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 15:48:32 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-8c8f7c17-63ed-492c-9aec-3c6558afe9e6 tempest-VolumesCloneTest-1820874323 None] Creating volume a2d6ccb8-26b5-413a-932d-9a139238251b {{(pid=86212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 15:48:32 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-8c8f7c17-63ed-492c-9aec-3c6558afe9e6 tempest-VolumesCloneTest-1820874323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:48:32 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-8c8f7c17-63ed-492c-9aec-3c6558afe9e6 tempest-VolumesCloneTest-1820874323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:48:32 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-8c8f7c17-63ed-492c-9aec-3c6558afe9e6 tempest-VolumesCloneTest-1820874323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:48:32 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-8c8f7c17-63ed-492c-9aec-3c6558afe9e6 tempest-VolumesCloneTest-1820874323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:48:32 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-8c8f7c17-63ed-492c-9aec-3c6558afe9e6 tempest-VolumesCloneTest-1820874323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:48:32 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-8c8f7c17-63ed-492c-9aec-3c6558afe9e6 tempest-VolumesCloneTest-1820874323 None] Selected osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 as target Quobyte volume. {{(pid=86212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 15:48:32 devstack cinder-volume[86212]: INFO cinder.volume.drivers.remotefs [None req-8c8f7c17-63ed-492c-9aec-3c6558afe9e6 tempest-VolumesCloneTest-1820874323 None] casted to osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 Sep 22 15:48:32 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-8c8f7c17-63ed-492c-9aec-3c6558afe9e6 tempest-VolumesCloneTest-1820874323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a2d6ccb8-26b5-413a-932d-9a139238251b 1073741824 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:48:32 devstack sudo[98225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a2d6ccb8-26b5-413a-932d-9a139238251b 1073741824 Sep 22 15:48:32 devstack sudo[98225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:48:33 devstack sudo[98225]: pam_unix(sudo:session): session closed for user root Sep 22 15:48:33 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-8c8f7c17-63ed-492c-9aec-3c6558afe9e6 tempest-VolumesCloneTest-1820874323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a2d6ccb8-26b5-413a-932d-9a139238251b 1073741824" returned: 0 in 0.602s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:48:33 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-8c8f7c17-63ed-492c-9aec-3c6558afe9e6 tempest-VolumesCloneTest-1820874323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a2d6ccb8-26b5-413a-932d-9a139238251b {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:48:33 devstack sudo[98231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a2d6ccb8-26b5-413a-932d-9a139238251b Sep 22 15:48:33 devstack sudo[98231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:48:33 devstack sudo[98231]: pam_unix(sudo:session): session closed for user root Sep 22 15:48:33 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-8c8f7c17-63ed-492c-9aec-3c6558afe9e6 tempest-VolumesCloneTest-1820874323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a2d6ccb8-26b5-413a-932d-9a139238251b" returned: 0 in 0.288s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:48:33 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-8c8f7c17-63ed-492c-9aec-3c6558afe9e6 tempest-VolumesCloneTest-1820874323 None] <== create_volume: return (945ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'} {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 15:48:33 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-8c8f7c17-63ed-492c-9aec-3c6558afe9e6 tempest-VolumesCloneTest-1820874323 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.948s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:48:33 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-8c8f7c17-63ed-492c-9aec-3c6558afe9e6 tempest-VolumesCloneTest-1820874323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6673aed-3295-4f0d-a155-029db42eeb84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a2d6ccb8-26b5-413a-932d-9a139238251b', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:48:33 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-8c8f7c17-63ed-492c-9aec-3c6558afe9e6 tempest-VolumesCloneTest-1820874323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d51c8bee-9fe8-4d30-932c-b3a4b9f3afee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:48:33 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-8c8f7c17-63ed-492c-9aec-3c6558afe9e6 tempest-VolumesCloneTest-1820874323 None] Volume volume-a2d6ccb8-26b5-413a-932d-9a139238251b (a2d6ccb8-26b5-413a-932d-9a139238251b): created successfully Sep 22 15:48:33 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-8c8f7c17-63ed-492c-9aec-3c6558afe9e6 tempest-VolumesCloneTest-1820874323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d51c8bee-9fe8-4d30-932c-b3a4b9f3afee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:48:33 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-8c8f7c17-63ed-492c-9aec-3c6558afe9e6 tempest-VolumesCloneTest-1820874323 None] Flow 'volume_create_manager' (0d53e19e-26ac-4396-8081-c1af22c79a0d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:48:33 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-8c8f7c17-63ed-492c-9aec-3c6558afe9e6 tempest-VolumesCloneTest-1820874323 None] Created volume successfully. Sep 22 15:48:35 devstack cinder-volume[86212]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad882c44-6f0b-46ac-bf0b-9d78a66184c3 tempest-VolumesCloneTest-1820874323 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 15:48:35 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-ad882c44-6f0b-46ac-bf0b-9d78a66184c3 tempest-VolumesCloneTest-1820874323 None] Flow 'volume_create_manager' (667fd257-7c4c-44e7-aafd-02b10cd9a16d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:48:35 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-ad882c44-6f0b-46ac-bf0b-9d78a66184c3 tempest-VolumesCloneTest-1820874323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f54fa2c-ac03-49dd-b1b9-23ce3d449e17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:48:35 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-ad882c44-6f0b-46ac-bf0b-9d78a66184c3 tempest-VolumesCloneTest-1820874323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f54fa2c-ac03-49dd-b1b9-23ce3d449e17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:48:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-893264382',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a33f5078-68c8-4618-a750-28be1012a472,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75fc43111481495f89a8455e957cdc39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:48:35Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=a2d6ccb8-26b5-413a-932d-9a139238251b,status='creating',terminated_at=None,updated_at=2026-09-22T13:48:35Z,use_quota=True,user_id='74016ed422ec4111ae504745973c94c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:48:35 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-ad882c44-6f0b-46ac-bf0b-9d78a66184c3 tempest-VolumesCloneTest-1820874323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4b911bc-f1aa-45ff-989d-3ad2d4bf50f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:48:35 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-ad882c44-6f0b-46ac-bf0b-9d78a66184c3 tempest-VolumesCloneTest-1820874323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4b911bc-f1aa-45ff-989d-3ad2d4bf50f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:48:35 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-ad882c44-6f0b-46ac-bf0b-9d78a66184c3 tempest-VolumesCloneTest-1820874323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8191b183-63a4-46ec-845c-464f0223b314) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:48:35 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-ad882c44-6f0b-46ac-bf0b-9d78a66184c3 tempest-VolumesCloneTest-1820874323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8191b183-63a4-46ec-845c-464f0223b314) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'a33f5078-68c8-4618-a750-28be1012a472', 'volume_name': 'volume-a33f5078-68c8-4618-a750-28be1012a472', 'volume_size': 2, 'source_volid': 'a2d6ccb8-26b5-413a-932d-9a139238251b', 'source_volstatus': 'available'}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:48:35 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-ad882c44-6f0b-46ac-bf0b-9d78a66184c3 tempest-VolumesCloneTest-1820874323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c46bba6d-ad13-48bd-99f4-854715812bd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:48:35 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-ad882c44-6f0b-46ac-bf0b-9d78a66184c3 tempest-VolumesCloneTest-1820874323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c46bba6d-ad13-48bd-99f4-854715812bd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:48:35 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-ad882c44-6f0b-46ac-bf0b-9d78a66184c3 tempest-VolumesCloneTest-1820874323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91132131-4183-428c-839b-3f1039d6f108) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:48:35 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-ad882c44-6f0b-46ac-bf0b-9d78a66184c3 tempest-VolumesCloneTest-1820874323 None] Volume a33f5078-68c8-4618-a750-28be1012a472: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-a33f5078-68c8-4618-a750-28be1012a472', 'volume_size': 2, 'source_volid': 'a2d6ccb8-26b5-413a-932d-9a139238251b', 'source_volstatus': 'available'} Sep 22 15:48:35 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-ad882c44-6f0b-46ac-bf0b-9d78a66184c3 tempest-VolumesCloneTest-1820874323 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:48:35 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-ad882c44-6f0b-46ac-bf0b-9d78a66184c3 tempest-VolumesCloneTest-1820874323 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:48:35 devstack cinder-volume[86212]: INFO cinder.volume.drivers.remotefs [None req-ad882c44-6f0b-46ac-bf0b-9d78a66184c3 tempest-VolumesCloneTest-1820874323 None] Cloning volume a2d6ccb8-26b5-413a-932d-9a139238251b to volume a33f5078-68c8-4618-a750-28be1012a472 Sep 22 15:48:35 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-ad882c44-6f0b-46ac-bf0b-9d78a66184c3 tempest-VolumesCloneTest-1820874323 None] Creating offline snapshot fc6c7ce1-2387-48a6-94c4-2f723e7853c8 of volume a2d6ccb8-26b5-413a-932d-9a139238251b {{(pid=86212) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 22 15:48:35 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[233b78ff-eb1f-4621-aadd-4ff090149b06]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:48:35 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-ad882c44-6f0b-46ac-bf0b-9d78a66184c3 tempest-VolumesCloneTest-1820874323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a2d6ccb8-26b5-413a-932d-9a139238251b {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:48:35 devstack sudo[98235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a2d6ccb8-26b5-413a-932d-9a139238251b Sep 22 15:48:35 devstack sudo[98235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:48:36 devstack sudo[98235]: pam_unix(sudo:session): session closed for user root Sep 22 15:48:36 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-ad882c44-6f0b-46ac-bf0b-9d78a66184c3 tempest-VolumesCloneTest-1820874323 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a2d6ccb8-26b5-413a-932d-9a139238251b" returned: 0 in 0.496s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:48:36 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-ad882c44-6f0b-46ac-bf0b-9d78a66184c3 tempest-VolumesCloneTest-1820874323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a2d6ccb8-26b5-413a-932d-9a139238251b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a2d6ccb8-26b5-413a-932d-9a139238251b.fc6c7ce1-2387-48a6-94c4-2f723e7853c8 1G {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:48:36 devstack sudo[98243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a2d6ccb8-26b5-413a-932d-9a139238251b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a2d6ccb8-26b5-413a-932d-9a139238251b.fc6c7ce1-2387-48a6-94c4-2f723e7853c8 1G Sep 22 15:48:36 devstack sudo[98243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:48:37 devstack sudo[98243]: pam_unix(sudo:session): session closed for user root Sep 22 15:48:37 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-ad882c44-6f0b-46ac-bf0b-9d78a66184c3 tempest-VolumesCloneTest-1820874323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a2d6ccb8-26b5-413a-932d-9a139238251b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a2d6ccb8-26b5-413a-932d-9a139238251b.fc6c7ce1-2387-48a6-94c4-2f723e7853c8 1G" returned: 0 in 0.859s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:48:37 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-ad882c44-6f0b-46ac-bf0b-9d78a66184c3 tempest-VolumesCloneTest-1820874323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a2d6ccb8-26b5-413a-932d-9a139238251b -F qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a2d6ccb8-26b5-413a-932d-9a139238251b.fc6c7ce1-2387-48a6-94c4-2f723e7853c8 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:48:37 devstack sudo[98249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a2d6ccb8-26b5-413a-932d-9a139238251b -F qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a2d6ccb8-26b5-413a-932d-9a139238251b.fc6c7ce1-2387-48a6-94c4-2f723e7853c8 Sep 22 15:48:37 devstack sudo[98249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:48:37 devstack sudo[98249]: pam_unix(sudo:session): session closed for user root Sep 22 15:48:37 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-ad882c44-6f0b-46ac-bf0b-9d78a66184c3 tempest-VolumesCloneTest-1820874323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a2d6ccb8-26b5-413a-932d-9a139238251b -F qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a2d6ccb8-26b5-413a-932d-9a139238251b.fc6c7ce1-2387-48a6-94c4-2f723e7853c8" returned: 0 in 0.448s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:48:37 devstack cinder-volume[86212]: WARNING cinder.volume.drivers.remotefs [None req-ad882c44-6f0b-46ac-bf0b-9d78a66184c3 tempest-VolumesCloneTest-1820874323 None] /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a2d6ccb8-26b5-413a-932d-9a139238251b.fc6c7ce1-2387-48a6-94c4-2f723e7853c8 is being set with open permissions: ugo+rw Sep 22 15:48:37 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-ad882c44-6f0b-46ac-bf0b-9d78a66184c3 tempest-VolumesCloneTest-1820874323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a2d6ccb8-26b5-413a-932d-9a139238251b.fc6c7ce1-2387-48a6-94c4-2f723e7853c8 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:48:37 devstack sudo[98255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a2d6ccb8-26b5-413a-932d-9a139238251b.fc6c7ce1-2387-48a6-94c4-2f723e7853c8 Sep 22 15:48:37 devstack sudo[98255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:48:38 devstack sudo[98255]: pam_unix(sudo:session): session closed for user root Sep 22 15:48:38 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-ad882c44-6f0b-46ac-bf0b-9d78a66184c3 tempest-VolumesCloneTest-1820874323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a2d6ccb8-26b5-413a-932d-9a139238251b.fc6c7ce1-2387-48a6-94c4-2f723e7853c8" returned: 0 in 0.482s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:48:38 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-ad882c44-6f0b-46ac-bf0b-9d78a66184c3 tempest-VolumesCloneTest-1820874323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a2d6ccb8-26b5-413a-932d-9a139238251b.info {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:48:38 devstack sudo[98258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a2d6ccb8-26b5-413a-932d-9a139238251b.info Sep 22 15:48:38 devstack sudo[98258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:48:38 devstack cinder-volume[86212]: DEBUG oslo_service.periodic_task [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86212) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 22 15:48:38 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:48:38 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:48:38 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:48:38 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:48:38 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:48:38 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:48:38 devstack sudo[98300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc Sep 22 15:48:38 devstack sudo[98300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:48:38 devstack sudo[98258]: pam_unix(sudo:session): session closed for user root Sep 22 15:48:38 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-ad882c44-6f0b-46ac-bf0b-9d78a66184c3 tempest-VolumesCloneTest-1820874323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a2d6ccb8-26b5-413a-932d-9a139238251b.info" returned: 0 in 0.643s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:48:38 devstack cinder-volume[86212]: WARNING cinder.volume.drivers.remotefs [None req-ad882c44-6f0b-46ac-bf0b-9d78a66184c3 tempest-VolumesCloneTest-1820874323 None] /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a2d6ccb8-26b5-413a-932d-9a139238251b.info is being set with open permissions: ugo+rw Sep 22 15:48:38 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-ad882c44-6f0b-46ac-bf0b-9d78a66184c3 tempest-VolumesCloneTest-1820874323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a2d6ccb8-26b5-413a-932d-9a139238251b.info {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:48:38 devstack sudo[98309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a2d6ccb8-26b5-413a-932d-9a139238251b.info Sep 22 15:48:38 devstack sudo[98309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:48:38 devstack sudo[98300]: pam_unix(sudo:session): session closed for user root Sep 22 15:48:38 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc" returned: 0 in 0.470s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:48:38 devstack cinder-volume[86212]: DEBUG cinder.manager [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] Notifying Schedulers of capabilities ... {{(pid=86212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 15:48:38 devstack cinder-volume[86212]: DEBUG oslo_service.periodic_task [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] Running periodic task VolumeManager._thread_info {{(pid=86212) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 22 15:48:38 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] thread count: 29 {{(pid=86212) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 22 15:48:38 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] thread info: [<_MainThread(MainThread, started 136163191222400)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86212) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 22 15:48:39 devstack sudo[98309]: pam_unix(sudo:session): session closed for user root Sep 22 15:48:39 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-ad882c44-6f0b-46ac-bf0b-9d78a66184c3 tempest-VolumesCloneTest-1820874323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a2d6ccb8-26b5-413a-932d-9a139238251b.info" returned: 0 in 0.325s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:48:39 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-ad882c44-6f0b-46ac-bf0b-9d78a66184c3 tempest-VolumesCloneTest-1820874323 None] Acquiring lock "cinder-quobyte-a33f5078-68c8-4618-a750-28be1012a472" by "_copy_volume_from_snapshot" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:48:39 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-ad882c44-6f0b-46ac-bf0b-9d78a66184c3 tempest-VolumesCloneTest-1820874323 None] Lock "cinder-quobyte-a33f5078-68c8-4618-a750-28be1012a472" acquired by "_copy_volume_from_snapshot" :: waited 0.029s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:48:39 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-ad882c44-6f0b-46ac-bf0b-9d78a66184c3 tempest-VolumesCloneTest-1820874323 None] snapshot: fc6c7ce1-2387-48a6-94c4-2f723e7853c8, volume: a33f5078-68c8-4618-a750-28be1012a472, {{(pid=86212) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 22 15:48:39 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-ad882c44-6f0b-46ac-bf0b-9d78a66184c3 tempest-VolumesCloneTest-1820874323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:48:39 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-ad882c44-6f0b-46ac-bf0b-9d78a66184c3 tempest-VolumesCloneTest-1820874323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:48:39 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-ad882c44-6f0b-46ac-bf0b-9d78a66184c3 tempest-VolumesCloneTest-1820874323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:48:39 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-ad882c44-6f0b-46ac-bf0b-9d78a66184c3 tempest-VolumesCloneTest-1820874323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:48:39 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-ad882c44-6f0b-46ac-bf0b-9d78a66184c3 tempest-VolumesCloneTest-1820874323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:48:39 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecdcf72a-1f2c-48ba-abca-bbc285164c7f]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:48:39 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-ad882c44-6f0b-46ac-bf0b-9d78a66184c3 tempest-VolumesCloneTest-1820874323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a2d6ccb8-26b5-413a-932d-9a139238251b.fc6c7ce1-2387-48a6-94c4-2f723e7853c8 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:48:39 devstack sudo[98320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a2d6ccb8-26b5-413a-932d-9a139238251b.fc6c7ce1-2387-48a6-94c4-2f723e7853c8 Sep 22 15:48:39 devstack sudo[98320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:48:39 devstack sudo[98320]: pam_unix(sudo:session): session closed for user root Sep 22 15:48:39 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-ad882c44-6f0b-46ac-bf0b-9d78a66184c3 tempest-VolumesCloneTest-1820874323 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a2d6ccb8-26b5-413a-932d-9a139238251b.fc6c7ce1-2387-48a6-94c4-2f723e7853c8" returned: 0 in 0.478s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:48:39 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-ad882c44-6f0b-46ac-bf0b-9d78a66184c3 tempest-VolumesCloneTest-1820874323 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a2d6ccb8-26b5-413a-932d-9a139238251b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86212) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 22 15:48:39 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[24dd786f-7749-4bce-b034-b46aba773e2f]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:48:39 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-ad882c44-6f0b-46ac-bf0b-9d78a66184c3 tempest-VolumesCloneTest-1820874323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a2d6ccb8-26b5-413a-932d-9a139238251b {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:48:39 devstack sudo[98325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a2d6ccb8-26b5-413a-932d-9a139238251b Sep 22 15:48:39 devstack sudo[98325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:48:40 devstack sudo[98325]: pam_unix(sudo:session): session closed for user root Sep 22 15:48:40 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-ad882c44-6f0b-46ac-bf0b-9d78a66184c3 tempest-VolumesCloneTest-1820874323 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a2d6ccb8-26b5-413a-932d-9a139238251b" returned: 0 in 0.567s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:48:40 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-ad882c44-6f0b-46ac-bf0b-9d78a66184c3 tempest-VolumesCloneTest-1820874323 None] will copy from snapshot at /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a2d6ccb8-26b5-413a-932d-9a139238251b {{(pid=86212) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 22 15:48:40 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-ad882c44-6f0b-46ac-bf0b-9d78a66184c3 tempest-VolumesCloneTest-1820874323 None] Creating direct copy from snapshot {{(pid=86212) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 22 15:48:40 devstack cinder-volume[86212]: DEBUG cinder.utils [None req-ad882c44-6f0b-46ac-bf0b-9d78a66184c3 tempest-VolumesCloneTest-1820874323 None] Path /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a33f5078-68c8-4618-a750-28be1012a472 not found in is_blk_device check {{(pid=86212) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 22 15:48:40 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-ad882c44-6f0b-46ac-bf0b-9d78a66184c3 tempest-VolumesCloneTest-1820874323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a2d6ccb8-26b5-413a-932d-9a139238251b /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a33f5078-68c8-4618-a750-28be1012a472 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:48:40 devstack sudo[98334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a2d6ccb8-26b5-413a-932d-9a139238251b /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a33f5078-68c8-4618-a750-28be1012a472 Sep 22 15:48:40 devstack sudo[98334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:48:48 devstack cinder-volume[86212]: DEBUG dbcounter [-] [86212] Writing DB stats cinder:SELECT=53,cinder:INSERT=14,cinder:UPDATE=64,cinder:DELETE=6 {{(pid=86212) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 22 15:48:48 devstack cinder-volume[86212]: DEBUG dbcounter [-] [86212] Writing DB stats cinder:UPDATE=66,cinder:SELECT=49,cinder:DELETE=5,cinder:INSERT=17 {{(pid=86212) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 22 15:48:49 devstack sudo[98334]: pam_unix(sudo:session): session closed for user root Sep 22 15:48:49 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-ad882c44-6f0b-46ac-bf0b-9d78a66184c3 tempest-VolumesCloneTest-1820874323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a2d6ccb8-26b5-413a-932d-9a139238251b /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a33f5078-68c8-4618-a750-28be1012a472" returned: 0 in 8.987s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:48:49 devstack cinder-volume[86212]: DEBUG cinder.image.image_utils [None req-ad882c44-6f0b-46ac-bf0b-9d78a66184c3 tempest-VolumesCloneTest-1820874323 None] Image conversion details: src /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a2d6ccb8-26b5-413a-932d-9a139238251b, size 1024.00 MB, duration 8.99 sec, destination /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a33f5078-68c8-4618-a750-28be1012a472 {{(pid=86212) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 22 15:48:49 devstack cinder-volume[86212]: INFO cinder.image.image_utils [None req-ad882c44-6f0b-46ac-bf0b-9d78a66184c3 tempest-VolumesCloneTest-1820874323 None] Converted 1024.00 MB image at 113.93 MB/s Sep 22 15:48:49 devstack cinder-volume[86212]: WARNING cinder.volume.drivers.remotefs [None req-ad882c44-6f0b-46ac-bf0b-9d78a66184c3 tempest-VolumesCloneTest-1820874323 None] /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a33f5078-68c8-4618-a750-28be1012a472 is being set with open permissions: ugo+rw Sep 22 15:48:49 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-ad882c44-6f0b-46ac-bf0b-9d78a66184c3 tempest-VolumesCloneTest-1820874323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a33f5078-68c8-4618-a750-28be1012a472 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:48:49 devstack sudo[98350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a33f5078-68c8-4618-a750-28be1012a472 Sep 22 15:48:49 devstack sudo[98350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:48:49 devstack sudo[98350]: pam_unix(sudo:session): session closed for user root Sep 22 15:48:49 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-ad882c44-6f0b-46ac-bf0b-9d78a66184c3 tempest-VolumesCloneTest-1820874323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a33f5078-68c8-4618-a750-28be1012a472" returned: 0 in 0.282s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:48:49 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-ad882c44-6f0b-46ac-bf0b-9d78a66184c3 tempest-VolumesCloneTest-1820874323 None] Lock "cinder-quobyte-a33f5078-68c8-4618-a750-28be1012a472" released by "_copy_volume_from_snapshot" :: held 10.438s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:48:49 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-ad882c44-6f0b-46ac-bf0b-9d78a66184c3 tempest-VolumesCloneTest-1820874323 None] Acquiring lock "cinder-quobyte-fc6c7ce1-2387-48a6-94c4-2f723e7853c8" by "_delete_snapshot" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:48:49 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-ad882c44-6f0b-46ac-bf0b-9d78a66184c3 tempest-VolumesCloneTest-1820874323 None] Lock "cinder-quobyte-fc6c7ce1-2387-48a6-94c4-2f723e7853c8" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:48:49 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-ad882c44-6f0b-46ac-bf0b-9d78a66184c3 tempest-VolumesCloneTest-1820874323 None] Deleting offline snapshot fc6c7ce1-2387-48a6-94c4-2f723e7853c8 of volume a2d6ccb8-26b5-413a-932d-9a139238251b {{(pid=86212) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 22 15:48:49 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-ad882c44-6f0b-46ac-bf0b-9d78a66184c3 tempest-VolumesCloneTest-1820874323 None] snapshot_file for this snap is: volume-a2d6ccb8-26b5-413a-932d-9a139238251b.fc6c7ce1-2387-48a6-94c4-2f723e7853c8 {{(pid=86212) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 22 15:48:49 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[501f5168-e5d3-4b6b-93fe-810dc9039121]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:48:49 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-ad882c44-6f0b-46ac-bf0b-9d78a66184c3 tempest-VolumesCloneTest-1820874323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a2d6ccb8-26b5-413a-932d-9a139238251b.fc6c7ce1-2387-48a6-94c4-2f723e7853c8 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:48:49 devstack sudo[98353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a2d6ccb8-26b5-413a-932d-9a139238251b.fc6c7ce1-2387-48a6-94c4-2f723e7853c8 Sep 22 15:48:49 devstack sudo[98353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:48:50 devstack sudo[98353]: pam_unix(sudo:session): session closed for user root Sep 22 15:48:50 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-ad882c44-6f0b-46ac-bf0b-9d78a66184c3 tempest-VolumesCloneTest-1820874323 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a2d6ccb8-26b5-413a-932d-9a139238251b.fc6c7ce1-2387-48a6-94c4-2f723e7853c8" returned: 0 in 0.649s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:48:50 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-ad882c44-6f0b-46ac-bf0b-9d78a66184c3 tempest-VolumesCloneTest-1820874323 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a2d6ccb8-26b5-413a-932d-9a139238251b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86212) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 22 15:48:50 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c9e3989-32b5-48f3-889b-5b6c368adae1]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:48:50 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-ad882c44-6f0b-46ac-bf0b-9d78a66184c3 tempest-VolumesCloneTest-1820874323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a2d6ccb8-26b5-413a-932d-9a139238251b {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:48:50 devstack sudo[98374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a2d6ccb8-26b5-413a-932d-9a139238251b Sep 22 15:48:50 devstack sudo[98374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:48:51 devstack sudo[98374]: pam_unix(sudo:session): session closed for user root Sep 22 15:48:51 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-ad882c44-6f0b-46ac-bf0b-9d78a66184c3 tempest-VolumesCloneTest-1820874323 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a2d6ccb8-26b5-413a-932d-9a139238251b" returned: 0 in 1.259s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:48:51 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-ad882c44-6f0b-46ac-bf0b-9d78a66184c3 tempest-VolumesCloneTest-1820874323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a2d6ccb8-26b5-413a-932d-9a139238251b.fc6c7ce1-2387-48a6-94c4-2f723e7853c8 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:48:51 devstack sudo[98436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a2d6ccb8-26b5-413a-932d-9a139238251b.fc6c7ce1-2387-48a6-94c4-2f723e7853c8 Sep 22 15:48:51 devstack sudo[98436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:48:52 devstack sudo[98436]: pam_unix(sudo:session): session closed for user root Sep 22 15:48:52 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-ad882c44-6f0b-46ac-bf0b-9d78a66184c3 tempest-VolumesCloneTest-1820874323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a2d6ccb8-26b5-413a-932d-9a139238251b.fc6c7ce1-2387-48a6-94c4-2f723e7853c8" returned: 0 in 0.865s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:48:52 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-ad882c44-6f0b-46ac-bf0b-9d78a66184c3 tempest-VolumesCloneTest-1820874323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a2d6ccb8-26b5-413a-932d-9a139238251b.fc6c7ce1-2387-48a6-94c4-2f723e7853c8 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:48:52 devstack sudo[98447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a2d6ccb8-26b5-413a-932d-9a139238251b.fc6c7ce1-2387-48a6-94c4-2f723e7853c8 Sep 22 15:48:52 devstack sudo[98447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:48:52 devstack sudo[98447]: pam_unix(sudo:session): session closed for user root Sep 22 15:48:52 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-ad882c44-6f0b-46ac-bf0b-9d78a66184c3 tempest-VolumesCloneTest-1820874323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a2d6ccb8-26b5-413a-932d-9a139238251b.fc6c7ce1-2387-48a6-94c4-2f723e7853c8" returned: 0 in 0.424s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:48:52 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-ad882c44-6f0b-46ac-bf0b-9d78a66184c3 tempest-VolumesCloneTest-1820874323 None] Lock "cinder-quobyte-fc6c7ce1-2387-48a6-94c4-2f723e7853c8" released by "_delete_snapshot" :: held 3.378s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:48:53 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-ad882c44-6f0b-46ac-bf0b-9d78a66184c3 tempest-VolumesCloneTest-1820874323 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 17.371s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:48:53 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-ad882c44-6f0b-46ac-bf0b-9d78a66184c3 tempest-VolumesCloneTest-1820874323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91132131-4183-428c-839b-3f1039d6f108) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a33f5078-68c8-4618-a750-28be1012a472', 'volume_size': 2, 'source_volid': 'a2d6ccb8-26b5-413a-932d-9a139238251b', 'source_volstatus': 'available'}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:48:53 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-ad882c44-6f0b-46ac-bf0b-9d78a66184c3 tempest-VolumesCloneTest-1820874323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (510347b5-ff3c-48c7-ad83-156ecc186632) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:48:53 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-ad882c44-6f0b-46ac-bf0b-9d78a66184c3 tempest-VolumesCloneTest-1820874323 None] Volume volume-a33f5078-68c8-4618-a750-28be1012a472 (a33f5078-68c8-4618-a750-28be1012a472): created successfully Sep 22 15:48:53 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-ad882c44-6f0b-46ac-bf0b-9d78a66184c3 tempest-VolumesCloneTest-1820874323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (510347b5-ff3c-48c7-ad83-156ecc186632) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:48:53 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-ad882c44-6f0b-46ac-bf0b-9d78a66184c3 tempest-VolumesCloneTest-1820874323 None] Flow 'volume_create_manager' (667fd257-7c4c-44e7-aafd-02b10cd9a16d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:48:53 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-ad882c44-6f0b-46ac-bf0b-9d78a66184c3 tempest-VolumesCloneTest-1820874323 None] Created volume successfully. Sep 22 15:48:53 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-03f57916-e7a5-43ca-a133-376ee62630f8 tempest-VolumesCloneTest-1820874323 None] Acquiring lock "cinder-a33f5078-68c8-4618-a750-28be1012a472-delete_volume" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:48:54 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-03f57916-e7a5-43ca-a133-376ee62630f8 tempest-VolumesCloneTest-1820874323 None] Lock "cinder-a33f5078-68c8-4618-a750-28be1012a472-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:48:54 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-03f57916-e7a5-43ca-a133-376ee62630f8 tempest-VolumesCloneTest-1820874323 None] Acquiring lock "cinder-quobyte-a33f5078-68c8-4618-a750-28be1012a472" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:48:54 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-03f57916-e7a5-43ca-a133-376ee62630f8 tempest-VolumesCloneTest-1820874323 None] Lock "cinder-quobyte-a33f5078-68c8-4618-a750-28be1012a472" acquired by "delete_volume" :: waited 0.034s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:48:54 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac6fbdac-233e-4b99-a193-935a5f1b6dd3]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:48:54 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-03f57916-e7a5-43ca-a133-376ee62630f8 tempest-VolumesCloneTest-1820874323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a33f5078-68c8-4618-a750-28be1012a472 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:48:54 devstack sudo[98450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a33f5078-68c8-4618-a750-28be1012a472 Sep 22 15:48:54 devstack sudo[98450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:48:55 devstack sudo[98450]: pam_unix(sudo:session): session closed for user root Sep 22 15:48:55 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-03f57916-e7a5-43ca-a133-376ee62630f8 tempest-VolumesCloneTest-1820874323 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a33f5078-68c8-4618-a750-28be1012a472" returned: 0 in 0.998s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:48:55 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-03f57916-e7a5-43ca-a133-376ee62630f8 tempest-VolumesCloneTest-1820874323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a33f5078-68c8-4618-a750-28be1012a472 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:48:55 devstack sudo[98461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a33f5078-68c8-4618-a750-28be1012a472 Sep 22 15:48:55 devstack sudo[98461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:48:55 devstack sudo[98461]: pam_unix(sudo:session): session closed for user root Sep 22 15:48:55 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-03f57916-e7a5-43ca-a133-376ee62630f8 tempest-VolumesCloneTest-1820874323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a33f5078-68c8-4618-a750-28be1012a472" returned: 0 in 0.411s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:48:55 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-03f57916-e7a5-43ca-a133-376ee62630f8 tempest-VolumesCloneTest-1820874323 None] Lock "cinder-quobyte-a33f5078-68c8-4618-a750-28be1012a472" released by "delete_volume" :: held 1.516s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:48:55 devstack cinder-volume[86212]: DEBUG cinder.quota [None req-03f57916-e7a5-43ca-a133-376ee62630f8 tempest-VolumesCloneTest-1820874323 None] Created reservations ['30bd771b-8bc7-4e96-94e7-854fac7add26', 'a267ef09-0010-4c8b-8b95-b16ffae262d1', '6a4932e3-0eb7-4031-a3ab-da1aff10e49a', 'e799dc2c-4dc3-4c7a-9495-30d7834cf6b6'] {{(pid=86212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 15:48:55 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-03f57916-e7a5-43ca-a133-376ee62630f8 tempest-VolumesCloneTest-1820874323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:48:55 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-03f57916-e7a5-43ca-a133-376ee62630f8 tempest-VolumesCloneTest-1820874323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:48:55 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-03f57916-e7a5-43ca-a133-376ee62630f8 tempest-VolumesCloneTest-1820874323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:48:55 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-03f57916-e7a5-43ca-a133-376ee62630f8 tempest-VolumesCloneTest-1820874323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:48:55 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-03f57916-e7a5-43ca-a133-376ee62630f8 tempest-VolumesCloneTest-1820874323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:48:55 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-03f57916-e7a5-43ca-a133-376ee62630f8 tempest-VolumesCloneTest-1820874323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:48:55 devstack sudo[98492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc Sep 22 15:48:55 devstack sudo[98492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:48:56 devstack sudo[98492]: pam_unix(sudo:session): session closed for user root Sep 22 15:48:56 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-03f57916-e7a5-43ca-a133-376ee62630f8 tempest-VolumesCloneTest-1820874323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc" returned: 0 in 0.438s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:48:56 devstack cinder-volume[86212]: DEBUG cinder.manager [None req-03f57916-e7a5-43ca-a133-376ee62630f8 tempest-VolumesCloneTest-1820874323 None] Notifying Schedulers of capabilities ... {{(pid=86212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 15:48:56 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-03f57916-e7a5-43ca-a133-376ee62630f8 tempest-VolumesCloneTest-1820874323 None] Deleted volume successfully. Sep 22 15:48:56 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-03f57916-e7a5-43ca-a133-376ee62630f8 tempest-VolumesCloneTest-1820874323 None] Lock "cinder-a33f5078-68c8-4618-a750-28be1012a472-delete_volume" released by "delete_volume" :: held 2.417s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:48:56 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-e39a5944-7aab-44ec-9fb1-7d7454317c07 tempest-VolumesCloneTest-1820874323 None] Acquiring lock "cinder-a2d6ccb8-26b5-413a-932d-9a139238251b-delete_volume" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:48:56 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-e39a5944-7aab-44ec-9fb1-7d7454317c07 tempest-VolumesCloneTest-1820874323 None] Lock "cinder-a2d6ccb8-26b5-413a-932d-9a139238251b-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:48:56 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-e39a5944-7aab-44ec-9fb1-7d7454317c07 tempest-VolumesCloneTest-1820874323 None] Acquiring lock "cinder-quobyte-a2d6ccb8-26b5-413a-932d-9a139238251b" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:48:56 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-e39a5944-7aab-44ec-9fb1-7d7454317c07 tempest-VolumesCloneTest-1820874323 None] Lock "cinder-quobyte-a2d6ccb8-26b5-413a-932d-9a139238251b" acquired by "delete_volume" :: waited 0.036s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:48:56 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2ecb3e9-8e40-4739-8705-1a08c3a91565]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:48:56 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-e39a5944-7aab-44ec-9fb1-7d7454317c07 tempest-VolumesCloneTest-1820874323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a2d6ccb8-26b5-413a-932d-9a139238251b {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:48:56 devstack sudo[98499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a2d6ccb8-26b5-413a-932d-9a139238251b Sep 22 15:48:56 devstack sudo[98499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:48:57 devstack sudo[98499]: pam_unix(sudo:session): session closed for user root Sep 22 15:48:57 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-e39a5944-7aab-44ec-9fb1-7d7454317c07 tempest-VolumesCloneTest-1820874323 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a2d6ccb8-26b5-413a-932d-9a139238251b" returned: 0 in 0.639s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:48:57 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-e39a5944-7aab-44ec-9fb1-7d7454317c07 tempest-VolumesCloneTest-1820874323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a2d6ccb8-26b5-413a-932d-9a139238251b {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:48:57 devstack sudo[98506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a2d6ccb8-26b5-413a-932d-9a139238251b Sep 22 15:48:57 devstack cinder-volume[86212]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9ea9639-8582-47b1-8a0a-92cf1641e092 tempest-VolumeImageDependencyTests-747002242 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 15:48:57 devstack sudo[98506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:48:57 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-f9ea9639-8582-47b1-8a0a-92cf1641e092 tempest-VolumeImageDependencyTests-747002242 None] Flow 'volume_create_manager' (b49dc054-2a89-4ca6-a8c9-bb8f9fa37c3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:48:57 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-f9ea9639-8582-47b1-8a0a-92cf1641e092 tempest-VolumeImageDependencyTests-747002242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f99681ac-e729-4c86-ad74-81a13ea97f58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:48:57 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-f9ea9639-8582-47b1-8a0a-92cf1641e092 tempest-VolumeImageDependencyTests-747002242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f99681ac-e729-4c86-ad74-81a13ea97f58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:48:57Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65451fb8-9317-4671-8a54-6de55a44ffeb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06a0051fe05a4866a2ca580eb690eb6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:48:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:48:57Z,use_quota=True,user_id='3b926bfc515f498893b7d228340d8e04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:48:57 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-f9ea9639-8582-47b1-8a0a-92cf1641e092 tempest-VolumeImageDependencyTests-747002242 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ef8e770-8660-4cea-88ef-97f0ef12cd1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:48:57 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-f9ea9639-8582-47b1-8a0a-92cf1641e092 tempest-VolumeImageDependencyTests-747002242 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ef8e770-8660-4cea-88ef-97f0ef12cd1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:48:57 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-f9ea9639-8582-47b1-8a0a-92cf1641e092 tempest-VolumeImageDependencyTests-747002242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b5e0d7d-be55-4546-b849-7f23ffa108c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:48:57 devstack cinder-volume[86212]: DEBUG cinder.image.glance [None req-f9ea9639-8582-47b1-8a0a-92cf1641e092 tempest-VolumeImageDependencyTests-747002242 None] Creating Keystone auth plugin from conf {{(pid=86212) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 22 15:48:57 devstack sudo[98506]: pam_unix(sudo:session): session closed for user root Sep 22 15:48:57 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-e39a5944-7aab-44ec-9fb1-7d7454317c07 tempest-VolumesCloneTest-1820874323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a2d6ccb8-26b5-413a-932d-9a139238251b" returned: 0 in 0.356s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:48:57 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-e39a5944-7aab-44ec-9fb1-7d7454317c07 tempest-VolumesCloneTest-1820874323 None] Lock "cinder-quobyte-a2d6ccb8-26b5-413a-932d-9a139238251b" released by "delete_volume" :: held 1.115s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:48:57 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-f9ea9639-8582-47b1-8a0a-92cf1641e092 tempest-VolumeImageDependencyTests-747002242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b5e0d7d-be55-4546-b849-7f23ffa108c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '65451fb8-9317-4671-8a54-6de55a44ffeb', 'volume_name': 'volume-65451fb8-9317-4671-8a54-6de55a44ffeb', 'volume_size': 1, 'image_id': '2c3d29fb-a781-4c0c-92e3-bd62bf9a6666', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2c3d29fb-a781-4c0c-92e3-bd62bf9a6666', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '2ee3e7ee883781f29c545c296c2ef352', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '06a0051fe05a4866a2ca580eb690eb6b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '267c313513ace89f4d5308e78c97632edd0e9a8729f6f127adf000cc17a5d8eee177749c7af5ad80365423b307b5feaa9285cc469bba7870e94028030c023eee', 'id': '2c3d29fb-a781-4c0c-92e3-bd62bf9a6666', 'created_at': datetime.datetime(2026, 9, 22, 13, 48, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 13, 48, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2c3d29fb-a781-4c0c-92e3-bd62bf9a6666/file', 'properties': {}}, 'image_service': }' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:48:57 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-f9ea9639-8582-47b1-8a0a-92cf1641e092 tempest-VolumeImageDependencyTests-747002242 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc987fd5-74b0-4eb7-8503-922603f1ffee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:48:57 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-f9ea9639-8582-47b1-8a0a-92cf1641e092 tempest-VolumeImageDependencyTests-747002242 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc987fd5-74b0-4eb7-8503-922603f1ffee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:48:57 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-f9ea9639-8582-47b1-8a0a-92cf1641e092 tempest-VolumeImageDependencyTests-747002242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c48929e8-5516-42e2-969d-b8246a1e4311) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:48:57 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-f9ea9639-8582-47b1-8a0a-92cf1641e092 tempest-VolumeImageDependencyTests-747002242 None] Volume 65451fb8-9317-4671-8a54-6de55a44ffeb: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-65451fb8-9317-4671-8a54-6de55a44ffeb', 'volume_size': 1, 'image_id': '2c3d29fb-a781-4c0c-92e3-bd62bf9a6666', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2c3d29fb-a781-4c0c-92e3-bd62bf9a6666', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '2ee3e7ee883781f29c545c296c2ef352', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '06a0051fe05a4866a2ca580eb690eb6b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '267c313513ace89f4d5308e78c97632edd0e9a8729f6f127adf000cc17a5d8eee177749c7af5ad80365423b307b5feaa9285cc469bba7870e94028030c023eee', 'id': '2c3d29fb-a781-4c0c-92e3-bd62bf9a6666', 'created_at': datetime.datetime(2026, 9, 22, 13, 48, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 13, 48, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2c3d29fb-a781-4c0c-92e3-bd62bf9a6666/file', 'properties': {}}, 'image_service': } Sep 22 15:48:57 devstack cinder-volume[86212]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9ea9639-8582-47b1-8a0a-92cf1641e092 tempest-VolumeImageDependencyTests-747002242 None] Trying to clone 65451fb8-9317-4671-8a54-6de55a44ffeb from image 2c3d29fb-a781-4c0c-92e3-bd62bf9a6666 at location (None, [{'url': 'file:///opt/stack/data/glance/images/2c3d29fb-a781-4c0c-92e3-bd62bf9a6666', 'metadata': {}}]). {{(pid=86212) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 22 15:48:57 devstack cinder-volume[86212]: DEBUG cinder.quota [None req-e39a5944-7aab-44ec-9fb1-7d7454317c07 tempest-VolumesCloneTest-1820874323 None] Created reservations ['5ab1ae5b-678e-462a-a20f-8f59b6685cc4', '9d328150-d1b0-41eb-8407-8aa8b88ddb88', '7197d020-4ec0-478a-a816-7ebb6243b076', '0f95d42e-bd79-4c57-b1a7-7553259e3dfc'] {{(pid=86212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 15:48:57 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-e39a5944-7aab-44ec-9fb1-7d7454317c07 tempest-VolumesCloneTest-1820874323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:48:57 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-e39a5944-7aab-44ec-9fb1-7d7454317c07 tempest-VolumesCloneTest-1820874323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:48:57 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-e39a5944-7aab-44ec-9fb1-7d7454317c07 tempest-VolumesCloneTest-1820874323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:48:57 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-e39a5944-7aab-44ec-9fb1-7d7454317c07 tempest-VolumesCloneTest-1820874323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:48:57 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-e39a5944-7aab-44ec-9fb1-7d7454317c07 tempest-VolumesCloneTest-1820874323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:48:57 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-e39a5944-7aab-44ec-9fb1-7d7454317c07 tempest-VolumesCloneTest-1820874323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:48:58 devstack cinder-volume[86212]: DEBUG cinder.image.image_utils [None req-f9ea9639-8582-47b1-8a0a-92cf1641e092 tempest-VolumeImageDependencyTests-747002242 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_2c3d29fb-a781-4c0c-92e3-bd62bf9a6666_gs_aw3j5devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86212) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 22 15:48:58 devstack cinder-volume[86212]: INFO cinder.image.image_utils [None req-f9ea9639-8582-47b1-8a0a-92cf1641e092 tempest-VolumeImageDependencyTests-747002242 None] Image download 0.00 MB at 0.00 MB/s Sep 22 15:48:58 devstack sudo[98510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc Sep 22 15:48:58 devstack sudo[98510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:48:58 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa399332-c241-4af8-83e6-c2bcba443a9b]: (4, 'raw') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:48:58 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-f9ea9639-8582-47b1-8a0a-92cf1641e092 tempest-VolumeImageDependencyTests-747002242 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2c3d29fb-a781-4c0c-92e3-bd62bf9a6666_gs_aw3j5devstack@QuobyteHD {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:48:58 devstack sudo[98512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2c3d29fb-a781-4c0c-92e3-bd62bf9a6666_gs_aw3j5devstack@QuobyteHD Sep 22 15:48:58 devstack sudo[98512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:48:58 devstack sudo[98510]: pam_unix(sudo:session): session closed for user root Sep 22 15:48:58 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-e39a5944-7aab-44ec-9fb1-7d7454317c07 tempest-VolumesCloneTest-1820874323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc" returned: 0 in 0.282s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:48:58 devstack cinder-volume[86212]: DEBUG cinder.manager [None req-e39a5944-7aab-44ec-9fb1-7d7454317c07 tempest-VolumesCloneTest-1820874323 None] Notifying Schedulers of capabilities ... {{(pid=86212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 15:48:58 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-e39a5944-7aab-44ec-9fb1-7d7454317c07 tempest-VolumesCloneTest-1820874323 None] Deleted volume successfully. Sep 22 15:48:58 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-e39a5944-7aab-44ec-9fb1-7d7454317c07 tempest-VolumesCloneTest-1820874323 None] Lock "cinder-a2d6ccb8-26b5-413a-932d-9a139238251b-delete_volume" released by "delete_volume" :: held 1.756s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:48:58 devstack sudo[98512]: pam_unix(sudo:session): session closed for user root Sep 22 15:48:58 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-f9ea9639-8582-47b1-8a0a-92cf1641e092 tempest-VolumeImageDependencyTests-747002242 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2c3d29fb-a781-4c0c-92e3-bd62bf9a6666_gs_aw3j5devstack@QuobyteHD" returned: 0 in 0.427s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:48:58 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-f9ea9639-8582-47b1-8a0a-92cf1641e092 tempest-VolumeImageDependencyTests-747002242 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2c3d29fb-a781-4c0c-92e3-bd62bf9a6666_gs_aw3j5devstack@QuobyteHD {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:48:58 devstack sudo[98518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2c3d29fb-a781-4c0c-92e3-bd62bf9a6666_gs_aw3j5devstack@QuobyteHD Sep 22 15:48:58 devstack sudo[98518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:48:58 devstack sudo[98518]: pam_unix(sudo:session): session closed for user root Sep 22 15:48:58 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-f9ea9639-8582-47b1-8a0a-92cf1641e092 tempest-VolumeImageDependencyTests-747002242 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2c3d29fb-a781-4c0c-92e3-bd62bf9a6666_gs_aw3j5devstack@QuobyteHD" returned: 1 in 0.383s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:48:58 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-f9ea9639-8582-47b1-8a0a-92cf1641e092 tempest-VolumeImageDependencyTests-747002242 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2c3d29fb-a781-4c0c-92e3-bd62bf9a6666_gs_aw3j5devstack@QuobyteHD' failed. Not Retrying. {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 22 15:48:58 devstack cinder-volume[86212]: DEBUG cinder.image.image_utils [None req-f9ea9639-8582-47b1-8a0a-92cf1641e092 tempest-VolumeImageDependencyTests-747002242 None] Temporary image 2c3d29fb-a781-4c0c-92e3-bd62bf9a6666 is fetched for user 3b926bfc515f498893b7d228340d8e04. {{(pid=86212) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 22 15:48:59 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba0599e3-75b8-426d-abe3-958e3f497af3]: (4, 'raw') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:48:59 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-f9ea9639-8582-47b1-8a0a-92cf1641e092 tempest-VolumeImageDependencyTests-747002242 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2c3d29fb-a781-4c0c-92e3-bd62bf9a6666_gs_aw3j5devstack@QuobyteHD {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:48:59 devstack sudo[98523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2c3d29fb-a781-4c0c-92e3-bd62bf9a6666_gs_aw3j5devstack@QuobyteHD Sep 22 15:48:59 devstack sudo[98523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:48:59 devstack sudo[98523]: pam_unix(sudo:session): session closed for user root Sep 22 15:48:59 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-f9ea9639-8582-47b1-8a0a-92cf1641e092 tempest-VolumeImageDependencyTests-747002242 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2c3d29fb-a781-4c0c-92e3-bd62bf9a6666_gs_aw3j5devstack@QuobyteHD" returned: 0 in 0.986s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:48:59 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-f9ea9639-8582-47b1-8a0a-92cf1641e092 tempest-VolumeImageDependencyTests-747002242 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2c3d29fb-a781-4c0c-92e3-bd62bf9a6666_gs_aw3j5devstack@QuobyteHD {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:49:00 devstack sudo[98584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2c3d29fb-a781-4c0c-92e3-bd62bf9a6666_gs_aw3j5devstack@QuobyteHD Sep 22 15:49:00 devstack sudo[98584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:49:00 devstack sudo[98584]: pam_unix(sudo:session): session closed for user root Sep 22 15:49:00 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-f9ea9639-8582-47b1-8a0a-92cf1641e092 tempest-VolumeImageDependencyTests-747002242 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2c3d29fb-a781-4c0c-92e3-bd62bf9a6666_gs_aw3j5devstack@QuobyteHD" returned: 1 in 0.503s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:49:00 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-f9ea9639-8582-47b1-8a0a-92cf1641e092 tempest-VolumeImageDependencyTests-747002242 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2c3d29fb-a781-4c0c-92e3-bd62bf9a6666_gs_aw3j5devstack@QuobyteHD' failed. Not Retrying. {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 22 15:49:00 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-f9ea9639-8582-47b1-8a0a-92cf1641e092 tempest-VolumeImageDependencyTests-747002242 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:49:00 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-f9ea9639-8582-47b1-8a0a-92cf1641e092 tempest-VolumeImageDependencyTests-747002242 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:49:00 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-f9ea9639-8582-47b1-8a0a-92cf1641e092 tempest-VolumeImageDependencyTests-747002242 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:48:57Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65451fb8-9317-4671-8a54-6de55a44ffeb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06a0051fe05a4866a2ca580eb690eb6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:48:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:48:57Z,use_quota=True,user_id='3b926bfc515f498893b7d228340d8e04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)}" {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 15:49:00 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-f9ea9639-8582-47b1-8a0a-92cf1641e092 tempest-VolumeImageDependencyTests-747002242 None] Creating volume 65451fb8-9317-4671-8a54-6de55a44ffeb {{(pid=86212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 15:49:00 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-f9ea9639-8582-47b1-8a0a-92cf1641e092 tempest-VolumeImageDependencyTests-747002242 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:49:00 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-f9ea9639-8582-47b1-8a0a-92cf1641e092 tempest-VolumeImageDependencyTests-747002242 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:49:00 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-f9ea9639-8582-47b1-8a0a-92cf1641e092 tempest-VolumeImageDependencyTests-747002242 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:49:00 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-f9ea9639-8582-47b1-8a0a-92cf1641e092 tempest-VolumeImageDependencyTests-747002242 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:49:00 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-f9ea9639-8582-47b1-8a0a-92cf1641e092 tempest-VolumeImageDependencyTests-747002242 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:49:00 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-f9ea9639-8582-47b1-8a0a-92cf1641e092 tempest-VolumeImageDependencyTests-747002242 None] Selected osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 as target Quobyte volume. {{(pid=86212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 15:49:00 devstack cinder-volume[86212]: INFO cinder.volume.drivers.remotefs [None req-f9ea9639-8582-47b1-8a0a-92cf1641e092 tempest-VolumeImageDependencyTests-747002242 None] casted to osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 Sep 22 15:49:00 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-f9ea9639-8582-47b1-8a0a-92cf1641e092 tempest-VolumeImageDependencyTests-747002242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-65451fb8-9317-4671-8a54-6de55a44ffeb 1073741824 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:49:00 devstack sudo[98597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-65451fb8-9317-4671-8a54-6de55a44ffeb 1073741824 Sep 22 15:49:00 devstack sudo[98597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:49:01 devstack sudo[98597]: pam_unix(sudo:session): session closed for user root Sep 22 15:49:01 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-f9ea9639-8582-47b1-8a0a-92cf1641e092 tempest-VolumeImageDependencyTests-747002242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-65451fb8-9317-4671-8a54-6de55a44ffeb 1073741824" returned: 0 in 1.068s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:49:01 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-f9ea9639-8582-47b1-8a0a-92cf1641e092 tempest-VolumeImageDependencyTests-747002242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-65451fb8-9317-4671-8a54-6de55a44ffeb {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:49:01 devstack sudo[98606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-65451fb8-9317-4671-8a54-6de55a44ffeb Sep 22 15:49:01 devstack sudo[98606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:49:02 devstack sudo[98606]: pam_unix(sudo:session): session closed for user root Sep 22 15:49:02 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-f9ea9639-8582-47b1-8a0a-92cf1641e092 tempest-VolumeImageDependencyTests-747002242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-65451fb8-9317-4671-8a54-6de55a44ffeb" returned: 0 in 0.412s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:49:02 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-f9ea9639-8582-47b1-8a0a-92cf1641e092 tempest-VolumeImageDependencyTests-747002242 None] <== create_volume: return (1603ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'} {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 15:49:02 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-f9ea9639-8582-47b1-8a0a-92cf1641e092 tempest-VolumeImageDependencyTests-747002242 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.606s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:49:02 devstack cinder-volume[86212]: DEBUG cinder.volume.volume_utils [None req-f9ea9639-8582-47b1-8a0a-92cf1641e092 tempest-VolumeImageDependencyTests-747002242 None] Attempting download of 2c3d29fb-a781-4c0c-92e3-bd62bf9a6666 ((None, [{'url': 'file:///opt/stack/data/glance/images/2c3d29fb-a781-4c0c-92e3-bd62bf9a6666', 'metadata': {}}])) to volume 65451fb8-9317-4671-8a54-6de55a44ffeb. {{(pid=86212) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 22 15:49:02 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e504aec-970a-4b82-8c0c-e6516f8ca024]: (4, 'raw') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:49:02 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-f9ea9639-8582-47b1-8a0a-92cf1641e092 tempest-VolumeImageDependencyTests-747002242 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2c3d29fb-a781-4c0c-92e3-bd62bf9a6666_7fc44qm8 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:49:02 devstack sudo[98609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2c3d29fb-a781-4c0c-92e3-bd62bf9a6666_7fc44qm8 Sep 22 15:49:02 devstack sudo[98609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:49:02 devstack sudo[98609]: pam_unix(sudo:session): session closed for user root Sep 22 15:49:02 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-f9ea9639-8582-47b1-8a0a-92cf1641e092 tempest-VolumeImageDependencyTests-747002242 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2c3d29fb-a781-4c0c-92e3-bd62bf9a6666_7fc44qm8" returned: 0 in 0.474s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:49:02 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-f9ea9639-8582-47b1-8a0a-92cf1641e092 tempest-VolumeImageDependencyTests-747002242 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2c3d29fb-a781-4c0c-92e3-bd62bf9a6666_7fc44qm8 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:49:02 devstack sudo[98614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2c3d29fb-a781-4c0c-92e3-bd62bf9a6666_7fc44qm8 Sep 22 15:49:02 devstack sudo[98614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:49:03 devstack sudo[98614]: pam_unix(sudo:session): session closed for user root Sep 22 15:49:03 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-f9ea9639-8582-47b1-8a0a-92cf1641e092 tempest-VolumeImageDependencyTests-747002242 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2c3d29fb-a781-4c0c-92e3-bd62bf9a6666_7fc44qm8" returned: 1 in 0.752s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:49:03 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-f9ea9639-8582-47b1-8a0a-92cf1641e092 tempest-VolumeImageDependencyTests-747002242 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2c3d29fb-a781-4c0c-92e3-bd62bf9a6666_7fc44qm8' failed. Not Retrying. {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 22 15:49:03 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5467847-8d3a-4ec4-a7ad-2294fafdc62e]: (4, 'raw') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:49:03 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-f9ea9639-8582-47b1-8a0a-92cf1641e092 tempest-VolumeImageDependencyTests-747002242 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2c3d29fb-a781-4c0c-92e3-bd62bf9a6666_gs_aw3j5devstack@QuobyteHD {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:49:03 devstack sudo[98618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2c3d29fb-a781-4c0c-92e3-bd62bf9a6666_gs_aw3j5devstack@QuobyteHD Sep 22 15:49:03 devstack sudo[98618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:49:03 devstack sudo[98618]: pam_unix(sudo:session): session closed for user root Sep 22 15:49:03 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-f9ea9639-8582-47b1-8a0a-92cf1641e092 tempest-VolumeImageDependencyTests-747002242 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2c3d29fb-a781-4c0c-92e3-bd62bf9a6666_gs_aw3j5devstack@QuobyteHD" returned: 0 in 0.439s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:49:03 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-f9ea9639-8582-47b1-8a0a-92cf1641e092 tempest-VolumeImageDependencyTests-747002242 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2c3d29fb-a781-4c0c-92e3-bd62bf9a6666_gs_aw3j5devstack@QuobyteHD {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:49:04 devstack sudo[98622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2c3d29fb-a781-4c0c-92e3-bd62bf9a6666_gs_aw3j5devstack@QuobyteHD Sep 22 15:49:04 devstack sudo[98622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:49:04 devstack sudo[98622]: pam_unix(sudo:session): session closed for user root Sep 22 15:49:04 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-f9ea9639-8582-47b1-8a0a-92cf1641e092 tempest-VolumeImageDependencyTests-747002242 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2c3d29fb-a781-4c0c-92e3-bd62bf9a6666_gs_aw3j5devstack@QuobyteHD" returned: 1 in 0.449s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:49:04 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-f9ea9639-8582-47b1-8a0a-92cf1641e092 tempest-VolumeImageDependencyTests-747002242 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2c3d29fb-a781-4c0c-92e3-bd62bf9a6666_gs_aw3j5devstack@QuobyteHD' failed. Not Retrying. {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 22 15:49:04 devstack cinder-volume[86212]: DEBUG cinder.image.image_utils [None req-f9ea9639-8582-47b1-8a0a-92cf1641e092 tempest-VolumeImageDependencyTests-747002242 None] 2c3d29fb-a781-4c0c-92e3-bd62bf9a6666 was raw, converting to qcow2 {{(pid=86212) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 22 15:49:04 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-f9ea9639-8582-47b1-8a0a-92cf1641e092 tempest-VolumeImageDependencyTests-747002242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_2c3d29fb-a781-4c0c-92e3-bd62bf9a6666_gs_aw3j5devstack@QuobyteHD /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-65451fb8-9317-4671-8a54-6de55a44ffeb {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:49:04 devstack sudo[98628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_2c3d29fb-a781-4c0c-92e3-bd62bf9a6666_gs_aw3j5devstack@QuobyteHD /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-65451fb8-9317-4671-8a54-6de55a44ffeb Sep 22 15:49:04 devstack sudo[98628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:49:05 devstack sudo[98628]: pam_unix(sudo:session): session closed for user root Sep 22 15:49:05 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-f9ea9639-8582-47b1-8a0a-92cf1641e092 tempest-VolumeImageDependencyTests-747002242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_2c3d29fb-a781-4c0c-92e3-bd62bf9a6666_gs_aw3j5devstack@QuobyteHD /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-65451fb8-9317-4671-8a54-6de55a44ffeb" returned: 0 in 0.738s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:49:05 devstack cinder-volume[86212]: DEBUG cinder.image.image_utils [None req-f9ea9639-8582-47b1-8a0a-92cf1641e092 tempest-VolumeImageDependencyTests-747002242 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_2c3d29fb-a781-4c0c-92e3-bd62bf9a6666_gs_aw3j5devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-65451fb8-9317-4671-8a54-6de55a44ffeb {{(pid=86212) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 22 15:49:05 devstack cinder-volume[86212]: INFO cinder.image.image_utils [None req-f9ea9639-8582-47b1-8a0a-92cf1641e092 tempest-VolumeImageDependencyTests-747002242 None] Converted 0.00 MB image at 0.00 MB/s Sep 22 15:49:05 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-f9ea9639-8582-47b1-8a0a-92cf1641e092 tempest-VolumeImageDependencyTests-747002242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-65451fb8-9317-4671-8a54-6de55a44ffeb 1G {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:49:05 devstack sudo[98635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-65451fb8-9317-4671-8a54-6de55a44ffeb 1G Sep 22 15:49:05 devstack sudo[98635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:49:05 devstack sudo[98635]: pam_unix(sudo:session): session closed for user root Sep 22 15:49:05 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-f9ea9639-8582-47b1-8a0a-92cf1641e092 tempest-VolumeImageDependencyTests-747002242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-65451fb8-9317-4671-8a54-6de55a44ffeb 1G" returned: 0 in 0.639s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:49:05 devstack cinder-volume[86212]: DEBUG cinder.volume.volume_utils [None req-f9ea9639-8582-47b1-8a0a-92cf1641e092 tempest-VolumeImageDependencyTests-747002242 None] Downloaded image 2c3d29fb-a781-4c0c-92e3-bd62bf9a6666 ((None, [{'url': 'file:///opt/stack/data/glance/images/2c3d29fb-a781-4c0c-92e3-bd62bf9a6666', 'metadata': {}}])) to volume 65451fb8-9317-4671-8a54-6de55a44ffeb successfully. {{(pid=86212) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 22 15:49:05 devstack cinder-volume[86212]: DEBUG cinder.image.image_utils [None req-f9ea9639-8582-47b1-8a0a-92cf1641e092 tempest-VolumeImageDependencyTests-747002242 None] Temporary image 2c3d29fb-a781-4c0c-92e3-bd62bf9a6666 for user 3b926bfc515f498893b7d228340d8e04 is deleted. {{(pid=86212) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 22 15:49:05 devstack cinder-volume[86212]: DEBUG cinder.volume.volume_utils [None req-f9ea9639-8582-47b1-8a0a-92cf1641e092 tempest-VolumeImageDependencyTests-747002242 None] Marking volume 65451fb8-9317-4671-8a54-6de55a44ffeb as bootable. {{(pid=86212) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 22 15:49:05 devstack cinder-volume[86212]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9ea9639-8582-47b1-8a0a-92cf1641e092 tempest-VolumeImageDependencyTests-747002242 None] Copying metadata from image 2c3d29fb-a781-4c0c-92e3-bd62bf9a6666 to 65451fb8-9317-4671-8a54-6de55a44ffeb. {{(pid=86212) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 22 15:49:05 devstack cinder-volume[86212]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9ea9639-8582-47b1-8a0a-92cf1641e092 tempest-VolumeImageDependencyTests-747002242 None] Creating volume glance metadata for volume 65451fb8-9317-4671-8a54-6de55a44ffeb backed by image 2c3d29fb-a781-4c0c-92e3-bd62bf9a6666 with: {'image_id': '2c3d29fb-a781-4c0c-92e3-bd62bf9a6666', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '2ee3e7ee883781f29c545c296c2ef352', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86212) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 22 15:49:05 devstack cinder-volume[86212]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a58748b-4a4d-4249-b8cc-c1495ad39b75 tempest-VolumesListTestJSON-2098048748 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 15:49:05 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-0a58748b-4a4d-4249-b8cc-c1495ad39b75 tempest-VolumesListTestJSON-2098048748 None] Flow 'volume_create_manager' (4427c779-155c-4c59-9f3d-339265e7eff2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:49:05 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-0a58748b-4a4d-4249-b8cc-c1495ad39b75 tempest-VolumesListTestJSON-2098048748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f05ef51-c4e9-4c05-b462-77ed9420bea0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:49:05 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-0a58748b-4a4d-4249-b8cc-c1495ad39b75 tempest-VolumesListTestJSON-2098048748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f05ef51-c4e9-4c05-b462-77ed9420bea0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:49:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-979508303',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0364c82f-ce62-4dd3-829d-0f3524b2cce6,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8b6613f8c4974768b913feb238f6564a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:49:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:49:06Z,use_quota=True,user_id='2be4f95f45c74a41b934e1cd809a1d08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:49:05 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-0a58748b-4a4d-4249-b8cc-c1495ad39b75 tempest-VolumesListTestJSON-2098048748 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da8c228d-fa96-4aad-8967-9a625872222c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:49:05 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-0a58748b-4a4d-4249-b8cc-c1495ad39b75 tempest-VolumesListTestJSON-2098048748 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da8c228d-fa96-4aad-8967-9a625872222c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:49:05 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-0a58748b-4a4d-4249-b8cc-c1495ad39b75 tempest-VolumesListTestJSON-2098048748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b0fe6ca-b73e-4629-92e1-1f9b89b93c98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:49:05 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-0a58748b-4a4d-4249-b8cc-c1495ad39b75 tempest-VolumesListTestJSON-2098048748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b0fe6ca-b73e-4629-92e1-1f9b89b93c98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0364c82f-ce62-4dd3-829d-0f3524b2cce6', 'volume_name': 'volume-0364c82f-ce62-4dd3-829d-0f3524b2cce6', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:49:05 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-0a58748b-4a4d-4249-b8cc-c1495ad39b75 tempest-VolumesListTestJSON-2098048748 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f13cc91-ec1d-46a7-8f56-a2db79d52517) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:49:05 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-0a58748b-4a4d-4249-b8cc-c1495ad39b75 tempest-VolumesListTestJSON-2098048748 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f13cc91-ec1d-46a7-8f56-a2db79d52517) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:49:05 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-0a58748b-4a4d-4249-b8cc-c1495ad39b75 tempest-VolumesListTestJSON-2098048748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a12bbf8-4bfe-47c6-8e0b-bbe40b6daed8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:49:05 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-0a58748b-4a4d-4249-b8cc-c1495ad39b75 tempest-VolumesListTestJSON-2098048748 None] Volume 0364c82f-ce62-4dd3-829d-0f3524b2cce6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0364c82f-ce62-4dd3-829d-0f3524b2cce6', 'volume_size': 1} Sep 22 15:49:05 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-0a58748b-4a4d-4249-b8cc-c1495ad39b75 tempest-VolumesListTestJSON-2098048748 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:49:05 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-0a58748b-4a4d-4249-b8cc-c1495ad39b75 tempest-VolumesListTestJSON-2098048748 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:49:05 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-0a58748b-4a4d-4249-b8cc-c1495ad39b75 tempest-VolumesListTestJSON-2098048748 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:49:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-979508303',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0364c82f-ce62-4dd3-829d-0f3524b2cce6,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8b6613f8c4974768b913feb238f6564a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:49:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:49:06Z,use_quota=True,user_id='2be4f95f45c74a41b934e1cd809a1d08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)}" {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 15:49:05 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-0a58748b-4a4d-4249-b8cc-c1495ad39b75 tempest-VolumesListTestJSON-2098048748 None] Creating volume 0364c82f-ce62-4dd3-829d-0f3524b2cce6 {{(pid=86212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 15:49:05 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-0a58748b-4a4d-4249-b8cc-c1495ad39b75 tempest-VolumesListTestJSON-2098048748 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:49:05 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-0a58748b-4a4d-4249-b8cc-c1495ad39b75 tempest-VolumesListTestJSON-2098048748 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:49:05 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-0a58748b-4a4d-4249-b8cc-c1495ad39b75 tempest-VolumesListTestJSON-2098048748 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:49:05 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-0a58748b-4a4d-4249-b8cc-c1495ad39b75 tempest-VolumesListTestJSON-2098048748 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:49:05 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-0a58748b-4a4d-4249-b8cc-c1495ad39b75 tempest-VolumesListTestJSON-2098048748 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:49:05 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-0a58748b-4a4d-4249-b8cc-c1495ad39b75 tempest-VolumesListTestJSON-2098048748 None] Selected osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 as target Quobyte volume. {{(pid=86212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 15:49:05 devstack cinder-volume[86212]: INFO cinder.volume.drivers.remotefs [None req-0a58748b-4a4d-4249-b8cc-c1495ad39b75 tempest-VolumesListTestJSON-2098048748 None] casted to osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 Sep 22 15:49:05 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-0a58748b-4a4d-4249-b8cc-c1495ad39b75 tempest-VolumesListTestJSON-2098048748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-0364c82f-ce62-4dd3-829d-0f3524b2cce6 1073741824 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:49:06 devstack sudo[98642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-0364c82f-ce62-4dd3-829d-0f3524b2cce6 1073741824 Sep 22 15:49:06 devstack sudo[98642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:49:06 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-f9ea9639-8582-47b1-8a0a-92cf1641e092 tempest-VolumeImageDependencyTests-747002242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c48929e8-5516-42e2-969d-b8246a1e4311) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-65451fb8-9317-4671-8a54-6de55a44ffeb', 'volume_size': 1, 'image_id': '2c3d29fb-a781-4c0c-92e3-bd62bf9a6666', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2c3d29fb-a781-4c0c-92e3-bd62bf9a6666', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '2ee3e7ee883781f29c545c296c2ef352', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '06a0051fe05a4866a2ca580eb690eb6b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '267c313513ace89f4d5308e78c97632edd0e9a8729f6f127adf000cc17a5d8eee177749c7af5ad80365423b307b5feaa9285cc469bba7870e94028030c023eee', 'id': '2c3d29fb-a781-4c0c-92e3-bd62bf9a6666', 'created_at': datetime.datetime(2026, 9, 22, 13, 48, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 13, 48, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2c3d29fb-a781-4c0c-92e3-bd62bf9a6666/file', 'properties': {}}, 'image_service': }' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:49:06 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-f9ea9639-8582-47b1-8a0a-92cf1641e092 tempest-VolumeImageDependencyTests-747002242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8904174-7303-4432-afb3-50cf2dedf19c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:49:06 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-f9ea9639-8582-47b1-8a0a-92cf1641e092 tempest-VolumeImageDependencyTests-747002242 None] Volume volume-65451fb8-9317-4671-8a54-6de55a44ffeb (65451fb8-9317-4671-8a54-6de55a44ffeb): created successfully Sep 22 15:49:06 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-f9ea9639-8582-47b1-8a0a-92cf1641e092 tempest-VolumeImageDependencyTests-747002242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8904174-7303-4432-afb3-50cf2dedf19c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:49:06 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-f9ea9639-8582-47b1-8a0a-92cf1641e092 tempest-VolumeImageDependencyTests-747002242 None] Flow 'volume_create_manager' (b49dc054-2a89-4ca6-a8c9-bb8f9fa37c3b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:49:06 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-f9ea9639-8582-47b1-8a0a-92cf1641e092 tempest-VolumeImageDependencyTests-747002242 None] Created volume successfully. Sep 22 15:49:06 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-dc68409c-983e-4d99-bb71-3cdff9e92fe6 tempest-VolumeImageDependencyTests-747002242 None] Acquiring lock "cinder-65451fb8-9317-4671-8a54-6de55a44ffeb-delete_volume" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:49:06 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-dc68409c-983e-4d99-bb71-3cdff9e92fe6 tempest-VolumeImageDependencyTests-747002242 None] Lock "cinder-65451fb8-9317-4671-8a54-6de55a44ffeb-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:49:06 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-dc68409c-983e-4d99-bb71-3cdff9e92fe6 tempest-VolumeImageDependencyTests-747002242 None] Acquiring lock "cinder-quobyte-65451fb8-9317-4671-8a54-6de55a44ffeb" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:49:06 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-dc68409c-983e-4d99-bb71-3cdff9e92fe6 tempest-VolumeImageDependencyTests-747002242 None] Lock "cinder-quobyte-65451fb8-9317-4671-8a54-6de55a44ffeb" acquired by "delete_volume" :: waited 0.029s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:49:06 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[afd3d510-da52-475f-95ba-cdb593ff5eed]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:49:06 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-dc68409c-983e-4d99-bb71-3cdff9e92fe6 tempest-VolumeImageDependencyTests-747002242 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-65451fb8-9317-4671-8a54-6de55a44ffeb {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:49:06 devstack sudo[98648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-65451fb8-9317-4671-8a54-6de55a44ffeb Sep 22 15:49:06 devstack sudo[98648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:49:06 devstack sudo[98642]: pam_unix(sudo:session): session closed for user root Sep 22 15:49:06 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-0a58748b-4a4d-4249-b8cc-c1495ad39b75 tempest-VolumesListTestJSON-2098048748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-0364c82f-ce62-4dd3-829d-0f3524b2cce6 1073741824" returned: 0 in 0.738s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:49:06 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-0a58748b-4a4d-4249-b8cc-c1495ad39b75 tempest-VolumesListTestJSON-2098048748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-0364c82f-ce62-4dd3-829d-0f3524b2cce6 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:49:06 devstack sudo[98650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-0364c82f-ce62-4dd3-829d-0f3524b2cce6 Sep 22 15:49:06 devstack sudo[98650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:49:07 devstack sudo[98648]: pam_unix(sudo:session): session closed for user root Sep 22 15:49:07 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-dc68409c-983e-4d99-bb71-3cdff9e92fe6 tempest-VolumeImageDependencyTests-747002242 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-65451fb8-9317-4671-8a54-6de55a44ffeb" returned: 0 in 0.507s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:49:07 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-dc68409c-983e-4d99-bb71-3cdff9e92fe6 tempest-VolumeImageDependencyTests-747002242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-65451fb8-9317-4671-8a54-6de55a44ffeb {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:49:07 devstack sudo[98650]: pam_unix(sudo:session): session closed for user root Sep 22 15:49:07 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-0a58748b-4a4d-4249-b8cc-c1495ad39b75 tempest-VolumesListTestJSON-2098048748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-0364c82f-ce62-4dd3-829d-0f3524b2cce6" returned: 0 in 0.337s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:49:07 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-0a58748b-4a4d-4249-b8cc-c1495ad39b75 tempest-VolumesListTestJSON-2098048748 None] <== create_volume: return (1137ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'} {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 15:49:07 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-0a58748b-4a4d-4249-b8cc-c1495ad39b75 tempest-VolumesListTestJSON-2098048748 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.139s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:49:07 devstack sudo[98656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-65451fb8-9317-4671-8a54-6de55a44ffeb Sep 22 15:49:07 devstack sudo[98656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:49:07 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-0a58748b-4a4d-4249-b8cc-c1495ad39b75 tempest-VolumesListTestJSON-2098048748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a12bbf8-4bfe-47c6-8e0b-bbe40b6daed8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0364c82f-ce62-4dd3-829d-0f3524b2cce6', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:49:07 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-0a58748b-4a4d-4249-b8cc-c1495ad39b75 tempest-VolumesListTestJSON-2098048748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7d6b27a-9f44-4c08-b918-3519a66f91c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:49:07 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-0a58748b-4a4d-4249-b8cc-c1495ad39b75 tempest-VolumesListTestJSON-2098048748 None] Volume volume-0364c82f-ce62-4dd3-829d-0f3524b2cce6 (0364c82f-ce62-4dd3-829d-0f3524b2cce6): created successfully Sep 22 15:49:07 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-0a58748b-4a4d-4249-b8cc-c1495ad39b75 tempest-VolumesListTestJSON-2098048748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7d6b27a-9f44-4c08-b918-3519a66f91c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:49:07 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-0a58748b-4a4d-4249-b8cc-c1495ad39b75 tempest-VolumesListTestJSON-2098048748 None] Flow 'volume_create_manager' (4427c779-155c-4c59-9f3d-339265e7eff2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:49:07 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-0a58748b-4a4d-4249-b8cc-c1495ad39b75 tempest-VolumesListTestJSON-2098048748 None] Created volume successfully. Sep 22 15:49:07 devstack sudo[98656]: pam_unix(sudo:session): session closed for user root Sep 22 15:49:07 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-dc68409c-983e-4d99-bb71-3cdff9e92fe6 tempest-VolumeImageDependencyTests-747002242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-65451fb8-9317-4671-8a54-6de55a44ffeb" returned: 0 in 0.272s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:49:07 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-dc68409c-983e-4d99-bb71-3cdff9e92fe6 tempest-VolumeImageDependencyTests-747002242 None] Lock "cinder-quobyte-65451fb8-9317-4671-8a54-6de55a44ffeb" released by "delete_volume" :: held 0.849s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:49:07 devstack cinder-volume[86212]: DEBUG cinder.quota [None req-dc68409c-983e-4d99-bb71-3cdff9e92fe6 tempest-VolumeImageDependencyTests-747002242 None] Created reservations ['a6a5cd47-9455-47c7-a187-71a25baf58ed', '50bcfd04-3b5e-4452-9850-145d39397d0f', 'b2954dca-d262-4e04-8500-6b49c053d2ba', 'd579dacc-71b0-402b-8fd2-1137fbb0b7e3'] {{(pid=86212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 15:49:07 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-dc68409c-983e-4d99-bb71-3cdff9e92fe6 tempest-VolumeImageDependencyTests-747002242 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:49:07 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-dc68409c-983e-4d99-bb71-3cdff9e92fe6 tempest-VolumeImageDependencyTests-747002242 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:49:07 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-dc68409c-983e-4d99-bb71-3cdff9e92fe6 tempest-VolumeImageDependencyTests-747002242 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:49:07 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-dc68409c-983e-4d99-bb71-3cdff9e92fe6 tempest-VolumeImageDependencyTests-747002242 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:49:07 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-dc68409c-983e-4d99-bb71-3cdff9e92fe6 tempest-VolumeImageDependencyTests-747002242 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:49:07 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-dc68409c-983e-4d99-bb71-3cdff9e92fe6 tempest-VolumeImageDependencyTests-747002242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:49:07 devstack sudo[98659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc Sep 22 15:49:07 devstack sudo[98659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:49:07 devstack sudo[98659]: pam_unix(sudo:session): session closed for user root Sep 22 15:49:07 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-dc68409c-983e-4d99-bb71-3cdff9e92fe6 tempest-VolumeImageDependencyTests-747002242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc" returned: 0 in 0.384s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:49:07 devstack cinder-volume[86212]: DEBUG cinder.manager [None req-dc68409c-983e-4d99-bb71-3cdff9e92fe6 tempest-VolumeImageDependencyTests-747002242 None] Notifying Schedulers of capabilities ... {{(pid=86212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 15:49:07 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-dc68409c-983e-4d99-bb71-3cdff9e92fe6 tempest-VolumeImageDependencyTests-747002242 None] Deleted volume successfully. Sep 22 15:49:07 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-dc68409c-983e-4d99-bb71-3cdff9e92fe6 tempest-VolumeImageDependencyTests-747002242 None] Lock "cinder-65451fb8-9317-4671-8a54-6de55a44ffeb-delete_volume" released by "delete_volume" :: held 1.492s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:49:08 devstack cinder-volume[86212]: DEBUG cinder.volume.flows.manager.create_volume [None req-93f71295-c3f7-4958-b7a7-fa19c18be32c tempest-VolumesListTestJSON-2098048748 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 15:49:08 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-93f71295-c3f7-4958-b7a7-fa19c18be32c tempest-VolumesListTestJSON-2098048748 None] Flow 'volume_create_manager' (ff3a76c8-18ef-46f3-ab66-f3cc80813c84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:49:08 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-93f71295-c3f7-4958-b7a7-fa19c18be32c tempest-VolumesListTestJSON-2098048748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ddb6ee47-38fc-4e99-adbe-bc034995ab4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:49:08 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-93f71295-c3f7-4958-b7a7-fa19c18be32c tempest-VolumesListTestJSON-2098048748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ddb6ee47-38fc-4e99-adbe-bc034995ab4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:49:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-412443877',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac9778e2-4f66-495d-aa67-e561024b773c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8b6613f8c4974768b913feb238f6564a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:49:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:49:09Z,use_quota=True,user_id='2be4f95f45c74a41b934e1cd809a1d08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:49:08 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-93f71295-c3f7-4958-b7a7-fa19c18be32c tempest-VolumesListTestJSON-2098048748 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a725f565-6f6b-4055-b3be-4152d210da9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:49:08 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-93f71295-c3f7-4958-b7a7-fa19c18be32c tempest-VolumesListTestJSON-2098048748 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a725f565-6f6b-4055-b3be-4152d210da9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:49:08 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-93f71295-c3f7-4958-b7a7-fa19c18be32c tempest-VolumesListTestJSON-2098048748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20db1441-8cdc-4f6d-a202-079da93c1563) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:49:08 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-93f71295-c3f7-4958-b7a7-fa19c18be32c tempest-VolumesListTestJSON-2098048748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20db1441-8cdc-4f6d-a202-079da93c1563) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ac9778e2-4f66-495d-aa67-e561024b773c', 'volume_name': 'volume-ac9778e2-4f66-495d-aa67-e561024b773c', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:49:08 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-93f71295-c3f7-4958-b7a7-fa19c18be32c tempest-VolumesListTestJSON-2098048748 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30fed7c1-68c4-4d31-bbfd-5b0bab8a3fca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:49:08 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-93f71295-c3f7-4958-b7a7-fa19c18be32c tempest-VolumesListTestJSON-2098048748 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30fed7c1-68c4-4d31-bbfd-5b0bab8a3fca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:49:08 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-93f71295-c3f7-4958-b7a7-fa19c18be32c tempest-VolumesListTestJSON-2098048748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2a795bb-7ef3-48fc-8796-51cfb81ce18b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:49:08 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-93f71295-c3f7-4958-b7a7-fa19c18be32c tempest-VolumesListTestJSON-2098048748 None] Volume ac9778e2-4f66-495d-aa67-e561024b773c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ac9778e2-4f66-495d-aa67-e561024b773c', 'volume_size': 1} Sep 22 15:49:08 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-93f71295-c3f7-4958-b7a7-fa19c18be32c tempest-VolumesListTestJSON-2098048748 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:49:08 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-93f71295-c3f7-4958-b7a7-fa19c18be32c tempest-VolumesListTestJSON-2098048748 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:49:08 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-93f71295-c3f7-4958-b7a7-fa19c18be32c tempest-VolumesListTestJSON-2098048748 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:49:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-412443877',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac9778e2-4f66-495d-aa67-e561024b773c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8b6613f8c4974768b913feb238f6564a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:49:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:49:09Z,use_quota=True,user_id='2be4f95f45c74a41b934e1cd809a1d08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)}" {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 15:49:08 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-93f71295-c3f7-4958-b7a7-fa19c18be32c tempest-VolumesListTestJSON-2098048748 None] Creating volume ac9778e2-4f66-495d-aa67-e561024b773c {{(pid=86212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 15:49:08 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-93f71295-c3f7-4958-b7a7-fa19c18be32c tempest-VolumesListTestJSON-2098048748 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:49:08 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-93f71295-c3f7-4958-b7a7-fa19c18be32c tempest-VolumesListTestJSON-2098048748 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:49:08 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-93f71295-c3f7-4958-b7a7-fa19c18be32c tempest-VolumesListTestJSON-2098048748 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:49:08 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-93f71295-c3f7-4958-b7a7-fa19c18be32c tempest-VolumesListTestJSON-2098048748 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:49:08 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-93f71295-c3f7-4958-b7a7-fa19c18be32c tempest-VolumesListTestJSON-2098048748 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:49:08 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-93f71295-c3f7-4958-b7a7-fa19c18be32c tempest-VolumesListTestJSON-2098048748 None] Selected osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 as target Quobyte volume. {{(pid=86212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 15:49:08 devstack cinder-volume[86212]: INFO cinder.volume.drivers.remotefs [None req-93f71295-c3f7-4958-b7a7-fa19c18be32c tempest-VolumesListTestJSON-2098048748 None] casted to osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 Sep 22 15:49:08 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-93f71295-c3f7-4958-b7a7-fa19c18be32c tempest-VolumesListTestJSON-2098048748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-ac9778e2-4f66-495d-aa67-e561024b773c 1073741824 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:49:08 devstack sudo[98663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-ac9778e2-4f66-495d-aa67-e561024b773c 1073741824 Sep 22 15:49:08 devstack sudo[98663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:49:09 devstack sudo[98663]: pam_unix(sudo:session): session closed for user root Sep 22 15:49:09 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-93f71295-c3f7-4958-b7a7-fa19c18be32c tempest-VolumesListTestJSON-2098048748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-ac9778e2-4f66-495d-aa67-e561024b773c 1073741824" returned: 0 in 0.604s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:49:09 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-93f71295-c3f7-4958-b7a7-fa19c18be32c tempest-VolumesListTestJSON-2098048748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-ac9778e2-4f66-495d-aa67-e561024b773c {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:49:09 devstack sudo[98669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-ac9778e2-4f66-495d-aa67-e561024b773c Sep 22 15:49:09 devstack sudo[98669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:49:09 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-540a7495-313b-40bf-8f0f-dedd60d06056 tempest-VolumesNegativeTest-1392661253 None] Acquiring lock "cinder-d3ddb034-c551-4321-a9fd-164572a30565-delete_volume" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:49:10 devstack sudo[98669]: pam_unix(sudo:session): session closed for user root Sep 22 15:49:10 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-93f71295-c3f7-4958-b7a7-fa19c18be32c tempest-VolumesListTestJSON-2098048748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-ac9778e2-4f66-495d-aa67-e561024b773c" returned: 0 in 0.467s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:49:10 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-93f71295-c3f7-4958-b7a7-fa19c18be32c tempest-VolumesListTestJSON-2098048748 None] <== create_volume: return (1155ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'} {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 15:49:10 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-93f71295-c3f7-4958-b7a7-fa19c18be32c tempest-VolumesListTestJSON-2098048748 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.158s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:49:10 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-540a7495-313b-40bf-8f0f-dedd60d06056 tempest-VolumesNegativeTest-1392661253 None] Lock "cinder-d3ddb034-c551-4321-a9fd-164572a30565-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:49:10 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-93f71295-c3f7-4958-b7a7-fa19c18be32c tempest-VolumesListTestJSON-2098048748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2a795bb-7ef3-48fc-8796-51cfb81ce18b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac9778e2-4f66-495d-aa67-e561024b773c', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:49:10 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-93f71295-c3f7-4958-b7a7-fa19c18be32c tempest-VolumesListTestJSON-2098048748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9e7a500-a311-46fa-92ae-e06016087a1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:49:10 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-93f71295-c3f7-4958-b7a7-fa19c18be32c tempest-VolumesListTestJSON-2098048748 None] Volume volume-ac9778e2-4f66-495d-aa67-e561024b773c (ac9778e2-4f66-495d-aa67-e561024b773c): created successfully Sep 22 15:49:10 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-93f71295-c3f7-4958-b7a7-fa19c18be32c tempest-VolumesListTestJSON-2098048748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9e7a500-a311-46fa-92ae-e06016087a1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:49:10 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-93f71295-c3f7-4958-b7a7-fa19c18be32c tempest-VolumesListTestJSON-2098048748 None] Flow 'volume_create_manager' (ff3a76c8-18ef-46f3-ab66-f3cc80813c84) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:49:10 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-93f71295-c3f7-4958-b7a7-fa19c18be32c tempest-VolumesListTestJSON-2098048748 None] Created volume successfully. Sep 22 15:49:10 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-540a7495-313b-40bf-8f0f-dedd60d06056 tempest-VolumesNegativeTest-1392661253 None] Acquiring lock "cinder-quobyte-d3ddb034-c551-4321-a9fd-164572a30565" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:49:10 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-540a7495-313b-40bf-8f0f-dedd60d06056 tempest-VolumesNegativeTest-1392661253 None] Lock "cinder-quobyte-d3ddb034-c551-4321-a9fd-164572a30565" acquired by "delete_volume" :: waited 0.020s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:49:10 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[c78fa97f-0ec4-44d3-90f8-7f255622fc7f]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:49:10 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-540a7495-313b-40bf-8f0f-dedd60d06056 tempest-VolumesNegativeTest-1392661253 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-d3ddb034-c551-4321-a9fd-164572a30565 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:49:10 devstack sudo[98672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-d3ddb034-c551-4321-a9fd-164572a30565 Sep 22 15:49:10 devstack sudo[98672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:49:10 devstack sudo[98672]: pam_unix(sudo:session): session closed for user root Sep 22 15:49:10 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-540a7495-313b-40bf-8f0f-dedd60d06056 tempest-VolumesNegativeTest-1392661253 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-d3ddb034-c551-4321-a9fd-164572a30565" returned: 0 in 0.456s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:49:10 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-540a7495-313b-40bf-8f0f-dedd60d06056 tempest-VolumesNegativeTest-1392661253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-d3ddb034-c551-4321-a9fd-164572a30565 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:49:10 devstack sudo[98678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-d3ddb034-c551-4321-a9fd-164572a30565 Sep 22 15:49:10 devstack sudo[98678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:49:10 devstack sudo[98678]: pam_unix(sudo:session): session closed for user root Sep 22 15:49:10 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-540a7495-313b-40bf-8f0f-dedd60d06056 tempest-VolumesNegativeTest-1392661253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-d3ddb034-c551-4321-a9fd-164572a30565" returned: 0 in 0.296s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:49:10 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-540a7495-313b-40bf-8f0f-dedd60d06056 tempest-VolumesNegativeTest-1392661253 None] Lock "cinder-quobyte-d3ddb034-c551-4321-a9fd-164572a30565" released by "delete_volume" :: held 0.827s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:49:11 devstack cinder-volume[86212]: DEBUG cinder.quota [None req-540a7495-313b-40bf-8f0f-dedd60d06056 tempest-VolumesNegativeTest-1392661253 None] Created reservations ['69a1f142-cd12-4227-99bd-08d42b403324', '8eef3f16-a6de-4ccb-b162-e67cbe2ece9b', 'b5edc7c2-a2c2-4428-b5c7-8ca9059e1ba8', 'fa9a3188-52ab-4e2a-a386-b6057b3eed95'] {{(pid=86212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 15:49:11 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-540a7495-313b-40bf-8f0f-dedd60d06056 tempest-VolumesNegativeTest-1392661253 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:49:11 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-540a7495-313b-40bf-8f0f-dedd60d06056 tempest-VolumesNegativeTest-1392661253 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:49:11 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-540a7495-313b-40bf-8f0f-dedd60d06056 tempest-VolumesNegativeTest-1392661253 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:49:11 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-540a7495-313b-40bf-8f0f-dedd60d06056 tempest-VolumesNegativeTest-1392661253 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:49:11 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-540a7495-313b-40bf-8f0f-dedd60d06056 tempest-VolumesNegativeTest-1392661253 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:49:11 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-540a7495-313b-40bf-8f0f-dedd60d06056 tempest-VolumesNegativeTest-1392661253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:49:11 devstack sudo[98681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc Sep 22 15:49:11 devstack sudo[98681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:49:11 devstack sudo[98681]: pam_unix(sudo:session): session closed for user root Sep 22 15:49:11 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-540a7495-313b-40bf-8f0f-dedd60d06056 tempest-VolumesNegativeTest-1392661253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc" returned: 0 in 0.399s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:49:11 devstack cinder-volume[86212]: DEBUG cinder.manager [None req-540a7495-313b-40bf-8f0f-dedd60d06056 tempest-VolumesNegativeTest-1392661253 None] Notifying Schedulers of capabilities ... {{(pid=86212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 15:49:11 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-540a7495-313b-40bf-8f0f-dedd60d06056 tempest-VolumesNegativeTest-1392661253 None] Deleted volume successfully. Sep 22 15:49:11 devstack cinder-volume[86212]: DEBUG cinder.volume.flows.manager.create_volume [None req-48f95694-bcf0-4788-a5d4-c9d9b19013fa tempest-VolumesListTestJSON-2098048748 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 15:49:11 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-48f95694-bcf0-4788-a5d4-c9d9b19013fa tempest-VolumesListTestJSON-2098048748 None] Flow 'volume_create_manager' (8b6647d3-84e1-4f04-9b92-f6df68341b3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:49:11 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-48f95694-bcf0-4788-a5d4-c9d9b19013fa tempest-VolumesListTestJSON-2098048748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (feec76a6-f465-4c38-9b2f-409ec47b37e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:49:11 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-48f95694-bcf0-4788-a5d4-c9d9b19013fa tempest-VolumesListTestJSON-2098048748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (feec76a6-f465-4c38-9b2f-409ec47b37e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:49:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-181163156',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=693d9405-40b6-4b85-b7e4-79cb8c7e431e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8b6613f8c4974768b913feb238f6564a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:49:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:49:12Z,use_quota=True,user_id='2be4f95f45c74a41b934e1cd809a1d08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:49:11 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-48f95694-bcf0-4788-a5d4-c9d9b19013fa tempest-VolumesListTestJSON-2098048748 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd451d63-7339-4302-be3f-5e55fb403806) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:49:11 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-48f95694-bcf0-4788-a5d4-c9d9b19013fa tempest-VolumesListTestJSON-2098048748 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd451d63-7339-4302-be3f-5e55fb403806) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:49:11 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-48f95694-bcf0-4788-a5d4-c9d9b19013fa tempest-VolumesListTestJSON-2098048748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2e2e063-dc4e-498e-b043-4b316302cd23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:49:11 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-48f95694-bcf0-4788-a5d4-c9d9b19013fa tempest-VolumesListTestJSON-2098048748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2e2e063-dc4e-498e-b043-4b316302cd23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '693d9405-40b6-4b85-b7e4-79cb8c7e431e', 'volume_name': 'volume-693d9405-40b6-4b85-b7e4-79cb8c7e431e', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:49:11 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-48f95694-bcf0-4788-a5d4-c9d9b19013fa tempest-VolumesListTestJSON-2098048748 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a73d0f8-5366-492e-9845-d9b3d5bd215b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:49:11 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-48f95694-bcf0-4788-a5d4-c9d9b19013fa tempest-VolumesListTestJSON-2098048748 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a73d0f8-5366-492e-9845-d9b3d5bd215b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:49:11 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-48f95694-bcf0-4788-a5d4-c9d9b19013fa tempest-VolumesListTestJSON-2098048748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0169aa6-14f3-4c25-92d4-b9f868f5a72e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:49:11 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-48f95694-bcf0-4788-a5d4-c9d9b19013fa tempest-VolumesListTestJSON-2098048748 None] Volume 693d9405-40b6-4b85-b7e4-79cb8c7e431e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-693d9405-40b6-4b85-b7e4-79cb8c7e431e', 'volume_size': 1} Sep 22 15:49:11 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-48f95694-bcf0-4788-a5d4-c9d9b19013fa tempest-VolumesListTestJSON-2098048748 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:49:11 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-48f95694-bcf0-4788-a5d4-c9d9b19013fa tempest-VolumesListTestJSON-2098048748 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:49:11 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-48f95694-bcf0-4788-a5d4-c9d9b19013fa tempest-VolumesListTestJSON-2098048748 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:49:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-181163156',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=693d9405-40b6-4b85-b7e4-79cb8c7e431e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8b6613f8c4974768b913feb238f6564a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:49:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:49:12Z,use_quota=True,user_id='2be4f95f45c74a41b934e1cd809a1d08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)}" {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 15:49:11 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-48f95694-bcf0-4788-a5d4-c9d9b19013fa tempest-VolumesListTestJSON-2098048748 None] Creating volume 693d9405-40b6-4b85-b7e4-79cb8c7e431e {{(pid=86212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 15:49:11 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-48f95694-bcf0-4788-a5d4-c9d9b19013fa tempest-VolumesListTestJSON-2098048748 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:49:11 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-48f95694-bcf0-4788-a5d4-c9d9b19013fa tempest-VolumesListTestJSON-2098048748 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:49:11 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-48f95694-bcf0-4788-a5d4-c9d9b19013fa tempest-VolumesListTestJSON-2098048748 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:49:11 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-48f95694-bcf0-4788-a5d4-c9d9b19013fa tempest-VolumesListTestJSON-2098048748 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:49:11 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-48f95694-bcf0-4788-a5d4-c9d9b19013fa tempest-VolumesListTestJSON-2098048748 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:49:11 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-48f95694-bcf0-4788-a5d4-c9d9b19013fa tempest-VolumesListTestJSON-2098048748 None] Selected osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 as target Quobyte volume. {{(pid=86212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 15:49:11 devstack cinder-volume[86212]: INFO cinder.volume.drivers.remotefs [None req-48f95694-bcf0-4788-a5d4-c9d9b19013fa tempest-VolumesListTestJSON-2098048748 None] casted to osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 Sep 22 15:49:11 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-48f95694-bcf0-4788-a5d4-c9d9b19013fa tempest-VolumesListTestJSON-2098048748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-693d9405-40b6-4b85-b7e4-79cb8c7e431e 1073741824 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:49:11 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-540a7495-313b-40bf-8f0f-dedd60d06056 tempest-VolumesNegativeTest-1392661253 None] Lock "cinder-d3ddb034-c551-4321-a9fd-164572a30565-delete_volume" released by "delete_volume" :: held 1.786s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:49:11 devstack sudo[98684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-693d9405-40b6-4b85-b7e4-79cb8c7e431e 1073741824 Sep 22 15:49:11 devstack sudo[98684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:49:12 devstack sudo[98684]: pam_unix(sudo:session): session closed for user root Sep 22 15:49:12 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-48f95694-bcf0-4788-a5d4-c9d9b19013fa tempest-VolumesListTestJSON-2098048748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-693d9405-40b6-4b85-b7e4-79cb8c7e431e 1073741824" returned: 0 in 0.543s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:49:12 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-48f95694-bcf0-4788-a5d4-c9d9b19013fa tempest-VolumesListTestJSON-2098048748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-693d9405-40b6-4b85-b7e4-79cb8c7e431e {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:49:12 devstack sudo[98690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-693d9405-40b6-4b85-b7e4-79cb8c7e431e Sep 22 15:49:12 devstack sudo[98690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:49:12 devstack sudo[98690]: pam_unix(sudo:session): session closed for user root Sep 22 15:49:12 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-48f95694-bcf0-4788-a5d4-c9d9b19013fa tempest-VolumesListTestJSON-2098048748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-693d9405-40b6-4b85-b7e4-79cb8c7e431e" returned: 0 in 0.361s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:49:12 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-48f95694-bcf0-4788-a5d4-c9d9b19013fa tempest-VolumesListTestJSON-2098048748 None] <== create_volume: return (967ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'} {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 15:49:12 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-48f95694-bcf0-4788-a5d4-c9d9b19013fa tempest-VolumesListTestJSON-2098048748 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.970s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:49:12 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-48f95694-bcf0-4788-a5d4-c9d9b19013fa tempest-VolumesListTestJSON-2098048748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0169aa6-14f3-4c25-92d4-b9f868f5a72e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-693d9405-40b6-4b85-b7e4-79cb8c7e431e', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:49:12 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-48f95694-bcf0-4788-a5d4-c9d9b19013fa tempest-VolumesListTestJSON-2098048748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3ff58cc-eecf-49c3-b0f4-fe795998aa37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:49:12 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-48f95694-bcf0-4788-a5d4-c9d9b19013fa tempest-VolumesListTestJSON-2098048748 None] Volume volume-693d9405-40b6-4b85-b7e4-79cb8c7e431e (693d9405-40b6-4b85-b7e4-79cb8c7e431e): created successfully Sep 22 15:49:12 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-48f95694-bcf0-4788-a5d4-c9d9b19013fa tempest-VolumesListTestJSON-2098048748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3ff58cc-eecf-49c3-b0f4-fe795998aa37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:49:12 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-48f95694-bcf0-4788-a5d4-c9d9b19013fa tempest-VolumesListTestJSON-2098048748 None] Flow 'volume_create_manager' (8b6647d3-84e1-4f04-9b92-f6df68341b3a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:49:12 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-48f95694-bcf0-4788-a5d4-c9d9b19013fa tempest-VolumesListTestJSON-2098048748 None] Created volume successfully. Sep 22 15:49:15 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-c7e75b65-688e-484a-9337-0be52172f4c1 tempest-VolumesListTestJSON-2098048748 None] Acquiring lock "cinder-693d9405-40b6-4b85-b7e4-79cb8c7e431e-delete_volume" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:49:15 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-c7e75b65-688e-484a-9337-0be52172f4c1 tempest-VolumesListTestJSON-2098048748 None] Lock "cinder-693d9405-40b6-4b85-b7e4-79cb8c7e431e-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:49:15 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-c7e75b65-688e-484a-9337-0be52172f4c1 tempest-VolumesListTestJSON-2098048748 None] Acquiring lock "cinder-quobyte-693d9405-40b6-4b85-b7e4-79cb8c7e431e" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:49:15 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-c7e75b65-688e-484a-9337-0be52172f4c1 tempest-VolumesListTestJSON-2098048748 None] Lock "cinder-quobyte-693d9405-40b6-4b85-b7e4-79cb8c7e431e" acquired by "delete_volume" :: waited 0.027s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:49:15 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba424dd5-5840-49c4-a3f2-9c8d80b5ca06]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:49:15 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-c7e75b65-688e-484a-9337-0be52172f4c1 tempest-VolumesListTestJSON-2098048748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-693d9405-40b6-4b85-b7e4-79cb8c7e431e {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:49:15 devstack cinder-volume[86212]: DEBUG cinder.volume.flows.manager.create_volume [None req-a246b212-fb37-492e-90fa-2fe0af0e55b2 tempest-VolumesSnapshotListTestJSON-1813721960 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 15:49:15 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-a246b212-fb37-492e-90fa-2fe0af0e55b2 tempest-VolumesSnapshotListTestJSON-1813721960 None] Flow 'volume_create_manager' (188cba72-1278-4254-a0d0-d5fd91207f15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:49:15 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-a246b212-fb37-492e-90fa-2fe0af0e55b2 tempest-VolumesSnapshotListTestJSON-1813721960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91fb703c-3305-4f09-8eef-dc2df7094545) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:49:15 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-a246b212-fb37-492e-90fa-2fe0af0e55b2 tempest-VolumesSnapshotListTestJSON-1813721960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91fb703c-3305-4f09-8eef-dc2df7094545) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:49:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1594693292',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=722726ce-36c4-41de-b575-64be96ebf06c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4845b70c3d44d54bc5cd20dd7b26be3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:49:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:49:16Z,use_quota=True,user_id='540ecf35939b4d2295dbe8b911f8d087',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:49:15 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-a246b212-fb37-492e-90fa-2fe0af0e55b2 tempest-VolumesSnapshotListTestJSON-1813721960 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aaffe9b9-1a6f-4aad-bfb1-d558ec6e3a16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:49:15 devstack sudo[98711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-693d9405-40b6-4b85-b7e4-79cb8c7e431e Sep 22 15:49:15 devstack sudo[98711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:49:15 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-a246b212-fb37-492e-90fa-2fe0af0e55b2 tempest-VolumesSnapshotListTestJSON-1813721960 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aaffe9b9-1a6f-4aad-bfb1-d558ec6e3a16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:49:15 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-a246b212-fb37-492e-90fa-2fe0af0e55b2 tempest-VolumesSnapshotListTestJSON-1813721960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eff02b8a-30d0-48ec-87ec-0c86099f4351) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:49:15 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-a246b212-fb37-492e-90fa-2fe0af0e55b2 tempest-VolumesSnapshotListTestJSON-1813721960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eff02b8a-30d0-48ec-87ec-0c86099f4351) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '722726ce-36c4-41de-b575-64be96ebf06c', 'volume_name': 'volume-722726ce-36c4-41de-b575-64be96ebf06c', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:49:15 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-a246b212-fb37-492e-90fa-2fe0af0e55b2 tempest-VolumesSnapshotListTestJSON-1813721960 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae884c67-502d-4ad2-9b83-147097ead62c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:49:15 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-a246b212-fb37-492e-90fa-2fe0af0e55b2 tempest-VolumesSnapshotListTestJSON-1813721960 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae884c67-502d-4ad2-9b83-147097ead62c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:49:15 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-a246b212-fb37-492e-90fa-2fe0af0e55b2 tempest-VolumesSnapshotListTestJSON-1813721960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1af857a-c157-4cdf-a7e9-22ff4e360823) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:49:15 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-a246b212-fb37-492e-90fa-2fe0af0e55b2 tempest-VolumesSnapshotListTestJSON-1813721960 None] Volume 722726ce-36c4-41de-b575-64be96ebf06c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-722726ce-36c4-41de-b575-64be96ebf06c', 'volume_size': 1} Sep 22 15:49:15 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-a246b212-fb37-492e-90fa-2fe0af0e55b2 tempest-VolumesSnapshotListTestJSON-1813721960 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:49:15 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-a246b212-fb37-492e-90fa-2fe0af0e55b2 tempest-VolumesSnapshotListTestJSON-1813721960 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:49:15 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-a246b212-fb37-492e-90fa-2fe0af0e55b2 tempest-VolumesSnapshotListTestJSON-1813721960 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:49:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1594693292',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=722726ce-36c4-41de-b575-64be96ebf06c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4845b70c3d44d54bc5cd20dd7b26be3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:49:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:49:16Z,use_quota=True,user_id='540ecf35939b4d2295dbe8b911f8d087',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)}" {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 15:49:15 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-a246b212-fb37-492e-90fa-2fe0af0e55b2 tempest-VolumesSnapshotListTestJSON-1813721960 None] Creating volume 722726ce-36c4-41de-b575-64be96ebf06c {{(pid=86212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 15:49:15 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-a246b212-fb37-492e-90fa-2fe0af0e55b2 tempest-VolumesSnapshotListTestJSON-1813721960 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:49:15 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-a246b212-fb37-492e-90fa-2fe0af0e55b2 tempest-VolumesSnapshotListTestJSON-1813721960 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:49:15 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-a246b212-fb37-492e-90fa-2fe0af0e55b2 tempest-VolumesSnapshotListTestJSON-1813721960 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:49:15 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-a246b212-fb37-492e-90fa-2fe0af0e55b2 tempest-VolumesSnapshotListTestJSON-1813721960 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:49:15 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-a246b212-fb37-492e-90fa-2fe0af0e55b2 tempest-VolumesSnapshotListTestJSON-1813721960 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:49:15 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-a246b212-fb37-492e-90fa-2fe0af0e55b2 tempest-VolumesSnapshotListTestJSON-1813721960 None] Selected osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 as target Quobyte volume. {{(pid=86212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 15:49:15 devstack cinder-volume[86212]: INFO cinder.volume.drivers.remotefs [None req-a246b212-fb37-492e-90fa-2fe0af0e55b2 tempest-VolumesSnapshotListTestJSON-1813721960 None] casted to osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 Sep 22 15:49:15 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-a246b212-fb37-492e-90fa-2fe0af0e55b2 tempest-VolumesSnapshotListTestJSON-1813721960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-722726ce-36c4-41de-b575-64be96ebf06c 1073741824 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:49:15 devstack sudo[98714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-722726ce-36c4-41de-b575-64be96ebf06c 1073741824 Sep 22 15:49:15 devstack sudo[98714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:49:16 devstack sudo[98711]: pam_unix(sudo:session): session closed for user root Sep 22 15:49:16 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-c7e75b65-688e-484a-9337-0be52172f4c1 tempest-VolumesListTestJSON-2098048748 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-693d9405-40b6-4b85-b7e4-79cb8c7e431e" returned: 0 in 0.416s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:49:16 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-c7e75b65-688e-484a-9337-0be52172f4c1 tempest-VolumesListTestJSON-2098048748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-693d9405-40b6-4b85-b7e4-79cb8c7e431e {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:49:16 devstack sudo[98722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-693d9405-40b6-4b85-b7e4-79cb8c7e431e Sep 22 15:49:16 devstack sudo[98722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:49:16 devstack sudo[98714]: pam_unix(sudo:session): session closed for user root Sep 22 15:49:16 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-a246b212-fb37-492e-90fa-2fe0af0e55b2 tempest-VolumesSnapshotListTestJSON-1813721960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-722726ce-36c4-41de-b575-64be96ebf06c 1073741824" returned: 0 in 0.530s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:49:16 devstack sudo[98722]: pam_unix(sudo:session): session closed for user root Sep 22 15:49:16 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-c7e75b65-688e-484a-9337-0be52172f4c1 tempest-VolumesListTestJSON-2098048748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-693d9405-40b6-4b85-b7e4-79cb8c7e431e" returned: 0 in 0.296s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:49:16 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-a246b212-fb37-492e-90fa-2fe0af0e55b2 tempest-VolumesSnapshotListTestJSON-1813721960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-722726ce-36c4-41de-b575-64be96ebf06c {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:49:16 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-c7e75b65-688e-484a-9337-0be52172f4c1 tempest-VolumesListTestJSON-2098048748 None] Lock "cinder-quobyte-693d9405-40b6-4b85-b7e4-79cb8c7e431e" released by "delete_volume" :: held 0.779s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:49:16 devstack sudo[98727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-722726ce-36c4-41de-b575-64be96ebf06c Sep 22 15:49:16 devstack sudo[98727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:49:16 devstack cinder-volume[86212]: DEBUG cinder.quota [None req-c7e75b65-688e-484a-9337-0be52172f4c1 tempest-VolumesListTestJSON-2098048748 None] Created reservations ['cd5d7d30-92d2-4fb8-978c-4979e2edb1df', '794f6de4-d66e-436a-b81a-7b99dc0ebd38', 'e77dde24-b68f-4abd-868b-d81e7e37fb27', '415f76f5-f6fd-416d-a251-01a07f2f528f'] {{(pid=86212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 15:49:16 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-c7e75b65-688e-484a-9337-0be52172f4c1 tempest-VolumesListTestJSON-2098048748 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:49:16 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-c7e75b65-688e-484a-9337-0be52172f4c1 tempest-VolumesListTestJSON-2098048748 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:49:16 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-c7e75b65-688e-484a-9337-0be52172f4c1 tempest-VolumesListTestJSON-2098048748 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:49:16 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-c7e75b65-688e-484a-9337-0be52172f4c1 tempest-VolumesListTestJSON-2098048748 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:49:16 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-c7e75b65-688e-484a-9337-0be52172f4c1 tempest-VolumesListTestJSON-2098048748 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:49:16 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-c7e75b65-688e-484a-9337-0be52172f4c1 tempest-VolumesListTestJSON-2098048748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:49:16 devstack sudo[98729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc Sep 22 15:49:16 devstack sudo[98729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:49:16 devstack sudo[98727]: pam_unix(sudo:session): session closed for user root Sep 22 15:49:16 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-a246b212-fb37-492e-90fa-2fe0af0e55b2 tempest-VolumesSnapshotListTestJSON-1813721960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-722726ce-36c4-41de-b575-64be96ebf06c" returned: 0 in 0.352s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:49:16 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-a246b212-fb37-492e-90fa-2fe0af0e55b2 tempest-VolumesSnapshotListTestJSON-1813721960 None] <== create_volume: return (933ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'} {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 15:49:16 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-a246b212-fb37-492e-90fa-2fe0af0e55b2 tempest-VolumesSnapshotListTestJSON-1813721960 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.936s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:49:16 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-a246b212-fb37-492e-90fa-2fe0af0e55b2 tempest-VolumesSnapshotListTestJSON-1813721960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1af857a-c157-4cdf-a7e9-22ff4e360823) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-722726ce-36c4-41de-b575-64be96ebf06c', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:49:16 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-a246b212-fb37-492e-90fa-2fe0af0e55b2 tempest-VolumesSnapshotListTestJSON-1813721960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (919601c4-856b-47a3-a1d6-a5de0803fa03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:49:16 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-a246b212-fb37-492e-90fa-2fe0af0e55b2 tempest-VolumesSnapshotListTestJSON-1813721960 None] Volume volume-722726ce-36c4-41de-b575-64be96ebf06c (722726ce-36c4-41de-b575-64be96ebf06c): created successfully Sep 22 15:49:16 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-a246b212-fb37-492e-90fa-2fe0af0e55b2 tempest-VolumesSnapshotListTestJSON-1813721960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (919601c4-856b-47a3-a1d6-a5de0803fa03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:49:16 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-a246b212-fb37-492e-90fa-2fe0af0e55b2 tempest-VolumesSnapshotListTestJSON-1813721960 None] Flow 'volume_create_manager' (188cba72-1278-4254-a0d0-d5fd91207f15) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:49:16 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-6678a8ce-291a-425b-b393-212db2456e9b tempest-VolumesListTestJSON-2098048748 None] Acquiring lock "cinder-ac9778e2-4f66-495d-aa67-e561024b773c-delete_volume" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:49:16 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-a246b212-fb37-492e-90fa-2fe0af0e55b2 tempest-VolumesSnapshotListTestJSON-1813721960 None] Created volume successfully. Sep 22 15:49:17 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-6678a8ce-291a-425b-b393-212db2456e9b tempest-VolumesListTestJSON-2098048748 None] Lock "cinder-ac9778e2-4f66-495d-aa67-e561024b773c-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:49:17 devstack sudo[98729]: pam_unix(sudo:session): session closed for user root Sep 22 15:49:17 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-c7e75b65-688e-484a-9337-0be52172f4c1 tempest-VolumesListTestJSON-2098048748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc" returned: 0 in 0.353s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:49:17 devstack cinder-volume[86212]: DEBUG cinder.manager [None req-c7e75b65-688e-484a-9337-0be52172f4c1 tempest-VolumesListTestJSON-2098048748 None] Notifying Schedulers of capabilities ... {{(pid=86212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 15:49:17 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-c7e75b65-688e-484a-9337-0be52172f4c1 tempest-VolumesListTestJSON-2098048748 None] Deleted volume successfully. Sep 22 15:49:17 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-c7e75b65-688e-484a-9337-0be52172f4c1 tempest-VolumesListTestJSON-2098048748 None] Lock "cinder-693d9405-40b6-4b85-b7e4-79cb8c7e431e-delete_volume" released by "delete_volume" :: held 1.402s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:49:17 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-6678a8ce-291a-425b-b393-212db2456e9b tempest-VolumesListTestJSON-2098048748 None] Acquiring lock "cinder-quobyte-ac9778e2-4f66-495d-aa67-e561024b773c" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:49:17 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-6678a8ce-291a-425b-b393-212db2456e9b tempest-VolumesListTestJSON-2098048748 None] Lock "cinder-quobyte-ac9778e2-4f66-495d-aa67-e561024b773c" acquired by "delete_volume" :: waited 0.015s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:49:17 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd77c349-f01f-4ffd-a51e-c62ab201898d]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:49:17 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-6678a8ce-291a-425b-b393-212db2456e9b tempest-VolumesListTestJSON-2098048748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-ac9778e2-4f66-495d-aa67-e561024b773c {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:49:17 devstack sudo[98733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-ac9778e2-4f66-495d-aa67-e561024b773c Sep 22 15:49:17 devstack sudo[98733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:49:17 devstack sudo[98733]: pam_unix(sudo:session): session closed for user root Sep 22 15:49:17 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-6678a8ce-291a-425b-b393-212db2456e9b tempest-VolumesListTestJSON-2098048748 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-ac9778e2-4f66-495d-aa67-e561024b773c" returned: 0 in 0.383s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:49:17 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-6678a8ce-291a-425b-b393-212db2456e9b tempest-VolumesListTestJSON-2098048748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-ac9778e2-4f66-495d-aa67-e561024b773c {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:49:17 devstack sudo[98738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-ac9778e2-4f66-495d-aa67-e561024b773c Sep 22 15:49:17 devstack sudo[98738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:49:17 devstack sudo[98738]: pam_unix(sudo:session): session closed for user root Sep 22 15:49:17 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-6678a8ce-291a-425b-b393-212db2456e9b tempest-VolumesListTestJSON-2098048748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-ac9778e2-4f66-495d-aa67-e561024b773c" returned: 0 in 0.276s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:49:17 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-6678a8ce-291a-425b-b393-212db2456e9b tempest-VolumesListTestJSON-2098048748 None] Lock "cinder-quobyte-ac9778e2-4f66-495d-aa67-e561024b773c" released by "delete_volume" :: held 0.705s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:49:17 devstack cinder-volume[86212]: DEBUG cinder.quota [None req-6678a8ce-291a-425b-b393-212db2456e9b tempest-VolumesListTestJSON-2098048748 None] Created reservations ['88538a73-44bb-407e-8455-938f18dc209c', 'de06fb87-0f8a-4736-8ea5-05349dded74a', '304ce1fb-9dc9-491b-853b-d9175a566f37', '01220d04-75cd-4919-aefc-7623073e36cc'] {{(pid=86212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 15:49:17 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-6678a8ce-291a-425b-b393-212db2456e9b tempest-VolumesListTestJSON-2098048748 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:49:17 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-6678a8ce-291a-425b-b393-212db2456e9b tempest-VolumesListTestJSON-2098048748 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:49:17 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-6678a8ce-291a-425b-b393-212db2456e9b tempest-VolumesListTestJSON-2098048748 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:49:17 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-6678a8ce-291a-425b-b393-212db2456e9b tempest-VolumesListTestJSON-2098048748 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:49:17 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-6678a8ce-291a-425b-b393-212db2456e9b tempest-VolumesListTestJSON-2098048748 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:49:17 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-6678a8ce-291a-425b-b393-212db2456e9b tempest-VolumesListTestJSON-2098048748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:49:17 devstack sudo[98742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc Sep 22 15:49:17 devstack sudo[98742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:49:18 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-bcddfe42-f6f8-423b-9085-6b861bf30659 tempest-VolumesSnapshotListTestJSON-1813721960 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:49:18 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-bcddfe42-f6f8-423b-9085-6b861bf30659 tempest-VolumesSnapshotListTestJSON-1813721960 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.005s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:49:18 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-bcddfe42-f6f8-423b-9085-6b861bf30659 tempest-VolumesSnapshotListTestJSON-1813721960 None] Creating offline snapshot de53b2f4-180a-4a91-b90f-50de0029db82 of volume 722726ce-36c4-41de-b575-64be96ebf06c {{(pid=86212) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 22 15:49:18 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe84c64a-a37b-4ce9-8443-ce52fd49e42a]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:49:18 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-bcddfe42-f6f8-423b-9085-6b861bf30659 tempest-VolumesSnapshotListTestJSON-1813721960 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-722726ce-36c4-41de-b575-64be96ebf06c {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:49:18 devstack sudo[98742]: pam_unix(sudo:session): session closed for user root Sep 22 15:49:18 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-6678a8ce-291a-425b-b393-212db2456e9b tempest-VolumesListTestJSON-2098048748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc" returned: 0 in 0.310s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:49:18 devstack cinder-volume[86212]: DEBUG cinder.manager [None req-6678a8ce-291a-425b-b393-212db2456e9b tempest-VolumesListTestJSON-2098048748 None] Notifying Schedulers of capabilities ... {{(pid=86212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 15:49:18 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-6678a8ce-291a-425b-b393-212db2456e9b tempest-VolumesListTestJSON-2098048748 None] Deleted volume successfully. Sep 22 15:49:18 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-6678a8ce-291a-425b-b393-212db2456e9b tempest-VolumesListTestJSON-2098048748 None] Lock "cinder-ac9778e2-4f66-495d-aa67-e561024b773c-delete_volume" released by "delete_volume" :: held 1.263s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:49:18 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-4d60301c-6da2-4faf-8935-7672e8ae562f tempest-VolumesListTestJSON-2098048748 None] Acquiring lock "cinder-0364c82f-ce62-4dd3-829d-0f3524b2cce6-delete_volume" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:49:18 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-4d60301c-6da2-4faf-8935-7672e8ae562f tempest-VolumesListTestJSON-2098048748 None] Lock "cinder-0364c82f-ce62-4dd3-829d-0f3524b2cce6-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:49:18 devstack sudo[98745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-722726ce-36c4-41de-b575-64be96ebf06c Sep 22 15:49:18 devstack sudo[98745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:49:18 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-4d60301c-6da2-4faf-8935-7672e8ae562f tempest-VolumesListTestJSON-2098048748 None] Acquiring lock "cinder-quobyte-0364c82f-ce62-4dd3-829d-0f3524b2cce6" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:49:18 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-4d60301c-6da2-4faf-8935-7672e8ae562f tempest-VolumesListTestJSON-2098048748 None] Lock "cinder-quobyte-0364c82f-ce62-4dd3-829d-0f3524b2cce6" acquired by "delete_volume" :: waited 0.024s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:49:18 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[823d4d01-f1c2-4d24-85cb-ee3a6b395fe3]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:49:18 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-4d60301c-6da2-4faf-8935-7672e8ae562f tempest-VolumesListTestJSON-2098048748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-0364c82f-ce62-4dd3-829d-0f3524b2cce6 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:49:18 devstack sudo[98747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-0364c82f-ce62-4dd3-829d-0f3524b2cce6 Sep 22 15:49:18 devstack sudo[98747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:49:18 devstack sudo[98745]: pam_unix(sudo:session): session closed for user root Sep 22 15:49:18 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-bcddfe42-f6f8-423b-9085-6b861bf30659 tempest-VolumesSnapshotListTestJSON-1813721960 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-722726ce-36c4-41de-b575-64be96ebf06c" returned: 0 in 0.443s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:49:18 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-bcddfe42-f6f8-423b-9085-6b861bf30659 tempest-VolumesSnapshotListTestJSON-1813721960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-722726ce-36c4-41de-b575-64be96ebf06c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-722726ce-36c4-41de-b575-64be96ebf06c.de53b2f4-180a-4a91-b90f-50de0029db82 1G {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:49:18 devstack sudo[98752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-722726ce-36c4-41de-b575-64be96ebf06c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-722726ce-36c4-41de-b575-64be96ebf06c.de53b2f4-180a-4a91-b90f-50de0029db82 1G Sep 22 15:49:18 devstack sudo[98752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:49:18 devstack sudo[98747]: pam_unix(sudo:session): session closed for user root Sep 22 15:49:18 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-4d60301c-6da2-4faf-8935-7672e8ae562f tempest-VolumesListTestJSON-2098048748 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-0364c82f-ce62-4dd3-829d-0f3524b2cce6" returned: 0 in 0.463s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:49:18 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-4d60301c-6da2-4faf-8935-7672e8ae562f tempest-VolumesListTestJSON-2098048748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-0364c82f-ce62-4dd3-829d-0f3524b2cce6 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:49:18 devstack sudo[98757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-0364c82f-ce62-4dd3-829d-0f3524b2cce6 Sep 22 15:49:18 devstack sudo[98757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:49:19 devstack sudo[98752]: pam_unix(sudo:session): session closed for user root Sep 22 15:49:19 devstack sudo[98757]: pam_unix(sudo:session): session closed for user root Sep 22 15:49:19 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-bcddfe42-f6f8-423b-9085-6b861bf30659 tempest-VolumesSnapshotListTestJSON-1813721960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-722726ce-36c4-41de-b575-64be96ebf06c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-722726ce-36c4-41de-b575-64be96ebf06c.de53b2f4-180a-4a91-b90f-50de0029db82 1G" returned: 0 in 0.550s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:49:19 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-bcddfe42-f6f8-423b-9085-6b861bf30659 tempest-VolumesSnapshotListTestJSON-1813721960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-722726ce-36c4-41de-b575-64be96ebf06c -F qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-722726ce-36c4-41de-b575-64be96ebf06c.de53b2f4-180a-4a91-b90f-50de0029db82 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:49:19 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-4d60301c-6da2-4faf-8935-7672e8ae562f tempest-VolumesListTestJSON-2098048748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-0364c82f-ce62-4dd3-829d-0f3524b2cce6" returned: 0 in 0.328s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:49:19 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-4d60301c-6da2-4faf-8935-7672e8ae562f tempest-VolumesListTestJSON-2098048748 None] Lock "cinder-quobyte-0364c82f-ce62-4dd3-829d-0f3524b2cce6" released by "delete_volume" :: held 0.852s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:49:19 devstack sudo[98764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-722726ce-36c4-41de-b575-64be96ebf06c -F qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-722726ce-36c4-41de-b575-64be96ebf06c.de53b2f4-180a-4a91-b90f-50de0029db82 Sep 22 15:49:19 devstack sudo[98764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:49:19 devstack cinder-volume[86212]: DEBUG cinder.quota [None req-4d60301c-6da2-4faf-8935-7672e8ae562f tempest-VolumesListTestJSON-2098048748 None] Created reservations ['a31adbd7-8d95-487e-97e0-ddabad13d7e1', 'd47bdcb1-8472-4789-95f7-7394ff624fbd', '52061583-027c-4bd3-8790-ee7802ac2b97', 'e11e26f4-3854-47af-8324-926d5345aac8'] {{(pid=86212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 15:49:19 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-4d60301c-6da2-4faf-8935-7672e8ae562f tempest-VolumesListTestJSON-2098048748 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:49:19 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-4d60301c-6da2-4faf-8935-7672e8ae562f tempest-VolumesListTestJSON-2098048748 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:49:19 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-4d60301c-6da2-4faf-8935-7672e8ae562f tempest-VolumesListTestJSON-2098048748 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:49:19 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-4d60301c-6da2-4faf-8935-7672e8ae562f tempest-VolumesListTestJSON-2098048748 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:49:19 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-4d60301c-6da2-4faf-8935-7672e8ae562f tempest-VolumesListTestJSON-2098048748 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:49:19 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-4d60301c-6da2-4faf-8935-7672e8ae562f tempest-VolumesListTestJSON-2098048748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:49:19 devstack sudo[98766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc Sep 22 15:49:19 devstack sudo[98766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:49:19 devstack sudo[98764]: pam_unix(sudo:session): session closed for user root Sep 22 15:49:19 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-bcddfe42-f6f8-423b-9085-6b861bf30659 tempest-VolumesSnapshotListTestJSON-1813721960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-722726ce-36c4-41de-b575-64be96ebf06c -F qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-722726ce-36c4-41de-b575-64be96ebf06c.de53b2f4-180a-4a91-b90f-50de0029db82" returned: 0 in 0.389s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:49:19 devstack cinder-volume[86212]: WARNING cinder.volume.drivers.remotefs [None req-bcddfe42-f6f8-423b-9085-6b861bf30659 tempest-VolumesSnapshotListTestJSON-1813721960 None] /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-722726ce-36c4-41de-b575-64be96ebf06c.de53b2f4-180a-4a91-b90f-50de0029db82 is being set with open permissions: ugo+rw Sep 22 15:49:19 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-bcddfe42-f6f8-423b-9085-6b861bf30659 tempest-VolumesSnapshotListTestJSON-1813721960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-722726ce-36c4-41de-b575-64be96ebf06c.de53b2f4-180a-4a91-b90f-50de0029db82 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:49:19 devstack sudo[98771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-722726ce-36c4-41de-b575-64be96ebf06c.de53b2f4-180a-4a91-b90f-50de0029db82 Sep 22 15:49:19 devstack sudo[98771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:49:19 devstack sudo[98766]: pam_unix(sudo:session): session closed for user root Sep 22 15:49:19 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-4d60301c-6da2-4faf-8935-7672e8ae562f tempest-VolumesListTestJSON-2098048748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc" returned: 0 in 0.340s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:49:19 devstack cinder-volume[86212]: DEBUG cinder.manager [None req-4d60301c-6da2-4faf-8935-7672e8ae562f tempest-VolumesListTestJSON-2098048748 None] Notifying Schedulers of capabilities ... {{(pid=86212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 15:49:19 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-4d60301c-6da2-4faf-8935-7672e8ae562f tempest-VolumesListTestJSON-2098048748 None] Deleted volume successfully. Sep 22 15:49:19 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-4d60301c-6da2-4faf-8935-7672e8ae562f tempest-VolumesListTestJSON-2098048748 None] Lock "cinder-0364c82f-ce62-4dd3-829d-0f3524b2cce6-delete_volume" released by "delete_volume" :: held 1.456s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:49:19 devstack sudo[98771]: pam_unix(sudo:session): session closed for user root Sep 22 15:49:19 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-bcddfe42-f6f8-423b-9085-6b861bf30659 tempest-VolumesSnapshotListTestJSON-1813721960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-722726ce-36c4-41de-b575-64be96ebf06c.de53b2f4-180a-4a91-b90f-50de0029db82" returned: 0 in 0.312s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:49:19 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-bcddfe42-f6f8-423b-9085-6b861bf30659 tempest-VolumesSnapshotListTestJSON-1813721960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-722726ce-36c4-41de-b575-64be96ebf06c.info {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:49:19 devstack sudo[98775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-722726ce-36c4-41de-b575-64be96ebf06c.info Sep 22 15:49:19 devstack sudo[98775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:49:20 devstack sudo[98775]: pam_unix(sudo:session): session closed for user root Sep 22 15:49:20 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-bcddfe42-f6f8-423b-9085-6b861bf30659 tempest-VolumesSnapshotListTestJSON-1813721960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-722726ce-36c4-41de-b575-64be96ebf06c.info" returned: 0 in 0.290s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:49:20 devstack cinder-volume[86212]: WARNING cinder.volume.drivers.remotefs [None req-bcddfe42-f6f8-423b-9085-6b861bf30659 tempest-VolumesSnapshotListTestJSON-1813721960 None] /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-722726ce-36c4-41de-b575-64be96ebf06c.info is being set with open permissions: ugo+rw Sep 22 15:49:20 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-bcddfe42-f6f8-423b-9085-6b861bf30659 tempest-VolumesSnapshotListTestJSON-1813721960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-722726ce-36c4-41de-b575-64be96ebf06c.info {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:49:20 devstack sudo[98778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-722726ce-36c4-41de-b575-64be96ebf06c.info Sep 22 15:49:20 devstack sudo[98778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:49:20 devstack sudo[98778]: pam_unix(sudo:session): session closed for user root Sep 22 15:49:20 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-bcddfe42-f6f8-423b-9085-6b861bf30659 tempest-VolumesSnapshotListTestJSON-1813721960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-722726ce-36c4-41de-b575-64be96ebf06c.info" returned: 0 in 0.267s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:49:20 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-bcddfe42-f6f8-423b-9085-6b861bf30659 tempest-VolumesSnapshotListTestJSON-1813721960 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.372s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:49:20 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-bcddfe42-f6f8-423b-9085-6b861bf30659 tempest-VolumesSnapshotListTestJSON-1813721960 None] Create snapshot completed successfully Sep 22 15:49:21 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-4a52618e-a909-4a59-bd27-6e5e9d612349 tempest-VolumesSnapshotListTestJSON-1813721960 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:49:21 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-4a52618e-a909-4a59-bd27-6e5e9d612349 tempest-VolumesSnapshotListTestJSON-1813721960 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:49:21 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-4a52618e-a909-4a59-bd27-6e5e9d612349 tempest-VolumesSnapshotListTestJSON-1813721960 None] Creating offline snapshot 6e115a1d-525b-441f-abac-8227fc95aa28 of volume 722726ce-36c4-41de-b575-64be96ebf06c {{(pid=86212) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 22 15:49:21 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7fa249c-c7cb-4372-9bae-203ddde94b0b]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:49:21 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-4a52618e-a909-4a59-bd27-6e5e9d612349 tempest-VolumesSnapshotListTestJSON-1813721960 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-722726ce-36c4-41de-b575-64be96ebf06c.de53b2f4-180a-4a91-b90f-50de0029db82 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:49:21 devstack sudo[98781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-722726ce-36c4-41de-b575-64be96ebf06c.de53b2f4-180a-4a91-b90f-50de0029db82 Sep 22 15:49:21 devstack sudo[98781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:49:22 devstack sudo[98781]: pam_unix(sudo:session): session closed for user root Sep 22 15:49:22 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-4a52618e-a909-4a59-bd27-6e5e9d612349 tempest-VolumesSnapshotListTestJSON-1813721960 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-722726ce-36c4-41de-b575-64be96ebf06c.de53b2f4-180a-4a91-b90f-50de0029db82" returned: 0 in 0.467s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:49:22 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-4a52618e-a909-4a59-bd27-6e5e9d612349 tempest-VolumesSnapshotListTestJSON-1813721960 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-722726ce-36c4-41de-b575-64be96ebf06c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86212) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 22 15:49:22 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-4a52618e-a909-4a59-bd27-6e5e9d612349 tempest-VolumesSnapshotListTestJSON-1813721960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-722726ce-36c4-41de-b575-64be96ebf06c.de53b2f4-180a-4a91-b90f-50de0029db82,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-722726ce-36c4-41de-b575-64be96ebf06c.6e115a1d-525b-441f-abac-8227fc95aa28 1G {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:49:22 devstack sudo[98786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-722726ce-36c4-41de-b575-64be96ebf06c.de53b2f4-180a-4a91-b90f-50de0029db82,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-722726ce-36c4-41de-b575-64be96ebf06c.6e115a1d-525b-441f-abac-8227fc95aa28 1G Sep 22 15:49:22 devstack sudo[98786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:49:22 devstack sudo[98786]: pam_unix(sudo:session): session closed for user root Sep 22 15:49:22 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-4a52618e-a909-4a59-bd27-6e5e9d612349 tempest-VolumesSnapshotListTestJSON-1813721960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-722726ce-36c4-41de-b575-64be96ebf06c.de53b2f4-180a-4a91-b90f-50de0029db82,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-722726ce-36c4-41de-b575-64be96ebf06c.6e115a1d-525b-441f-abac-8227fc95aa28 1G" returned: 0 in 0.585s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:49:22 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-4a52618e-a909-4a59-bd27-6e5e9d612349 tempest-VolumesSnapshotListTestJSON-1813721960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-722726ce-36c4-41de-b575-64be96ebf06c.de53b2f4-180a-4a91-b90f-50de0029db82 -F qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-722726ce-36c4-41de-b575-64be96ebf06c.6e115a1d-525b-441f-abac-8227fc95aa28 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:49:22 devstack sudo[98794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-722726ce-36c4-41de-b575-64be96ebf06c.de53b2f4-180a-4a91-b90f-50de0029db82 -F qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-722726ce-36c4-41de-b575-64be96ebf06c.6e115a1d-525b-441f-abac-8227fc95aa28 Sep 22 15:49:22 devstack sudo[98794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:49:23 devstack sudo[98794]: pam_unix(sudo:session): session closed for user root Sep 22 15:49:23 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-4a52618e-a909-4a59-bd27-6e5e9d612349 tempest-VolumesSnapshotListTestJSON-1813721960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-722726ce-36c4-41de-b575-64be96ebf06c.de53b2f4-180a-4a91-b90f-50de0029db82 -F qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-722726ce-36c4-41de-b575-64be96ebf06c.6e115a1d-525b-441f-abac-8227fc95aa28" returned: 0 in 0.381s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:49:23 devstack cinder-volume[86212]: WARNING cinder.volume.drivers.remotefs [None req-4a52618e-a909-4a59-bd27-6e5e9d612349 tempest-VolumesSnapshotListTestJSON-1813721960 None] /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-722726ce-36c4-41de-b575-64be96ebf06c.6e115a1d-525b-441f-abac-8227fc95aa28 is being set with open permissions: ugo+rw Sep 22 15:49:23 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-4a52618e-a909-4a59-bd27-6e5e9d612349 tempest-VolumesSnapshotListTestJSON-1813721960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-722726ce-36c4-41de-b575-64be96ebf06c.6e115a1d-525b-441f-abac-8227fc95aa28 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:49:23 devstack sudo[98799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-722726ce-36c4-41de-b575-64be96ebf06c.6e115a1d-525b-441f-abac-8227fc95aa28 Sep 22 15:49:23 devstack sudo[98799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:49:23 devstack sudo[98799]: pam_unix(sudo:session): session closed for user root Sep 22 15:49:23 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-4a52618e-a909-4a59-bd27-6e5e9d612349 tempest-VolumesSnapshotListTestJSON-1813721960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-722726ce-36c4-41de-b575-64be96ebf06c.6e115a1d-525b-441f-abac-8227fc95aa28" returned: 0 in 0.315s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:49:23 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-4a52618e-a909-4a59-bd27-6e5e9d612349 tempest-VolumesSnapshotListTestJSON-1813721960 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.901s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:49:23 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-4a52618e-a909-4a59-bd27-6e5e9d612349 tempest-VolumesSnapshotListTestJSON-1813721960 None] Create snapshot completed successfully Sep 22 15:49:23 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-4eb57560-9b15-4af7-8a43-fa4a24d2ea49 tempest-VolumesSnapshotListTestJSON-1813721960 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:49:23 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-4eb57560-9b15-4af7-8a43-fa4a24d2ea49 tempest-VolumesSnapshotListTestJSON-1813721960 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:49:23 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-4eb57560-9b15-4af7-8a43-fa4a24d2ea49 tempest-VolumesSnapshotListTestJSON-1813721960 None] Creating offline snapshot b1d1ed1e-9f93-47f1-94d2-2791fb7f3937 of volume 722726ce-36c4-41de-b575-64be96ebf06c {{(pid=86212) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 22 15:49:24 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce0d2d99-4041-4829-99ce-aa74536a8fcc]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:49:24 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-4eb57560-9b15-4af7-8a43-fa4a24d2ea49 tempest-VolumesSnapshotListTestJSON-1813721960 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-722726ce-36c4-41de-b575-64be96ebf06c.6e115a1d-525b-441f-abac-8227fc95aa28 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:49:24 devstack sudo[98802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-722726ce-36c4-41de-b575-64be96ebf06c.6e115a1d-525b-441f-abac-8227fc95aa28 Sep 22 15:49:24 devstack sudo[98802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:49:24 devstack sudo[98802]: pam_unix(sudo:session): session closed for user root Sep 22 15:49:24 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-4eb57560-9b15-4af7-8a43-fa4a24d2ea49 tempest-VolumesSnapshotListTestJSON-1813721960 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-722726ce-36c4-41de-b575-64be96ebf06c.6e115a1d-525b-441f-abac-8227fc95aa28" returned: 0 in 0.466s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:49:24 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-4eb57560-9b15-4af7-8a43-fa4a24d2ea49 tempest-VolumesSnapshotListTestJSON-1813721960 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-722726ce-36c4-41de-b575-64be96ebf06c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86212) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 22 15:49:24 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-4eb57560-9b15-4af7-8a43-fa4a24d2ea49 tempest-VolumesSnapshotListTestJSON-1813721960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-722726ce-36c4-41de-b575-64be96ebf06c.6e115a1d-525b-441f-abac-8227fc95aa28,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-722726ce-36c4-41de-b575-64be96ebf06c.b1d1ed1e-9f93-47f1-94d2-2791fb7f3937 1G {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:49:24 devstack sudo[98809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-722726ce-36c4-41de-b575-64be96ebf06c.6e115a1d-525b-441f-abac-8227fc95aa28,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-722726ce-36c4-41de-b575-64be96ebf06c.b1d1ed1e-9f93-47f1-94d2-2791fb7f3937 1G Sep 22 15:49:24 devstack sudo[98809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:49:25 devstack sudo[98809]: pam_unix(sudo:session): session closed for user root Sep 22 15:49:25 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-4eb57560-9b15-4af7-8a43-fa4a24d2ea49 tempest-VolumesSnapshotListTestJSON-1813721960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-722726ce-36c4-41de-b575-64be96ebf06c.6e115a1d-525b-441f-abac-8227fc95aa28,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-722726ce-36c4-41de-b575-64be96ebf06c.b1d1ed1e-9f93-47f1-94d2-2791fb7f3937 1G" returned: 0 in 0.587s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:49:25 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-4eb57560-9b15-4af7-8a43-fa4a24d2ea49 tempest-VolumesSnapshotListTestJSON-1813721960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-722726ce-36c4-41de-b575-64be96ebf06c.6e115a1d-525b-441f-abac-8227fc95aa28 -F qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-722726ce-36c4-41de-b575-64be96ebf06c.b1d1ed1e-9f93-47f1-94d2-2791fb7f3937 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:49:25 devstack sudo[98817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-722726ce-36c4-41de-b575-64be96ebf06c.6e115a1d-525b-441f-abac-8227fc95aa28 -F qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-722726ce-36c4-41de-b575-64be96ebf06c.b1d1ed1e-9f93-47f1-94d2-2791fb7f3937 Sep 22 15:49:25 devstack sudo[98817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:49:25 devstack sudo[98817]: pam_unix(sudo:session): session closed for user root Sep 22 15:49:25 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-4eb57560-9b15-4af7-8a43-fa4a24d2ea49 tempest-VolumesSnapshotListTestJSON-1813721960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-722726ce-36c4-41de-b575-64be96ebf06c.6e115a1d-525b-441f-abac-8227fc95aa28 -F qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-722726ce-36c4-41de-b575-64be96ebf06c.b1d1ed1e-9f93-47f1-94d2-2791fb7f3937" returned: 0 in 0.413s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:49:25 devstack cinder-volume[86212]: WARNING cinder.volume.drivers.remotefs [None req-4eb57560-9b15-4af7-8a43-fa4a24d2ea49 tempest-VolumesSnapshotListTestJSON-1813721960 None] /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-722726ce-36c4-41de-b575-64be96ebf06c.b1d1ed1e-9f93-47f1-94d2-2791fb7f3937 is being set with open permissions: ugo+rw Sep 22 15:49:25 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-4eb57560-9b15-4af7-8a43-fa4a24d2ea49 tempest-VolumesSnapshotListTestJSON-1813721960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-722726ce-36c4-41de-b575-64be96ebf06c.b1d1ed1e-9f93-47f1-94d2-2791fb7f3937 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:49:25 devstack sudo[98824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-722726ce-36c4-41de-b575-64be96ebf06c.b1d1ed1e-9f93-47f1-94d2-2791fb7f3937 Sep 22 15:49:25 devstack sudo[98824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:49:25 devstack sudo[98824]: pam_unix(sudo:session): session closed for user root Sep 22 15:49:25 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-4eb57560-9b15-4af7-8a43-fa4a24d2ea49 tempest-VolumesSnapshotListTestJSON-1813721960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-722726ce-36c4-41de-b575-64be96ebf06c.b1d1ed1e-9f93-47f1-94d2-2791fb7f3937" returned: 0 in 0.344s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:49:25 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-4eb57560-9b15-4af7-8a43-fa4a24d2ea49 tempest-VolumesSnapshotListTestJSON-1813721960 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.956s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:49:25 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-4eb57560-9b15-4af7-8a43-fa4a24d2ea49 tempest-VolumesSnapshotListTestJSON-1813721960 None] Create snapshot completed successfully Sep 22 15:49:26 devstack cinder-volume[86212]: DEBUG cinder.volume.flows.manager.create_volume [None req-40ecff09-f28c-4cce-85cb-25e64cd5dc80 tempest-TestServerVolumeAttachScenarioOldVersion-670480170 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 15:49:26 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-40ecff09-f28c-4cce-85cb-25e64cd5dc80 tempest-TestServerVolumeAttachScenarioOldVersion-670480170 None] Flow 'volume_create_manager' (53257d62-3f13-4936-83e7-6b3869b912ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:49:26 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-40ecff09-f28c-4cce-85cb-25e64cd5dc80 tempest-TestServerVolumeAttachScenarioOldVersion-670480170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc7fbf29-89b2-4d97-ab26-808ee76aabc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:49:26 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-40ecff09-f28c-4cce-85cb-25e64cd5dc80 tempest-TestServerVolumeAttachScenarioOldVersion-670480170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc7fbf29-89b2-4d97-ab26-808ee76aabc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:49:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-285877502',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4448bdb-1804-4ddb-aa8e-0e7810b9f0dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd69222b8852464caf4e64addfabadd0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:49:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:49:27Z,use_quota=True,user_id='1173bb3094b64ed2b86d369aa1b4e319',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:49:26 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-40ecff09-f28c-4cce-85cb-25e64cd5dc80 tempest-TestServerVolumeAttachScenarioOldVersion-670480170 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb59c6fe-0c9e-48d1-929f-447a2cf64c5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:49:26 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-40ecff09-f28c-4cce-85cb-25e64cd5dc80 tempest-TestServerVolumeAttachScenarioOldVersion-670480170 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb59c6fe-0c9e-48d1-929f-447a2cf64c5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:49:26 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-40ecff09-f28c-4cce-85cb-25e64cd5dc80 tempest-TestServerVolumeAttachScenarioOldVersion-670480170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebef0d8c-5236-460d-97f7-25a157f05282) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:49:26 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-40ecff09-f28c-4cce-85cb-25e64cd5dc80 tempest-TestServerVolumeAttachScenarioOldVersion-670480170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebef0d8c-5236-460d-97f7-25a157f05282) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b4448bdb-1804-4ddb-aa8e-0e7810b9f0dc', 'volume_name': 'volume-b4448bdb-1804-4ddb-aa8e-0e7810b9f0dc', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:49:26 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-40ecff09-f28c-4cce-85cb-25e64cd5dc80 tempest-TestServerVolumeAttachScenarioOldVersion-670480170 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29d085ba-1800-4a2d-8c74-04b351870084) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:49:26 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-40ecff09-f28c-4cce-85cb-25e64cd5dc80 tempest-TestServerVolumeAttachScenarioOldVersion-670480170 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29d085ba-1800-4a2d-8c74-04b351870084) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:49:26 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-40ecff09-f28c-4cce-85cb-25e64cd5dc80 tempest-TestServerVolumeAttachScenarioOldVersion-670480170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7508f213-671d-419c-8950-f63c66c6527d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:49:26 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-40ecff09-f28c-4cce-85cb-25e64cd5dc80 tempest-TestServerVolumeAttachScenarioOldVersion-670480170 None] Volume b4448bdb-1804-4ddb-aa8e-0e7810b9f0dc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b4448bdb-1804-4ddb-aa8e-0e7810b9f0dc', 'volume_size': 1} Sep 22 15:49:26 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-40ecff09-f28c-4cce-85cb-25e64cd5dc80 tempest-TestServerVolumeAttachScenarioOldVersion-670480170 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:49:26 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-40ecff09-f28c-4cce-85cb-25e64cd5dc80 tempest-TestServerVolumeAttachScenarioOldVersion-670480170 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:49:26 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-40ecff09-f28c-4cce-85cb-25e64cd5dc80 tempest-TestServerVolumeAttachScenarioOldVersion-670480170 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:49:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-285877502',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4448bdb-1804-4ddb-aa8e-0e7810b9f0dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd69222b8852464caf4e64addfabadd0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:49:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:49:27Z,use_quota=True,user_id='1173bb3094b64ed2b86d369aa1b4e319',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)}" {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 15:49:26 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-40ecff09-f28c-4cce-85cb-25e64cd5dc80 tempest-TestServerVolumeAttachScenarioOldVersion-670480170 None] Creating volume b4448bdb-1804-4ddb-aa8e-0e7810b9f0dc {{(pid=86212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 15:49:26 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-40ecff09-f28c-4cce-85cb-25e64cd5dc80 tempest-TestServerVolumeAttachScenarioOldVersion-670480170 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:49:26 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-40ecff09-f28c-4cce-85cb-25e64cd5dc80 tempest-TestServerVolumeAttachScenarioOldVersion-670480170 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:49:26 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-40ecff09-f28c-4cce-85cb-25e64cd5dc80 tempest-TestServerVolumeAttachScenarioOldVersion-670480170 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:49:26 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-40ecff09-f28c-4cce-85cb-25e64cd5dc80 tempest-TestServerVolumeAttachScenarioOldVersion-670480170 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:49:26 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-40ecff09-f28c-4cce-85cb-25e64cd5dc80 tempest-TestServerVolumeAttachScenarioOldVersion-670480170 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:49:26 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-40ecff09-f28c-4cce-85cb-25e64cd5dc80 tempest-TestServerVolumeAttachScenarioOldVersion-670480170 None] Selected osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 as target Quobyte volume. {{(pid=86212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 15:49:26 devstack cinder-volume[86212]: INFO cinder.volume.drivers.remotefs [None req-40ecff09-f28c-4cce-85cb-25e64cd5dc80 tempest-TestServerVolumeAttachScenarioOldVersion-670480170 None] casted to osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 Sep 22 15:49:26 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-40ecff09-f28c-4cce-85cb-25e64cd5dc80 tempest-TestServerVolumeAttachScenarioOldVersion-670480170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b4448bdb-1804-4ddb-aa8e-0e7810b9f0dc 1073741824 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:49:26 devstack sudo[98827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b4448bdb-1804-4ddb-aa8e-0e7810b9f0dc 1073741824 Sep 22 15:49:26 devstack sudo[98827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:49:27 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-dc022018-ecca-4e9b-9dae-7142d1fc3626 tempest-VolumesSnapshotListTestJSON-1813721960 None] Acquiring lock "cinder-b1d1ed1e-9f93-47f1-94d2-2791fb7f3937-delete_snapshot" by "delete_snapshot" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:49:27 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-dc022018-ecca-4e9b-9dae-7142d1fc3626 tempest-VolumesSnapshotListTestJSON-1813721960 None] Lock "cinder-b1d1ed1e-9f93-47f1-94d2-2791fb7f3937-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:49:27 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-dc022018-ecca-4e9b-9dae-7142d1fc3626 tempest-VolumesSnapshotListTestJSON-1813721960 None] Acquiring lock "cinder-quobyte-722726ce-36c4-41de-b575-64be96ebf06c" by "delete_snapshot" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:49:27 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-dc022018-ecca-4e9b-9dae-7142d1fc3626 tempest-VolumesSnapshotListTestJSON-1813721960 None] Lock "cinder-quobyte-722726ce-36c4-41de-b575-64be96ebf06c" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:49:27 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-dc022018-ecca-4e9b-9dae-7142d1fc3626 tempest-VolumesSnapshotListTestJSON-1813721960 None] Acquiring lock "cinder-quobyte-b1d1ed1e-9f93-47f1-94d2-2791fb7f3937" by "_delete_snapshot" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:49:27 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-dc022018-ecca-4e9b-9dae-7142d1fc3626 tempest-VolumesSnapshotListTestJSON-1813721960 None] Lock "cinder-quobyte-b1d1ed1e-9f93-47f1-94d2-2791fb7f3937" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:49:27 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-dc022018-ecca-4e9b-9dae-7142d1fc3626 tempest-VolumesSnapshotListTestJSON-1813721960 None] Deleting offline snapshot b1d1ed1e-9f93-47f1-94d2-2791fb7f3937 of volume 722726ce-36c4-41de-b575-64be96ebf06c {{(pid=86212) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 22 15:49:27 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-dc022018-ecca-4e9b-9dae-7142d1fc3626 tempest-VolumesSnapshotListTestJSON-1813721960 None] snapshot_file for this snap is: volume-722726ce-36c4-41de-b575-64be96ebf06c.b1d1ed1e-9f93-47f1-94d2-2791fb7f3937 {{(pid=86212) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 22 15:49:27 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f3581ec-847a-4b0d-a449-46ab8567d9e7]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:49:27 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-dc022018-ecca-4e9b-9dae-7142d1fc3626 tempest-VolumesSnapshotListTestJSON-1813721960 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-722726ce-36c4-41de-b575-64be96ebf06c.b1d1ed1e-9f93-47f1-94d2-2791fb7f3937 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:49:27 devstack sudo[98827]: pam_unix(sudo:session): session closed for user root Sep 22 15:49:27 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-40ecff09-f28c-4cce-85cb-25e64cd5dc80 tempest-TestServerVolumeAttachScenarioOldVersion-670480170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b4448bdb-1804-4ddb-aa8e-0e7810b9f0dc 1073741824" returned: 0 in 0.664s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:49:27 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-40ecff09-f28c-4cce-85cb-25e64cd5dc80 tempest-TestServerVolumeAttachScenarioOldVersion-670480170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b4448bdb-1804-4ddb-aa8e-0e7810b9f0dc {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:49:27 devstack sudo[98834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b4448bdb-1804-4ddb-aa8e-0e7810b9f0dc Sep 22 15:49:27 devstack sudo[98834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:49:27 devstack sudo[98833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-722726ce-36c4-41de-b575-64be96ebf06c.b1d1ed1e-9f93-47f1-94d2-2791fb7f3937 Sep 22 15:49:27 devstack sudo[98833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:49:27 devstack sudo[98834]: pam_unix(sudo:session): session closed for user root Sep 22 15:49:27 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-40ecff09-f28c-4cce-85cb-25e64cd5dc80 tempest-TestServerVolumeAttachScenarioOldVersion-670480170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b4448bdb-1804-4ddb-aa8e-0e7810b9f0dc" returned: 0 in 0.358s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:49:27 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-40ecff09-f28c-4cce-85cb-25e64cd5dc80 tempest-TestServerVolumeAttachScenarioOldVersion-670480170 None] <== create_volume: return (1097ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'} {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 15:49:27 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-40ecff09-f28c-4cce-85cb-25e64cd5dc80 tempest-TestServerVolumeAttachScenarioOldVersion-670480170 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.100s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:49:27 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-40ecff09-f28c-4cce-85cb-25e64cd5dc80 tempest-TestServerVolumeAttachScenarioOldVersion-670480170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7508f213-671d-419c-8950-f63c66c6527d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b4448bdb-1804-4ddb-aa8e-0e7810b9f0dc', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:49:27 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-40ecff09-f28c-4cce-85cb-25e64cd5dc80 tempest-TestServerVolumeAttachScenarioOldVersion-670480170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a44cfab0-b4e6-4b67-8a59-15f0c03eb5ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:49:27 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-40ecff09-f28c-4cce-85cb-25e64cd5dc80 tempest-TestServerVolumeAttachScenarioOldVersion-670480170 None] Volume volume-b4448bdb-1804-4ddb-aa8e-0e7810b9f0dc (b4448bdb-1804-4ddb-aa8e-0e7810b9f0dc): created successfully Sep 22 15:49:27 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-40ecff09-f28c-4cce-85cb-25e64cd5dc80 tempest-TestServerVolumeAttachScenarioOldVersion-670480170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a44cfab0-b4e6-4b67-8a59-15f0c03eb5ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:49:27 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-40ecff09-f28c-4cce-85cb-25e64cd5dc80 tempest-TestServerVolumeAttachScenarioOldVersion-670480170 None] Flow 'volume_create_manager' (53257d62-3f13-4936-83e7-6b3869b912ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:49:27 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-40ecff09-f28c-4cce-85cb-25e64cd5dc80 tempest-TestServerVolumeAttachScenarioOldVersion-670480170 None] Created volume successfully. Sep 22 15:49:28 devstack sudo[98833]: pam_unix(sudo:session): session closed for user root Sep 22 15:49:28 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-dc022018-ecca-4e9b-9dae-7142d1fc3626 tempest-VolumesSnapshotListTestJSON-1813721960 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-722726ce-36c4-41de-b575-64be96ebf06c.b1d1ed1e-9f93-47f1-94d2-2791fb7f3937" returned: 0 in 0.558s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:49:28 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-dc022018-ecca-4e9b-9dae-7142d1fc3626 tempest-VolumesSnapshotListTestJSON-1813721960 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-722726ce-36c4-41de-b575-64be96ebf06c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86212) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 22 15:49:28 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[07736b88-95ca-476b-8383-e61eb3632fb8]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:49:28 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-dc022018-ecca-4e9b-9dae-7142d1fc3626 tempest-VolumesSnapshotListTestJSON-1813721960 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-722726ce-36c4-41de-b575-64be96ebf06c.6e115a1d-525b-441f-abac-8227fc95aa28 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:49:28 devstack sudo[98842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-722726ce-36c4-41de-b575-64be96ebf06c.6e115a1d-525b-441f-abac-8227fc95aa28 Sep 22 15:49:28 devstack sudo[98842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:49:28 devstack sudo[98842]: pam_unix(sudo:session): session closed for user root Sep 22 15:49:28 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-dc022018-ecca-4e9b-9dae-7142d1fc3626 tempest-VolumesSnapshotListTestJSON-1813721960 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-722726ce-36c4-41de-b575-64be96ebf06c.6e115a1d-525b-441f-abac-8227fc95aa28" returned: 0 in 0.481s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:49:28 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-dc022018-ecca-4e9b-9dae-7142d1fc3626 tempest-VolumesSnapshotListTestJSON-1813721960 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-722726ce-36c4-41de-b575-64be96ebf06c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86212) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 22 15:49:28 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-dc022018-ecca-4e9b-9dae-7142d1fc3626 tempest-VolumesSnapshotListTestJSON-1813721960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-722726ce-36c4-41de-b575-64be96ebf06c.b1d1ed1e-9f93-47f1-94d2-2791fb7f3937 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:49:28 devstack sudo[98847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-722726ce-36c4-41de-b575-64be96ebf06c.b1d1ed1e-9f93-47f1-94d2-2791fb7f3937 Sep 22 15:49:28 devstack sudo[98847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:49:29 devstack sudo[98847]: pam_unix(sudo:session): session closed for user root Sep 22 15:49:29 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-dc022018-ecca-4e9b-9dae-7142d1fc3626 tempest-VolumesSnapshotListTestJSON-1813721960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-722726ce-36c4-41de-b575-64be96ebf06c.b1d1ed1e-9f93-47f1-94d2-2791fb7f3937" returned: 0 in 0.564s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:49:29 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-dc022018-ecca-4e9b-9dae-7142d1fc3626 tempest-VolumesSnapshotListTestJSON-1813721960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-722726ce-36c4-41de-b575-64be96ebf06c.b1d1ed1e-9f93-47f1-94d2-2791fb7f3937 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:49:29 devstack sudo[98856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-722726ce-36c4-41de-b575-64be96ebf06c.b1d1ed1e-9f93-47f1-94d2-2791fb7f3937 Sep 22 15:49:29 devstack sudo[98856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:49:29 devstack sudo[98856]: pam_unix(sudo:session): session closed for user root Sep 22 15:49:29 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-dc022018-ecca-4e9b-9dae-7142d1fc3626 tempest-VolumesSnapshotListTestJSON-1813721960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-722726ce-36c4-41de-b575-64be96ebf06c.b1d1ed1e-9f93-47f1-94d2-2791fb7f3937" returned: 0 in 0.318s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:49:29 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-dc022018-ecca-4e9b-9dae-7142d1fc3626 tempest-VolumesSnapshotListTestJSON-1813721960 None] Lock "cinder-quobyte-b1d1ed1e-9f93-47f1-94d2-2791fb7f3937" released by "_delete_snapshot" :: held 2.077s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:49:29 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-dc022018-ecca-4e9b-9dae-7142d1fc3626 tempest-VolumesSnapshotListTestJSON-1813721960 None] Lock "cinder-quobyte-722726ce-36c4-41de-b575-64be96ebf06c" released by "delete_snapshot" :: held 2.112s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:49:29 devstack cinder-volume[86212]: DEBUG cinder.quota [None req-dc022018-ecca-4e9b-9dae-7142d1fc3626 tempest-VolumesSnapshotListTestJSON-1813721960 None] Created reservations ['c022264d-1708-4c5f-9680-bf93277f9711', 'd44f0a66-1bc9-473e-b755-f48c81dd327e', '82cffbaf-7854-4755-989b-3b09587b5d5b', 'b6c15c65-3514-4592-896d-ef9760fdfee9'] {{(pid=86212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 15:49:29 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-dc022018-ecca-4e9b-9dae-7142d1fc3626 tempest-VolumesSnapshotListTestJSON-1813721960 None] Delete snapshot completed successfully. Sep 22 15:49:29 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-dc022018-ecca-4e9b-9dae-7142d1fc3626 tempest-VolumesSnapshotListTestJSON-1813721960 None] Lock "cinder-b1d1ed1e-9f93-47f1-94d2-2791fb7f3937-delete_snapshot" released by "delete_snapshot" :: held 2.447s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:49:30 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [req-c3794f43-2681-430b-9f15-283e7a39b2ef req-dc522117-ef42-4817-a387-106662ed4ac3 tempest-TestServerVolumeAttachScenarioOldVersion-670480170 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:49:30 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [req-c3794f43-2681-430b-9f15-283e7a39b2ef req-dc522117-ef42-4817-a387-106662ed4ac3 tempest-TestServerVolumeAttachScenarioOldVersion-670480170 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:49:30 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [req-c3794f43-2681-430b-9f15-283e7a39b2ef req-dc522117-ef42-4817-a387-106662ed4ac3 tempest-TestServerVolumeAttachScenarioOldVersion-670480170 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:49:30 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [req-c3794f43-2681-430b-9f15-283e7a39b2ef req-dc522117-ef42-4817-a387-106662ed4ac3 tempest-TestServerVolumeAttachScenarioOldVersion-670480170 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31', 'name': 'volume-b4448bdb-1804-4ddb-aa8e-0e7810b9f0dc', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9be10f8c-80f9-499e-a03f-0bb69264c68d', 'enforce_multipath': True} {{(pid=86212) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 22 15:49:30 devstack cinder-volume[86212]: INFO cinder.volume.manager [req-c3794f43-2681-430b-9f15-283e7a39b2ef req-dc522117-ef42-4817-a387-106662ed4ac3 tempest-TestServerVolumeAttachScenarioOldVersion-670480170 None] attachment_update completed successfully. Sep 22 15:49:30 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-db5bc7c1-4230-4d61-9158-3da45f133765 tempest-VolumesSnapshotListTestJSON-1813721960 None] Acquiring lock "cinder-6e115a1d-525b-441f-abac-8227fc95aa28-delete_snapshot" by "delete_snapshot" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:49:30 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-db5bc7c1-4230-4d61-9158-3da45f133765 tempest-VolumesSnapshotListTestJSON-1813721960 None] Lock "cinder-6e115a1d-525b-441f-abac-8227fc95aa28-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:49:30 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-db5bc7c1-4230-4d61-9158-3da45f133765 tempest-VolumesSnapshotListTestJSON-1813721960 None] Acquiring lock "cinder-quobyte-722726ce-36c4-41de-b575-64be96ebf06c" by "delete_snapshot" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:49:30 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-db5bc7c1-4230-4d61-9158-3da45f133765 tempest-VolumesSnapshotListTestJSON-1813721960 None] Lock "cinder-quobyte-722726ce-36c4-41de-b575-64be96ebf06c" acquired by "delete_snapshot" :: waited 0.036s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:49:30 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-db5bc7c1-4230-4d61-9158-3da45f133765 tempest-VolumesSnapshotListTestJSON-1813721960 None] Acquiring lock "cinder-quobyte-6e115a1d-525b-441f-abac-8227fc95aa28" by "_delete_snapshot" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:49:30 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-db5bc7c1-4230-4d61-9158-3da45f133765 tempest-VolumesSnapshotListTestJSON-1813721960 None] Lock "cinder-quobyte-6e115a1d-525b-441f-abac-8227fc95aa28" acquired by "_delete_snapshot" :: waited 0.040s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:49:30 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-db5bc7c1-4230-4d61-9158-3da45f133765 tempest-VolumesSnapshotListTestJSON-1813721960 None] Deleting offline snapshot 6e115a1d-525b-441f-abac-8227fc95aa28 of volume 722726ce-36c4-41de-b575-64be96ebf06c {{(pid=86212) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 22 15:49:30 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-db5bc7c1-4230-4d61-9158-3da45f133765 tempest-VolumesSnapshotListTestJSON-1813721960 None] snapshot_file for this snap is: volume-722726ce-36c4-41de-b575-64be96ebf06c.6e115a1d-525b-441f-abac-8227fc95aa28 {{(pid=86212) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 22 15:49:30 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e47c90a-dd60-4b1a-a7f3-955e0e8f2b6c]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:49:30 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-db5bc7c1-4230-4d61-9158-3da45f133765 tempest-VolumesSnapshotListTestJSON-1813721960 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-722726ce-36c4-41de-b575-64be96ebf06c.6e115a1d-525b-441f-abac-8227fc95aa28 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:49:30 devstack sudo[99279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-722726ce-36c4-41de-b575-64be96ebf06c.6e115a1d-525b-441f-abac-8227fc95aa28 Sep 22 15:49:30 devstack sudo[99279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:49:31 devstack sudo[99279]: pam_unix(sudo:session): session closed for user root Sep 22 15:49:31 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-db5bc7c1-4230-4d61-9158-3da45f133765 tempest-VolumesSnapshotListTestJSON-1813721960 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-722726ce-36c4-41de-b575-64be96ebf06c.6e115a1d-525b-441f-abac-8227fc95aa28" returned: 0 in 0.490s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:49:31 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-db5bc7c1-4230-4d61-9158-3da45f133765 tempest-VolumesSnapshotListTestJSON-1813721960 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-722726ce-36c4-41de-b575-64be96ebf06c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86212) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 22 15:49:31 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[323b3e5d-19be-4c56-8148-e8fc2bb0ee54]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:49:31 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-db5bc7c1-4230-4d61-9158-3da45f133765 tempest-VolumesSnapshotListTestJSON-1813721960 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-722726ce-36c4-41de-b575-64be96ebf06c.de53b2f4-180a-4a91-b90f-50de0029db82 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:49:31 devstack sudo[99285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-722726ce-36c4-41de-b575-64be96ebf06c.de53b2f4-180a-4a91-b90f-50de0029db82 Sep 22 15:49:31 devstack sudo[99285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:49:31 devstack sudo[99285]: pam_unix(sudo:session): session closed for user root Sep 22 15:49:31 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-db5bc7c1-4230-4d61-9158-3da45f133765 tempest-VolumesSnapshotListTestJSON-1813721960 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-722726ce-36c4-41de-b575-64be96ebf06c.de53b2f4-180a-4a91-b90f-50de0029db82" returned: 0 in 0.545s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:49:31 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-db5bc7c1-4230-4d61-9158-3da45f133765 tempest-VolumesSnapshotListTestJSON-1813721960 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-722726ce-36c4-41de-b575-64be96ebf06c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86212) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 22 15:49:31 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-db5bc7c1-4230-4d61-9158-3da45f133765 tempest-VolumesSnapshotListTestJSON-1813721960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-722726ce-36c4-41de-b575-64be96ebf06c.6e115a1d-525b-441f-abac-8227fc95aa28 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:49:31 devstack sudo[99290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-722726ce-36c4-41de-b575-64be96ebf06c.6e115a1d-525b-441f-abac-8227fc95aa28 Sep 22 15:49:31 devstack sudo[99290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:49:32 devstack sudo[99290]: pam_unix(sudo:session): session closed for user root Sep 22 15:49:32 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-db5bc7c1-4230-4d61-9158-3da45f133765 tempest-VolumesSnapshotListTestJSON-1813721960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-722726ce-36c4-41de-b575-64be96ebf06c.6e115a1d-525b-441f-abac-8227fc95aa28" returned: 0 in 0.525s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:49:32 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-db5bc7c1-4230-4d61-9158-3da45f133765 tempest-VolumesSnapshotListTestJSON-1813721960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-722726ce-36c4-41de-b575-64be96ebf06c.6e115a1d-525b-441f-abac-8227fc95aa28 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:49:32 devstack sudo[99295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-722726ce-36c4-41de-b575-64be96ebf06c.6e115a1d-525b-441f-abac-8227fc95aa28 Sep 22 15:49:32 devstack sudo[99295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:49:32 devstack sudo[99295]: pam_unix(sudo:session): session closed for user root Sep 22 15:49:32 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-db5bc7c1-4230-4d61-9158-3da45f133765 tempest-VolumesSnapshotListTestJSON-1813721960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-722726ce-36c4-41de-b575-64be96ebf06c.6e115a1d-525b-441f-abac-8227fc95aa28" returned: 0 in 0.380s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:49:32 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-db5bc7c1-4230-4d61-9158-3da45f133765 tempest-VolumesSnapshotListTestJSON-1813721960 None] Lock "cinder-quobyte-6e115a1d-525b-441f-abac-8227fc95aa28" released by "_delete_snapshot" :: held 2.177s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:49:32 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-db5bc7c1-4230-4d61-9158-3da45f133765 tempest-VolumesSnapshotListTestJSON-1813721960 None] Lock "cinder-quobyte-722726ce-36c4-41de-b575-64be96ebf06c" released by "delete_snapshot" :: held 2.228s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:49:33 devstack cinder-volume[86212]: DEBUG cinder.quota [None req-db5bc7c1-4230-4d61-9158-3da45f133765 tempest-VolumesSnapshotListTestJSON-1813721960 None] Created reservations ['3e51d401-1772-4445-9bf6-bae12dcbef82', '98feb055-c699-43c6-904b-f35c24dcccf2', 'a8e41e59-59f9-4ac6-9bfd-09568a48dd72', 'e7ab278e-3f4a-4e2d-90bb-0e22013862e0'] {{(pid=86212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 15:49:33 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-db5bc7c1-4230-4d61-9158-3da45f133765 tempest-VolumesSnapshotListTestJSON-1813721960 None] Delete snapshot completed successfully. Sep 22 15:49:33 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-db5bc7c1-4230-4d61-9158-3da45f133765 tempest-VolumesSnapshotListTestJSON-1813721960 None] Lock "cinder-6e115a1d-525b-441f-abac-8227fc95aa28-delete_snapshot" released by "delete_snapshot" :: held 2.459s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:49:33 devstack cinder-volume[86212]: INFO cinder.volume.manager [req-9935febd-65fb-4aa2-a66a-63339311da79 req-415d8d65-481f-427d-844f-9b9574ed3da5 tempest-TestServerVolumeAttachScenarioOldVersion-670480170 None] Terminate volume connection completed successfully. Sep 22 15:49:33 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [req-9935febd-65fb-4aa2-a66a-63339311da79 req-415d8d65-481f-427d-844f-9b9574ed3da5 tempest-TestServerVolumeAttachScenarioOldVersion-670480170 None] Deleting attachment 9be10f8c-80f9-499e-a03f-0bb69264c68d. {{(pid=86212) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 22 15:49:33 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-145bcd9c-7312-44e4-a360-973a75ed13bd tempest-VolumesSnapshotListTestJSON-1813721960 None] Acquiring lock "cinder-de53b2f4-180a-4a91-b90f-50de0029db82-delete_snapshot" by "delete_snapshot" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:49:33 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-145bcd9c-7312-44e4-a360-973a75ed13bd tempest-VolumesSnapshotListTestJSON-1813721960 None] Lock "cinder-de53b2f4-180a-4a91-b90f-50de0029db82-delete_snapshot" acquired by "delete_snapshot" :: waited 0.046s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:49:33 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-145bcd9c-7312-44e4-a360-973a75ed13bd tempest-VolumesSnapshotListTestJSON-1813721960 None] Acquiring lock "cinder-quobyte-722726ce-36c4-41de-b575-64be96ebf06c" by "delete_snapshot" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:49:33 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-145bcd9c-7312-44e4-a360-973a75ed13bd tempest-VolumesSnapshotListTestJSON-1813721960 None] Lock "cinder-quobyte-722726ce-36c4-41de-b575-64be96ebf06c" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:49:33 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-145bcd9c-7312-44e4-a360-973a75ed13bd tempest-VolumesSnapshotListTestJSON-1813721960 None] Acquiring lock "cinder-quobyte-de53b2f4-180a-4a91-b90f-50de0029db82" by "_delete_snapshot" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:49:34 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-145bcd9c-7312-44e4-a360-973a75ed13bd tempest-VolumesSnapshotListTestJSON-1813721960 None] Lock "cinder-quobyte-de53b2f4-180a-4a91-b90f-50de0029db82" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:49:34 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-145bcd9c-7312-44e4-a360-973a75ed13bd tempest-VolumesSnapshotListTestJSON-1813721960 None] Deleting offline snapshot de53b2f4-180a-4a91-b90f-50de0029db82 of volume 722726ce-36c4-41de-b575-64be96ebf06c {{(pid=86212) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 22 15:49:34 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-145bcd9c-7312-44e4-a360-973a75ed13bd tempest-VolumesSnapshotListTestJSON-1813721960 None] snapshot_file for this snap is: volume-722726ce-36c4-41de-b575-64be96ebf06c.de53b2f4-180a-4a91-b90f-50de0029db82 {{(pid=86212) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 22 15:49:34 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[002ef65e-5ba4-4c8b-ab2d-ba2f7bd6246e]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:49:34 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-145bcd9c-7312-44e4-a360-973a75ed13bd tempest-VolumesSnapshotListTestJSON-1813721960 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-722726ce-36c4-41de-b575-64be96ebf06c.de53b2f4-180a-4a91-b90f-50de0029db82 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:49:34 devstack sudo[99326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-722726ce-36c4-41de-b575-64be96ebf06c.de53b2f4-180a-4a91-b90f-50de0029db82 Sep 22 15:49:34 devstack sudo[99326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:49:34 devstack sudo[99326]: pam_unix(sudo:session): session closed for user root Sep 22 15:49:34 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-145bcd9c-7312-44e4-a360-973a75ed13bd tempest-VolumesSnapshotListTestJSON-1813721960 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-722726ce-36c4-41de-b575-64be96ebf06c.de53b2f4-180a-4a91-b90f-50de0029db82" returned: 0 in 0.429s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:49:34 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-145bcd9c-7312-44e4-a360-973a75ed13bd tempest-VolumesSnapshotListTestJSON-1813721960 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-722726ce-36c4-41de-b575-64be96ebf06c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86212) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 22 15:49:34 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-2573162d-f8a9-49f8-9006-58464de7cc91 tempest-TestServerVolumeAttachScenarioOldVersion-670480170 None] Acquiring lock "cinder-b4448bdb-1804-4ddb-aa8e-0e7810b9f0dc-delete_volume" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:49:34 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[89ceda89-b2a9-43f8-ac09-35874e3239ce]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:49:34 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-145bcd9c-7312-44e4-a360-973a75ed13bd tempest-VolumesSnapshotListTestJSON-1813721960 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-722726ce-36c4-41de-b575-64be96ebf06c {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:49:34 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-2573162d-f8a9-49f8-9006-58464de7cc91 tempest-TestServerVolumeAttachScenarioOldVersion-670480170 None] Lock "cinder-b4448bdb-1804-4ddb-aa8e-0e7810b9f0dc-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:49:34 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-2573162d-f8a9-49f8-9006-58464de7cc91 tempest-TestServerVolumeAttachScenarioOldVersion-670480170 None] Acquiring lock "cinder-quobyte-b4448bdb-1804-4ddb-aa8e-0e7810b9f0dc" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:49:34 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-2573162d-f8a9-49f8-9006-58464de7cc91 tempest-TestServerVolumeAttachScenarioOldVersion-670480170 None] Lock "cinder-quobyte-b4448bdb-1804-4ddb-aa8e-0e7810b9f0dc" acquired by "delete_volume" :: waited 0.026s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:49:34 devstack sudo[99331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-722726ce-36c4-41de-b575-64be96ebf06c Sep 22 15:49:34 devstack sudo[99331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:49:34 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf139968-5b48-4be7-a405-c3116bb767c3]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:49:34 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-2573162d-f8a9-49f8-9006-58464de7cc91 tempest-TestServerVolumeAttachScenarioOldVersion-670480170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b4448bdb-1804-4ddb-aa8e-0e7810b9f0dc {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:49:34 devstack sudo[99333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b4448bdb-1804-4ddb-aa8e-0e7810b9f0dc Sep 22 15:49:34 devstack sudo[99333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:49:35 devstack sudo[99331]: pam_unix(sudo:session): session closed for user root Sep 22 15:49:35 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-145bcd9c-7312-44e4-a360-973a75ed13bd tempest-VolumesSnapshotListTestJSON-1813721960 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-722726ce-36c4-41de-b575-64be96ebf06c" returned: 0 in 0.550s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:49:35 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-145bcd9c-7312-44e4-a360-973a75ed13bd tempest-VolumesSnapshotListTestJSON-1813721960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-722726ce-36c4-41de-b575-64be96ebf06c.de53b2f4-180a-4a91-b90f-50de0029db82 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:49:35 devstack sudo[99342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-722726ce-36c4-41de-b575-64be96ebf06c.de53b2f4-180a-4a91-b90f-50de0029db82 Sep 22 15:49:35 devstack sudo[99342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:49:35 devstack sudo[99333]: pam_unix(sudo:session): session closed for user root Sep 22 15:49:35 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-2573162d-f8a9-49f8-9006-58464de7cc91 tempest-TestServerVolumeAttachScenarioOldVersion-670480170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b4448bdb-1804-4ddb-aa8e-0e7810b9f0dc" returned: 0 in 0.449s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:49:35 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-2573162d-f8a9-49f8-9006-58464de7cc91 tempest-TestServerVolumeAttachScenarioOldVersion-670480170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b4448bdb-1804-4ddb-aa8e-0e7810b9f0dc {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:49:35 devstack sudo[99344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b4448bdb-1804-4ddb-aa8e-0e7810b9f0dc Sep 22 15:49:35 devstack sudo[99344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:49:35 devstack sudo[99344]: pam_unix(sudo:session): session closed for user root Sep 22 15:49:35 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-2573162d-f8a9-49f8-9006-58464de7cc91 tempest-TestServerVolumeAttachScenarioOldVersion-670480170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b4448bdb-1804-4ddb-aa8e-0e7810b9f0dc" returned: 0 in 0.378s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:49:35 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-2573162d-f8a9-49f8-9006-58464de7cc91 tempest-TestServerVolumeAttachScenarioOldVersion-670480170 None] Lock "cinder-quobyte-b4448bdb-1804-4ddb-aa8e-0e7810b9f0dc" released by "delete_volume" :: held 0.911s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:49:35 devstack sudo[99342]: pam_unix(sudo:session): session closed for user root Sep 22 15:49:35 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-145bcd9c-7312-44e4-a360-973a75ed13bd tempest-VolumesSnapshotListTestJSON-1813721960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-722726ce-36c4-41de-b575-64be96ebf06c.de53b2f4-180a-4a91-b90f-50de0029db82" returned: 0 in 0.496s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:49:35 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-145bcd9c-7312-44e4-a360-973a75ed13bd tempest-VolumesSnapshotListTestJSON-1813721960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-722726ce-36c4-41de-b575-64be96ebf06c.de53b2f4-180a-4a91-b90f-50de0029db82 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:49:35 devstack sudo[99352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-722726ce-36c4-41de-b575-64be96ebf06c.de53b2f4-180a-4a91-b90f-50de0029db82 Sep 22 15:49:35 devstack sudo[99352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:49:35 devstack cinder-volume[86212]: DEBUG cinder.quota [None req-2573162d-f8a9-49f8-9006-58464de7cc91 tempest-TestServerVolumeAttachScenarioOldVersion-670480170 None] Created reservations ['ab9a8121-7048-4ddc-8c39-a4bb57c87dd8', '58898f99-780f-48ab-ac6b-25ab3dc1e584', '21871ec4-9a66-4c03-81ad-d6f54b02c266', '7bf07638-6473-444b-9f87-30822255a0b8'] {{(pid=86212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 15:49:35 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-2573162d-f8a9-49f8-9006-58464de7cc91 tempest-TestServerVolumeAttachScenarioOldVersion-670480170 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:49:35 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-2573162d-f8a9-49f8-9006-58464de7cc91 tempest-TestServerVolumeAttachScenarioOldVersion-670480170 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:49:35 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-2573162d-f8a9-49f8-9006-58464de7cc91 tempest-TestServerVolumeAttachScenarioOldVersion-670480170 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:49:35 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-2573162d-f8a9-49f8-9006-58464de7cc91 tempest-TestServerVolumeAttachScenarioOldVersion-670480170 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:49:35 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-2573162d-f8a9-49f8-9006-58464de7cc91 tempest-TestServerVolumeAttachScenarioOldVersion-670480170 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:49:35 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-2573162d-f8a9-49f8-9006-58464de7cc91 tempest-TestServerVolumeAttachScenarioOldVersion-670480170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:49:35 devstack sudo[99355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc Sep 22 15:49:35 devstack sudo[99355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:49:36 devstack sudo[99352]: pam_unix(sudo:session): session closed for user root Sep 22 15:49:36 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-145bcd9c-7312-44e4-a360-973a75ed13bd tempest-VolumesSnapshotListTestJSON-1813721960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-722726ce-36c4-41de-b575-64be96ebf06c.de53b2f4-180a-4a91-b90f-50de0029db82" returned: 0 in 0.382s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:49:36 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-145bcd9c-7312-44e4-a360-973a75ed13bd tempest-VolumesSnapshotListTestJSON-1813721960 None] Lock "cinder-quobyte-de53b2f4-180a-4a91-b90f-50de0029db82" released by "_delete_snapshot" :: held 2.069s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:49:36 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-145bcd9c-7312-44e4-a360-973a75ed13bd tempest-VolumesSnapshotListTestJSON-1813721960 None] Lock "cinder-quobyte-722726ce-36c4-41de-b575-64be96ebf06c" released by "delete_snapshot" :: held 2.104s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:49:36 devstack cinder-volume[86212]: DEBUG cinder.quota [None req-145bcd9c-7312-44e4-a360-973a75ed13bd tempest-VolumesSnapshotListTestJSON-1813721960 None] Created reservations ['9aca7523-15b2-4d43-9e0f-d9c2ae168390', '5babc865-634a-4b47-a9d7-ac18e9276c30', '5c7104e1-f3e3-4597-8033-ae2a46901b0f', '3160502c-aa1b-47b7-88d0-a19880788a34'] {{(pid=86212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 15:49:36 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-145bcd9c-7312-44e4-a360-973a75ed13bd tempest-VolumesSnapshotListTestJSON-1813721960 None] Delete snapshot completed successfully. Sep 22 15:49:36 devstack sudo[99355]: pam_unix(sudo:session): session closed for user root Sep 22 15:49:36 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-145bcd9c-7312-44e4-a360-973a75ed13bd tempest-VolumesSnapshotListTestJSON-1813721960 None] Lock "cinder-de53b2f4-180a-4a91-b90f-50de0029db82-delete_snapshot" released by "delete_snapshot" :: held 2.327s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:49:36 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-2573162d-f8a9-49f8-9006-58464de7cc91 tempest-TestServerVolumeAttachScenarioOldVersion-670480170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc" returned: 0 in 0.367s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:49:36 devstack cinder-volume[86212]: DEBUG cinder.manager [None req-2573162d-f8a9-49f8-9006-58464de7cc91 tempest-TestServerVolumeAttachScenarioOldVersion-670480170 None] Notifying Schedulers of capabilities ... {{(pid=86212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 15:49:36 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-2573162d-f8a9-49f8-9006-58464de7cc91 tempest-TestServerVolumeAttachScenarioOldVersion-670480170 None] Deleted volume successfully. Sep 22 15:49:36 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-2573162d-f8a9-49f8-9006-58464de7cc91 tempest-TestServerVolumeAttachScenarioOldVersion-670480170 None] Lock "cinder-b4448bdb-1804-4ddb-aa8e-0e7810b9f0dc-delete_volume" released by "delete_volume" :: held 1.730s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:49:37 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-915f7580-5cd7-486b-998a-7030298e9fe0 tempest-VolumesSnapshotListTestJSON-1813721960 None] Acquiring lock "cinder-722726ce-36c4-41de-b575-64be96ebf06c-delete_volume" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:49:37 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-915f7580-5cd7-486b-998a-7030298e9fe0 tempest-VolumesSnapshotListTestJSON-1813721960 None] Lock "cinder-722726ce-36c4-41de-b575-64be96ebf06c-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:49:37 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-915f7580-5cd7-486b-998a-7030298e9fe0 tempest-VolumesSnapshotListTestJSON-1813721960 None] Acquiring lock "cinder-quobyte-722726ce-36c4-41de-b575-64be96ebf06c" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:49:37 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-915f7580-5cd7-486b-998a-7030298e9fe0 tempest-VolumesSnapshotListTestJSON-1813721960 None] Lock "cinder-quobyte-722726ce-36c4-41de-b575-64be96ebf06c" acquired by "delete_volume" :: waited 0.023s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:49:37 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[698d42a5-59fa-4b2a-96ee-68b7fa594e15]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:49:37 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-915f7580-5cd7-486b-998a-7030298e9fe0 tempest-VolumesSnapshotListTestJSON-1813721960 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-722726ce-36c4-41de-b575-64be96ebf06c {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:49:37 devstack sudo[99369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-722726ce-36c4-41de-b575-64be96ebf06c Sep 22 15:49:37 devstack sudo[99369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:49:38 devstack sudo[99369]: pam_unix(sudo:session): session closed for user root Sep 22 15:49:38 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-915f7580-5cd7-486b-998a-7030298e9fe0 tempest-VolumesSnapshotListTestJSON-1813721960 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-722726ce-36c4-41de-b575-64be96ebf06c" returned: 0 in 0.574s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:49:38 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-915f7580-5cd7-486b-998a-7030298e9fe0 tempest-VolumesSnapshotListTestJSON-1813721960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-722726ce-36c4-41de-b575-64be96ebf06c {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:49:38 devstack sudo[99384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-722726ce-36c4-41de-b575-64be96ebf06c Sep 22 15:49:38 devstack sudo[99384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:49:38 devstack sudo[99384]: pam_unix(sudo:session): session closed for user root Sep 22 15:49:38 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-915f7580-5cd7-486b-998a-7030298e9fe0 tempest-VolumesSnapshotListTestJSON-1813721960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-722726ce-36c4-41de-b575-64be96ebf06c" returned: 0 in 0.300s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:49:38 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-915f7580-5cd7-486b-998a-7030298e9fe0 tempest-VolumesSnapshotListTestJSON-1813721960 None] Lock "cinder-quobyte-722726ce-36c4-41de-b575-64be96ebf06c" released by "delete_volume" :: held 1.037s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:49:38 devstack cinder-volume[86212]: DEBUG oslo_service.periodic_task [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86212) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 22 15:49:38 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:49:38 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:49:38 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:49:38 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:49:38 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:49:38 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:49:38 devstack sudo[99387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc Sep 22 15:49:38 devstack sudo[99387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:49:38 devstack cinder-volume[86212]: DEBUG cinder.quota [None req-915f7580-5cd7-486b-998a-7030298e9fe0 tempest-VolumesSnapshotListTestJSON-1813721960 None] Created reservations ['496b53a7-19fc-4c3e-a823-9deda1b9fbe5', 'fcfc7de3-96bb-4d17-a62f-505efecd793a', 'b06f83ad-2dc7-4803-b5ea-ea7a6efac492', '76e07fdb-6742-46eb-a802-fd4ce2a405e5'] {{(pid=86212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 15:49:38 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-915f7580-5cd7-486b-998a-7030298e9fe0 tempest-VolumesSnapshotListTestJSON-1813721960 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:49:38 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-915f7580-5cd7-486b-998a-7030298e9fe0 tempest-VolumesSnapshotListTestJSON-1813721960 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:49:38 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-915f7580-5cd7-486b-998a-7030298e9fe0 tempest-VolumesSnapshotListTestJSON-1813721960 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:49:38 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-915f7580-5cd7-486b-998a-7030298e9fe0 tempest-VolumesSnapshotListTestJSON-1813721960 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:49:38 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-915f7580-5cd7-486b-998a-7030298e9fe0 tempest-VolumesSnapshotListTestJSON-1813721960 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:49:38 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-915f7580-5cd7-486b-998a-7030298e9fe0 tempest-VolumesSnapshotListTestJSON-1813721960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:49:38 devstack sudo[99405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc Sep 22 15:49:38 devstack sudo[99405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:49:39 devstack sudo[99387]: pam_unix(sudo:session): session closed for user root Sep 22 15:49:39 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc" returned: 0 in 0.556s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:49:39 devstack cinder-volume[86212]: DEBUG cinder.manager [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] Notifying Schedulers of capabilities ... {{(pid=86212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 15:49:39 devstack cinder-volume[86212]: DEBUG oslo_service.periodic_task [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] Running periodic task VolumeManager._thread_info {{(pid=86212) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 22 15:49:39 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] thread count: 29 {{(pid=86212) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 22 15:49:39 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] thread info: [<_MainThread(MainThread, started 136163191222400)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86212) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 22 15:49:39 devstack sudo[99405]: pam_unix(sudo:session): session closed for user root Sep 22 15:49:39 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-915f7580-5cd7-486b-998a-7030298e9fe0 tempest-VolumesSnapshotListTestJSON-1813721960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc" returned: 0 in 0.393s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:49:39 devstack cinder-volume[86212]: DEBUG cinder.manager [None req-915f7580-5cd7-486b-998a-7030298e9fe0 tempest-VolumesSnapshotListTestJSON-1813721960 None] Notifying Schedulers of capabilities ... {{(pid=86212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 15:49:39 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-915f7580-5cd7-486b-998a-7030298e9fe0 tempest-VolumesSnapshotListTestJSON-1813721960 None] Deleted volume successfully. Sep 22 15:49:39 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-915f7580-5cd7-486b-998a-7030298e9fe0 tempest-VolumesSnapshotListTestJSON-1813721960 None] Lock "cinder-722726ce-36c4-41de-b575-64be96ebf06c-delete_volume" released by "delete_volume" :: held 1.923s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:49:48 devstack cinder-volume[86212]: DEBUG dbcounter [-] [86212] Writing DB stats cinder:UPDATE=118,cinder:SELECT=85,cinder:INSERT=37,cinder:DELETE=10 {{(pid=86212) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 22 15:49:49 devstack cinder-volume[86212]: DEBUG dbcounter [-] [86212] Writing DB stats cinder:UPDATE=116,cinder:SELECT=104,cinder:DELETE=9,cinder:INSERT=28 {{(pid=86212) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 22 15:50:01 devstack cinder-volume[86212]: DEBUG cinder.volume.flows.manager.create_volume [None req-b531b7d9-f589-4e76-9be2-dd6298a1f80a tempest-SnapshotDependencyTests-1609965027 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 15:50:01 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-b531b7d9-f589-4e76-9be2-dd6298a1f80a tempest-SnapshotDependencyTests-1609965027 None] Flow 'volume_create_manager' (21562d80-1788-40d0-95b5-c40cee4e2a2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:50:01 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-b531b7d9-f589-4e76-9be2-dd6298a1f80a tempest-SnapshotDependencyTests-1609965027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b361f6aa-513b-4eaa-bbb9-31b7b71a2283) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:50:01 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-b531b7d9-f589-4e76-9be2-dd6298a1f80a tempest-SnapshotDependencyTests-1609965027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b361f6aa-513b-4eaa-bbb9-31b7b71a2283) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:50:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-128209225',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c585843b-6ae4-413e-b7ae-d3784bdcca1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8e2d4e0e35a4840b5be93223f1bec8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:50:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:50:01Z,use_quota=True,user_id='d9413e3817f54ed987df84e22cf867dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:50:01 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-b531b7d9-f589-4e76-9be2-dd6298a1f80a tempest-SnapshotDependencyTests-1609965027 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdb5cebc-23e5-49fb-a397-10f41af68693) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:50:01 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-b531b7d9-f589-4e76-9be2-dd6298a1f80a tempest-SnapshotDependencyTests-1609965027 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdb5cebc-23e5-49fb-a397-10f41af68693) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:50:01 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-b531b7d9-f589-4e76-9be2-dd6298a1f80a tempest-SnapshotDependencyTests-1609965027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15613fd8-5b83-439f-a35a-d4bf8ce109cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:50:01 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-b531b7d9-f589-4e76-9be2-dd6298a1f80a tempest-SnapshotDependencyTests-1609965027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15613fd8-5b83-439f-a35a-d4bf8ce109cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c585843b-6ae4-413e-b7ae-d3784bdcca1e', 'volume_name': 'volume-c585843b-6ae4-413e-b7ae-d3784bdcca1e', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:50:01 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-b531b7d9-f589-4e76-9be2-dd6298a1f80a tempest-SnapshotDependencyTests-1609965027 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d4617c7-f486-4158-a39f-f08e24847639) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:50:01 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-b531b7d9-f589-4e76-9be2-dd6298a1f80a tempest-SnapshotDependencyTests-1609965027 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d4617c7-f486-4158-a39f-f08e24847639) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:50:01 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-b531b7d9-f589-4e76-9be2-dd6298a1f80a tempest-SnapshotDependencyTests-1609965027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab097de8-4855-4aac-83f6-311d567c1a21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:50:01 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-b531b7d9-f589-4e76-9be2-dd6298a1f80a tempest-SnapshotDependencyTests-1609965027 None] Volume c585843b-6ae4-413e-b7ae-d3784bdcca1e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c585843b-6ae4-413e-b7ae-d3784bdcca1e', 'volume_size': 1} Sep 22 15:50:01 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-b531b7d9-f589-4e76-9be2-dd6298a1f80a tempest-SnapshotDependencyTests-1609965027 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:50:01 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-b531b7d9-f589-4e76-9be2-dd6298a1f80a tempest-SnapshotDependencyTests-1609965027 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:50:01 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-b531b7d9-f589-4e76-9be2-dd6298a1f80a tempest-SnapshotDependencyTests-1609965027 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:50:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-128209225',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c585843b-6ae4-413e-b7ae-d3784bdcca1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8e2d4e0e35a4840b5be93223f1bec8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:50:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:50:01Z,use_quota=True,user_id='d9413e3817f54ed987df84e22cf867dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)}" {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 15:50:01 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-b531b7d9-f589-4e76-9be2-dd6298a1f80a tempest-SnapshotDependencyTests-1609965027 None] Creating volume c585843b-6ae4-413e-b7ae-d3784bdcca1e {{(pid=86212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 15:50:01 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-b531b7d9-f589-4e76-9be2-dd6298a1f80a tempest-SnapshotDependencyTests-1609965027 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:50:01 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-b531b7d9-f589-4e76-9be2-dd6298a1f80a tempest-SnapshotDependencyTests-1609965027 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:50:01 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-b531b7d9-f589-4e76-9be2-dd6298a1f80a tempest-SnapshotDependencyTests-1609965027 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:50:01 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-b531b7d9-f589-4e76-9be2-dd6298a1f80a tempest-SnapshotDependencyTests-1609965027 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:50:01 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-b531b7d9-f589-4e76-9be2-dd6298a1f80a tempest-SnapshotDependencyTests-1609965027 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:50:01 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-b531b7d9-f589-4e76-9be2-dd6298a1f80a tempest-SnapshotDependencyTests-1609965027 None] Selected osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 as target Quobyte volume. {{(pid=86212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 15:50:01 devstack cinder-volume[86212]: INFO cinder.volume.drivers.remotefs [None req-b531b7d9-f589-4e76-9be2-dd6298a1f80a tempest-SnapshotDependencyTests-1609965027 None] casted to osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 Sep 22 15:50:01 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-b531b7d9-f589-4e76-9be2-dd6298a1f80a tempest-SnapshotDependencyTests-1609965027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-c585843b-6ae4-413e-b7ae-d3784bdcca1e 1073741824 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:50:01 devstack sudo[99445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-c585843b-6ae4-413e-b7ae-d3784bdcca1e 1073741824 Sep 22 15:50:01 devstack sudo[99445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:50:02 devstack sudo[99445]: pam_unix(sudo:session): session closed for user root Sep 22 15:50:02 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-b531b7d9-f589-4e76-9be2-dd6298a1f80a tempest-SnapshotDependencyTests-1609965027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-c585843b-6ae4-413e-b7ae-d3784bdcca1e 1073741824" returned: 0 in 0.589s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:50:02 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-b531b7d9-f589-4e76-9be2-dd6298a1f80a tempest-SnapshotDependencyTests-1609965027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-c585843b-6ae4-413e-b7ae-d3784bdcca1e {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:50:02 devstack sudo[99452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-c585843b-6ae4-413e-b7ae-d3784bdcca1e Sep 22 15:50:02 devstack sudo[99452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:50:02 devstack sudo[99452]: pam_unix(sudo:session): session closed for user root Sep 22 15:50:02 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-b531b7d9-f589-4e76-9be2-dd6298a1f80a tempest-SnapshotDependencyTests-1609965027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-c585843b-6ae4-413e-b7ae-d3784bdcca1e" returned: 0 in 0.293s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:50:02 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-b531b7d9-f589-4e76-9be2-dd6298a1f80a tempest-SnapshotDependencyTests-1609965027 None] <== create_volume: return (938ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'} {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 15:50:02 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-b531b7d9-f589-4e76-9be2-dd6298a1f80a tempest-SnapshotDependencyTests-1609965027 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.940s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:50:02 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-b531b7d9-f589-4e76-9be2-dd6298a1f80a tempest-SnapshotDependencyTests-1609965027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab097de8-4855-4aac-83f6-311d567c1a21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c585843b-6ae4-413e-b7ae-d3784bdcca1e', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:50:02 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-b531b7d9-f589-4e76-9be2-dd6298a1f80a tempest-SnapshotDependencyTests-1609965027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e51787e-f99b-4a8d-9d2b-135489ebd919) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:50:02 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-b531b7d9-f589-4e76-9be2-dd6298a1f80a tempest-SnapshotDependencyTests-1609965027 None] Volume volume-c585843b-6ae4-413e-b7ae-d3784bdcca1e (c585843b-6ae4-413e-b7ae-d3784bdcca1e): created successfully Sep 22 15:50:02 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-b531b7d9-f589-4e76-9be2-dd6298a1f80a tempest-SnapshotDependencyTests-1609965027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e51787e-f99b-4a8d-9d2b-135489ebd919) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:50:02 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-b531b7d9-f589-4e76-9be2-dd6298a1f80a tempest-SnapshotDependencyTests-1609965027 None] Flow 'volume_create_manager' (21562d80-1788-40d0-95b5-c40cee4e2a2b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:50:02 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-b531b7d9-f589-4e76-9be2-dd6298a1f80a tempest-SnapshotDependencyTests-1609965027 None] Created volume successfully. Sep 22 15:50:03 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-d827663e-fc5a-47a7-9f8b-e933c937d820 tempest-SnapshotDependencyTests-1609965027 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:50:03 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-d827663e-fc5a-47a7-9f8b-e933c937d820 tempest-SnapshotDependencyTests-1609965027 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:50:03 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-d827663e-fc5a-47a7-9f8b-e933c937d820 tempest-SnapshotDependencyTests-1609965027 None] Creating offline snapshot 16ae9032-29ad-4624-8e40-1f9b7ee8c946 of volume c585843b-6ae4-413e-b7ae-d3784bdcca1e {{(pid=86212) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 22 15:50:03 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[59243193-c31e-4fb3-bdd1-a5e3f35bb9e0]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:50:03 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-d827663e-fc5a-47a7-9f8b-e933c937d820 tempest-SnapshotDependencyTests-1609965027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-c585843b-6ae4-413e-b7ae-d3784bdcca1e {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:50:04 devstack sudo[99456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-c585843b-6ae4-413e-b7ae-d3784bdcca1e Sep 22 15:50:04 devstack sudo[99456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:50:04 devstack sudo[99456]: pam_unix(sudo:session): session closed for user root Sep 22 15:50:04 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-d827663e-fc5a-47a7-9f8b-e933c937d820 tempest-SnapshotDependencyTests-1609965027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-c585843b-6ae4-413e-b7ae-d3784bdcca1e" returned: 0 in 0.465s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:50:04 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-d827663e-fc5a-47a7-9f8b-e933c937d820 tempest-SnapshotDependencyTests-1609965027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-c585843b-6ae4-413e-b7ae-d3784bdcca1e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-c585843b-6ae4-413e-b7ae-d3784bdcca1e.16ae9032-29ad-4624-8e40-1f9b7ee8c946 1G {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:50:04 devstack sudo[99462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-c585843b-6ae4-413e-b7ae-d3784bdcca1e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-c585843b-6ae4-413e-b7ae-d3784bdcca1e.16ae9032-29ad-4624-8e40-1f9b7ee8c946 1G Sep 22 15:50:04 devstack sudo[99462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:50:04 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-d827663e-fc5a-47a7-9f8b-e933c937d820 tempest-SnapshotDependencyTests-1609965027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-c585843b-6ae4-413e-b7ae-d3784bdcca1e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-c585843b-6ae4-413e-b7ae-d3784bdcca1e.16ae9032-29ad-4624-8e40-1f9b7ee8c946 1G" returned: 0 in 0.533s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:50:04 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-d827663e-fc5a-47a7-9f8b-e933c937d820 tempest-SnapshotDependencyTests-1609965027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c585843b-6ae4-413e-b7ae-d3784bdcca1e -F qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-c585843b-6ae4-413e-b7ae-d3784bdcca1e.16ae9032-29ad-4624-8e40-1f9b7ee8c946 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:50:04 devstack sudo[99462]: pam_unix(sudo:session): session closed for user root Sep 22 15:50:05 devstack sudo[99468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c585843b-6ae4-413e-b7ae-d3784bdcca1e -F qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-c585843b-6ae4-413e-b7ae-d3784bdcca1e.16ae9032-29ad-4624-8e40-1f9b7ee8c946 Sep 22 15:50:05 devstack sudo[99468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:50:05 devstack sudo[99468]: pam_unix(sudo:session): session closed for user root Sep 22 15:50:05 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-d827663e-fc5a-47a7-9f8b-e933c937d820 tempest-SnapshotDependencyTests-1609965027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c585843b-6ae4-413e-b7ae-d3784bdcca1e -F qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-c585843b-6ae4-413e-b7ae-d3784bdcca1e.16ae9032-29ad-4624-8e40-1f9b7ee8c946" returned: 0 in 0.335s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:50:05 devstack cinder-volume[86212]: WARNING cinder.volume.drivers.remotefs [None req-d827663e-fc5a-47a7-9f8b-e933c937d820 tempest-SnapshotDependencyTests-1609965027 None] /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-c585843b-6ae4-413e-b7ae-d3784bdcca1e.16ae9032-29ad-4624-8e40-1f9b7ee8c946 is being set with open permissions: ugo+rw Sep 22 15:50:05 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-d827663e-fc5a-47a7-9f8b-e933c937d820 tempest-SnapshotDependencyTests-1609965027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-c585843b-6ae4-413e-b7ae-d3784bdcca1e.16ae9032-29ad-4624-8e40-1f9b7ee8c946 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:50:05 devstack sudo[99473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-c585843b-6ae4-413e-b7ae-d3784bdcca1e.16ae9032-29ad-4624-8e40-1f9b7ee8c946 Sep 22 15:50:05 devstack sudo[99473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:50:05 devstack sudo[99473]: pam_unix(sudo:session): session closed for user root Sep 22 15:50:05 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-d827663e-fc5a-47a7-9f8b-e933c937d820 tempest-SnapshotDependencyTests-1609965027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-c585843b-6ae4-413e-b7ae-d3784bdcca1e.16ae9032-29ad-4624-8e40-1f9b7ee8c946" returned: 0 in 0.249s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:50:05 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-d827663e-fc5a-47a7-9f8b-e933c937d820 tempest-SnapshotDependencyTests-1609965027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-c585843b-6ae4-413e-b7ae-d3784bdcca1e.info {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:50:05 devstack sudo[99476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-c585843b-6ae4-413e-b7ae-d3784bdcca1e.info Sep 22 15:50:05 devstack sudo[99476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:50:05 devstack sudo[99476]: pam_unix(sudo:session): session closed for user root Sep 22 15:50:05 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-d827663e-fc5a-47a7-9f8b-e933c937d820 tempest-SnapshotDependencyTests-1609965027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-c585843b-6ae4-413e-b7ae-d3784bdcca1e.info" returned: 0 in 0.315s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:50:05 devstack cinder-volume[86212]: WARNING cinder.volume.drivers.remotefs [None req-d827663e-fc5a-47a7-9f8b-e933c937d820 tempest-SnapshotDependencyTests-1609965027 None] /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-c585843b-6ae4-413e-b7ae-d3784bdcca1e.info is being set with open permissions: ugo+rw Sep 22 15:50:05 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-d827663e-fc5a-47a7-9f8b-e933c937d820 tempest-SnapshotDependencyTests-1609965027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-c585843b-6ae4-413e-b7ae-d3784bdcca1e.info {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:50:05 devstack sudo[99479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-c585843b-6ae4-413e-b7ae-d3784bdcca1e.info Sep 22 15:50:05 devstack sudo[99479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:50:06 devstack sudo[99479]: pam_unix(sudo:session): session closed for user root Sep 22 15:50:06 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-d827663e-fc5a-47a7-9f8b-e933c937d820 tempest-SnapshotDependencyTests-1609965027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-c585843b-6ae4-413e-b7ae-d3784bdcca1e.info" returned: 0 in 0.335s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:50:06 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-d827663e-fc5a-47a7-9f8b-e933c937d820 tempest-SnapshotDependencyTests-1609965027 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.361s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:50:06 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-d827663e-fc5a-47a7-9f8b-e933c937d820 tempest-SnapshotDependencyTests-1609965027 None] Create snapshot completed successfully Sep 22 15:50:07 devstack cinder-volume[86212]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ff4900d-f119-4c66-98c9-61d649cfdd20 tempest-SnapshotDependencyTests-1609965027 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 15:50:08 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-5ff4900d-f119-4c66-98c9-61d649cfdd20 tempest-SnapshotDependencyTests-1609965027 None] Flow 'volume_create_manager' (d439ee3c-d4af-4686-a354-774673850f26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:50:08 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-5ff4900d-f119-4c66-98c9-61d649cfdd20 tempest-SnapshotDependencyTests-1609965027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1eba0620-8fc0-4c7f-bfc4-56fd75498e63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:50:08 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-5ff4900d-f119-4c66-98c9-61d649cfdd20 tempest-SnapshotDependencyTests-1609965027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1eba0620-8fc0-4c7f-bfc4-56fd75498e63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:50:07Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=988f697b-a5c5-4fcc-bd92-c82e494352aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8e2d4e0e35a4840b5be93223f1bec8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:50:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=16ae9032-29ad-4624-8e40-1f9b7ee8c946,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:50:08Z,use_quota=True,user_id='d9413e3817f54ed987df84e22cf867dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:50:08 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-5ff4900d-f119-4c66-98c9-61d649cfdd20 tempest-SnapshotDependencyTests-1609965027 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c638cca-a3c8-4ba6-97b9-1e60630917db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:50:08 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-5ff4900d-f119-4c66-98c9-61d649cfdd20 tempest-SnapshotDependencyTests-1609965027 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c638cca-a3c8-4ba6-97b9-1e60630917db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:50:08 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-5ff4900d-f119-4c66-98c9-61d649cfdd20 tempest-SnapshotDependencyTests-1609965027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d72a5c3f-a02a-4416-b065-596db45a2b0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:50:08 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-5ff4900d-f119-4c66-98c9-61d649cfdd20 tempest-SnapshotDependencyTests-1609965027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d72a5c3f-a02a-4416-b065-596db45a2b0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '988f697b-a5c5-4fcc-bd92-c82e494352aa', 'volume_name': 'volume-988f697b-a5c5-4fcc-bd92-c82e494352aa', 'volume_size': 1, 'snapshot_id': '16ae9032-29ad-4624-8e40-1f9b7ee8c946'}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:50:08 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-5ff4900d-f119-4c66-98c9-61d649cfdd20 tempest-SnapshotDependencyTests-1609965027 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e61a9ae-3ff6-43d3-a64b-5015c065f8f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:50:08 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-5ff4900d-f119-4c66-98c9-61d649cfdd20 tempest-SnapshotDependencyTests-1609965027 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e61a9ae-3ff6-43d3-a64b-5015c065f8f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:50:08 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-5ff4900d-f119-4c66-98c9-61d649cfdd20 tempest-SnapshotDependencyTests-1609965027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eff311bc-8e6a-46e7-8f40-a4d826066bba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:50:08 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-5ff4900d-f119-4c66-98c9-61d649cfdd20 tempest-SnapshotDependencyTests-1609965027 None] Volume 988f697b-a5c5-4fcc-bd92-c82e494352aa: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-988f697b-a5c5-4fcc-bd92-c82e494352aa', 'volume_size': 1, 'snapshot_id': '16ae9032-29ad-4624-8e40-1f9b7ee8c946'} Sep 22 15:50:08 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-5ff4900d-f119-4c66-98c9-61d649cfdd20 tempest-SnapshotDependencyTests-1609965027 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:50:08 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-5ff4900d-f119-4c66-98c9-61d649cfdd20 tempest-SnapshotDependencyTests-1609965027 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:50:08 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-5ff4900d-f119-4c66-98c9-61d649cfdd20 tempest-SnapshotDependencyTests-1609965027 None] Acquiring lock "cinder-quobyte-16ae9032-29ad-4624-8e40-1f9b7ee8c946-988f697b-a5c5-4fcc-bd92-c82e494352aa" by "_create_volume_from_snapshot" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:50:08 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-5ff4900d-f119-4c66-98c9-61d649cfdd20 tempest-SnapshotDependencyTests-1609965027 None] Lock "cinder-quobyte-16ae9032-29ad-4624-8e40-1f9b7ee8c946-988f697b-a5c5-4fcc-bd92-c82e494352aa" acquired by "_create_volume_from_snapshot" :: waited 0.026s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:50:08 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-5ff4900d-f119-4c66-98c9-61d649cfdd20 tempest-SnapshotDependencyTests-1609965027 None] Creating volume 988f697b-a5c5-4fcc-bd92-c82e494352aa from snapshot 16ae9032-29ad-4624-8e40-1f9b7ee8c946 {{(pid=86212) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 22 15:50:08 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-5ff4900d-f119-4c66-98c9-61d649cfdd20 tempest-SnapshotDependencyTests-1609965027 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:50:08 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-5ff4900d-f119-4c66-98c9-61d649cfdd20 tempest-SnapshotDependencyTests-1609965027 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:50:08 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-5ff4900d-f119-4c66-98c9-61d649cfdd20 tempest-SnapshotDependencyTests-1609965027 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:50:08 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-5ff4900d-f119-4c66-98c9-61d649cfdd20 tempest-SnapshotDependencyTests-1609965027 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:50:08 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-5ff4900d-f119-4c66-98c9-61d649cfdd20 tempest-SnapshotDependencyTests-1609965027 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:50:08 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-5ff4900d-f119-4c66-98c9-61d649cfdd20 tempest-SnapshotDependencyTests-1609965027 None] Selected osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 as target Quobyte volume. {{(pid=86212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 15:50:08 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-5ff4900d-f119-4c66-98c9-61d649cfdd20 tempest-SnapshotDependencyTests-1609965027 None] Acquiring lock "cinder-quobyte-988f697b-a5c5-4fcc-bd92-c82e494352aa" by "_copy_volume_from_snapshot" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:50:08 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-5ff4900d-f119-4c66-98c9-61d649cfdd20 tempest-SnapshotDependencyTests-1609965027 None] Lock "cinder-quobyte-988f697b-a5c5-4fcc-bd92-c82e494352aa" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:50:08 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-5ff4900d-f119-4c66-98c9-61d649cfdd20 tempest-SnapshotDependencyTests-1609965027 None] snapshot: 16ae9032-29ad-4624-8e40-1f9b7ee8c946, volume: 988f697b-a5c5-4fcc-bd92-c82e494352aa, {{(pid=86212) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 22 15:50:08 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-5ff4900d-f119-4c66-98c9-61d649cfdd20 tempest-SnapshotDependencyTests-1609965027 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:50:08 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-5ff4900d-f119-4c66-98c9-61d649cfdd20 tempest-SnapshotDependencyTests-1609965027 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:50:08 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-5ff4900d-f119-4c66-98c9-61d649cfdd20 tempest-SnapshotDependencyTests-1609965027 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:50:08 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-5ff4900d-f119-4c66-98c9-61d649cfdd20 tempest-SnapshotDependencyTests-1609965027 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:50:08 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-5ff4900d-f119-4c66-98c9-61d649cfdd20 tempest-SnapshotDependencyTests-1609965027 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:50:08 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[22527678-2a74-458b-a57b-51d7347e02fb]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:50:08 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-5ff4900d-f119-4c66-98c9-61d649cfdd20 tempest-SnapshotDependencyTests-1609965027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-c585843b-6ae4-413e-b7ae-d3784bdcca1e.16ae9032-29ad-4624-8e40-1f9b7ee8c946 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:50:08 devstack sudo[99487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-c585843b-6ae4-413e-b7ae-d3784bdcca1e.16ae9032-29ad-4624-8e40-1f9b7ee8c946 Sep 22 15:50:08 devstack sudo[99487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:50:08 devstack sudo[99487]: pam_unix(sudo:session): session closed for user root Sep 22 15:50:08 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-5ff4900d-f119-4c66-98c9-61d649cfdd20 tempest-SnapshotDependencyTests-1609965027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-c585843b-6ae4-413e-b7ae-d3784bdcca1e.16ae9032-29ad-4624-8e40-1f9b7ee8c946" returned: 0 in 0.605s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:50:08 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-5ff4900d-f119-4c66-98c9-61d649cfdd20 tempest-SnapshotDependencyTests-1609965027 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c585843b-6ae4-413e-b7ae-d3784bdcca1e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86212) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 22 15:50:08 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ba1238f-731c-4411-a68e-09c0f5503840]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:50:08 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-5ff4900d-f119-4c66-98c9-61d649cfdd20 tempest-SnapshotDependencyTests-1609965027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-c585843b-6ae4-413e-b7ae-d3784bdcca1e {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:50:09 devstack sudo[99493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-c585843b-6ae4-413e-b7ae-d3784bdcca1e Sep 22 15:50:09 devstack sudo[99493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:50:09 devstack sudo[99493]: pam_unix(sudo:session): session closed for user root Sep 22 15:50:09 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-5ff4900d-f119-4c66-98c9-61d649cfdd20 tempest-SnapshotDependencyTests-1609965027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-c585843b-6ae4-413e-b7ae-d3784bdcca1e" returned: 0 in 0.653s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:50:09 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-5ff4900d-f119-4c66-98c9-61d649cfdd20 tempest-SnapshotDependencyTests-1609965027 None] will copy from snapshot at /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-c585843b-6ae4-413e-b7ae-d3784bdcca1e {{(pid=86212) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 22 15:50:09 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-5ff4900d-f119-4c66-98c9-61d649cfdd20 tempest-SnapshotDependencyTests-1609965027 None] Creating direct copy from snapshot {{(pid=86212) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 22 15:50:09 devstack cinder-volume[86212]: DEBUG cinder.utils [None req-5ff4900d-f119-4c66-98c9-61d649cfdd20 tempest-SnapshotDependencyTests-1609965027 None] Path /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-988f697b-a5c5-4fcc-bd92-c82e494352aa not found in is_blk_device check {{(pid=86212) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 22 15:50:09 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-5ff4900d-f119-4c66-98c9-61d649cfdd20 tempest-SnapshotDependencyTests-1609965027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-c585843b-6ae4-413e-b7ae-d3784bdcca1e /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-988f697b-a5c5-4fcc-bd92-c82e494352aa {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:50:09 devstack sudo[99499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-c585843b-6ae4-413e-b7ae-d3784bdcca1e /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-988f697b-a5c5-4fcc-bd92-c82e494352aa Sep 22 15:50:09 devstack sudo[99499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:50:16 devstack cinder-volume[86212]: DEBUG dbcounter [-] [86212] Writing DB stats cinder:SELECT=5,cinder:UPDATE=4,cinder:INSERT=2,cinder:DELETE=2 {{(pid=86212) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 22 15:50:18 devstack cinder-volume[86212]: DEBUG dbcounter [-] [86212] Writing DB stats cinder:UPDATE=6,cinder:SELECT=10 {{(pid=86212) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 22 15:50:20 devstack sudo[99499]: pam_unix(sudo:session): session closed for user root Sep 22 15:50:20 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-5ff4900d-f119-4c66-98c9-61d649cfdd20 tempest-SnapshotDependencyTests-1609965027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-c585843b-6ae4-413e-b7ae-d3784bdcca1e /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-988f697b-a5c5-4fcc-bd92-c82e494352aa" returned: 0 in 10.828s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:50:20 devstack cinder-volume[86212]: DEBUG cinder.image.image_utils [None req-5ff4900d-f119-4c66-98c9-61d649cfdd20 tempest-SnapshotDependencyTests-1609965027 None] Image conversion details: src /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-c585843b-6ae4-413e-b7ae-d3784bdcca1e, size 1024.00 MB, duration 10.83 sec, destination /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-988f697b-a5c5-4fcc-bd92-c82e494352aa {{(pid=86212) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 22 15:50:20 devstack cinder-volume[86212]: INFO cinder.image.image_utils [None req-5ff4900d-f119-4c66-98c9-61d649cfdd20 tempest-SnapshotDependencyTests-1609965027 None] Converted 1024.00 MB image at 94.56 MB/s Sep 22 15:50:20 devstack cinder-volume[86212]: WARNING cinder.volume.drivers.remotefs [None req-5ff4900d-f119-4c66-98c9-61d649cfdd20 tempest-SnapshotDependencyTests-1609965027 None] /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-988f697b-a5c5-4fcc-bd92-c82e494352aa is being set with open permissions: ugo+rw Sep 22 15:50:20 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-5ff4900d-f119-4c66-98c9-61d649cfdd20 tempest-SnapshotDependencyTests-1609965027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-988f697b-a5c5-4fcc-bd92-c82e494352aa {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:50:20 devstack sudo[99617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-988f697b-a5c5-4fcc-bd92-c82e494352aa Sep 22 15:50:20 devstack sudo[99617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:50:20 devstack sudo[99617]: pam_unix(sudo:session): session closed for user root Sep 22 15:50:20 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-5ff4900d-f119-4c66-98c9-61d649cfdd20 tempest-SnapshotDependencyTests-1609965027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-988f697b-a5c5-4fcc-bd92-c82e494352aa" returned: 0 in 0.402s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:50:20 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-5ff4900d-f119-4c66-98c9-61d649cfdd20 tempest-SnapshotDependencyTests-1609965027 None] Lock "cinder-quobyte-988f697b-a5c5-4fcc-bd92-c82e494352aa" released by "_copy_volume_from_snapshot" :: held 12.690s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:50:20 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-5ff4900d-f119-4c66-98c9-61d649cfdd20 tempest-SnapshotDependencyTests-1609965027 None] Lock "cinder-quobyte-16ae9032-29ad-4624-8e40-1f9b7ee8c946-988f697b-a5c5-4fcc-bd92-c82e494352aa" released by "_create_volume_from_snapshot" :: held 12.798s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:50:20 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-5ff4900d-f119-4c66-98c9-61d649cfdd20 tempest-SnapshotDependencyTests-1609965027 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 12.827s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:50:21 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-5ff4900d-f119-4c66-98c9-61d649cfdd20 tempest-SnapshotDependencyTests-1609965027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eff311bc-8e6a-46e7-8f40-a4d826066bba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-988f697b-a5c5-4fcc-bd92-c82e494352aa', 'volume_size': 1, 'snapshot_id': '16ae9032-29ad-4624-8e40-1f9b7ee8c946'}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:50:21 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-5ff4900d-f119-4c66-98c9-61d649cfdd20 tempest-SnapshotDependencyTests-1609965027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3e9dd78-09d8-44f6-ae58-9977fcca155c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:50:21 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-5ff4900d-f119-4c66-98c9-61d649cfdd20 tempest-SnapshotDependencyTests-1609965027 None] Volume volume-988f697b-a5c5-4fcc-bd92-c82e494352aa (988f697b-a5c5-4fcc-bd92-c82e494352aa): created successfully Sep 22 15:50:21 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-5ff4900d-f119-4c66-98c9-61d649cfdd20 tempest-SnapshotDependencyTests-1609965027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3e9dd78-09d8-44f6-ae58-9977fcca155c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:50:21 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-5ff4900d-f119-4c66-98c9-61d649cfdd20 tempest-SnapshotDependencyTests-1609965027 None] Flow 'volume_create_manager' (d439ee3c-d4af-4686-a354-774673850f26) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:50:21 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-5ff4900d-f119-4c66-98c9-61d649cfdd20 tempest-SnapshotDependencyTests-1609965027 None] Created volume successfully. Sep 22 15:50:22 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-47ff5a09-00b1-40dc-bb30-f4663c12f2c8 tempest-SnapshotDependencyTests-1609965027 None] Acquiring lock "cinder-16ae9032-29ad-4624-8e40-1f9b7ee8c946-delete_snapshot" by "delete_snapshot" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:50:22 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-47ff5a09-00b1-40dc-bb30-f4663c12f2c8 tempest-SnapshotDependencyTests-1609965027 None] Lock "cinder-16ae9032-29ad-4624-8e40-1f9b7ee8c946-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:50:22 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-47ff5a09-00b1-40dc-bb30-f4663c12f2c8 tempest-SnapshotDependencyTests-1609965027 None] Acquiring lock "cinder-quobyte-c585843b-6ae4-413e-b7ae-d3784bdcca1e" by "delete_snapshot" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:50:22 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-47ff5a09-00b1-40dc-bb30-f4663c12f2c8 tempest-SnapshotDependencyTests-1609965027 None] Lock "cinder-quobyte-c585843b-6ae4-413e-b7ae-d3784bdcca1e" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:50:22 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-47ff5a09-00b1-40dc-bb30-f4663c12f2c8 tempest-SnapshotDependencyTests-1609965027 None] Acquiring lock "cinder-quobyte-16ae9032-29ad-4624-8e40-1f9b7ee8c946" by "_delete_snapshot" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:50:22 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-47ff5a09-00b1-40dc-bb30-f4663c12f2c8 tempest-SnapshotDependencyTests-1609965027 None] Lock "cinder-quobyte-16ae9032-29ad-4624-8e40-1f9b7ee8c946" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:50:22 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-47ff5a09-00b1-40dc-bb30-f4663c12f2c8 tempest-SnapshotDependencyTests-1609965027 None] Deleting offline snapshot 16ae9032-29ad-4624-8e40-1f9b7ee8c946 of volume c585843b-6ae4-413e-b7ae-d3784bdcca1e {{(pid=86212) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 22 15:50:22 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-47ff5a09-00b1-40dc-bb30-f4663c12f2c8 tempest-SnapshotDependencyTests-1609965027 None] snapshot_file for this snap is: volume-c585843b-6ae4-413e-b7ae-d3784bdcca1e.16ae9032-29ad-4624-8e40-1f9b7ee8c946 {{(pid=86212) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 22 15:50:22 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce88a998-4e09-4825-b5e6-d699b6c8f785]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:50:22 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-47ff5a09-00b1-40dc-bb30-f4663c12f2c8 tempest-SnapshotDependencyTests-1609965027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-c585843b-6ae4-413e-b7ae-d3784bdcca1e.16ae9032-29ad-4624-8e40-1f9b7ee8c946 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:50:22 devstack sudo[99620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-c585843b-6ae4-413e-b7ae-d3784bdcca1e.16ae9032-29ad-4624-8e40-1f9b7ee8c946 Sep 22 15:50:22 devstack sudo[99620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:50:22 devstack sudo[99620]: pam_unix(sudo:session): session closed for user root Sep 22 15:50:22 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-47ff5a09-00b1-40dc-bb30-f4663c12f2c8 tempest-SnapshotDependencyTests-1609965027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-c585843b-6ae4-413e-b7ae-d3784bdcca1e.16ae9032-29ad-4624-8e40-1f9b7ee8c946" returned: 0 in 0.438s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:50:22 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-47ff5a09-00b1-40dc-bb30-f4663c12f2c8 tempest-SnapshotDependencyTests-1609965027 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c585843b-6ae4-413e-b7ae-d3784bdcca1e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86212) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 22 15:50:22 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[75191422-d9fa-4a9e-9303-81f4d6bd6b8f]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:50:22 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-47ff5a09-00b1-40dc-bb30-f4663c12f2c8 tempest-SnapshotDependencyTests-1609965027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-c585843b-6ae4-413e-b7ae-d3784bdcca1e {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:50:22 devstack sudo[99626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-c585843b-6ae4-413e-b7ae-d3784bdcca1e Sep 22 15:50:22 devstack sudo[99626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:50:23 devstack sudo[99626]: pam_unix(sudo:session): session closed for user root Sep 22 15:50:23 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-47ff5a09-00b1-40dc-bb30-f4663c12f2c8 tempest-SnapshotDependencyTests-1609965027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-c585843b-6ae4-413e-b7ae-d3784bdcca1e" returned: 0 in 0.675s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:50:23 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-47ff5a09-00b1-40dc-bb30-f4663c12f2c8 tempest-SnapshotDependencyTests-1609965027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-c585843b-6ae4-413e-b7ae-d3784bdcca1e.16ae9032-29ad-4624-8e40-1f9b7ee8c946 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:50:23 devstack sudo[99631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-c585843b-6ae4-413e-b7ae-d3784bdcca1e.16ae9032-29ad-4624-8e40-1f9b7ee8c946 Sep 22 15:50:23 devstack sudo[99631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:50:23 devstack sudo[99631]: pam_unix(sudo:session): session closed for user root Sep 22 15:50:23 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-47ff5a09-00b1-40dc-bb30-f4663c12f2c8 tempest-SnapshotDependencyTests-1609965027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-c585843b-6ae4-413e-b7ae-d3784bdcca1e.16ae9032-29ad-4624-8e40-1f9b7ee8c946" returned: 0 in 0.567s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:50:23 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-47ff5a09-00b1-40dc-bb30-f4663c12f2c8 tempest-SnapshotDependencyTests-1609965027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-c585843b-6ae4-413e-b7ae-d3784bdcca1e.16ae9032-29ad-4624-8e40-1f9b7ee8c946 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:50:23 devstack sudo[99636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-c585843b-6ae4-413e-b7ae-d3784bdcca1e.16ae9032-29ad-4624-8e40-1f9b7ee8c946 Sep 22 15:50:23 devstack sudo[99636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:50:24 devstack sudo[99636]: pam_unix(sudo:session): session closed for user root Sep 22 15:50:24 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-47ff5a09-00b1-40dc-bb30-f4663c12f2c8 tempest-SnapshotDependencyTests-1609965027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-c585843b-6ae4-413e-b7ae-d3784bdcca1e.16ae9032-29ad-4624-8e40-1f9b7ee8c946" returned: 0 in 0.440s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:50:24 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-47ff5a09-00b1-40dc-bb30-f4663c12f2c8 tempest-SnapshotDependencyTests-1609965027 None] Lock "cinder-quobyte-16ae9032-29ad-4624-8e40-1f9b7ee8c946" released by "_delete_snapshot" :: held 2.302s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:50:24 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-47ff5a09-00b1-40dc-bb30-f4663c12f2c8 tempest-SnapshotDependencyTests-1609965027 None] Lock "cinder-quobyte-c585843b-6ae4-413e-b7ae-d3784bdcca1e" released by "delete_snapshot" :: held 2.341s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:50:24 devstack cinder-volume[86212]: DEBUG cinder.quota [None req-47ff5a09-00b1-40dc-bb30-f4663c12f2c8 tempest-SnapshotDependencyTests-1609965027 None] Created reservations ['76896715-5b59-4de5-9a9a-745ed7aec97e', 'fad9ec56-bc89-4955-9d01-ce4eb2e82bf0', '1b68b279-8bde-46eb-8748-650e25670dd0', 'e4fec0da-0cc1-433b-8eb2-a2640976e729'] {{(pid=86212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 15:50:24 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-47ff5a09-00b1-40dc-bb30-f4663c12f2c8 tempest-SnapshotDependencyTests-1609965027 None] Delete snapshot completed successfully. Sep 22 15:50:24 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-47ff5a09-00b1-40dc-bb30-f4663c12f2c8 tempest-SnapshotDependencyTests-1609965027 None] Lock "cinder-16ae9032-29ad-4624-8e40-1f9b7ee8c946-delete_snapshot" released by "delete_snapshot" :: held 2.570s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:50:25 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-15e261ea-0aa6-4a31-97f6-beb6fd63759b tempest-SnapshotDependencyTests-1609965027 None] Acquiring lock "cinder-c585843b-6ae4-413e-b7ae-d3784bdcca1e-delete_volume" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:50:25 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-15e261ea-0aa6-4a31-97f6-beb6fd63759b tempest-SnapshotDependencyTests-1609965027 None] Lock "cinder-c585843b-6ae4-413e-b7ae-d3784bdcca1e-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:50:25 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-15e261ea-0aa6-4a31-97f6-beb6fd63759b tempest-SnapshotDependencyTests-1609965027 None] Acquiring lock "cinder-quobyte-c585843b-6ae4-413e-b7ae-d3784bdcca1e" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:50:25 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-15e261ea-0aa6-4a31-97f6-beb6fd63759b tempest-SnapshotDependencyTests-1609965027 None] Lock "cinder-quobyte-c585843b-6ae4-413e-b7ae-d3784bdcca1e" acquired by "delete_volume" :: waited 0.020s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:50:25 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[0360d199-c855-4720-9197-38eb7971bcd9]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:50:25 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-15e261ea-0aa6-4a31-97f6-beb6fd63759b tempest-SnapshotDependencyTests-1609965027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-c585843b-6ae4-413e-b7ae-d3784bdcca1e {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:50:25 devstack sudo[99641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-c585843b-6ae4-413e-b7ae-d3784bdcca1e Sep 22 15:50:25 devstack sudo[99641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:50:26 devstack sudo[99641]: pam_unix(sudo:session): session closed for user root Sep 22 15:50:26 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-15e261ea-0aa6-4a31-97f6-beb6fd63759b tempest-SnapshotDependencyTests-1609965027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-c585843b-6ae4-413e-b7ae-d3784bdcca1e" returned: 0 in 0.495s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:50:26 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-15e261ea-0aa6-4a31-97f6-beb6fd63759b tempest-SnapshotDependencyTests-1609965027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-c585843b-6ae4-413e-b7ae-d3784bdcca1e {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:50:26 devstack sudo[99646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-c585843b-6ae4-413e-b7ae-d3784bdcca1e Sep 22 15:50:26 devstack sudo[99646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:50:26 devstack sudo[99646]: pam_unix(sudo:session): session closed for user root Sep 22 15:50:26 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-15e261ea-0aa6-4a31-97f6-beb6fd63759b tempest-SnapshotDependencyTests-1609965027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-c585843b-6ae4-413e-b7ae-d3784bdcca1e" returned: 0 in 0.325s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:50:26 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-15e261ea-0aa6-4a31-97f6-beb6fd63759b tempest-SnapshotDependencyTests-1609965027 None] Lock "cinder-quobyte-c585843b-6ae4-413e-b7ae-d3784bdcca1e" released by "delete_volume" :: held 0.931s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:50:26 devstack cinder-volume[86212]: DEBUG cinder.quota [None req-15e261ea-0aa6-4a31-97f6-beb6fd63759b tempest-SnapshotDependencyTests-1609965027 None] Created reservations ['6348f72b-169c-44b8-9a0f-d37f9a364c92', 'b0e7a137-319c-4b39-bb64-7792d46f8fe0', '11d2358f-d235-4c52-88c7-6f1518fc872b', 'a927f2b1-ec94-4446-ae0d-07420cb5d0e6'] {{(pid=86212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 15:50:26 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-15e261ea-0aa6-4a31-97f6-beb6fd63759b tempest-SnapshotDependencyTests-1609965027 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:50:26 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-15e261ea-0aa6-4a31-97f6-beb6fd63759b tempest-SnapshotDependencyTests-1609965027 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:50:26 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-15e261ea-0aa6-4a31-97f6-beb6fd63759b tempest-SnapshotDependencyTests-1609965027 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:50:26 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-15e261ea-0aa6-4a31-97f6-beb6fd63759b tempest-SnapshotDependencyTests-1609965027 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:50:26 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-15e261ea-0aa6-4a31-97f6-beb6fd63759b tempest-SnapshotDependencyTests-1609965027 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:50:26 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-15e261ea-0aa6-4a31-97f6-beb6fd63759b tempest-SnapshotDependencyTests-1609965027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:50:26 devstack sudo[99649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc Sep 22 15:50:26 devstack sudo[99649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:50:27 devstack sudo[99649]: pam_unix(sudo:session): session closed for user root Sep 22 15:50:27 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-15e261ea-0aa6-4a31-97f6-beb6fd63759b tempest-SnapshotDependencyTests-1609965027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc" returned: 0 in 0.572s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:50:27 devstack cinder-volume[86212]: DEBUG cinder.manager [None req-15e261ea-0aa6-4a31-97f6-beb6fd63759b tempest-SnapshotDependencyTests-1609965027 None] Notifying Schedulers of capabilities ... {{(pid=86212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 15:50:27 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-15e261ea-0aa6-4a31-97f6-beb6fd63759b tempest-SnapshotDependencyTests-1609965027 None] Deleted volume successfully. Sep 22 15:50:27 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-15e261ea-0aa6-4a31-97f6-beb6fd63759b tempest-SnapshotDependencyTests-1609965027 None] Lock "cinder-c585843b-6ae4-413e-b7ae-d3784bdcca1e-delete_volume" released by "delete_volume" :: held 1.864s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:50:27 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-bd3e2bbd-7441-438b-86ea-1342fd6e905c tempest-SnapshotDependencyTests-1609965027 None] Acquiring lock "cinder-988f697b-a5c5-4fcc-bd92-c82e494352aa-delete_volume" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:50:27 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-bd3e2bbd-7441-438b-86ea-1342fd6e905c tempest-SnapshotDependencyTests-1609965027 None] Lock "cinder-988f697b-a5c5-4fcc-bd92-c82e494352aa-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:50:27 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-bd3e2bbd-7441-438b-86ea-1342fd6e905c tempest-SnapshotDependencyTests-1609965027 None] Acquiring lock "cinder-quobyte-988f697b-a5c5-4fcc-bd92-c82e494352aa" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:50:27 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-bd3e2bbd-7441-438b-86ea-1342fd6e905c tempest-SnapshotDependencyTests-1609965027 None] Lock "cinder-quobyte-988f697b-a5c5-4fcc-bd92-c82e494352aa" acquired by "delete_volume" :: waited 0.044s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:50:27 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[8978c41d-d725-47bb-be2e-b31b232e52e9]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:50:27 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-bd3e2bbd-7441-438b-86ea-1342fd6e905c tempest-SnapshotDependencyTests-1609965027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-988f697b-a5c5-4fcc-bd92-c82e494352aa {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:50:28 devstack sudo[99653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-988f697b-a5c5-4fcc-bd92-c82e494352aa Sep 22 15:50:28 devstack sudo[99653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:50:28 devstack sudo[99653]: pam_unix(sudo:session): session closed for user root Sep 22 15:50:28 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-bd3e2bbd-7441-438b-86ea-1342fd6e905c tempest-SnapshotDependencyTests-1609965027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-988f697b-a5c5-4fcc-bd92-c82e494352aa" returned: 0 in 0.606s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:50:28 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-bd3e2bbd-7441-438b-86ea-1342fd6e905c tempest-SnapshotDependencyTests-1609965027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-988f697b-a5c5-4fcc-bd92-c82e494352aa {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:50:28 devstack sudo[99658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-988f697b-a5c5-4fcc-bd92-c82e494352aa Sep 22 15:50:28 devstack sudo[99658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:50:28 devstack sudo[99658]: pam_unix(sudo:session): session closed for user root Sep 22 15:50:28 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-bd3e2bbd-7441-438b-86ea-1342fd6e905c tempest-SnapshotDependencyTests-1609965027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-988f697b-a5c5-4fcc-bd92-c82e494352aa" returned: 0 in 0.353s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:50:28 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-bd3e2bbd-7441-438b-86ea-1342fd6e905c tempest-SnapshotDependencyTests-1609965027 None] Lock "cinder-quobyte-988f697b-a5c5-4fcc-bd92-c82e494352aa" released by "delete_volume" :: held 1.066s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:50:29 devstack cinder-volume[86212]: DEBUG cinder.quota [None req-bd3e2bbd-7441-438b-86ea-1342fd6e905c tempest-SnapshotDependencyTests-1609965027 None] Created reservations ['13981bb5-01a4-48d0-a7f8-67470c9b2a87', '879690ed-e864-4be6-a932-7c14dec5a9b0', '180a6a5d-dcb2-4eef-bf51-71dcc501b83a', '2a8f9f51-1671-4465-a810-ccd24c785eaa'] {{(pid=86212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 15:50:29 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-bd3e2bbd-7441-438b-86ea-1342fd6e905c tempest-SnapshotDependencyTests-1609965027 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:50:29 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-bd3e2bbd-7441-438b-86ea-1342fd6e905c tempest-SnapshotDependencyTests-1609965027 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:50:29 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-bd3e2bbd-7441-438b-86ea-1342fd6e905c tempest-SnapshotDependencyTests-1609965027 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:50:29 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-bd3e2bbd-7441-438b-86ea-1342fd6e905c tempest-SnapshotDependencyTests-1609965027 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:50:29 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-bd3e2bbd-7441-438b-86ea-1342fd6e905c tempest-SnapshotDependencyTests-1609965027 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:50:29 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-bd3e2bbd-7441-438b-86ea-1342fd6e905c tempest-SnapshotDependencyTests-1609965027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:50:29 devstack sudo[99661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc Sep 22 15:50:29 devstack sudo[99661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:50:29 devstack sudo[99661]: pam_unix(sudo:session): session closed for user root Sep 22 15:50:29 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-bd3e2bbd-7441-438b-86ea-1342fd6e905c tempest-SnapshotDependencyTests-1609965027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc" returned: 0 in 0.323s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:50:29 devstack cinder-volume[86212]: DEBUG cinder.manager [None req-bd3e2bbd-7441-438b-86ea-1342fd6e905c tempest-SnapshotDependencyTests-1609965027 None] Notifying Schedulers of capabilities ... {{(pid=86212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 15:50:29 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-bd3e2bbd-7441-438b-86ea-1342fd6e905c tempest-SnapshotDependencyTests-1609965027 None] Deleted volume successfully. Sep 22 15:50:29 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-bd3e2bbd-7441-438b-86ea-1342fd6e905c tempest-SnapshotDependencyTests-1609965027 None] Lock "cinder-988f697b-a5c5-4fcc-bd92-c82e494352aa-delete_volume" released by "delete_volume" :: held 1.760s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:50:37 devstack cinder-volume[86212]: DEBUG cinder.volume.flows.manager.create_volume [None req-0cdf706f-6d42-42b8-b001-8f96e3157032 tempest-TestInstancesWithCinderVolumes-793553421 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 15:50:38 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-0cdf706f-6d42-42b8-b001-8f96e3157032 tempest-TestInstancesWithCinderVolumes-793553421 None] Flow 'volume_create_manager' (3150213a-1aeb-49a6-a330-457a1f36ebf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:50:38 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-0cdf706f-6d42-42b8-b001-8f96e3157032 tempest-TestInstancesWithCinderVolumes-793553421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36fc5e3a-85b4-4cf7-9b8d-d8c329451c20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:50:38 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-0cdf706f-6d42-42b8-b001-8f96e3157032 tempest-TestInstancesWithCinderVolumes-793553421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36fc5e3a-85b4-4cf7-9b8d-d8c329451c20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:50:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-426790132',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=964bd87b-df78-4c57-810a-6fa48f8d9257,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2355badd46c049cdacda0257342b55cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:50:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:50:38Z,use_quota=True,user_id='dc4b3fc55f81498faafc5162cf0d1049',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1949a6b7-7c3a-4b5d-902c-98b1e45fc695),volume_type_id=1949a6b7-7c3a-4b5d-902c-98b1e45fc695)' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:50:38 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-0cdf706f-6d42-42b8-b001-8f96e3157032 tempest-TestInstancesWithCinderVolumes-793553421 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cd7275d-2679-40a5-aaa2-feb2e2a7adc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:50:38 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-0cdf706f-6d42-42b8-b001-8f96e3157032 tempest-TestInstancesWithCinderVolumes-793553421 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cd7275d-2679-40a5-aaa2-feb2e2a7adc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:50:38 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-0cdf706f-6d42-42b8-b001-8f96e3157032 tempest-TestInstancesWithCinderVolumes-793553421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aeddb36f-c399-4b5c-96b7-ccd095d8b8db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:50:38 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-0cdf706f-6d42-42b8-b001-8f96e3157032 tempest-TestInstancesWithCinderVolumes-793553421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aeddb36f-c399-4b5c-96b7-ccd095d8b8db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '964bd87b-df78-4c57-810a-6fa48f8d9257', 'volume_name': 'volume-964bd87b-df78-4c57-810a-6fa48f8d9257', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:50:38 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-0cdf706f-6d42-42b8-b001-8f96e3157032 tempest-TestInstancesWithCinderVolumes-793553421 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (710876db-8360-4fff-8abe-83994051912e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:50:38 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-0cdf706f-6d42-42b8-b001-8f96e3157032 tempest-TestInstancesWithCinderVolumes-793553421 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (710876db-8360-4fff-8abe-83994051912e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:50:38 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-0cdf706f-6d42-42b8-b001-8f96e3157032 tempest-TestInstancesWithCinderVolumes-793553421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (642d9fec-a7b3-4e2d-a73c-4037bade1d1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:50:38 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-0cdf706f-6d42-42b8-b001-8f96e3157032 tempest-TestInstancesWithCinderVolumes-793553421 None] Volume 964bd87b-df78-4c57-810a-6fa48f8d9257: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-964bd87b-df78-4c57-810a-6fa48f8d9257', 'volume_size': 1} Sep 22 15:50:38 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-0cdf706f-6d42-42b8-b001-8f96e3157032 tempest-TestInstancesWithCinderVolumes-793553421 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:50:38 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-0cdf706f-6d42-42b8-b001-8f96e3157032 tempest-TestInstancesWithCinderVolumes-793553421 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:50:38 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-0cdf706f-6d42-42b8-b001-8f96e3157032 tempest-TestInstancesWithCinderVolumes-793553421 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:50:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-426790132',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=964bd87b-df78-4c57-810a-6fa48f8d9257,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2355badd46c049cdacda0257342b55cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:50:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:50:38Z,use_quota=True,user_id='dc4b3fc55f81498faafc5162cf0d1049',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1949a6b7-7c3a-4b5d-902c-98b1e45fc695),volume_type_id=1949a6b7-7c3a-4b5d-902c-98b1e45fc695)}" {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 15:50:38 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-0cdf706f-6d42-42b8-b001-8f96e3157032 tempest-TestInstancesWithCinderVolumes-793553421 None] Creating volume 964bd87b-df78-4c57-810a-6fa48f8d9257 {{(pid=86212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 15:50:38 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-0cdf706f-6d42-42b8-b001-8f96e3157032 tempest-TestInstancesWithCinderVolumes-793553421 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:50:38 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-0cdf706f-6d42-42b8-b001-8f96e3157032 tempest-TestInstancesWithCinderVolumes-793553421 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:50:38 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-0cdf706f-6d42-42b8-b001-8f96e3157032 tempest-TestInstancesWithCinderVolumes-793553421 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:50:38 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-0cdf706f-6d42-42b8-b001-8f96e3157032 tempest-TestInstancesWithCinderVolumes-793553421 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:50:38 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-0cdf706f-6d42-42b8-b001-8f96e3157032 tempest-TestInstancesWithCinderVolumes-793553421 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:50:38 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-0cdf706f-6d42-42b8-b001-8f96e3157032 tempest-TestInstancesWithCinderVolumes-793553421 None] Selected osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 as target Quobyte volume. {{(pid=86212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 15:50:38 devstack cinder-volume[86212]: INFO cinder.volume.drivers.remotefs [None req-0cdf706f-6d42-42b8-b001-8f96e3157032 tempest-TestInstancesWithCinderVolumes-793553421 None] casted to osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 Sep 22 15:50:38 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-0cdf706f-6d42-42b8-b001-8f96e3157032 tempest-TestInstancesWithCinderVolumes-793553421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-964bd87b-df78-4c57-810a-6fa48f8d9257 1073741824 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:50:38 devstack sudo[99692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-964bd87b-df78-4c57-810a-6fa48f8d9257 1073741824 Sep 22 15:50:38 devstack sudo[99692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:50:38 devstack cinder-volume[86212]: DEBUG oslo_service.periodic_task [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86212) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 22 15:50:38 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:50:38 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:50:38 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:50:38 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:50:38 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:50:38 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:50:38 devstack cinder-volume[86212]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab7d2f43-f77a-4089-9477-834485b5bd16 tempest-TestMinimumBasicScenario-120257745 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 15:50:38 devstack sudo[99696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc Sep 22 15:50:38 devstack sudo[99696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:50:38 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-ab7d2f43-f77a-4089-9477-834485b5bd16 tempest-TestMinimumBasicScenario-120257745 None] Flow 'volume_create_manager' (0360338b-14f8-46e5-9022-d2baebc57dbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:50:38 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-ab7d2f43-f77a-4089-9477-834485b5bd16 tempest-TestMinimumBasicScenario-120257745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98dceaf5-9e66-4452-b600-8630322e0501) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:50:38 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-ab7d2f43-f77a-4089-9477-834485b5bd16 tempest-TestMinimumBasicScenario-120257745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98dceaf5-9e66-4452-b600-8630322e0501) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:50:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1372965665',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fcbeeea-14f3-4722-8ec5-81221768647c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='319427c211f34982bbc4e126d73f20d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:50:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:50:38Z,use_quota=True,user_id='9f4cf622fbe548e58ab070ea54ec2d19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:50:38 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-ab7d2f43-f77a-4089-9477-834485b5bd16 tempest-TestMinimumBasicScenario-120257745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f55db04a-72ab-45d1-a447-4972ed91675f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:50:38 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-ab7d2f43-f77a-4089-9477-834485b5bd16 tempest-TestMinimumBasicScenario-120257745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f55db04a-72ab-45d1-a447-4972ed91675f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:50:38 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-ab7d2f43-f77a-4089-9477-834485b5bd16 tempest-TestMinimumBasicScenario-120257745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d411294b-ce27-4b4a-b0af-c8c52558dbb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:50:38 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-ab7d2f43-f77a-4089-9477-834485b5bd16 tempest-TestMinimumBasicScenario-120257745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d411294b-ce27-4b4a-b0af-c8c52558dbb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6fcbeeea-14f3-4722-8ec5-81221768647c', 'volume_name': 'volume-6fcbeeea-14f3-4722-8ec5-81221768647c', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:50:38 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-ab7d2f43-f77a-4089-9477-834485b5bd16 tempest-TestMinimumBasicScenario-120257745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (957461eb-84d6-489a-938b-6479924034af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:50:38 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-ab7d2f43-f77a-4089-9477-834485b5bd16 tempest-TestMinimumBasicScenario-120257745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (957461eb-84d6-489a-938b-6479924034af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:50:38 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-ab7d2f43-f77a-4089-9477-834485b5bd16 tempest-TestMinimumBasicScenario-120257745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e113d6dc-086f-440b-86da-12d0f98e3de3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:50:38 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-ab7d2f43-f77a-4089-9477-834485b5bd16 tempest-TestMinimumBasicScenario-120257745 None] Volume 6fcbeeea-14f3-4722-8ec5-81221768647c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6fcbeeea-14f3-4722-8ec5-81221768647c', 'volume_size': 1} Sep 22 15:50:38 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-ab7d2f43-f77a-4089-9477-834485b5bd16 tempest-TestMinimumBasicScenario-120257745 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:50:38 devstack cinder-volume[86212]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ebb3f42-df58-40ab-ad29-e677e05c942e tempest-TestInstancesWithCinderVolumes-793553421 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 15:50:38 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-8ebb3f42-df58-40ab-ad29-e677e05c942e tempest-TestInstancesWithCinderVolumes-793553421 None] Flow 'volume_create_manager' (59896e76-c8ac-4d9d-9fcd-a9ce03893e33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:50:38 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-8ebb3f42-df58-40ab-ad29-e677e05c942e tempest-TestInstancesWithCinderVolumes-793553421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a277d581-ab49-4694-bf66-d3c38695bca2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:50:38 devstack sudo[99696]: pam_unix(sudo:session): session closed for user root Sep 22 15:50:39 devstack sudo[99692]: pam_unix(sudo:session): session closed for user root Sep 22 15:50:39 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-0cdf706f-6d42-42b8-b001-8f96e3157032 tempest-TestInstancesWithCinderVolumes-793553421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-964bd87b-df78-4c57-810a-6fa48f8d9257 1073741824" returned: 0 in 0.881s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:50:39 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-8ebb3f42-df58-40ab-ad29-e677e05c942e tempest-TestInstancesWithCinderVolumes-793553421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a277d581-ab49-4694-bf66-d3c38695bca2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:50:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1340025704',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c028b07-9b81-4b00-8a2f-4fad0385253b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2355badd46c049cdacda0257342b55cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:50:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:50:39Z,use_quota=True,user_id='dc4b3fc55f81498faafc5162cf0d1049',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c813531a-5dbe-4707-9e86-e1723f3013c6),volume_type_id=c813531a-5dbe-4707-9e86-e1723f3013c6)' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:50:39 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-8ebb3f42-df58-40ab-ad29-e677e05c942e tempest-TestInstancesWithCinderVolumes-793553421 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1582954-48f5-48d7-a500-de9e64b91998) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:50:39 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-8ebb3f42-df58-40ab-ad29-e677e05c942e tempest-TestInstancesWithCinderVolumes-793553421 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1582954-48f5-48d7-a500-de9e64b91998) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:50:39 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-8ebb3f42-df58-40ab-ad29-e677e05c942e tempest-TestInstancesWithCinderVolumes-793553421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ecbb922-5749-4614-b542-6a9d4cc89f89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:50:39 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-8ebb3f42-df58-40ab-ad29-e677e05c942e tempest-TestInstancesWithCinderVolumes-793553421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ecbb922-5749-4614-b542-6a9d4cc89f89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7c028b07-9b81-4b00-8a2f-4fad0385253b', 'volume_name': 'volume-7c028b07-9b81-4b00-8a2f-4fad0385253b', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:50:39 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-8ebb3f42-df58-40ab-ad29-e677e05c942e tempest-TestInstancesWithCinderVolumes-793553421 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9eab8cb-0054-4f68-80e7-919928ea25b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:50:39 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-8ebb3f42-df58-40ab-ad29-e677e05c942e tempest-TestInstancesWithCinderVolumes-793553421 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9eab8cb-0054-4f68-80e7-919928ea25b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:50:39 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-8ebb3f42-df58-40ab-ad29-e677e05c942e tempest-TestInstancesWithCinderVolumes-793553421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fdd9abd-8707-49a2-a928-0e808292853f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:50:39 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-8ebb3f42-df58-40ab-ad29-e677e05c942e tempest-TestInstancesWithCinderVolumes-793553421 None] Volume 7c028b07-9b81-4b00-8a2f-4fad0385253b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7c028b07-9b81-4b00-8a2f-4fad0385253b', 'volume_size': 1} Sep 22 15:50:39 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-8ebb3f42-df58-40ab-ad29-e677e05c942e tempest-TestInstancesWithCinderVolumes-793553421 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:50:39 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc" returned: 0 in 0.672s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:50:39 devstack cinder-volume[86212]: DEBUG cinder.manager [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] Notifying Schedulers of capabilities ... {{(pid=86212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 15:50:39 devstack cinder-volume[86212]: DEBUG oslo_service.periodic_task [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] Running periodic task VolumeManager._thread_info {{(pid=86212) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 22 15:50:39 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] thread count: 29 {{(pid=86212) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 22 15:50:39 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] thread info: [<_MainThread(MainThread, started 136163191222400)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86212) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 22 15:50:39 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-0cdf706f-6d42-42b8-b001-8f96e3157032 tempest-TestInstancesWithCinderVolumes-793553421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-964bd87b-df78-4c57-810a-6fa48f8d9257 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:50:39 devstack sudo[99701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-964bd87b-df78-4c57-810a-6fa48f8d9257 Sep 22 15:50:39 devstack sudo[99701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:50:39 devstack cinder-volume[86212]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c2fe8dd-52f4-4b11-9253-e04250dfbf96 tempest-TestInstancesWithCinderVolumes-793553421 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 15:50:39 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-3c2fe8dd-52f4-4b11-9253-e04250dfbf96 tempest-TestInstancesWithCinderVolumes-793553421 None] Flow 'volume_create_manager' (c1153be3-ecdc-46fd-85a6-c8d2ed9c5fff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:50:39 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-3c2fe8dd-52f4-4b11-9253-e04250dfbf96 tempest-TestInstancesWithCinderVolumes-793553421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab1c47c6-b11d-41b3-b7a5-6c80a874a31b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:50:39 devstack sudo[99701]: pam_unix(sudo:session): session closed for user root Sep 22 15:50:39 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-3c2fe8dd-52f4-4b11-9253-e04250dfbf96 tempest-TestInstancesWithCinderVolumes-793553421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab1c47c6-b11d-41b3-b7a5-6c80a874a31b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:50:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1505590968',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=485d3f7a-f7bc-4cbc-a362-858f126f010e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2355badd46c049cdacda0257342b55cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:50:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:50:40Z,use_quota=True,user_id='dc4b3fc55f81498faafc5162cf0d1049',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5785a0bd-8fd1-493c-ae05-dbc13ca19d22),volume_type_id=5785a0bd-8fd1-493c-ae05-dbc13ca19d22)' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:50:39 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-3c2fe8dd-52f4-4b11-9253-e04250dfbf96 tempest-TestInstancesWithCinderVolumes-793553421 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8af7cc7f-724d-4e64-8b8e-e1de67c49978) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:50:39 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-3c2fe8dd-52f4-4b11-9253-e04250dfbf96 tempest-TestInstancesWithCinderVolumes-793553421 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8af7cc7f-724d-4e64-8b8e-e1de67c49978) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:50:39 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-3c2fe8dd-52f4-4b11-9253-e04250dfbf96 tempest-TestInstancesWithCinderVolumes-793553421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b089c94b-f82c-41a6-a09e-75a97c4bf548) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:50:39 devstack cinder-volume[86212]: DEBUG cinder.image.glance [None req-3c2fe8dd-52f4-4b11-9253-e04250dfbf96 tempest-TestInstancesWithCinderVolumes-793553421 None] Creating Keystone auth plugin from conf {{(pid=86212) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 22 15:50:39 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-0cdf706f-6d42-42b8-b001-8f96e3157032 tempest-TestInstancesWithCinderVolumes-793553421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-964bd87b-df78-4c57-810a-6fa48f8d9257" returned: 0 in 0.490s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:50:39 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-0cdf706f-6d42-42b8-b001-8f96e3157032 tempest-TestInstancesWithCinderVolumes-793553421 None] <== create_volume: return (1588ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'} {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 15:50:39 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-0cdf706f-6d42-42b8-b001-8f96e3157032 tempest-TestInstancesWithCinderVolumes-793553421 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.591s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:50:39 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-ab7d2f43-f77a-4089-9477-834485b5bd16 tempest-TestMinimumBasicScenario-120257745 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.974s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:50:39 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-ab7d2f43-f77a-4089-9477-834485b5bd16 tempest-TestMinimumBasicScenario-120257745 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:50:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1372965665',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fcbeeea-14f3-4722-8ec5-81221768647c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='319427c211f34982bbc4e126d73f20d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:50:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:50:38Z,use_quota=True,user_id='9f4cf622fbe548e58ab070ea54ec2d19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)}" {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 15:50:39 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-ab7d2f43-f77a-4089-9477-834485b5bd16 tempest-TestMinimumBasicScenario-120257745 None] Creating volume 6fcbeeea-14f3-4722-8ec5-81221768647c {{(pid=86212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 15:50:39 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-ab7d2f43-f77a-4089-9477-834485b5bd16 tempest-TestMinimumBasicScenario-120257745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:50:39 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-ab7d2f43-f77a-4089-9477-834485b5bd16 tempest-TestMinimumBasicScenario-120257745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:50:39 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-ab7d2f43-f77a-4089-9477-834485b5bd16 tempest-TestMinimumBasicScenario-120257745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:50:39 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-ab7d2f43-f77a-4089-9477-834485b5bd16 tempest-TestMinimumBasicScenario-120257745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:50:39 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-ab7d2f43-f77a-4089-9477-834485b5bd16 tempest-TestMinimumBasicScenario-120257745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:50:39 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-ab7d2f43-f77a-4089-9477-834485b5bd16 tempest-TestMinimumBasicScenario-120257745 None] Selected osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 as target Quobyte volume. {{(pid=86212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 15:50:39 devstack cinder-volume[86212]: INFO cinder.volume.drivers.remotefs [None req-ab7d2f43-f77a-4089-9477-834485b5bd16 tempest-TestMinimumBasicScenario-120257745 None] casted to osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 Sep 22 15:50:39 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-ab7d2f43-f77a-4089-9477-834485b5bd16 tempest-TestMinimumBasicScenario-120257745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-6fcbeeea-14f3-4722-8ec5-81221768647c 1073741824 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:50:39 devstack sudo[99739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-6fcbeeea-14f3-4722-8ec5-81221768647c 1073741824 Sep 22 15:50:39 devstack sudo[99739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:50:39 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-0cdf706f-6d42-42b8-b001-8f96e3157032 tempest-TestInstancesWithCinderVolumes-793553421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (642d9fec-a7b3-4e2d-a73c-4037bade1d1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-964bd87b-df78-4c57-810a-6fa48f8d9257', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:50:39 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-0cdf706f-6d42-42b8-b001-8f96e3157032 tempest-TestInstancesWithCinderVolumes-793553421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e311d5a-a15e-4b41-8ca7-b50ca834fc77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:50:39 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-0cdf706f-6d42-42b8-b001-8f96e3157032 tempest-TestInstancesWithCinderVolumes-793553421 None] Volume volume-964bd87b-df78-4c57-810a-6fa48f8d9257 (964bd87b-df78-4c57-810a-6fa48f8d9257): created successfully Sep 22 15:50:39 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-0cdf706f-6d42-42b8-b001-8f96e3157032 tempest-TestInstancesWithCinderVolumes-793553421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e311d5a-a15e-4b41-8ca7-b50ca834fc77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:50:39 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-0cdf706f-6d42-42b8-b001-8f96e3157032 tempest-TestInstancesWithCinderVolumes-793553421 None] Flow 'volume_create_manager' (3150213a-1aeb-49a6-a330-457a1f36ebf7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:50:40 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-0cdf706f-6d42-42b8-b001-8f96e3157032 tempest-TestInstancesWithCinderVolumes-793553421 None] Created volume successfully. Sep 22 15:50:40 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-3c2fe8dd-52f4-4b11-9253-e04250dfbf96 tempest-TestInstancesWithCinderVolumes-793553421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b089c94b-f82c-41a6-a09e-75a97c4bf548) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '485d3f7a-f7bc-4cbc-a362-858f126f010e', 'volume_name': 'volume-485d3f7a-f7bc-4cbc-a362-858f126f010e', 'volume_size': 1, 'image_id': '237bf3d2-0bdc-463c-a61e-a9bcfc657234', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/237bf3d2-0bdc-463c-a61e-a9bcfc657234', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--545549118', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2355badd46c049cdacda0257342b55cf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '237bf3d2-0bdc-463c-a61e-a9bcfc657234', 'created_at': datetime.datetime(2026, 9, 22, 13, 50, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 13, 50, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/237bf3d2-0bdc-463c-a61e-a9bcfc657234/file', 'properties': {}}, 'image_service': }' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:50:40 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-3c2fe8dd-52f4-4b11-9253-e04250dfbf96 tempest-TestInstancesWithCinderVolumes-793553421 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (101fdcc4-0b15-455a-8fee-38b7578a2441) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:50:40 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-3c2fe8dd-52f4-4b11-9253-e04250dfbf96 tempest-TestInstancesWithCinderVolumes-793553421 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (101fdcc4-0b15-455a-8fee-38b7578a2441) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:50:40 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-3c2fe8dd-52f4-4b11-9253-e04250dfbf96 tempest-TestInstancesWithCinderVolumes-793553421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9dd8717-e046-40dd-aaa3-8adce6945543) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:50:40 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-3c2fe8dd-52f4-4b11-9253-e04250dfbf96 tempest-TestInstancesWithCinderVolumes-793553421 None] Volume 485d3f7a-f7bc-4cbc-a362-858f126f010e: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-485d3f7a-f7bc-4cbc-a362-858f126f010e', 'volume_size': 1, 'image_id': '237bf3d2-0bdc-463c-a61e-a9bcfc657234', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/237bf3d2-0bdc-463c-a61e-a9bcfc657234', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--545549118', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2355badd46c049cdacda0257342b55cf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '237bf3d2-0bdc-463c-a61e-a9bcfc657234', 'created_at': datetime.datetime(2026, 9, 22, 13, 50, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 13, 50, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/237bf3d2-0bdc-463c-a61e-a9bcfc657234/file', 'properties': {}}, 'image_service': } Sep 22 15:50:40 devstack cinder-volume[86212]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c2fe8dd-52f4-4b11-9253-e04250dfbf96 tempest-TestInstancesWithCinderVolumes-793553421 None] Trying to clone 485d3f7a-f7bc-4cbc-a362-858f126f010e from image 237bf3d2-0bdc-463c-a61e-a9bcfc657234 at location (None, [{'url': 'file:///opt/stack/data/glance/images/237bf3d2-0bdc-463c-a61e-a9bcfc657234', 'metadata': {}}]). {{(pid=86212) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 22 15:50:40 devstack sudo[99739]: pam_unix(sudo:session): session closed for user root Sep 22 15:50:40 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-ab7d2f43-f77a-4089-9477-834485b5bd16 tempest-TestMinimumBasicScenario-120257745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-6fcbeeea-14f3-4722-8ec5-81221768647c 1073741824" returned: 0 in 0.656s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:50:40 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-ab7d2f43-f77a-4089-9477-834485b5bd16 tempest-TestMinimumBasicScenario-120257745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-6fcbeeea-14f3-4722-8ec5-81221768647c {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:50:40 devstack sudo[99747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-6fcbeeea-14f3-4722-8ec5-81221768647c Sep 22 15:50:40 devstack sudo[99747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:50:40 devstack sudo[99747]: pam_unix(sudo:session): session closed for user root Sep 22 15:50:40 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-ab7d2f43-f77a-4089-9477-834485b5bd16 tempest-TestMinimumBasicScenario-120257745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-6fcbeeea-14f3-4722-8ec5-81221768647c" returned: 0 in 0.294s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:50:40 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-ab7d2f43-f77a-4089-9477-834485b5bd16 tempest-TestMinimumBasicScenario-120257745 None] <== create_volume: return (1056ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'} {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 15:50:40 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-ab7d2f43-f77a-4089-9477-834485b5bd16 tempest-TestMinimumBasicScenario-120257745 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.062s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:50:40 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-8ebb3f42-df58-40ab-ad29-e677e05c942e tempest-TestInstancesWithCinderVolumes-793553421 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.651s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:50:40 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-8ebb3f42-df58-40ab-ad29-e677e05c942e tempest-TestInstancesWithCinderVolumes-793553421 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:50:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1340025704',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c028b07-9b81-4b00-8a2f-4fad0385253b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2355badd46c049cdacda0257342b55cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:50:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:50:39Z,use_quota=True,user_id='dc4b3fc55f81498faafc5162cf0d1049',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c813531a-5dbe-4707-9e86-e1723f3013c6),volume_type_id=c813531a-5dbe-4707-9e86-e1723f3013c6)}" {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 15:50:40 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-8ebb3f42-df58-40ab-ad29-e677e05c942e tempest-TestInstancesWithCinderVolumes-793553421 None] Creating volume 7c028b07-9b81-4b00-8a2f-4fad0385253b {{(pid=86212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 15:50:40 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-8ebb3f42-df58-40ab-ad29-e677e05c942e tempest-TestInstancesWithCinderVolumes-793553421 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:50:40 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-8ebb3f42-df58-40ab-ad29-e677e05c942e tempest-TestInstancesWithCinderVolumes-793553421 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:50:40 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-8ebb3f42-df58-40ab-ad29-e677e05c942e tempest-TestInstancesWithCinderVolumes-793553421 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:50:40 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-8ebb3f42-df58-40ab-ad29-e677e05c942e tempest-TestInstancesWithCinderVolumes-793553421 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:50:40 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-8ebb3f42-df58-40ab-ad29-e677e05c942e tempest-TestInstancesWithCinderVolumes-793553421 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:50:40 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-8ebb3f42-df58-40ab-ad29-e677e05c942e tempest-TestInstancesWithCinderVolumes-793553421 None] Selected osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 as target Quobyte volume. {{(pid=86212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 15:50:40 devstack cinder-volume[86212]: INFO cinder.volume.drivers.remotefs [None req-8ebb3f42-df58-40ab-ad29-e677e05c942e tempest-TestInstancesWithCinderVolumes-793553421 None] casted to osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 Sep 22 15:50:40 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-8ebb3f42-df58-40ab-ad29-e677e05c942e tempest-TestInstancesWithCinderVolumes-793553421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-7c028b07-9b81-4b00-8a2f-4fad0385253b 1073741824 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:50:40 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-ab7d2f43-f77a-4089-9477-834485b5bd16 tempest-TestMinimumBasicScenario-120257745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e113d6dc-086f-440b-86da-12d0f98e3de3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6fcbeeea-14f3-4722-8ec5-81221768647c', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:50:40 devstack sudo[99750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-7c028b07-9b81-4b00-8a2f-4fad0385253b 1073741824 Sep 22 15:50:40 devstack sudo[99750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:50:40 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-ab7d2f43-f77a-4089-9477-834485b5bd16 tempest-TestMinimumBasicScenario-120257745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e93f6de-07fb-4fc8-a72d-b038f62358b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:50:40 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-ab7d2f43-f77a-4089-9477-834485b5bd16 tempest-TestMinimumBasicScenario-120257745 None] Volume volume-6fcbeeea-14f3-4722-8ec5-81221768647c (6fcbeeea-14f3-4722-8ec5-81221768647c): created successfully Sep 22 15:50:40 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-ab7d2f43-f77a-4089-9477-834485b5bd16 tempest-TestMinimumBasicScenario-120257745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e93f6de-07fb-4fc8-a72d-b038f62358b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:50:40 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-ab7d2f43-f77a-4089-9477-834485b5bd16 tempest-TestMinimumBasicScenario-120257745 None] Flow 'volume_create_manager' (0360338b-14f8-46e5-9022-d2baebc57dbc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:50:40 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-ab7d2f43-f77a-4089-9477-834485b5bd16 tempest-TestMinimumBasicScenario-120257745 None] Created volume successfully. Sep 22 15:50:41 devstack sudo[99750]: pam_unix(sudo:session): session closed for user root Sep 22 15:50:41 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-8ebb3f42-df58-40ab-ad29-e677e05c942e tempest-TestInstancesWithCinderVolumes-793553421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-7c028b07-9b81-4b00-8a2f-4fad0385253b 1073741824" returned: 0 in 0.901s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:50:41 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-8ebb3f42-df58-40ab-ad29-e677e05c942e tempest-TestInstancesWithCinderVolumes-793553421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-7c028b07-9b81-4b00-8a2f-4fad0385253b {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:50:41 devstack sudo[99758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-7c028b07-9b81-4b00-8a2f-4fad0385253b Sep 22 15:50:41 devstack sudo[99758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:50:42 devstack sudo[99758]: pam_unix(sudo:session): session closed for user root Sep 22 15:50:42 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-8ebb3f42-df58-40ab-ad29-e677e05c942e tempest-TestInstancesWithCinderVolumes-793553421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-7c028b07-9b81-4b00-8a2f-4fad0385253b" returned: 0 in 0.673s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:50:42 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-8ebb3f42-df58-40ab-ad29-e677e05c942e tempest-TestInstancesWithCinderVolumes-793553421 None] <== create_volume: return (1680ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'} {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 15:50:42 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-8ebb3f42-df58-40ab-ad29-e677e05c942e tempest-TestInstancesWithCinderVolumes-793553421 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.683s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:50:42 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-8ebb3f42-df58-40ab-ad29-e677e05c942e tempest-TestInstancesWithCinderVolumes-793553421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fdd9abd-8707-49a2-a928-0e808292853f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c028b07-9b81-4b00-8a2f-4fad0385253b', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:50:42 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-8ebb3f42-df58-40ab-ad29-e677e05c942e tempest-TestInstancesWithCinderVolumes-793553421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86538853-5dea-480e-8dc0-fe3541402893) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:50:42 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-8ebb3f42-df58-40ab-ad29-e677e05c942e tempest-TestInstancesWithCinderVolumes-793553421 None] Volume volume-7c028b07-9b81-4b00-8a2f-4fad0385253b (7c028b07-9b81-4b00-8a2f-4fad0385253b): created successfully Sep 22 15:50:42 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-8ebb3f42-df58-40ab-ad29-e677e05c942e tempest-TestInstancesWithCinderVolumes-793553421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86538853-5dea-480e-8dc0-fe3541402893) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:50:42 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-8ebb3f42-df58-40ab-ad29-e677e05c942e tempest-TestInstancesWithCinderVolumes-793553421 None] Flow 'volume_create_manager' (59896e76-c8ac-4d9d-9fcd-a9ce03893e33) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:50:42 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-8ebb3f42-df58-40ab-ad29-e677e05c942e tempest-TestInstancesWithCinderVolumes-793553421 None] Created volume successfully. Sep 22 15:50:43 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [req-fd0a830a-759b-4c0f-937c-6a6361860f46 req-bf739f6c-b164-4c8e-a8be-120bdd4278cf tempest-TestMinimumBasicScenario-120257745 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:50:43 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [req-fd0a830a-759b-4c0f-937c-6a6361860f46 req-bf739f6c-b164-4c8e-a8be-120bdd4278cf tempest-TestMinimumBasicScenario-120257745 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:50:43 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [req-fd0a830a-759b-4c0f-937c-6a6361860f46 req-bf739f6c-b164-4c8e-a8be-120bdd4278cf tempest-TestMinimumBasicScenario-120257745 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.038s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:50:43 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [req-fd0a830a-759b-4c0f-937c-6a6361860f46 req-bf739f6c-b164-4c8e-a8be-120bdd4278cf tempest-TestMinimumBasicScenario-120257745 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31', 'name': 'volume-6fcbeeea-14f3-4722-8ec5-81221768647c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3bcbf315-deb3-49f2-9484-2841990e901c', 'enforce_multipath': True} {{(pid=86212) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 22 15:50:43 devstack cinder-volume[86212]: INFO cinder.volume.manager [req-fd0a830a-759b-4c0f-937c-6a6361860f46 req-bf739f6c-b164-4c8e-a8be-120bdd4278cf tempest-TestMinimumBasicScenario-120257745 None] attachment_update completed successfully. Sep 22 15:50:46 devstack cinder-volume[86212]: DEBUG cinder.image.image_utils [None req-3c2fe8dd-52f4-4b11-9253-e04250dfbf96 tempest-TestInstancesWithCinderVolumes-793553421 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_237bf3d2-0bdc-463c-a61e-a9bcfc657234_mai3n25ddevstack@QuobyteHD, size 20.69 MB, duration 6.04 sec {{(pid=86212) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 22 15:50:46 devstack cinder-volume[86212]: INFO cinder.image.image_utils [None req-3c2fe8dd-52f4-4b11-9253-e04250dfbf96 tempest-TestInstancesWithCinderVolumes-793553421 None] Image download 20.69 MB at 3.43 MB/s Sep 22 15:50:46 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[a633505f-ff64-42f9-9496-c5a4cbcd1de5]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:50:46 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-3c2fe8dd-52f4-4b11-9253-e04250dfbf96 tempest-TestInstancesWithCinderVolumes-793553421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_237bf3d2-0bdc-463c-a61e-a9bcfc657234_mai3n25ddevstack@QuobyteHD {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:50:46 devstack sudo[100192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_237bf3d2-0bdc-463c-a61e-a9bcfc657234_mai3n25ddevstack@QuobyteHD Sep 22 15:50:46 devstack sudo[100192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:50:46 devstack sudo[100192]: pam_unix(sudo:session): session closed for user root Sep 22 15:50:46 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-3c2fe8dd-52f4-4b11-9253-e04250dfbf96 tempest-TestInstancesWithCinderVolumes-793553421 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_237bf3d2-0bdc-463c-a61e-a9bcfc657234_mai3n25ddevstack@QuobyteHD" returned: 0 in 0.376s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:50:46 devstack cinder-volume[86212]: DEBUG cinder.image.image_utils [None req-3c2fe8dd-52f4-4b11-9253-e04250dfbf96 tempest-TestInstancesWithCinderVolumes-793553421 None] Temporary image 237bf3d2-0bdc-463c-a61e-a9bcfc657234 is fetched for user dc4b3fc55f81498faafc5162cf0d1049. {{(pid=86212) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 22 15:50:46 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc9a749d-eaed-40c6-8ef3-0fd344f43f27]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:50:46 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-3c2fe8dd-52f4-4b11-9253-e04250dfbf96 tempest-TestInstancesWithCinderVolumes-793553421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_237bf3d2-0bdc-463c-a61e-a9bcfc657234_mai3n25ddevstack@QuobyteHD {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:50:47 devstack sudo[100197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_237bf3d2-0bdc-463c-a61e-a9bcfc657234_mai3n25ddevstack@QuobyteHD Sep 22 15:50:47 devstack sudo[100197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:50:47 devstack sudo[100197]: pam_unix(sudo:session): session closed for user root Sep 22 15:50:47 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-3c2fe8dd-52f4-4b11-9253-e04250dfbf96 tempest-TestInstancesWithCinderVolumes-793553421 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_237bf3d2-0bdc-463c-a61e-a9bcfc657234_mai3n25ddevstack@QuobyteHD" returned: 0 in 0.522s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:50:47 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-3c2fe8dd-52f4-4b11-9253-e04250dfbf96 tempest-TestInstancesWithCinderVolumes-793553421 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:50:47 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-3c2fe8dd-52f4-4b11-9253-e04250dfbf96 tempest-TestInstancesWithCinderVolumes-793553421 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:50:47 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-3c2fe8dd-52f4-4b11-9253-e04250dfbf96 tempest-TestInstancesWithCinderVolumes-793553421 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:50:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1505590968',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=485d3f7a-f7bc-4cbc-a362-858f126f010e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2355badd46c049cdacda0257342b55cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:50:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:50:40Z,use_quota=True,user_id='dc4b3fc55f81498faafc5162cf0d1049',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5785a0bd-8fd1-493c-ae05-dbc13ca19d22),volume_type_id=5785a0bd-8fd1-493c-ae05-dbc13ca19d22)}" {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 15:50:47 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-3c2fe8dd-52f4-4b11-9253-e04250dfbf96 tempest-TestInstancesWithCinderVolumes-793553421 None] Creating volume 485d3f7a-f7bc-4cbc-a362-858f126f010e {{(pid=86212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 15:50:47 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-3c2fe8dd-52f4-4b11-9253-e04250dfbf96 tempest-TestInstancesWithCinderVolumes-793553421 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:50:47 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-3c2fe8dd-52f4-4b11-9253-e04250dfbf96 tempest-TestInstancesWithCinderVolumes-793553421 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:50:47 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-3c2fe8dd-52f4-4b11-9253-e04250dfbf96 tempest-TestInstancesWithCinderVolumes-793553421 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:50:47 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-3c2fe8dd-52f4-4b11-9253-e04250dfbf96 tempest-TestInstancesWithCinderVolumes-793553421 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:50:47 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-3c2fe8dd-52f4-4b11-9253-e04250dfbf96 tempest-TestInstancesWithCinderVolumes-793553421 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:50:47 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-3c2fe8dd-52f4-4b11-9253-e04250dfbf96 tempest-TestInstancesWithCinderVolumes-793553421 None] Selected osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 as target Quobyte volume. {{(pid=86212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 15:50:47 devstack cinder-volume[86212]: INFO cinder.volume.drivers.remotefs [None req-3c2fe8dd-52f4-4b11-9253-e04250dfbf96 tempest-TestInstancesWithCinderVolumes-793553421 None] casted to osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 Sep 22 15:50:47 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-3c2fe8dd-52f4-4b11-9253-e04250dfbf96 tempest-TestInstancesWithCinderVolumes-793553421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-485d3f7a-f7bc-4cbc-a362-858f126f010e 1073741824 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:50:47 devstack sudo[100203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-485d3f7a-f7bc-4cbc-a362-858f126f010e 1073741824 Sep 22 15:50:47 devstack sudo[100203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:50:48 devstack sudo[100203]: pam_unix(sudo:session): session closed for user root Sep 22 15:50:48 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-3c2fe8dd-52f4-4b11-9253-e04250dfbf96 tempest-TestInstancesWithCinderVolumes-793553421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-485d3f7a-f7bc-4cbc-a362-858f126f010e 1073741824" returned: 0 in 0.695s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:50:48 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-3c2fe8dd-52f4-4b11-9253-e04250dfbf96 tempest-TestInstancesWithCinderVolumes-793553421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-485d3f7a-f7bc-4cbc-a362-858f126f010e {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:50:48 devstack sudo[100210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-485d3f7a-f7bc-4cbc-a362-858f126f010e Sep 22 15:50:48 devstack sudo[100210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:50:48 devstack sudo[100210]: pam_unix(sudo:session): session closed for user root Sep 22 15:50:48 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-3c2fe8dd-52f4-4b11-9253-e04250dfbf96 tempest-TestInstancesWithCinderVolumes-793553421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-485d3f7a-f7bc-4cbc-a362-858f126f010e" returned: 0 in 0.365s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:50:48 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-3c2fe8dd-52f4-4b11-9253-e04250dfbf96 tempest-TestInstancesWithCinderVolumes-793553421 None] <== create_volume: return (1132ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'} {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 15:50:48 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-3c2fe8dd-52f4-4b11-9253-e04250dfbf96 tempest-TestInstancesWithCinderVolumes-793553421 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.136s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:50:48 devstack cinder-volume[86212]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc76cd8b-e56c-4bb4-bc92-0b0c6386ce73 tempest-TestImageHashVerification-1983717145 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 15:50:48 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-fc76cd8b-e56c-4bb4-bc92-0b0c6386ce73 tempest-TestImageHashVerification-1983717145 None] Flow 'volume_create_manager' (aab75499-6b6d-47c3-a115-89c48274ce50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:50:48 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-fc76cd8b-e56c-4bb4-bc92-0b0c6386ce73 tempest-TestImageHashVerification-1983717145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fcfb1ce0-3442-4e34-b2b4-ce4991c353da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:50:48 devstack cinder-volume[86212]: DEBUG cinder.volume.volume_utils [None req-3c2fe8dd-52f4-4b11-9253-e04250dfbf96 tempest-TestInstancesWithCinderVolumes-793553421 None] Attempting download of 237bf3d2-0bdc-463c-a61e-a9bcfc657234 ((None, [{'url': 'file:///opt/stack/data/glance/images/237bf3d2-0bdc-463c-a61e-a9bcfc657234', 'metadata': {}}])) to volume 485d3f7a-f7bc-4cbc-a362-858f126f010e. {{(pid=86212) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 22 15:50:48 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-fc76cd8b-e56c-4bb4-bc92-0b0c6386ce73 tempest-TestImageHashVerification-1983717145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fcfb1ce0-3442-4e34-b2b4-ce4991c353da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:50:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1121199759',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=583e7944-02fd-4901-a13e-ef82b6520c02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ceb993484c441bab09be2f231e9bd57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:50:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:50:49Z,use_quota=True,user_id='1d199a5e485c4d52968eff88bc2b4809',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:50:48 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-fc76cd8b-e56c-4bb4-bc92-0b0c6386ce73 tempest-TestImageHashVerification-1983717145 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df523688-aa7b-4b45-8f40-9992dd064405) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:50:48 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-fc76cd8b-e56c-4bb4-bc92-0b0c6386ce73 tempest-TestImageHashVerification-1983717145 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df523688-aa7b-4b45-8f40-9992dd064405) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:50:48 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-fc76cd8b-e56c-4bb4-bc92-0b0c6386ce73 tempest-TestImageHashVerification-1983717145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc608013-326f-45ca-97f3-681d5c05a621) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:50:48 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-fc76cd8b-e56c-4bb4-bc92-0b0c6386ce73 tempest-TestImageHashVerification-1983717145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc608013-326f-45ca-97f3-681d5c05a621) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '583e7944-02fd-4901-a13e-ef82b6520c02', 'volume_name': 'volume-583e7944-02fd-4901-a13e-ef82b6520c02', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:50:48 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-fc76cd8b-e56c-4bb4-bc92-0b0c6386ce73 tempest-TestImageHashVerification-1983717145 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc218798-11c4-4b23-8c9c-2494c44c79f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:50:48 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-fc76cd8b-e56c-4bb4-bc92-0b0c6386ce73 tempest-TestImageHashVerification-1983717145 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc218798-11c4-4b23-8c9c-2494c44c79f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:50:48 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-fc76cd8b-e56c-4bb4-bc92-0b0c6386ce73 tempest-TestImageHashVerification-1983717145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3425082f-4a07-47d3-8738-a2d77361f096) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:50:48 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-fc76cd8b-e56c-4bb4-bc92-0b0c6386ce73 tempest-TestImageHashVerification-1983717145 None] Volume 583e7944-02fd-4901-a13e-ef82b6520c02: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-583e7944-02fd-4901-a13e-ef82b6520c02', 'volume_size': 1} Sep 22 15:50:48 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-fc76cd8b-e56c-4bb4-bc92-0b0c6386ce73 tempest-TestImageHashVerification-1983717145 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:50:48 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-fc76cd8b-e56c-4bb4-bc92-0b0c6386ce73 tempest-TestImageHashVerification-1983717145 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:50:48 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-fc76cd8b-e56c-4bb4-bc92-0b0c6386ce73 tempest-TestImageHashVerification-1983717145 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:50:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1121199759',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=583e7944-02fd-4901-a13e-ef82b6520c02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ceb993484c441bab09be2f231e9bd57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:50:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:50:49Z,use_quota=True,user_id='1d199a5e485c4d52968eff88bc2b4809',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)}" {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 15:50:48 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-fc76cd8b-e56c-4bb4-bc92-0b0c6386ce73 tempest-TestImageHashVerification-1983717145 None] Creating volume 583e7944-02fd-4901-a13e-ef82b6520c02 {{(pid=86212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 15:50:48 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-fc76cd8b-e56c-4bb4-bc92-0b0c6386ce73 tempest-TestImageHashVerification-1983717145 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:50:48 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-fc76cd8b-e56c-4bb4-bc92-0b0c6386ce73 tempest-TestImageHashVerification-1983717145 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:50:48 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-fc76cd8b-e56c-4bb4-bc92-0b0c6386ce73 tempest-TestImageHashVerification-1983717145 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:50:48 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-fc76cd8b-e56c-4bb4-bc92-0b0c6386ce73 tempest-TestImageHashVerification-1983717145 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:50:48 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-fc76cd8b-e56c-4bb4-bc92-0b0c6386ce73 tempest-TestImageHashVerification-1983717145 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:50:48 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-fc76cd8b-e56c-4bb4-bc92-0b0c6386ce73 tempest-TestImageHashVerification-1983717145 None] Selected osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 as target Quobyte volume. {{(pid=86212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 15:50:48 devstack cinder-volume[86212]: INFO cinder.volume.drivers.remotefs [None req-fc76cd8b-e56c-4bb4-bc92-0b0c6386ce73 tempest-TestImageHashVerification-1983717145 None] casted to osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 Sep 22 15:50:48 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-fc76cd8b-e56c-4bb4-bc92-0b0c6386ce73 tempest-TestImageHashVerification-1983717145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-583e7944-02fd-4901-a13e-ef82b6520c02 1073741824 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:50:48 devstack sudo[100213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-583e7944-02fd-4901-a13e-ef82b6520c02 1073741824 Sep 22 15:50:48 devstack sudo[100213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:50:48 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[31956c74-74c0-46ee-9f95-fb358b2c09f3]: (4, 'raw') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:50:48 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-3c2fe8dd-52f4-4b11-9253-e04250dfbf96 tempest-TestInstancesWithCinderVolumes-793553421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_237bf3d2-0bdc-463c-a61e-a9bcfc657234_omp70hwo {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:50:48 devstack sudo[100215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_237bf3d2-0bdc-463c-a61e-a9bcfc657234_omp70hwo Sep 22 15:50:48 devstack sudo[100215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:50:49 devstack sudo[100215]: pam_unix(sudo:session): session closed for user root Sep 22 15:50:49 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-3c2fe8dd-52f4-4b11-9253-e04250dfbf96 tempest-TestInstancesWithCinderVolumes-793553421 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_237bf3d2-0bdc-463c-a61e-a9bcfc657234_omp70hwo" returned: 0 in 0.514s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:50:49 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-3c2fe8dd-52f4-4b11-9253-e04250dfbf96 tempest-TestInstancesWithCinderVolumes-793553421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_237bf3d2-0bdc-463c-a61e-a9bcfc657234_omp70hwo {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:50:49 devstack sudo[100213]: pam_unix(sudo:session): session closed for user root Sep 22 15:50:49 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-fc76cd8b-e56c-4bb4-bc92-0b0c6386ce73 tempest-TestImageHashVerification-1983717145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-583e7944-02fd-4901-a13e-ef82b6520c02 1073741824" returned: 0 in 0.685s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:50:49 devstack sudo[100223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_237bf3d2-0bdc-463c-a61e-a9bcfc657234_omp70hwo Sep 22 15:50:49 devstack sudo[100223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:50:49 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-fc76cd8b-e56c-4bb4-bc92-0b0c6386ce73 tempest-TestImageHashVerification-1983717145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-583e7944-02fd-4901-a13e-ef82b6520c02 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:50:49 devstack sudo[100225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-583e7944-02fd-4901-a13e-ef82b6520c02 Sep 22 15:50:49 devstack sudo[100225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:50:49 devstack sudo[100223]: pam_unix(sudo:session): session closed for user root Sep 22 15:50:49 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-3c2fe8dd-52f4-4b11-9253-e04250dfbf96 tempest-TestInstancesWithCinderVolumes-793553421 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_237bf3d2-0bdc-463c-a61e-a9bcfc657234_omp70hwo" returned: 1 in 0.430s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:50:49 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-3c2fe8dd-52f4-4b11-9253-e04250dfbf96 tempest-TestInstancesWithCinderVolumes-793553421 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_237bf3d2-0bdc-463c-a61e-a9bcfc657234_omp70hwo' failed. Not Retrying. {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 22 15:50:49 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[d21d09d7-3c71-4e35-970e-e56eca15a77e]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:50:49 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-3c2fe8dd-52f4-4b11-9253-e04250dfbf96 tempest-TestInstancesWithCinderVolumes-793553421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_237bf3d2-0bdc-463c-a61e-a9bcfc657234_mai3n25ddevstack@QuobyteHD {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:50:49 devstack sudo[100225]: pam_unix(sudo:session): session closed for user root Sep 22 15:50:49 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-fc76cd8b-e56c-4bb4-bc92-0b0c6386ce73 tempest-TestImageHashVerification-1983717145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-583e7944-02fd-4901-a13e-ef82b6520c02" returned: 0 in 0.289s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:50:49 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-fc76cd8b-e56c-4bb4-bc92-0b0c6386ce73 tempest-TestImageHashVerification-1983717145 None] <== create_volume: return (1057ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'} {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 15:50:49 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-fc76cd8b-e56c-4bb4-bc92-0b0c6386ce73 tempest-TestImageHashVerification-1983717145 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.059s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:50:49 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-fc76cd8b-e56c-4bb4-bc92-0b0c6386ce73 tempest-TestImageHashVerification-1983717145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3425082f-4a07-47d3-8738-a2d77361f096) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-583e7944-02fd-4901-a13e-ef82b6520c02', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:50:49 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-fc76cd8b-e56c-4bb4-bc92-0b0c6386ce73 tempest-TestImageHashVerification-1983717145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb026a0b-628a-4dc7-b0b3-d9e4f3e3f93b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:50:49 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-fc76cd8b-e56c-4bb4-bc92-0b0c6386ce73 tempest-TestImageHashVerification-1983717145 None] Volume volume-583e7944-02fd-4901-a13e-ef82b6520c02 (583e7944-02fd-4901-a13e-ef82b6520c02): created successfully Sep 22 15:50:49 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-fc76cd8b-e56c-4bb4-bc92-0b0c6386ce73 tempest-TestImageHashVerification-1983717145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb026a0b-628a-4dc7-b0b3-d9e4f3e3f93b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:50:49 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-fc76cd8b-e56c-4bb4-bc92-0b0c6386ce73 tempest-TestImageHashVerification-1983717145 None] Flow 'volume_create_manager' (aab75499-6b6d-47c3-a115-89c48274ce50) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:50:49 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-fc76cd8b-e56c-4bb4-bc92-0b0c6386ce73 tempest-TestImageHashVerification-1983717145 None] Created volume successfully. Sep 22 15:50:49 devstack sudo[100230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_237bf3d2-0bdc-463c-a61e-a9bcfc657234_mai3n25ddevstack@QuobyteHD Sep 22 15:50:49 devstack sudo[100230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:50:50 devstack sudo[100230]: pam_unix(sudo:session): session closed for user root Sep 22 15:50:50 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-3c2fe8dd-52f4-4b11-9253-e04250dfbf96 tempest-TestInstancesWithCinderVolumes-793553421 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_237bf3d2-0bdc-463c-a61e-a9bcfc657234_mai3n25ddevstack@QuobyteHD" returned: 0 in 0.426s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:50:50 devstack cinder-volume[86212]: DEBUG cinder.image.image_utils [None req-3c2fe8dd-52f4-4b11-9253-e04250dfbf96 tempest-TestInstancesWithCinderVolumes-793553421 None] 237bf3d2-0bdc-463c-a61e-a9bcfc657234 was qcow2, converting to qcow2 {{(pid=86212) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 22 15:50:50 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-3c2fe8dd-52f4-4b11-9253-e04250dfbf96 tempest-TestInstancesWithCinderVolumes-793553421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_237bf3d2-0bdc-463c-a61e-a9bcfc657234_mai3n25ddevstack@QuobyteHD /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-485d3f7a-f7bc-4cbc-a362-858f126f010e {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:50:50 devstack sudo[100236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_237bf3d2-0bdc-463c-a61e-a9bcfc657234_mai3n25ddevstack@QuobyteHD /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-485d3f7a-f7bc-4cbc-a362-858f126f010e Sep 22 15:50:50 devstack sudo[100236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:50:52 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-9514dee5-055b-464a-b4ea-9b08d3cb8ddd tempest-TestImageHashVerification-1983717145 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:50:52 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-9514dee5-055b-464a-b4ea-9b08d3cb8ddd tempest-TestImageHashVerification-1983717145 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:50:52 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[55f0e864-cfdc-4263-83be-fa8e13896112]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:50:52 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-9514dee5-055b-464a-b4ea-9b08d3cb8ddd tempest-TestImageHashVerification-1983717145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-583e7944-02fd-4901-a13e-ef82b6520c02 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:50:52 devstack sudo[100254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-583e7944-02fd-4901-a13e-ef82b6520c02 Sep 22 15:50:52 devstack sudo[100254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:50:52 devstack sudo[100254]: pam_unix(sudo:session): session closed for user root Sep 22 15:50:52 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-9514dee5-055b-464a-b4ea-9b08d3cb8ddd tempest-TestImageHashVerification-1983717145 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-583e7944-02fd-4901-a13e-ef82b6520c02" returned: 0 in 0.620s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:50:52 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fc09794-b26d-4824-857a-6b4f3a9cd92c]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:50:52 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-9514dee5-055b-464a-b4ea-9b08d3cb8ddd tempest-TestImageHashVerification-1983717145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-583e7944-02fd-4901-a13e-ef82b6520c02 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:50:53 devstack sudo[100236]: pam_unix(sudo:session): session closed for user root Sep 22 15:50:53 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-3c2fe8dd-52f4-4b11-9253-e04250dfbf96 tempest-TestInstancesWithCinderVolumes-793553421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_237bf3d2-0bdc-463c-a61e-a9bcfc657234_mai3n25ddevstack@QuobyteHD /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-485d3f7a-f7bc-4cbc-a362-858f126f010e" returned: 0 in 2.818s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:50:53 devstack cinder-volume[86212]: DEBUG cinder.image.image_utils [None req-3c2fe8dd-52f4-4b11-9253-e04250dfbf96 tempest-TestInstancesWithCinderVolumes-793553421 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_237bf3d2-0bdc-463c-a61e-a9bcfc657234_mai3n25ddevstack@QuobyteHD, size 112.00 MB, duration 2.82 sec, destination /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-485d3f7a-f7bc-4cbc-a362-858f126f010e {{(pid=86212) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 22 15:50:53 devstack cinder-volume[86212]: INFO cinder.image.image_utils [None req-3c2fe8dd-52f4-4b11-9253-e04250dfbf96 tempest-TestInstancesWithCinderVolumes-793553421 None] Converted 112.00 MB image at 39.73 MB/s Sep 22 15:50:53 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-3c2fe8dd-52f4-4b11-9253-e04250dfbf96 tempest-TestInstancesWithCinderVolumes-793553421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-485d3f7a-f7bc-4cbc-a362-858f126f010e 1G {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:50:53 devstack sudo[100259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-583e7944-02fd-4901-a13e-ef82b6520c02 Sep 22 15:50:53 devstack sudo[100259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:50:53 devstack sudo[100260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-485d3f7a-f7bc-4cbc-a362-858f126f010e 1G Sep 22 15:50:53 devstack sudo[100260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:50:53 devstack sudo[100259]: pam_unix(sudo:session): session closed for user root Sep 22 15:50:53 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-9514dee5-055b-464a-b4ea-9b08d3cb8ddd tempest-TestImageHashVerification-1983717145 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-583e7944-02fd-4901-a13e-ef82b6520c02" returned: 0 in 0.492s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:50:53 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-9514dee5-055b-464a-b4ea-9b08d3cb8ddd tempest-TestImageHashVerification-1983717145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-583e7944-02fd-4901-a13e-ef82b6520c02 /opt/stack/data/cinder/conversion/583e7944-02fd-4901-a13e-ef82b6520c02.temp_image.a50fc7c5-2b08-4d11-8dfd-a99c937081c15dt3wpvc.img {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:50:53 devstack sudo[100269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-583e7944-02fd-4901-a13e-ef82b6520c02 /opt/stack/data/cinder/conversion/583e7944-02fd-4901-a13e-ef82b6520c02.temp_image.a50fc7c5-2b08-4d11-8dfd-a99c937081c15dt3wpvc.img Sep 22 15:50:53 devstack sudo[100269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:50:53 devstack sudo[100260]: pam_unix(sudo:session): session closed for user root Sep 22 15:50:53 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-3c2fe8dd-52f4-4b11-9253-e04250dfbf96 tempest-TestInstancesWithCinderVolumes-793553421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-485d3f7a-f7bc-4cbc-a362-858f126f010e 1G" returned: 0 in 0.411s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:50:53 devstack cinder-volume[86212]: DEBUG cinder.volume.volume_utils [None req-3c2fe8dd-52f4-4b11-9253-e04250dfbf96 tempest-TestInstancesWithCinderVolumes-793553421 None] Downloaded image 237bf3d2-0bdc-463c-a61e-a9bcfc657234 ((None, [{'url': 'file:///opt/stack/data/glance/images/237bf3d2-0bdc-463c-a61e-a9bcfc657234', 'metadata': {}}])) to volume 485d3f7a-f7bc-4cbc-a362-858f126f010e successfully. {{(pid=86212) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 22 15:50:53 devstack cinder-volume[86212]: DEBUG cinder.image.image_utils [None req-3c2fe8dd-52f4-4b11-9253-e04250dfbf96 tempest-TestInstancesWithCinderVolumes-793553421 None] Temporary image 237bf3d2-0bdc-463c-a61e-a9bcfc657234 for user dc4b3fc55f81498faafc5162cf0d1049 is deleted. {{(pid=86212) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 22 15:50:53 devstack cinder-volume[86212]: DEBUG cinder.volume.volume_utils [None req-3c2fe8dd-52f4-4b11-9253-e04250dfbf96 tempest-TestInstancesWithCinderVolumes-793553421 None] Marking volume 485d3f7a-f7bc-4cbc-a362-858f126f010e as bootable. {{(pid=86212) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 22 15:50:53 devstack cinder-volume[86212]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c2fe8dd-52f4-4b11-9253-e04250dfbf96 tempest-TestInstancesWithCinderVolumes-793553421 None] Copying metadata from image 237bf3d2-0bdc-463c-a61e-a9bcfc657234 to 485d3f7a-f7bc-4cbc-a362-858f126f010e. {{(pid=86212) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 22 15:50:53 devstack cinder-volume[86212]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c2fe8dd-52f4-4b11-9253-e04250dfbf96 tempest-TestInstancesWithCinderVolumes-793553421 None] Creating volume glance metadata for volume 485d3f7a-f7bc-4cbc-a362-858f126f010e backed by image 237bf3d2-0bdc-463c-a61e-a9bcfc657234 with: {'image_id': '237bf3d2-0bdc-463c-a61e-a9bcfc657234', 'image_name': 'tempest-scenario-img--545549118', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86212) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 22 15:50:53 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-3c2fe8dd-52f4-4b11-9253-e04250dfbf96 tempest-TestInstancesWithCinderVolumes-793553421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9dd8717-e046-40dd-aaa3-8adce6945543) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-485d3f7a-f7bc-4cbc-a362-858f126f010e', 'volume_size': 1, 'image_id': '237bf3d2-0bdc-463c-a61e-a9bcfc657234', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/237bf3d2-0bdc-463c-a61e-a9bcfc657234', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--545549118', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2355badd46c049cdacda0257342b55cf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '237bf3d2-0bdc-463c-a61e-a9bcfc657234', 'created_at': datetime.datetime(2026, 9, 22, 13, 50, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 13, 50, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/237bf3d2-0bdc-463c-a61e-a9bcfc657234/file', 'properties': {}}, 'image_service': }' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:50:53 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-3c2fe8dd-52f4-4b11-9253-e04250dfbf96 tempest-TestInstancesWithCinderVolumes-793553421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d451d3d-29f7-4606-bf7d-377e6ea90951) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:50:53 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-3c2fe8dd-52f4-4b11-9253-e04250dfbf96 tempest-TestInstancesWithCinderVolumes-793553421 None] Volume volume-485d3f7a-f7bc-4cbc-a362-858f126f010e (485d3f7a-f7bc-4cbc-a362-858f126f010e): created successfully Sep 22 15:50:53 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-3c2fe8dd-52f4-4b11-9253-e04250dfbf96 tempest-TestInstancesWithCinderVolumes-793553421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d451d3d-29f7-4606-bf7d-377e6ea90951) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:50:53 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-3c2fe8dd-52f4-4b11-9253-e04250dfbf96 tempest-TestInstancesWithCinderVolumes-793553421 None] Flow 'volume_create_manager' (c1153be3-ecdc-46fd-85a6-c8d2ed9c5fff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:50:53 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-3c2fe8dd-52f4-4b11-9253-e04250dfbf96 tempest-TestInstancesWithCinderVolumes-793553421 None] Created volume successfully. Sep 22 15:50:59 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [req-da6fdafc-e0e5-466b-b0cb-e45a1be67473 req-dc1e1300-29b7-432c-b1e7-cac710852024 tempest-TestInstancesWithCinderVolumes-793553421 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:51:01 devstack sudo[100269]: pam_unix(sudo:session): session closed for user root Sep 22 15:51:01 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-9514dee5-055b-464a-b4ea-9b08d3cb8ddd tempest-TestImageHashVerification-1983717145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-583e7944-02fd-4901-a13e-ef82b6520c02 /opt/stack/data/cinder/conversion/583e7944-02fd-4901-a13e-ef82b6520c02.temp_image.a50fc7c5-2b08-4d11-8dfd-a99c937081c15dt3wpvc.img" returned: 0 in 8.353s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:51:01 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f24edf8-bb80-4a0c-8373-0ae2345bb659]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:51:01 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-9514dee5-055b-464a-b4ea-9b08d3cb8ddd tempest-TestImageHashVerification-1983717145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-583e7944-02fd-4901-a13e-ef82b6520c02 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:51:01 devstack sudo[100300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-583e7944-02fd-4901-a13e-ef82b6520c02 Sep 22 15:51:01 devstack sudo[100300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:51:02 devstack sudo[100300]: pam_unix(sudo:session): session closed for user root Sep 22 15:51:02 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-9514dee5-055b-464a-b4ea-9b08d3cb8ddd tempest-TestImageHashVerification-1983717145 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-583e7944-02fd-4901-a13e-ef82b6520c02" returned: 0 in 0.609s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:51:02 devstack cinder-volume[86212]: DEBUG cinder.image.image_utils [None req-9514dee5-055b-464a-b4ea-9b08d3cb8ddd tempest-TestImageHashVerification-1983717145 None] Image conversion details: src /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-583e7944-02fd-4901-a13e-ef82b6520c02, size 1024.00 MB, duration 8.35 sec, destination /opt/stack/data/cinder/conversion/583e7944-02fd-4901-a13e-ef82b6520c02.temp_image.a50fc7c5-2b08-4d11-8dfd-a99c937081c15dt3wpvc.img {{(pid=86212) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 22 15:51:02 devstack cinder-volume[86212]: INFO cinder.image.image_utils [None req-9514dee5-055b-464a-b4ea-9b08d3cb8ddd tempest-TestImageHashVerification-1983717145 None] Converted 1024.00 MB image at 122.58 MB/s Sep 22 15:51:02 devstack cinder-volume[86212]: DEBUG cinder.image.image_utils [None req-9514dee5-055b-464a-b4ea-9b08d3cb8ddd tempest-TestImageHashVerification-1983717145 None] a50fc7c5-2b08-4d11-8dfd-a99c937081c1 was raw, no need to convert to raw {{(pid=86212) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}} Sep 22 15:51:12 devstack cinder-volume[86212]: DEBUG dbcounter [-] [86212] Writing DB stats cinder:SELECT=42,cinder:UPDATE=46,cinder:DELETE=4,cinder:INSERT=16 {{(pid=86212) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 22 15:51:12 devstack cinder-volume[86212]: DEBUG dbcounter [-] [86212] Writing DB stats cinder:SELECT=41,cinder:INSERT=11,cinder:UPDATE=38,cinder:DELETE=4 {{(pid=86212) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 22 15:51:22 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-9514dee5-055b-464a-b4ea-9b08d3cb8ddd tempest-TestImageHashVerification-1983717145 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 30.689s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:51:22 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-9514dee5-055b-464a-b4ea-9b08d3cb8ddd tempest-TestImageHashVerification-1983717145 None] Uploaded volume to glance image-id: a50fc7c5-2b08-4d11-8dfd-a99c937081c1. {{(pid=86212) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 22 15:51:22 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [req-da6fdafc-e0e5-466b-b0cb-e45a1be67473 req-dc1e1300-29b7-432c-b1e7-cac710852024 tempest-TestInstancesWithCinderVolumes-793553421 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 23.654s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:51:22 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [req-da6fdafc-e0e5-466b-b0cb-e45a1be67473 req-dc1e1300-29b7-432c-b1e7-cac710852024 tempest-TestInstancesWithCinderVolumes-793553421 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.024s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:51:22 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-9514dee5-055b-464a-b4ea-9b08d3cb8ddd tempest-TestImageHashVerification-1983717145 None] Copy volume to image completed successfully. Sep 22 15:51:22 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [req-da6fdafc-e0e5-466b-b0cb-e45a1be67473 req-dc1e1300-29b7-432c-b1e7-cac710852024 tempest-TestInstancesWithCinderVolumes-793553421 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31', 'name': 'volume-485d3f7a-f7bc-4cbc-a362-858f126f010e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '61e0b7f6-ad29-4a28-a365-5746ded8c320', 'enforce_multipath': True} {{(pid=86212) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 22 15:51:23 devstack cinder-volume[86212]: INFO cinder.volume.manager [req-da6fdafc-e0e5-466b-b0cb-e45a1be67473 req-dc1e1300-29b7-432c-b1e7-cac710852024 tempest-TestInstancesWithCinderVolumes-793553421 None] attachment_update completed successfully. Sep 22 15:51:24 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-1b7a99e7-91c7-49f8-8c73-9e4e3ad7730a tempest-TestImageHashVerification-1983717145 None] Acquiring lock "cinder-583e7944-02fd-4901-a13e-ef82b6520c02-delete_volume" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:51:24 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-1b7a99e7-91c7-49f8-8c73-9e4e3ad7730a tempest-TestImageHashVerification-1983717145 None] Lock "cinder-583e7944-02fd-4901-a13e-ef82b6520c02-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:51:24 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-1b7a99e7-91c7-49f8-8c73-9e4e3ad7730a tempest-TestImageHashVerification-1983717145 None] Acquiring lock "cinder-quobyte-583e7944-02fd-4901-a13e-ef82b6520c02" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:51:24 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-1b7a99e7-91c7-49f8-8c73-9e4e3ad7730a tempest-TestImageHashVerification-1983717145 None] Lock "cinder-quobyte-583e7944-02fd-4901-a13e-ef82b6520c02" acquired by "delete_volume" :: waited 0.021s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:51:24 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[91ad2050-14e6-42d1-8324-ea818be30af2]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:51:24 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-1b7a99e7-91c7-49f8-8c73-9e4e3ad7730a tempest-TestImageHashVerification-1983717145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-583e7944-02fd-4901-a13e-ef82b6520c02 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:51:24 devstack sudo[100449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-583e7944-02fd-4901-a13e-ef82b6520c02 Sep 22 15:51:24 devstack sudo[100449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:51:25 devstack sudo[100449]: pam_unix(sudo:session): session closed for user root Sep 22 15:51:25 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-1b7a99e7-91c7-49f8-8c73-9e4e3ad7730a tempest-TestImageHashVerification-1983717145 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-583e7944-02fd-4901-a13e-ef82b6520c02" returned: 0 in 0.398s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:51:25 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-1b7a99e7-91c7-49f8-8c73-9e4e3ad7730a tempest-TestImageHashVerification-1983717145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-583e7944-02fd-4901-a13e-ef82b6520c02 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:51:25 devstack sudo[100456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-583e7944-02fd-4901-a13e-ef82b6520c02 Sep 22 15:51:25 devstack sudo[100456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:51:25 devstack sudo[100456]: pam_unix(sudo:session): session closed for user root Sep 22 15:51:25 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-1b7a99e7-91c7-49f8-8c73-9e4e3ad7730a tempest-TestImageHashVerification-1983717145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-583e7944-02fd-4901-a13e-ef82b6520c02" returned: 0 in 0.279s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:51:25 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-1b7a99e7-91c7-49f8-8c73-9e4e3ad7730a tempest-TestImageHashVerification-1983717145 None] Lock "cinder-quobyte-583e7944-02fd-4901-a13e-ef82b6520c02" released by "delete_volume" :: held 0.736s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:51:25 devstack cinder-volume[86212]: DEBUG cinder.quota [None req-1b7a99e7-91c7-49f8-8c73-9e4e3ad7730a tempest-TestImageHashVerification-1983717145 None] Created reservations ['cc715743-8424-4f8c-9280-f9b3586fabee', '50946bea-5442-4617-8878-74cc1fa36be1', '0cb4fdeb-a1b7-4b5d-8eaf-91f419aba492', '9f21ef4c-f441-4257-8df0-058ceffb3f90'] {{(pid=86212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 15:51:25 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-1b7a99e7-91c7-49f8-8c73-9e4e3ad7730a tempest-TestImageHashVerification-1983717145 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:51:25 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-1b7a99e7-91c7-49f8-8c73-9e4e3ad7730a tempest-TestImageHashVerification-1983717145 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:51:25 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-1b7a99e7-91c7-49f8-8c73-9e4e3ad7730a tempest-TestImageHashVerification-1983717145 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:51:25 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-1b7a99e7-91c7-49f8-8c73-9e4e3ad7730a tempest-TestImageHashVerification-1983717145 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:51:25 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-1b7a99e7-91c7-49f8-8c73-9e4e3ad7730a tempest-TestImageHashVerification-1983717145 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:51:25 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-1b7a99e7-91c7-49f8-8c73-9e4e3ad7730a tempest-TestImageHashVerification-1983717145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:51:25 devstack sudo[100461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc Sep 22 15:51:25 devstack sudo[100461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:51:25 devstack sudo[100461]: pam_unix(sudo:session): session closed for user root Sep 22 15:51:25 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-1b7a99e7-91c7-49f8-8c73-9e4e3ad7730a tempest-TestImageHashVerification-1983717145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc" returned: 0 in 0.328s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:51:25 devstack cinder-volume[86212]: DEBUG cinder.manager [None req-1b7a99e7-91c7-49f8-8c73-9e4e3ad7730a tempest-TestImageHashVerification-1983717145 None] Notifying Schedulers of capabilities ... {{(pid=86212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 15:51:25 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-1b7a99e7-91c7-49f8-8c73-9e4e3ad7730a tempest-TestImageHashVerification-1983717145 None] Deleted volume successfully. Sep 22 15:51:25 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-1b7a99e7-91c7-49f8-8c73-9e4e3ad7730a tempest-TestImageHashVerification-1983717145 None] Lock "cinder-583e7944-02fd-4901-a13e-ef82b6520c02-delete_volume" released by "delete_volume" :: held 1.359s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:51:35 devstack cinder-volume[86212]: DEBUG dbcounter [-] [86212] Writing DB stats cinder:SELECT=11,cinder:UPDATE=12,cinder:INSERT=3,cinder:DELETE=1 {{(pid=86212) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 22 15:51:36 devstack cinder-volume[86212]: INFO cinder.volume.manager [req-5a79b451-af0b-49c6-b24d-73d4f664cb0e req-0a719cbd-9efc-4ca5-b180-b5c1b7c422e9 tempest-TestMinimumBasicScenario-120257745 None] Terminate volume connection completed successfully. Sep 22 15:51:36 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [req-5a79b451-af0b-49c6-b24d-73d4f664cb0e req-0a719cbd-9efc-4ca5-b180-b5c1b7c422e9 tempest-TestMinimumBasicScenario-120257745 None] Deleting attachment 3bcbf315-deb3-49f2-9484-2841990e901c. {{(pid=86212) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 22 15:51:37 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-8f443dd6-9b5e-40bc-b9dd-64df044e799a tempest-TestMinimumBasicScenario-120257745 None] Acquiring lock "cinder-6fcbeeea-14f3-4722-8ec5-81221768647c-delete_volume" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:51:37 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-8f443dd6-9b5e-40bc-b9dd-64df044e799a tempest-TestMinimumBasicScenario-120257745 None] Lock "cinder-6fcbeeea-14f3-4722-8ec5-81221768647c-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:51:37 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-8f443dd6-9b5e-40bc-b9dd-64df044e799a tempest-TestMinimumBasicScenario-120257745 None] Acquiring lock "cinder-quobyte-6fcbeeea-14f3-4722-8ec5-81221768647c" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:51:37 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-8f443dd6-9b5e-40bc-b9dd-64df044e799a tempest-TestMinimumBasicScenario-120257745 None] Lock "cinder-quobyte-6fcbeeea-14f3-4722-8ec5-81221768647c" acquired by "delete_volume" :: waited 0.031s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:51:37 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c566c26-6eaf-4689-955b-955486292a76]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:51:37 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-8f443dd6-9b5e-40bc-b9dd-64df044e799a tempest-TestMinimumBasicScenario-120257745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-6fcbeeea-14f3-4722-8ec5-81221768647c {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:51:37 devstack sudo[100482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-6fcbeeea-14f3-4722-8ec5-81221768647c Sep 22 15:51:37 devstack sudo[100482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:51:37 devstack sudo[100482]: pam_unix(sudo:session): session closed for user root Sep 22 15:51:37 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-8f443dd6-9b5e-40bc-b9dd-64df044e799a tempest-TestMinimumBasicScenario-120257745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-6fcbeeea-14f3-4722-8ec5-81221768647c" returned: 0 in 0.408s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:51:37 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-8f443dd6-9b5e-40bc-b9dd-64df044e799a tempest-TestMinimumBasicScenario-120257745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-6fcbeeea-14f3-4722-8ec5-81221768647c {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:51:37 devstack sudo[100489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-6fcbeeea-14f3-4722-8ec5-81221768647c Sep 22 15:51:37 devstack sudo[100489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:51:38 devstack sudo[100489]: pam_unix(sudo:session): session closed for user root Sep 22 15:51:38 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-8f443dd6-9b5e-40bc-b9dd-64df044e799a tempest-TestMinimumBasicScenario-120257745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-6fcbeeea-14f3-4722-8ec5-81221768647c" returned: 0 in 0.304s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:51:38 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-8f443dd6-9b5e-40bc-b9dd-64df044e799a tempest-TestMinimumBasicScenario-120257745 None] Lock "cinder-quobyte-6fcbeeea-14f3-4722-8ec5-81221768647c" released by "delete_volume" :: held 0.822s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:51:38 devstack cinder-volume[86212]: DEBUG cinder.quota [None req-8f443dd6-9b5e-40bc-b9dd-64df044e799a tempest-TestMinimumBasicScenario-120257745 None] Created reservations ['0bcfb14f-6ff0-423a-a225-2eb318884f21', '2c87f32b-66ed-4ea1-b9c6-fd4c8e58abf8', '33ca3bae-5443-4c0d-8c93-ee1b1a978ff4', '119ca795-9efb-4164-aa3a-9e15e8e2e3c0'] {{(pid=86212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 15:51:38 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-8f443dd6-9b5e-40bc-b9dd-64df044e799a tempest-TestMinimumBasicScenario-120257745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:51:38 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-8f443dd6-9b5e-40bc-b9dd-64df044e799a tempest-TestMinimumBasicScenario-120257745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:51:38 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-8f443dd6-9b5e-40bc-b9dd-64df044e799a tempest-TestMinimumBasicScenario-120257745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:51:38 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-8f443dd6-9b5e-40bc-b9dd-64df044e799a tempest-TestMinimumBasicScenario-120257745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:51:38 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-8f443dd6-9b5e-40bc-b9dd-64df044e799a tempest-TestMinimumBasicScenario-120257745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:51:38 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-8f443dd6-9b5e-40bc-b9dd-64df044e799a tempest-TestMinimumBasicScenario-120257745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:51:38 devstack cinder-volume[86212]: DEBUG oslo_service.periodic_task [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86212) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 22 15:51:38 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:51:38 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:51:38 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:51:38 devstack sudo[100492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc Sep 22 15:51:38 devstack sudo[100492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:51:38 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:51:38 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:51:38 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:51:38 devstack sudo[100494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc Sep 22 15:51:38 devstack sudo[100494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:51:38 devstack sudo[100492]: pam_unix(sudo:session): session closed for user root Sep 22 15:51:38 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-8f443dd6-9b5e-40bc-b9dd-64df044e799a tempest-TestMinimumBasicScenario-120257745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc" returned: 0 in 0.514s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:51:38 devstack cinder-volume[86212]: DEBUG cinder.manager [None req-8f443dd6-9b5e-40bc-b9dd-64df044e799a tempest-TestMinimumBasicScenario-120257745 None] Notifying Schedulers of capabilities ... {{(pid=86212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 15:51:38 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-8f443dd6-9b5e-40bc-b9dd-64df044e799a tempest-TestMinimumBasicScenario-120257745 None] Deleted volume successfully. Sep 22 15:51:38 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-8f443dd6-9b5e-40bc-b9dd-64df044e799a tempest-TestMinimumBasicScenario-120257745 None] Lock "cinder-6fcbeeea-14f3-4722-8ec5-81221768647c-delete_volume" released by "delete_volume" :: held 1.693s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:51:39 devstack sudo[100494]: pam_unix(sudo:session): session closed for user root Sep 22 15:51:39 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc" returned: 0 in 0.559s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:51:39 devstack cinder-volume[86212]: DEBUG cinder.manager [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] Notifying Schedulers of capabilities ... {{(pid=86212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 15:51:39 devstack cinder-volume[86212]: DEBUG oslo_service.periodic_task [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] Running periodic task VolumeManager._thread_info {{(pid=86212) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 22 15:51:39 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] thread count: 29 {{(pid=86212) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 22 15:51:39 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] thread info: [<_MainThread(MainThread, started 136163191222400)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86212) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 22 15:51:42 devstack cinder-volume[86212]: DEBUG cinder.volume.flows.manager.create_volume [None req-847e2947-51b0-4b93-8950-4229428a6e4a tempest-CreateVolumesFromSnapshotTest-1505214100 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 15:51:42 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-847e2947-51b0-4b93-8950-4229428a6e4a tempest-CreateVolumesFromSnapshotTest-1505214100 None] Flow 'volume_create_manager' (05b1291a-d12d-483f-9cb2-8872793a6b5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:51:42 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-847e2947-51b0-4b93-8950-4229428a6e4a tempest-CreateVolumesFromSnapshotTest-1505214100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6129dd2f-54dd-433e-8962-bb25a162622a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:51:42 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-847e2947-51b0-4b93-8950-4229428a6e4a tempest-CreateVolumesFromSnapshotTest-1505214100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6129dd2f-54dd-433e-8962-bb25a162622a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:51:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-148369414',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ef27155-7ade-4993-90cb-89db13255902,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d93006db07834200af9c6cc36b81ce12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:51:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:51:42Z,use_quota=True,user_id='2cf3388ae2cd4242aedf09ca8a628ba1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:51:42 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-847e2947-51b0-4b93-8950-4229428a6e4a tempest-CreateVolumesFromSnapshotTest-1505214100 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05ef431c-c658-4c88-8207-98051e502434) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:51:42 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-847e2947-51b0-4b93-8950-4229428a6e4a tempest-CreateVolumesFromSnapshotTest-1505214100 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05ef431c-c658-4c88-8207-98051e502434) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:51:42 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-847e2947-51b0-4b93-8950-4229428a6e4a tempest-CreateVolumesFromSnapshotTest-1505214100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6777be7e-694b-4bb5-bc8b-1ca40224e8ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:51:42 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-847e2947-51b0-4b93-8950-4229428a6e4a tempest-CreateVolumesFromSnapshotTest-1505214100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6777be7e-694b-4bb5-bc8b-1ca40224e8ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ef27155-7ade-4993-90cb-89db13255902', 'volume_name': 'volume-9ef27155-7ade-4993-90cb-89db13255902', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:51:42 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-847e2947-51b0-4b93-8950-4229428a6e4a tempest-CreateVolumesFromSnapshotTest-1505214100 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99b8f96a-d590-45e9-9c15-147a7175d01a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:51:42 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-847e2947-51b0-4b93-8950-4229428a6e4a tempest-CreateVolumesFromSnapshotTest-1505214100 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99b8f96a-d590-45e9-9c15-147a7175d01a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:51:42 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-847e2947-51b0-4b93-8950-4229428a6e4a tempest-CreateVolumesFromSnapshotTest-1505214100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d1ad2c1-86a8-477d-a857-40257b0e832f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:51:42 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-847e2947-51b0-4b93-8950-4229428a6e4a tempest-CreateVolumesFromSnapshotTest-1505214100 None] Volume 9ef27155-7ade-4993-90cb-89db13255902: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ef27155-7ade-4993-90cb-89db13255902', 'volume_size': 1} Sep 22 15:51:42 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-847e2947-51b0-4b93-8950-4229428a6e4a tempest-CreateVolumesFromSnapshotTest-1505214100 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:51:42 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-847e2947-51b0-4b93-8950-4229428a6e4a tempest-CreateVolumesFromSnapshotTest-1505214100 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:51:42 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-847e2947-51b0-4b93-8950-4229428a6e4a tempest-CreateVolumesFromSnapshotTest-1505214100 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:51:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-148369414',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ef27155-7ade-4993-90cb-89db13255902,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d93006db07834200af9c6cc36b81ce12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:51:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:51:42Z,use_quota=True,user_id='2cf3388ae2cd4242aedf09ca8a628ba1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)}" {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 15:51:42 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-847e2947-51b0-4b93-8950-4229428a6e4a tempest-CreateVolumesFromSnapshotTest-1505214100 None] Creating volume 9ef27155-7ade-4993-90cb-89db13255902 {{(pid=86212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 15:51:42 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-847e2947-51b0-4b93-8950-4229428a6e4a tempest-CreateVolumesFromSnapshotTest-1505214100 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:51:42 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-847e2947-51b0-4b93-8950-4229428a6e4a tempest-CreateVolumesFromSnapshotTest-1505214100 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:51:42 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-847e2947-51b0-4b93-8950-4229428a6e4a tempest-CreateVolumesFromSnapshotTest-1505214100 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:51:42 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-847e2947-51b0-4b93-8950-4229428a6e4a tempest-CreateVolumesFromSnapshotTest-1505214100 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:51:42 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-847e2947-51b0-4b93-8950-4229428a6e4a tempest-CreateVolumesFromSnapshotTest-1505214100 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:51:42 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-847e2947-51b0-4b93-8950-4229428a6e4a tempest-CreateVolumesFromSnapshotTest-1505214100 None] Selected osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 as target Quobyte volume. {{(pid=86212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 15:51:42 devstack cinder-volume[86212]: INFO cinder.volume.drivers.remotefs [None req-847e2947-51b0-4b93-8950-4229428a6e4a tempest-CreateVolumesFromSnapshotTest-1505214100 None] casted to osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 Sep 22 15:51:42 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-847e2947-51b0-4b93-8950-4229428a6e4a tempest-CreateVolumesFromSnapshotTest-1505214100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-9ef27155-7ade-4993-90cb-89db13255902 1073741824 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:51:42 devstack sudo[100560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-9ef27155-7ade-4993-90cb-89db13255902 1073741824 Sep 22 15:51:42 devstack sudo[100560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:51:43 devstack sudo[100560]: pam_unix(sudo:session): session closed for user root Sep 22 15:51:43 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-847e2947-51b0-4b93-8950-4229428a6e4a tempest-CreateVolumesFromSnapshotTest-1505214100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-9ef27155-7ade-4993-90cb-89db13255902 1073741824" returned: 0 in 0.505s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:51:43 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-847e2947-51b0-4b93-8950-4229428a6e4a tempest-CreateVolumesFromSnapshotTest-1505214100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-9ef27155-7ade-4993-90cb-89db13255902 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:51:43 devstack sudo[100575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-9ef27155-7ade-4993-90cb-89db13255902 Sep 22 15:51:43 devstack sudo[100575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:51:43 devstack sudo[100575]: pam_unix(sudo:session): session closed for user root Sep 22 15:51:43 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-847e2947-51b0-4b93-8950-4229428a6e4a tempest-CreateVolumesFromSnapshotTest-1505214100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-9ef27155-7ade-4993-90cb-89db13255902" returned: 0 in 0.286s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:51:43 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-847e2947-51b0-4b93-8950-4229428a6e4a tempest-CreateVolumesFromSnapshotTest-1505214100 None] <== create_volume: return (840ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'} {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 15:51:43 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-847e2947-51b0-4b93-8950-4229428a6e4a tempest-CreateVolumesFromSnapshotTest-1505214100 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.843s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:51:43 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-847e2947-51b0-4b93-8950-4229428a6e4a tempest-CreateVolumesFromSnapshotTest-1505214100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d1ad2c1-86a8-477d-a857-40257b0e832f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ef27155-7ade-4993-90cb-89db13255902', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:51:43 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-847e2947-51b0-4b93-8950-4229428a6e4a tempest-CreateVolumesFromSnapshotTest-1505214100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c70ab669-be0a-4b3a-8dce-527832076df2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:51:43 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-847e2947-51b0-4b93-8950-4229428a6e4a tempest-CreateVolumesFromSnapshotTest-1505214100 None] Volume volume-9ef27155-7ade-4993-90cb-89db13255902 (9ef27155-7ade-4993-90cb-89db13255902): created successfully Sep 22 15:51:43 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-847e2947-51b0-4b93-8950-4229428a6e4a tempest-CreateVolumesFromSnapshotTest-1505214100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c70ab669-be0a-4b3a-8dce-527832076df2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:51:43 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-847e2947-51b0-4b93-8950-4229428a6e4a tempest-CreateVolumesFromSnapshotTest-1505214100 None] Flow 'volume_create_manager' (05b1291a-d12d-483f-9cb2-8872793a6b5f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:51:43 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-847e2947-51b0-4b93-8950-4229428a6e4a tempest-CreateVolumesFromSnapshotTest-1505214100 None] Created volume successfully. Sep 22 15:51:44 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-dd1279d4-f887-4152-a0a1-c46ff7b7975d tempest-CreateVolumesFromSnapshotTest-1505214100 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:51:44 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-dd1279d4-f887-4152-a0a1-c46ff7b7975d tempest-CreateVolumesFromSnapshotTest-1505214100 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:51:44 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-dd1279d4-f887-4152-a0a1-c46ff7b7975d tempest-CreateVolumesFromSnapshotTest-1505214100 None] Creating offline snapshot 585b834f-197e-4c2b-8c1c-aaa56faa6873 of volume 9ef27155-7ade-4993-90cb-89db13255902 {{(pid=86212) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 22 15:51:44 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[60db5ce2-ce11-4cfd-8448-1407189b833e]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:51:44 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-dd1279d4-f887-4152-a0a1-c46ff7b7975d tempest-CreateVolumesFromSnapshotTest-1505214100 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-9ef27155-7ade-4993-90cb-89db13255902 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:51:44 devstack sudo[100579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-9ef27155-7ade-4993-90cb-89db13255902 Sep 22 15:51:44 devstack sudo[100579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:51:45 devstack sudo[100579]: pam_unix(sudo:session): session closed for user root Sep 22 15:51:45 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-dd1279d4-f887-4152-a0a1-c46ff7b7975d tempest-CreateVolumesFromSnapshotTest-1505214100 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-9ef27155-7ade-4993-90cb-89db13255902" returned: 0 in 0.368s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:51:45 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-dd1279d4-f887-4152-a0a1-c46ff7b7975d tempest-CreateVolumesFromSnapshotTest-1505214100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-9ef27155-7ade-4993-90cb-89db13255902,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-9ef27155-7ade-4993-90cb-89db13255902.585b834f-197e-4c2b-8c1c-aaa56faa6873 1G {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:51:45 devstack sudo[100584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-9ef27155-7ade-4993-90cb-89db13255902,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-9ef27155-7ade-4993-90cb-89db13255902.585b834f-197e-4c2b-8c1c-aaa56faa6873 1G Sep 22 15:51:45 devstack sudo[100584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:51:45 devstack sudo[100584]: pam_unix(sudo:session): session closed for user root Sep 22 15:51:45 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-dd1279d4-f887-4152-a0a1-c46ff7b7975d tempest-CreateVolumesFromSnapshotTest-1505214100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-9ef27155-7ade-4993-90cb-89db13255902,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-9ef27155-7ade-4993-90cb-89db13255902.585b834f-197e-4c2b-8c1c-aaa56faa6873 1G" returned: 0 in 0.463s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:51:45 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-dd1279d4-f887-4152-a0a1-c46ff7b7975d tempest-CreateVolumesFromSnapshotTest-1505214100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9ef27155-7ade-4993-90cb-89db13255902 -F qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-9ef27155-7ade-4993-90cb-89db13255902.585b834f-197e-4c2b-8c1c-aaa56faa6873 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:51:45 devstack sudo[100589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9ef27155-7ade-4993-90cb-89db13255902 -F qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-9ef27155-7ade-4993-90cb-89db13255902.585b834f-197e-4c2b-8c1c-aaa56faa6873 Sep 22 15:51:45 devstack sudo[100589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:51:45 devstack sudo[100589]: pam_unix(sudo:session): session closed for user root Sep 22 15:51:46 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-dd1279d4-f887-4152-a0a1-c46ff7b7975d tempest-CreateVolumesFromSnapshotTest-1505214100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9ef27155-7ade-4993-90cb-89db13255902 -F qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-9ef27155-7ade-4993-90cb-89db13255902.585b834f-197e-4c2b-8c1c-aaa56faa6873" returned: 0 in 0.310s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:51:46 devstack cinder-volume[86212]: WARNING cinder.volume.drivers.remotefs [None req-dd1279d4-f887-4152-a0a1-c46ff7b7975d tempest-CreateVolumesFromSnapshotTest-1505214100 None] /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-9ef27155-7ade-4993-90cb-89db13255902.585b834f-197e-4c2b-8c1c-aaa56faa6873 is being set with open permissions: ugo+rw Sep 22 15:51:46 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-dd1279d4-f887-4152-a0a1-c46ff7b7975d tempest-CreateVolumesFromSnapshotTest-1505214100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-9ef27155-7ade-4993-90cb-89db13255902.585b834f-197e-4c2b-8c1c-aaa56faa6873 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:51:46 devstack sudo[100594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-9ef27155-7ade-4993-90cb-89db13255902.585b834f-197e-4c2b-8c1c-aaa56faa6873 Sep 22 15:51:46 devstack sudo[100594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:51:46 devstack sudo[100594]: pam_unix(sudo:session): session closed for user root Sep 22 15:51:46 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-dd1279d4-f887-4152-a0a1-c46ff7b7975d tempest-CreateVolumesFromSnapshotTest-1505214100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-9ef27155-7ade-4993-90cb-89db13255902.585b834f-197e-4c2b-8c1c-aaa56faa6873" returned: 0 in 0.240s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:51:46 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-dd1279d4-f887-4152-a0a1-c46ff7b7975d tempest-CreateVolumesFromSnapshotTest-1505214100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-9ef27155-7ade-4993-90cb-89db13255902.info {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:51:46 devstack sudo[100597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-9ef27155-7ade-4993-90cb-89db13255902.info Sep 22 15:51:46 devstack sudo[100597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:51:46 devstack sudo[100597]: pam_unix(sudo:session): session closed for user root Sep 22 15:51:46 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-dd1279d4-f887-4152-a0a1-c46ff7b7975d tempest-CreateVolumesFromSnapshotTest-1505214100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-9ef27155-7ade-4993-90cb-89db13255902.info" returned: 0 in 0.274s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:51:46 devstack cinder-volume[86212]: WARNING cinder.volume.drivers.remotefs [None req-dd1279d4-f887-4152-a0a1-c46ff7b7975d tempest-CreateVolumesFromSnapshotTest-1505214100 None] /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-9ef27155-7ade-4993-90cb-89db13255902.info is being set with open permissions: ugo+rw Sep 22 15:51:46 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-dd1279d4-f887-4152-a0a1-c46ff7b7975d tempest-CreateVolumesFromSnapshotTest-1505214100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-9ef27155-7ade-4993-90cb-89db13255902.info {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:51:46 devstack sudo[100600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-9ef27155-7ade-4993-90cb-89db13255902.info Sep 22 15:51:46 devstack sudo[100600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:51:46 devstack sudo[100600]: pam_unix(sudo:session): session closed for user root Sep 22 15:51:46 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-dd1279d4-f887-4152-a0a1-c46ff7b7975d tempest-CreateVolumesFromSnapshotTest-1505214100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-9ef27155-7ade-4993-90cb-89db13255902.info" returned: 0 in 0.272s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:51:46 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-dd1279d4-f887-4152-a0a1-c46ff7b7975d tempest-CreateVolumesFromSnapshotTest-1505214100 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.034s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:51:46 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-dd1279d4-f887-4152-a0a1-c46ff7b7975d tempest-CreateVolumesFromSnapshotTest-1505214100 None] Create snapshot completed successfully Sep 22 15:51:48 devstack cinder-volume[86212]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0c9261e-467d-4335-a875-875c8a1e6095 tempest-CreateVolumesFromSnapshotTest-1505214100 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 15:51:48 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-a0c9261e-467d-4335-a875-875c8a1e6095 tempest-CreateVolumesFromSnapshotTest-1505214100 None] Flow 'volume_create_manager' (5e077fcd-75d7-4054-82be-70a272d0e880) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:51:48 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-a0c9261e-467d-4335-a875-875c8a1e6095 tempest-CreateVolumesFromSnapshotTest-1505214100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc81e95d-8d0f-4c49-910c-8c0b55a34e7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:51:48 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-a0c9261e-467d-4335-a875-875c8a1e6095 tempest-CreateVolumesFromSnapshotTest-1505214100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc81e95d-8d0f-4c49-910c-8c0b55a34e7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:51:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1198925842',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62bee25b-4771-497e-8fba-cb147fc0fc65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d93006db07834200af9c6cc36b81ce12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:51:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:51:48Z,use_quota=True,user_id='2cf3388ae2cd4242aedf09ca8a628ba1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:51:48 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-a0c9261e-467d-4335-a875-875c8a1e6095 tempest-CreateVolumesFromSnapshotTest-1505214100 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bedb86e-1478-4a7e-b8fa-bcb7f8c98f01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:51:48 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-a0c9261e-467d-4335-a875-875c8a1e6095 tempest-CreateVolumesFromSnapshotTest-1505214100 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bedb86e-1478-4a7e-b8fa-bcb7f8c98f01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:51:48 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-a0c9261e-467d-4335-a875-875c8a1e6095 tempest-CreateVolumesFromSnapshotTest-1505214100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c050bf29-862e-4768-b239-a7ae26061c23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:51:48 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-a0c9261e-467d-4335-a875-875c8a1e6095 tempest-CreateVolumesFromSnapshotTest-1505214100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c050bf29-862e-4768-b239-a7ae26061c23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '62bee25b-4771-497e-8fba-cb147fc0fc65', 'volume_name': 'volume-62bee25b-4771-497e-8fba-cb147fc0fc65', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:51:48 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-a0c9261e-467d-4335-a875-875c8a1e6095 tempest-CreateVolumesFromSnapshotTest-1505214100 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1009c982-43d2-4547-90ee-86104570eecc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:51:48 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-a0c9261e-467d-4335-a875-875c8a1e6095 tempest-CreateVolumesFromSnapshotTest-1505214100 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1009c982-43d2-4547-90ee-86104570eecc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:51:48 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-a0c9261e-467d-4335-a875-875c8a1e6095 tempest-CreateVolumesFromSnapshotTest-1505214100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a43208e-3270-45f7-b609-576d1145b97c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:51:48 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-a0c9261e-467d-4335-a875-875c8a1e6095 tempest-CreateVolumesFromSnapshotTest-1505214100 None] Volume 62bee25b-4771-497e-8fba-cb147fc0fc65: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-62bee25b-4771-497e-8fba-cb147fc0fc65', 'volume_size': 1} Sep 22 15:51:48 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-a0c9261e-467d-4335-a875-875c8a1e6095 tempest-CreateVolumesFromSnapshotTest-1505214100 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:51:48 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-a0c9261e-467d-4335-a875-875c8a1e6095 tempest-CreateVolumesFromSnapshotTest-1505214100 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:51:48 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-a0c9261e-467d-4335-a875-875c8a1e6095 tempest-CreateVolumesFromSnapshotTest-1505214100 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:51:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1198925842',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62bee25b-4771-497e-8fba-cb147fc0fc65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d93006db07834200af9c6cc36b81ce12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:51:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:51:48Z,use_quota=True,user_id='2cf3388ae2cd4242aedf09ca8a628ba1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)}" {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 15:51:48 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-a0c9261e-467d-4335-a875-875c8a1e6095 tempest-CreateVolumesFromSnapshotTest-1505214100 None] Creating volume 62bee25b-4771-497e-8fba-cb147fc0fc65 {{(pid=86212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 15:51:48 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-a0c9261e-467d-4335-a875-875c8a1e6095 tempest-CreateVolumesFromSnapshotTest-1505214100 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:51:48 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-a0c9261e-467d-4335-a875-875c8a1e6095 tempest-CreateVolumesFromSnapshotTest-1505214100 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:51:48 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-a0c9261e-467d-4335-a875-875c8a1e6095 tempest-CreateVolumesFromSnapshotTest-1505214100 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:51:48 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-a0c9261e-467d-4335-a875-875c8a1e6095 tempest-CreateVolumesFromSnapshotTest-1505214100 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:51:48 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-a0c9261e-467d-4335-a875-875c8a1e6095 tempest-CreateVolumesFromSnapshotTest-1505214100 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:51:48 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-a0c9261e-467d-4335-a875-875c8a1e6095 tempest-CreateVolumesFromSnapshotTest-1505214100 None] Selected osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 as target Quobyte volume. {{(pid=86212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 15:51:48 devstack cinder-volume[86212]: INFO cinder.volume.drivers.remotefs [None req-a0c9261e-467d-4335-a875-875c8a1e6095 tempest-CreateVolumesFromSnapshotTest-1505214100 None] casted to osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 Sep 22 15:51:48 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-a0c9261e-467d-4335-a875-875c8a1e6095 tempest-CreateVolumesFromSnapshotTest-1505214100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-62bee25b-4771-497e-8fba-cb147fc0fc65 1073741824 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:51:48 devstack sudo[100605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-62bee25b-4771-497e-8fba-cb147fc0fc65 1073741824 Sep 22 15:51:48 devstack sudo[100605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:51:48 devstack cinder-volume[86212]: DEBUG cinder.volume.flows.manager.create_volume [None req-575a3f24-f8b2-489b-96d3-d6cf59c8a25b tempest-CreateVolumesFromSnapshotTest-1505214100 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 15:51:48 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-575a3f24-f8b2-489b-96d3-d6cf59c8a25b tempest-CreateVolumesFromSnapshotTest-1505214100 None] Flow 'volume_create_manager' (86af0bc7-8231-4b24-b288-fe53e8e7a818) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:51:48 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-575a3f24-f8b2-489b-96d3-d6cf59c8a25b tempest-CreateVolumesFromSnapshotTest-1505214100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9036ac91-d975-4a97-8a01-b75564cb3849) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:51:48 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-575a3f24-f8b2-489b-96d3-d6cf59c8a25b tempest-CreateVolumesFromSnapshotTest-1505214100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9036ac91-d975-4a97-8a01-b75564cb3849) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:51:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-467825980',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fb11329-8054-42ad-8564-e100b8026768,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d93006db07834200af9c6cc36b81ce12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:51:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:51:49Z,use_quota=True,user_id='2cf3388ae2cd4242aedf09ca8a628ba1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:51:48 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-575a3f24-f8b2-489b-96d3-d6cf59c8a25b tempest-CreateVolumesFromSnapshotTest-1505214100 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e394204-bfda-4d8c-9a35-354df9a81e76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:51:48 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-575a3f24-f8b2-489b-96d3-d6cf59c8a25b tempest-CreateVolumesFromSnapshotTest-1505214100 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e394204-bfda-4d8c-9a35-354df9a81e76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:51:48 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-575a3f24-f8b2-489b-96d3-d6cf59c8a25b tempest-CreateVolumesFromSnapshotTest-1505214100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1ce581a-7cbe-441d-9491-1e26cc1f08a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:51:48 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-575a3f24-f8b2-489b-96d3-d6cf59c8a25b tempest-CreateVolumesFromSnapshotTest-1505214100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1ce581a-7cbe-441d-9491-1e26cc1f08a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6fb11329-8054-42ad-8564-e100b8026768', 'volume_name': 'volume-6fb11329-8054-42ad-8564-e100b8026768', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:51:48 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-575a3f24-f8b2-489b-96d3-d6cf59c8a25b tempest-CreateVolumesFromSnapshotTest-1505214100 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (097d8cd7-5b73-4ac4-843b-74c9094c52af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:51:48 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-575a3f24-f8b2-489b-96d3-d6cf59c8a25b tempest-CreateVolumesFromSnapshotTest-1505214100 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (097d8cd7-5b73-4ac4-843b-74c9094c52af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:51:49 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-575a3f24-f8b2-489b-96d3-d6cf59c8a25b tempest-CreateVolumesFromSnapshotTest-1505214100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20349880-5ea6-4f9b-8fd5-23413b990141) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:51:49 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-575a3f24-f8b2-489b-96d3-d6cf59c8a25b tempest-CreateVolumesFromSnapshotTest-1505214100 None] Volume 6fb11329-8054-42ad-8564-e100b8026768: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6fb11329-8054-42ad-8564-e100b8026768', 'volume_size': 1} Sep 22 15:51:49 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-575a3f24-f8b2-489b-96d3-d6cf59c8a25b tempest-CreateVolumesFromSnapshotTest-1505214100 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:51:49 devstack sudo[100605]: pam_unix(sudo:session): session closed for user root Sep 22 15:51:49 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-a0c9261e-467d-4335-a875-875c8a1e6095 tempest-CreateVolumesFromSnapshotTest-1505214100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-62bee25b-4771-497e-8fba-cb147fc0fc65 1073741824" returned: 0 in 0.750s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:51:49 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-a0c9261e-467d-4335-a875-875c8a1e6095 tempest-CreateVolumesFromSnapshotTest-1505214100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-62bee25b-4771-497e-8fba-cb147fc0fc65 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:51:49 devstack sudo[100612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-62bee25b-4771-497e-8fba-cb147fc0fc65 Sep 22 15:51:49 devstack sudo[100612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:51:49 devstack cinder-volume[86212]: DEBUG cinder.volume.flows.manager.create_volume [None req-31bc4872-7ae2-4d2d-a4ba-3ef900d3623f tempest-CreateVolumesFromSnapshotTest-1505214100 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 15:51:49 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-31bc4872-7ae2-4d2d-a4ba-3ef900d3623f tempest-CreateVolumesFromSnapshotTest-1505214100 None] Flow 'volume_create_manager' (08ef4fb6-7749-4599-bd35-effba41ec624) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:51:49 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-31bc4872-7ae2-4d2d-a4ba-3ef900d3623f tempest-CreateVolumesFromSnapshotTest-1505214100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40dbae27-713f-49a8-ad79-d012be1ce5be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:51:49 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-31bc4872-7ae2-4d2d-a4ba-3ef900d3623f tempest-CreateVolumesFromSnapshotTest-1505214100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40dbae27-713f-49a8-ad79-d012be1ce5be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:51:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1063224483',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73f7b46a-3d73-4d25-a34d-eaf493b38559,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d93006db07834200af9c6cc36b81ce12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:51:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:51:49Z,use_quota=True,user_id='2cf3388ae2cd4242aedf09ca8a628ba1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:51:49 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-31bc4872-7ae2-4d2d-a4ba-3ef900d3623f tempest-CreateVolumesFromSnapshotTest-1505214100 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbd0b89d-2099-4348-b6e4-b1ae4ccd63d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:51:49 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-31bc4872-7ae2-4d2d-a4ba-3ef900d3623f tempest-CreateVolumesFromSnapshotTest-1505214100 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbd0b89d-2099-4348-b6e4-b1ae4ccd63d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:51:49 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-31bc4872-7ae2-4d2d-a4ba-3ef900d3623f tempest-CreateVolumesFromSnapshotTest-1505214100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d83460bd-345d-4093-9de1-0ec556bc22a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:51:49 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-31bc4872-7ae2-4d2d-a4ba-3ef900d3623f tempest-CreateVolumesFromSnapshotTest-1505214100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d83460bd-345d-4093-9de1-0ec556bc22a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '73f7b46a-3d73-4d25-a34d-eaf493b38559', 'volume_name': 'volume-73f7b46a-3d73-4d25-a34d-eaf493b38559', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:51:49 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-31bc4872-7ae2-4d2d-a4ba-3ef900d3623f tempest-CreateVolumesFromSnapshotTest-1505214100 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (124bb736-3601-4a83-aaa4-eb9a064a498d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:51:49 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-31bc4872-7ae2-4d2d-a4ba-3ef900d3623f tempest-CreateVolumesFromSnapshotTest-1505214100 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (124bb736-3601-4a83-aaa4-eb9a064a498d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:51:49 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-31bc4872-7ae2-4d2d-a4ba-3ef900d3623f tempest-CreateVolumesFromSnapshotTest-1505214100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6b40cf0-2062-43d7-aaf8-7018b4510456) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:51:49 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-31bc4872-7ae2-4d2d-a4ba-3ef900d3623f tempest-CreateVolumesFromSnapshotTest-1505214100 None] Volume 73f7b46a-3d73-4d25-a34d-eaf493b38559: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-73f7b46a-3d73-4d25-a34d-eaf493b38559', 'volume_size': 1} Sep 22 15:51:49 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-31bc4872-7ae2-4d2d-a4ba-3ef900d3623f tempest-CreateVolumesFromSnapshotTest-1505214100 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:51:49 devstack sudo[100612]: pam_unix(sudo:session): session closed for user root Sep 22 15:51:49 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-a0c9261e-467d-4335-a875-875c8a1e6095 tempest-CreateVolumesFromSnapshotTest-1505214100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-62bee25b-4771-497e-8fba-cb147fc0fc65" returned: 0 in 0.349s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:51:49 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-a0c9261e-467d-4335-a875-875c8a1e6095 tempest-CreateVolumesFromSnapshotTest-1505214100 None] <== create_volume: return (1165ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'} {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 15:51:49 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-a0c9261e-467d-4335-a875-875c8a1e6095 tempest-CreateVolumesFromSnapshotTest-1505214100 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.168s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:51:49 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-575a3f24-f8b2-489b-96d3-d6cf59c8a25b tempest-CreateVolumesFromSnapshotTest-1505214100 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.702s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:51:49 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-575a3f24-f8b2-489b-96d3-d6cf59c8a25b tempest-CreateVolumesFromSnapshotTest-1505214100 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:51:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-467825980',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fb11329-8054-42ad-8564-e100b8026768,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d93006db07834200af9c6cc36b81ce12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:51:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:51:49Z,use_quota=True,user_id='2cf3388ae2cd4242aedf09ca8a628ba1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)}" {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 15:51:49 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-575a3f24-f8b2-489b-96d3-d6cf59c8a25b tempest-CreateVolumesFromSnapshotTest-1505214100 None] Creating volume 6fb11329-8054-42ad-8564-e100b8026768 {{(pid=86212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 15:51:49 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-575a3f24-f8b2-489b-96d3-d6cf59c8a25b tempest-CreateVolumesFromSnapshotTest-1505214100 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:51:49 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-575a3f24-f8b2-489b-96d3-d6cf59c8a25b tempest-CreateVolumesFromSnapshotTest-1505214100 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:51:49 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-575a3f24-f8b2-489b-96d3-d6cf59c8a25b tempest-CreateVolumesFromSnapshotTest-1505214100 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:51:49 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-575a3f24-f8b2-489b-96d3-d6cf59c8a25b tempest-CreateVolumesFromSnapshotTest-1505214100 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:51:49 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-575a3f24-f8b2-489b-96d3-d6cf59c8a25b tempest-CreateVolumesFromSnapshotTest-1505214100 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:51:49 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-575a3f24-f8b2-489b-96d3-d6cf59c8a25b tempest-CreateVolumesFromSnapshotTest-1505214100 None] Selected osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 as target Quobyte volume. {{(pid=86212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 15:51:49 devstack cinder-volume[86212]: INFO cinder.volume.drivers.remotefs [None req-575a3f24-f8b2-489b-96d3-d6cf59c8a25b tempest-CreateVolumesFromSnapshotTest-1505214100 None] casted to osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 Sep 22 15:51:49 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-575a3f24-f8b2-489b-96d3-d6cf59c8a25b tempest-CreateVolumesFromSnapshotTest-1505214100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-6fb11329-8054-42ad-8564-e100b8026768 1073741824 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:51:49 devstack sudo[100615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-6fb11329-8054-42ad-8564-e100b8026768 1073741824 Sep 22 15:51:49 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-a0c9261e-467d-4335-a875-875c8a1e6095 tempest-CreateVolumesFromSnapshotTest-1505214100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a43208e-3270-45f7-b609-576d1145b97c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-62bee25b-4771-497e-8fba-cb147fc0fc65', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:51:49 devstack sudo[100615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:51:49 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-a0c9261e-467d-4335-a875-875c8a1e6095 tempest-CreateVolumesFromSnapshotTest-1505214100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5934d61a-2bef-4be7-94dc-c2c65ddfaae0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:51:49 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-a0c9261e-467d-4335-a875-875c8a1e6095 tempest-CreateVolumesFromSnapshotTest-1505214100 None] Volume volume-62bee25b-4771-497e-8fba-cb147fc0fc65 (62bee25b-4771-497e-8fba-cb147fc0fc65): created successfully Sep 22 15:51:49 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-a0c9261e-467d-4335-a875-875c8a1e6095 tempest-CreateVolumesFromSnapshotTest-1505214100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5934d61a-2bef-4be7-94dc-c2c65ddfaae0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:51:49 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-a0c9261e-467d-4335-a875-875c8a1e6095 tempest-CreateVolumesFromSnapshotTest-1505214100 None] Flow 'volume_create_manager' (5e077fcd-75d7-4054-82be-70a272d0e880) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:51:49 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-a0c9261e-467d-4335-a875-875c8a1e6095 tempest-CreateVolumesFromSnapshotTest-1505214100 None] Created volume successfully. Sep 22 15:51:49 devstack cinder-volume[86212]: DEBUG cinder.volume.flows.manager.create_volume [None req-e309e6da-de8c-4b58-8dc4-2df170752920 tempest-CreateVolumesFromSnapshotTest-1505214100 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 15:51:50 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-e309e6da-de8c-4b58-8dc4-2df170752920 tempest-CreateVolumesFromSnapshotTest-1505214100 None] Flow 'volume_create_manager' (284c8a9f-3926-42a5-9124-acdcec193fb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:51:50 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-e309e6da-de8c-4b58-8dc4-2df170752920 tempest-CreateVolumesFromSnapshotTest-1505214100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be2c1ada-ca69-4af5-a99c-aa4e3882f9da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:51:50 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-e309e6da-de8c-4b58-8dc4-2df170752920 tempest-CreateVolumesFromSnapshotTest-1505214100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be2c1ada-ca69-4af5-a99c-aa4e3882f9da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:51:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-85776120',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c226badf-0d19-464d-bc97-826a20774648,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d93006db07834200af9c6cc36b81ce12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:51:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:51:50Z,use_quota=True,user_id='2cf3388ae2cd4242aedf09ca8a628ba1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:51:50 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-e309e6da-de8c-4b58-8dc4-2df170752920 tempest-CreateVolumesFromSnapshotTest-1505214100 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6808da5-8b93-43de-b2f2-6fa6b54ffc05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:51:50 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-e309e6da-de8c-4b58-8dc4-2df170752920 tempest-CreateVolumesFromSnapshotTest-1505214100 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6808da5-8b93-43de-b2f2-6fa6b54ffc05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:51:50 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-e309e6da-de8c-4b58-8dc4-2df170752920 tempest-CreateVolumesFromSnapshotTest-1505214100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6492503b-85f6-484d-839d-c46544e6096d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:51:50 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-e309e6da-de8c-4b58-8dc4-2df170752920 tempest-CreateVolumesFromSnapshotTest-1505214100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6492503b-85f6-484d-839d-c46544e6096d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c226badf-0d19-464d-bc97-826a20774648', 'volume_name': 'volume-c226badf-0d19-464d-bc97-826a20774648', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:51:50 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-e309e6da-de8c-4b58-8dc4-2df170752920 tempest-CreateVolumesFromSnapshotTest-1505214100 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86258962-6880-4eb4-853c-f37687a674ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:51:50 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-e309e6da-de8c-4b58-8dc4-2df170752920 tempest-CreateVolumesFromSnapshotTest-1505214100 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86258962-6880-4eb4-853c-f37687a674ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:51:50 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-e309e6da-de8c-4b58-8dc4-2df170752920 tempest-CreateVolumesFromSnapshotTest-1505214100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65ad648f-55c4-46d3-bf87-4527b913e7ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:51:50 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-e309e6da-de8c-4b58-8dc4-2df170752920 tempest-CreateVolumesFromSnapshotTest-1505214100 None] Volume c226badf-0d19-464d-bc97-826a20774648: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c226badf-0d19-464d-bc97-826a20774648', 'volume_size': 1} Sep 22 15:51:50 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-e309e6da-de8c-4b58-8dc4-2df170752920 tempest-CreateVolumesFromSnapshotTest-1505214100 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:51:50 devstack cinder-volume[86212]: DEBUG cinder.volume.flows.manager.create_volume [None req-c672ec10-8e7e-44cf-8436-0579605aecd3 tempest-CreateVolumesFromSnapshotTest-1505214100 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 15:51:50 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-c672ec10-8e7e-44cf-8436-0579605aecd3 tempest-CreateVolumesFromSnapshotTest-1505214100 None] Flow 'volume_create_manager' (5a8af5c5-1903-4bbd-a919-b633d80c8749) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:51:50 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-c672ec10-8e7e-44cf-8436-0579605aecd3 tempest-CreateVolumesFromSnapshotTest-1505214100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8b37b9f-96d7-4542-8d2c-1b776e60ec0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:51:50 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-c672ec10-8e7e-44cf-8436-0579605aecd3 tempest-CreateVolumesFromSnapshotTest-1505214100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8b37b9f-96d7-4542-8d2c-1b776e60ec0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:51:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-632452042',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04ae98b8-25a6-41ec-9476-435b7a3c9707,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d93006db07834200af9c6cc36b81ce12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:51:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:51:50Z,use_quota=True,user_id='2cf3388ae2cd4242aedf09ca8a628ba1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:51:50 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-c672ec10-8e7e-44cf-8436-0579605aecd3 tempest-CreateVolumesFromSnapshotTest-1505214100 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (290b2e68-f4bf-4d77-ad4a-6b142365046d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:51:50 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-c672ec10-8e7e-44cf-8436-0579605aecd3 tempest-CreateVolumesFromSnapshotTest-1505214100 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (290b2e68-f4bf-4d77-ad4a-6b142365046d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:51:50 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-c672ec10-8e7e-44cf-8436-0579605aecd3 tempest-CreateVolumesFromSnapshotTest-1505214100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (249db9bf-c744-4d24-afa5-53386686645c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:51:50 devstack sudo[100615]: pam_unix(sudo:session): session closed for user root Sep 22 15:51:50 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-c672ec10-8e7e-44cf-8436-0579605aecd3 tempest-CreateVolumesFromSnapshotTest-1505214100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (249db9bf-c744-4d24-afa5-53386686645c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '04ae98b8-25a6-41ec-9476-435b7a3c9707', 'volume_name': 'volume-04ae98b8-25a6-41ec-9476-435b7a3c9707', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:51:50 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-c672ec10-8e7e-44cf-8436-0579605aecd3 tempest-CreateVolumesFromSnapshotTest-1505214100 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a902426-7f79-452f-9095-d8c4e5735802) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:51:50 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-c672ec10-8e7e-44cf-8436-0579605aecd3 tempest-CreateVolumesFromSnapshotTest-1505214100 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a902426-7f79-452f-9095-d8c4e5735802) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:51:50 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-c672ec10-8e7e-44cf-8436-0579605aecd3 tempest-CreateVolumesFromSnapshotTest-1505214100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b49acab4-b5f8-4c58-aa57-41f653c06c3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:51:50 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-c672ec10-8e7e-44cf-8436-0579605aecd3 tempest-CreateVolumesFromSnapshotTest-1505214100 None] Volume 04ae98b8-25a6-41ec-9476-435b7a3c9707: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-04ae98b8-25a6-41ec-9476-435b7a3c9707', 'volume_size': 1} Sep 22 15:51:50 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-c672ec10-8e7e-44cf-8436-0579605aecd3 tempest-CreateVolumesFromSnapshotTest-1505214100 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:51:50 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-575a3f24-f8b2-489b-96d3-d6cf59c8a25b tempest-CreateVolumesFromSnapshotTest-1505214100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-6fb11329-8054-42ad-8564-e100b8026768 1073741824" returned: 0 in 0.817s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:51:50 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-575a3f24-f8b2-489b-96d3-d6cf59c8a25b tempest-CreateVolumesFromSnapshotTest-1505214100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-6fb11329-8054-42ad-8564-e100b8026768 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:51:50 devstack sudo[100621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-6fb11329-8054-42ad-8564-e100b8026768 Sep 22 15:51:50 devstack sudo[100621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:51:50 devstack sudo[100621]: pam_unix(sudo:session): session closed for user root Sep 22 15:51:50 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-575a3f24-f8b2-489b-96d3-d6cf59c8a25b tempest-CreateVolumesFromSnapshotTest-1505214100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-6fb11329-8054-42ad-8564-e100b8026768" returned: 0 in 0.292s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:51:50 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-575a3f24-f8b2-489b-96d3-d6cf59c8a25b tempest-CreateVolumesFromSnapshotTest-1505214100 None] <== create_volume: return (1158ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'} {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 15:51:50 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-575a3f24-f8b2-489b-96d3-d6cf59c8a25b tempest-CreateVolumesFromSnapshotTest-1505214100 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.165s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:51:50 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-31bc4872-7ae2-4d2d-a4ba-3ef900d3623f tempest-CreateVolumesFromSnapshotTest-1505214100 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.239s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:51:50 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-31bc4872-7ae2-4d2d-a4ba-3ef900d3623f tempest-CreateVolumesFromSnapshotTest-1505214100 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:51:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1063224483',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73f7b46a-3d73-4d25-a34d-eaf493b38559,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d93006db07834200af9c6cc36b81ce12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:51:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:51:49Z,use_quota=True,user_id='2cf3388ae2cd4242aedf09ca8a628ba1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)}" {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 15:51:50 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-31bc4872-7ae2-4d2d-a4ba-3ef900d3623f tempest-CreateVolumesFromSnapshotTest-1505214100 None] Creating volume 73f7b46a-3d73-4d25-a34d-eaf493b38559 {{(pid=86212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 15:51:50 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-31bc4872-7ae2-4d2d-a4ba-3ef900d3623f tempest-CreateVolumesFromSnapshotTest-1505214100 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:51:50 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-31bc4872-7ae2-4d2d-a4ba-3ef900d3623f tempest-CreateVolumesFromSnapshotTest-1505214100 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:51:50 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-31bc4872-7ae2-4d2d-a4ba-3ef900d3623f tempest-CreateVolumesFromSnapshotTest-1505214100 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:51:50 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-31bc4872-7ae2-4d2d-a4ba-3ef900d3623f tempest-CreateVolumesFromSnapshotTest-1505214100 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:51:50 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-31bc4872-7ae2-4d2d-a4ba-3ef900d3623f tempest-CreateVolumesFromSnapshotTest-1505214100 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:51:50 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-31bc4872-7ae2-4d2d-a4ba-3ef900d3623f tempest-CreateVolumesFromSnapshotTest-1505214100 None] Selected osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 as target Quobyte volume. {{(pid=86212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 15:51:50 devstack cinder-volume[86212]: INFO cinder.volume.drivers.remotefs [None req-31bc4872-7ae2-4d2d-a4ba-3ef900d3623f tempest-CreateVolumesFromSnapshotTest-1505214100 None] casted to osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 Sep 22 15:51:50 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-31bc4872-7ae2-4d2d-a4ba-3ef900d3623f tempest-CreateVolumesFromSnapshotTest-1505214100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-73f7b46a-3d73-4d25-a34d-eaf493b38559 1073741824 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:51:50 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-575a3f24-f8b2-489b-96d3-d6cf59c8a25b tempest-CreateVolumesFromSnapshotTest-1505214100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20349880-5ea6-4f9b-8fd5-23413b990141) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6fb11329-8054-42ad-8564-e100b8026768', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:51:50 devstack sudo[100624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-73f7b46a-3d73-4d25-a34d-eaf493b38559 1073741824 Sep 22 15:51:50 devstack sudo[100624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:51:50 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-575a3f24-f8b2-489b-96d3-d6cf59c8a25b tempest-CreateVolumesFromSnapshotTest-1505214100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6668e2a5-fb05-47f6-a63e-6c2bdd33ef18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:51:50 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-575a3f24-f8b2-489b-96d3-d6cf59c8a25b tempest-CreateVolumesFromSnapshotTest-1505214100 None] Volume volume-6fb11329-8054-42ad-8564-e100b8026768 (6fb11329-8054-42ad-8564-e100b8026768): created successfully Sep 22 15:51:50 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-575a3f24-f8b2-489b-96d3-d6cf59c8a25b tempest-CreateVolumesFromSnapshotTest-1505214100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6668e2a5-fb05-47f6-a63e-6c2bdd33ef18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:51:50 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-575a3f24-f8b2-489b-96d3-d6cf59c8a25b tempest-CreateVolumesFromSnapshotTest-1505214100 None] Flow 'volume_create_manager' (86af0bc7-8231-4b24-b288-fe53e8e7a818) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:51:50 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-575a3f24-f8b2-489b-96d3-d6cf59c8a25b tempest-CreateVolumesFromSnapshotTest-1505214100 None] Created volume successfully. Sep 22 15:51:51 devstack sudo[100624]: pam_unix(sudo:session): session closed for user root Sep 22 15:51:51 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-31bc4872-7ae2-4d2d-a4ba-3ef900d3623f tempest-CreateVolumesFromSnapshotTest-1505214100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-73f7b46a-3d73-4d25-a34d-eaf493b38559 1073741824" returned: 0 in 0.417s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:51:51 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-31bc4872-7ae2-4d2d-a4ba-3ef900d3623f tempest-CreateVolumesFromSnapshotTest-1505214100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-73f7b46a-3d73-4d25-a34d-eaf493b38559 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:51:51 devstack sudo[100629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-73f7b46a-3d73-4d25-a34d-eaf493b38559 Sep 22 15:51:51 devstack sudo[100629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:51:51 devstack sudo[100629]: pam_unix(sudo:session): session closed for user root Sep 22 15:51:51 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-31bc4872-7ae2-4d2d-a4ba-3ef900d3623f tempest-CreateVolumesFromSnapshotTest-1505214100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-73f7b46a-3d73-4d25-a34d-eaf493b38559" returned: 0 in 0.263s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:51:51 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-31bc4872-7ae2-4d2d-a4ba-3ef900d3623f tempest-CreateVolumesFromSnapshotTest-1505214100 None] <== create_volume: return (731ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'} {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 15:51:51 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-31bc4872-7ae2-4d2d-a4ba-3ef900d3623f tempest-CreateVolumesFromSnapshotTest-1505214100 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.737s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:51:51 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-e309e6da-de8c-4b58-8dc4-2df170752920 tempest-CreateVolumesFromSnapshotTest-1505214100 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.507s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:51:51 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-e309e6da-de8c-4b58-8dc4-2df170752920 tempest-CreateVolumesFromSnapshotTest-1505214100 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:51:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-85776120',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c226badf-0d19-464d-bc97-826a20774648,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d93006db07834200af9c6cc36b81ce12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:51:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:51:50Z,use_quota=True,user_id='2cf3388ae2cd4242aedf09ca8a628ba1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)}" {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 15:51:51 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-e309e6da-de8c-4b58-8dc4-2df170752920 tempest-CreateVolumesFromSnapshotTest-1505214100 None] Creating volume c226badf-0d19-464d-bc97-826a20774648 {{(pid=86212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 15:51:51 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-e309e6da-de8c-4b58-8dc4-2df170752920 tempest-CreateVolumesFromSnapshotTest-1505214100 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:51:51 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-e309e6da-de8c-4b58-8dc4-2df170752920 tempest-CreateVolumesFromSnapshotTest-1505214100 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:51:51 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-e309e6da-de8c-4b58-8dc4-2df170752920 tempest-CreateVolumesFromSnapshotTest-1505214100 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:51:51 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-e309e6da-de8c-4b58-8dc4-2df170752920 tempest-CreateVolumesFromSnapshotTest-1505214100 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:51:51 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-e309e6da-de8c-4b58-8dc4-2df170752920 tempest-CreateVolumesFromSnapshotTest-1505214100 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:51:51 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-e309e6da-de8c-4b58-8dc4-2df170752920 tempest-CreateVolumesFromSnapshotTest-1505214100 None] Selected osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 as target Quobyte volume. {{(pid=86212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 15:51:51 devstack cinder-volume[86212]: INFO cinder.volume.drivers.remotefs [None req-e309e6da-de8c-4b58-8dc4-2df170752920 tempest-CreateVolumesFromSnapshotTest-1505214100 None] casted to osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 Sep 22 15:51:51 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-e309e6da-de8c-4b58-8dc4-2df170752920 tempest-CreateVolumesFromSnapshotTest-1505214100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-c226badf-0d19-464d-bc97-826a20774648 1073741824 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:51:51 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-31bc4872-7ae2-4d2d-a4ba-3ef900d3623f tempest-CreateVolumesFromSnapshotTest-1505214100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6b40cf0-2062-43d7-aaf8-7018b4510456) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-73f7b46a-3d73-4d25-a34d-eaf493b38559', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:51:51 devstack sudo[100632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-c226badf-0d19-464d-bc97-826a20774648 1073741824 Sep 22 15:51:51 devstack sudo[100632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:51:51 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-31bc4872-7ae2-4d2d-a4ba-3ef900d3623f tempest-CreateVolumesFromSnapshotTest-1505214100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5570a08-3024-460f-907f-dcedf7bea733) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:51:51 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-31bc4872-7ae2-4d2d-a4ba-3ef900d3623f tempest-CreateVolumesFromSnapshotTest-1505214100 None] Volume volume-73f7b46a-3d73-4d25-a34d-eaf493b38559 (73f7b46a-3d73-4d25-a34d-eaf493b38559): created successfully Sep 22 15:51:51 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-31bc4872-7ae2-4d2d-a4ba-3ef900d3623f tempest-CreateVolumesFromSnapshotTest-1505214100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5570a08-3024-460f-907f-dcedf7bea733) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:51:51 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-31bc4872-7ae2-4d2d-a4ba-3ef900d3623f tempest-CreateVolumesFromSnapshotTest-1505214100 None] Flow 'volume_create_manager' (08ef4fb6-7749-4599-bd35-effba41ec624) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:51:51 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-31bc4872-7ae2-4d2d-a4ba-3ef900d3623f tempest-CreateVolumesFromSnapshotTest-1505214100 None] Created volume successfully. Sep 22 15:51:52 devstack sudo[100632]: pam_unix(sudo:session): session closed for user root Sep 22 15:51:52 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-e309e6da-de8c-4b58-8dc4-2df170752920 tempest-CreateVolumesFromSnapshotTest-1505214100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-c226badf-0d19-464d-bc97-826a20774648 1073741824" returned: 0 in 0.559s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:51:52 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-e309e6da-de8c-4b58-8dc4-2df170752920 tempest-CreateVolumesFromSnapshotTest-1505214100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-c226badf-0d19-464d-bc97-826a20774648 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:51:52 devstack sudo[100644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-c226badf-0d19-464d-bc97-826a20774648 Sep 22 15:51:52 devstack sudo[100644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:51:52 devstack sudo[100644]: pam_unix(sudo:session): session closed for user root Sep 22 15:51:52 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-e309e6da-de8c-4b58-8dc4-2df170752920 tempest-CreateVolumesFromSnapshotTest-1505214100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-c226badf-0d19-464d-bc97-826a20774648" returned: 0 in 0.268s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:51:52 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-e309e6da-de8c-4b58-8dc4-2df170752920 tempest-CreateVolumesFromSnapshotTest-1505214100 None] <== create_volume: return (889ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'} {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 15:51:52 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-e309e6da-de8c-4b58-8dc4-2df170752920 tempest-CreateVolumesFromSnapshotTest-1505214100 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.894s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:51:52 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-c672ec10-8e7e-44cf-8436-0579605aecd3 tempest-CreateVolumesFromSnapshotTest-1505214100 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.976s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:51:52 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-c672ec10-8e7e-44cf-8436-0579605aecd3 tempest-CreateVolumesFromSnapshotTest-1505214100 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:51:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-632452042',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04ae98b8-25a6-41ec-9476-435b7a3c9707,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d93006db07834200af9c6cc36b81ce12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:51:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:51:50Z,use_quota=True,user_id='2cf3388ae2cd4242aedf09ca8a628ba1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)}" {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 15:51:52 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-c672ec10-8e7e-44cf-8436-0579605aecd3 tempest-CreateVolumesFromSnapshotTest-1505214100 None] Creating volume 04ae98b8-25a6-41ec-9476-435b7a3c9707 {{(pid=86212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 15:51:52 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-c672ec10-8e7e-44cf-8436-0579605aecd3 tempest-CreateVolumesFromSnapshotTest-1505214100 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:51:52 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-c672ec10-8e7e-44cf-8436-0579605aecd3 tempest-CreateVolumesFromSnapshotTest-1505214100 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:51:52 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-c672ec10-8e7e-44cf-8436-0579605aecd3 tempest-CreateVolumesFromSnapshotTest-1505214100 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:51:52 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-c672ec10-8e7e-44cf-8436-0579605aecd3 tempest-CreateVolumesFromSnapshotTest-1505214100 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:51:52 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-c672ec10-8e7e-44cf-8436-0579605aecd3 tempest-CreateVolumesFromSnapshotTest-1505214100 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:51:52 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-c672ec10-8e7e-44cf-8436-0579605aecd3 tempest-CreateVolumesFromSnapshotTest-1505214100 None] Selected osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 as target Quobyte volume. {{(pid=86212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 15:51:52 devstack cinder-volume[86212]: INFO cinder.volume.drivers.remotefs [None req-c672ec10-8e7e-44cf-8436-0579605aecd3 tempest-CreateVolumesFromSnapshotTest-1505214100 None] casted to osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 Sep 22 15:51:52 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-c672ec10-8e7e-44cf-8436-0579605aecd3 tempest-CreateVolumesFromSnapshotTest-1505214100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-04ae98b8-25a6-41ec-9476-435b7a3c9707 1073741824 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:51:52 devstack sudo[100647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-04ae98b8-25a6-41ec-9476-435b7a3c9707 1073741824 Sep 22 15:51:52 devstack sudo[100647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:51:52 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-e309e6da-de8c-4b58-8dc4-2df170752920 tempest-CreateVolumesFromSnapshotTest-1505214100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65ad648f-55c4-46d3-bf87-4527b913e7ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c226badf-0d19-464d-bc97-826a20774648', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:51:52 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-e309e6da-de8c-4b58-8dc4-2df170752920 tempest-CreateVolumesFromSnapshotTest-1505214100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67496a5e-2790-43bd-93c4-e5690c9d73da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:51:52 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-e309e6da-de8c-4b58-8dc4-2df170752920 tempest-CreateVolumesFromSnapshotTest-1505214100 None] Volume volume-c226badf-0d19-464d-bc97-826a20774648 (c226badf-0d19-464d-bc97-826a20774648): created successfully Sep 22 15:51:52 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-e309e6da-de8c-4b58-8dc4-2df170752920 tempest-CreateVolumesFromSnapshotTest-1505214100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67496a5e-2790-43bd-93c4-e5690c9d73da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:51:52 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-e309e6da-de8c-4b58-8dc4-2df170752920 tempest-CreateVolumesFromSnapshotTest-1505214100 None] Flow 'volume_create_manager' (284c8a9f-3926-42a5-9124-acdcec193fb1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:51:52 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-e309e6da-de8c-4b58-8dc4-2df170752920 tempest-CreateVolumesFromSnapshotTest-1505214100 None] Created volume successfully. Sep 22 15:51:53 devstack sudo[100647]: pam_unix(sudo:session): session closed for user root Sep 22 15:51:53 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-c672ec10-8e7e-44cf-8436-0579605aecd3 tempest-CreateVolumesFromSnapshotTest-1505214100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-04ae98b8-25a6-41ec-9476-435b7a3c9707 1073741824" returned: 0 in 0.608s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:51:53 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-c672ec10-8e7e-44cf-8436-0579605aecd3 tempest-CreateVolumesFromSnapshotTest-1505214100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-04ae98b8-25a6-41ec-9476-435b7a3c9707 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:51:53 devstack sudo[100654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-04ae98b8-25a6-41ec-9476-435b7a3c9707 Sep 22 15:51:53 devstack sudo[100654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:51:53 devstack sudo[100654]: pam_unix(sudo:session): session closed for user root Sep 22 15:51:53 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-c672ec10-8e7e-44cf-8436-0579605aecd3 tempest-CreateVolumesFromSnapshotTest-1505214100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-04ae98b8-25a6-41ec-9476-435b7a3c9707" returned: 0 in 0.261s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:51:53 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-c672ec10-8e7e-44cf-8436-0579605aecd3 tempest-CreateVolumesFromSnapshotTest-1505214100 None] <== create_volume: return (911ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'} {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 15:51:53 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-c672ec10-8e7e-44cf-8436-0579605aecd3 tempest-CreateVolumesFromSnapshotTest-1505214100 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.916s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:51:53 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-c672ec10-8e7e-44cf-8436-0579605aecd3 tempest-CreateVolumesFromSnapshotTest-1505214100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b49acab4-b5f8-4c58-aa57-41f653c06c3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-04ae98b8-25a6-41ec-9476-435b7a3c9707', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:51:53 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-c672ec10-8e7e-44cf-8436-0579605aecd3 tempest-CreateVolumesFromSnapshotTest-1505214100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18ba87e9-4e38-4e54-8cc8-f8d76ae186be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:51:53 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-c672ec10-8e7e-44cf-8436-0579605aecd3 tempest-CreateVolumesFromSnapshotTest-1505214100 None] Volume volume-04ae98b8-25a6-41ec-9476-435b7a3c9707 (04ae98b8-25a6-41ec-9476-435b7a3c9707): created successfully Sep 22 15:51:53 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-c672ec10-8e7e-44cf-8436-0579605aecd3 tempest-CreateVolumesFromSnapshotTest-1505214100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18ba87e9-4e38-4e54-8cc8-f8d76ae186be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:51:53 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-c672ec10-8e7e-44cf-8436-0579605aecd3 tempest-CreateVolumesFromSnapshotTest-1505214100 None] Flow 'volume_create_manager' (5a8af5c5-1903-4bbd-a919-b633d80c8749) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:51:53 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-c672ec10-8e7e-44cf-8436-0579605aecd3 tempest-CreateVolumesFromSnapshotTest-1505214100 None] Created volume successfully. Sep 22 15:51:53 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-94b8b4c9-5984-43e4-abc5-35a7d95cca64 tempest-CreateVolumesFromSnapshotTest-1505214100 None] Acquiring lock "cinder-04ae98b8-25a6-41ec-9476-435b7a3c9707-delete_volume" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:51:53 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-94b8b4c9-5984-43e4-abc5-35a7d95cca64 tempest-CreateVolumesFromSnapshotTest-1505214100 None] Lock "cinder-04ae98b8-25a6-41ec-9476-435b7a3c9707-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:51:53 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-94b8b4c9-5984-43e4-abc5-35a7d95cca64 tempest-CreateVolumesFromSnapshotTest-1505214100 None] Acquiring lock "cinder-quobyte-04ae98b8-25a6-41ec-9476-435b7a3c9707" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:51:53 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-94b8b4c9-5984-43e4-abc5-35a7d95cca64 tempest-CreateVolumesFromSnapshotTest-1505214100 None] Lock "cinder-quobyte-04ae98b8-25a6-41ec-9476-435b7a3c9707" acquired by "delete_volume" :: waited 0.017s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:51:53 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[43611c4d-7767-4fbf-91c4-9bb4d4de8094]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:51:53 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-94b8b4c9-5984-43e4-abc5-35a7d95cca64 tempest-CreateVolumesFromSnapshotTest-1505214100 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-04ae98b8-25a6-41ec-9476-435b7a3c9707 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:51:54 devstack sudo[100657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-04ae98b8-25a6-41ec-9476-435b7a3c9707 Sep 22 15:51:54 devstack sudo[100657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:51:54 devstack sudo[100657]: pam_unix(sudo:session): session closed for user root Sep 22 15:51:54 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-94b8b4c9-5984-43e4-abc5-35a7d95cca64 tempest-CreateVolumesFromSnapshotTest-1505214100 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-04ae98b8-25a6-41ec-9476-435b7a3c9707" returned: 0 in 0.398s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:51:54 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-94b8b4c9-5984-43e4-abc5-35a7d95cca64 tempest-CreateVolumesFromSnapshotTest-1505214100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-04ae98b8-25a6-41ec-9476-435b7a3c9707 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:51:54 devstack sudo[100662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-04ae98b8-25a6-41ec-9476-435b7a3c9707 Sep 22 15:51:54 devstack sudo[100662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:51:54 devstack sudo[100662]: pam_unix(sudo:session): session closed for user root Sep 22 15:51:54 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-94b8b4c9-5984-43e4-abc5-35a7d95cca64 tempest-CreateVolumesFromSnapshotTest-1505214100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-04ae98b8-25a6-41ec-9476-435b7a3c9707" returned: 0 in 0.249s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:51:54 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-94b8b4c9-5984-43e4-abc5-35a7d95cca64 tempest-CreateVolumesFromSnapshotTest-1505214100 None] Lock "cinder-quobyte-04ae98b8-25a6-41ec-9476-435b7a3c9707" released by "delete_volume" :: held 0.694s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:51:54 devstack cinder-volume[86212]: DEBUG cinder.quota [None req-94b8b4c9-5984-43e4-abc5-35a7d95cca64 tempest-CreateVolumesFromSnapshotTest-1505214100 None] Created reservations ['3e91bf31-2f69-48f4-98d6-286470f76742', 'adf394e0-5c70-40e3-93cc-74c52ab435a0', 'f0864659-ac68-4c35-a1b9-37e7173aa4bc', '68c146a8-9063-4509-9e56-37db83a816a5'] {{(pid=86212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 15:51:54 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-94b8b4c9-5984-43e4-abc5-35a7d95cca64 tempest-CreateVolumesFromSnapshotTest-1505214100 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:51:54 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-94b8b4c9-5984-43e4-abc5-35a7d95cca64 tempest-CreateVolumesFromSnapshotTest-1505214100 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:51:54 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-94b8b4c9-5984-43e4-abc5-35a7d95cca64 tempest-CreateVolumesFromSnapshotTest-1505214100 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:51:54 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-94b8b4c9-5984-43e4-abc5-35a7d95cca64 tempest-CreateVolumesFromSnapshotTest-1505214100 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:51:54 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-94b8b4c9-5984-43e4-abc5-35a7d95cca64 tempest-CreateVolumesFromSnapshotTest-1505214100 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:51:54 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-94b8b4c9-5984-43e4-abc5-35a7d95cca64 tempest-CreateVolumesFromSnapshotTest-1505214100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:51:54 devstack sudo[100666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc Sep 22 15:51:54 devstack sudo[100666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:51:55 devstack sudo[100666]: pam_unix(sudo:session): session closed for user root Sep 22 15:51:55 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-50f7a0a7-3606-46ae-a943-573aa09bb2ab tempest-CreateVolumesFromSnapshotTest-1505214100 None] Acquiring lock "cinder-c226badf-0d19-464d-bc97-826a20774648-delete_volume" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:51:55 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-94b8b4c9-5984-43e4-abc5-35a7d95cca64 tempest-CreateVolumesFromSnapshotTest-1505214100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc" returned: 0 in 0.291s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:51:55 devstack cinder-volume[86212]: DEBUG cinder.manager [None req-94b8b4c9-5984-43e4-abc5-35a7d95cca64 tempest-CreateVolumesFromSnapshotTest-1505214100 None] Notifying Schedulers of capabilities ... {{(pid=86212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 15:51:55 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-94b8b4c9-5984-43e4-abc5-35a7d95cca64 tempest-CreateVolumesFromSnapshotTest-1505214100 None] Deleted volume successfully. Sep 22 15:51:55 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-50f7a0a7-3606-46ae-a943-573aa09bb2ab tempest-CreateVolumesFromSnapshotTest-1505214100 None] Lock "cinder-c226badf-0d19-464d-bc97-826a20774648-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:51:55 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-94b8b4c9-5984-43e4-abc5-35a7d95cca64 tempest-CreateVolumesFromSnapshotTest-1505214100 None] Lock "cinder-04ae98b8-25a6-41ec-9476-435b7a3c9707-delete_volume" released by "delete_volume" :: held 1.241s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:51:55 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-50f7a0a7-3606-46ae-a943-573aa09bb2ab tempest-CreateVolumesFromSnapshotTest-1505214100 None] Acquiring lock "cinder-quobyte-c226badf-0d19-464d-bc97-826a20774648" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:51:55 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-50f7a0a7-3606-46ae-a943-573aa09bb2ab tempest-CreateVolumesFromSnapshotTest-1505214100 None] Lock "cinder-quobyte-c226badf-0d19-464d-bc97-826a20774648" acquired by "delete_volume" :: waited 0.015s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:51:55 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef5e0928-b932-4636-a439-db8ac926c6a7]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:51:55 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-50f7a0a7-3606-46ae-a943-573aa09bb2ab tempest-CreateVolumesFromSnapshotTest-1505214100 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-c226badf-0d19-464d-bc97-826a20774648 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:51:55 devstack sudo[100671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-c226badf-0d19-464d-bc97-826a20774648 Sep 22 15:51:55 devstack sudo[100671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:51:55 devstack sudo[100671]: pam_unix(sudo:session): session closed for user root Sep 22 15:51:55 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-50f7a0a7-3606-46ae-a943-573aa09bb2ab tempest-CreateVolumesFromSnapshotTest-1505214100 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-c226badf-0d19-464d-bc97-826a20774648" returned: 0 in 0.423s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:51:55 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-50f7a0a7-3606-46ae-a943-573aa09bb2ab tempest-CreateVolumesFromSnapshotTest-1505214100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-c226badf-0d19-464d-bc97-826a20774648 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:51:55 devstack sudo[100682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-c226badf-0d19-464d-bc97-826a20774648 Sep 22 15:51:55 devstack sudo[100682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:51:55 devstack sudo[100682]: pam_unix(sudo:session): session closed for user root Sep 22 15:51:55 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-50f7a0a7-3606-46ae-a943-573aa09bb2ab tempest-CreateVolumesFromSnapshotTest-1505214100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-c226badf-0d19-464d-bc97-826a20774648" returned: 0 in 0.303s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:51:55 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-50f7a0a7-3606-46ae-a943-573aa09bb2ab tempest-CreateVolumesFromSnapshotTest-1505214100 None] Lock "cinder-quobyte-c226badf-0d19-464d-bc97-826a20774648" released by "delete_volume" :: held 0.776s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:51:56 devstack cinder-volume[86212]: DEBUG cinder.quota [None req-50f7a0a7-3606-46ae-a943-573aa09bb2ab tempest-CreateVolumesFromSnapshotTest-1505214100 None] Created reservations ['82f96dfa-339d-4212-be4e-bc353d5132a0', '1a3397c2-7a1a-476f-bb12-5b6ec87edeb8', 'f792644c-c734-4db1-8a55-14a115dda74a', '65aeb2ca-6dd5-4614-9bef-1d5445b0940c'] {{(pid=86212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 15:51:56 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-50f7a0a7-3606-46ae-a943-573aa09bb2ab tempest-CreateVolumesFromSnapshotTest-1505214100 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:51:56 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-50f7a0a7-3606-46ae-a943-573aa09bb2ab tempest-CreateVolumesFromSnapshotTest-1505214100 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:51:56 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-50f7a0a7-3606-46ae-a943-573aa09bb2ab tempest-CreateVolumesFromSnapshotTest-1505214100 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:51:56 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-50f7a0a7-3606-46ae-a943-573aa09bb2ab tempest-CreateVolumesFromSnapshotTest-1505214100 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:51:56 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-50f7a0a7-3606-46ae-a943-573aa09bb2ab tempest-CreateVolumesFromSnapshotTest-1505214100 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:51:56 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-50f7a0a7-3606-46ae-a943-573aa09bb2ab tempest-CreateVolumesFromSnapshotTest-1505214100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:51:56 devstack sudo[100692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc Sep 22 15:51:56 devstack sudo[100692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:51:56 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-c53f200a-f633-4d22-9165-31244900bc90 tempest-CreateVolumesFromSnapshotTest-1505214100 None] Acquiring lock "cinder-73f7b46a-3d73-4d25-a34d-eaf493b38559-delete_volume" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:51:56 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [req-0859ef05-7997-42f9-b9ec-9149c813b504 req-bf891471-06ed-41a3-9617-32f267cb0e0c tempest-TestInstancesWithCinderVolumes-793553421 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:51:56 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [req-0859ef05-7997-42f9-b9ec-9149c813b504 req-bf891471-06ed-41a3-9617-32f267cb0e0c tempest-TestInstancesWithCinderVolumes-793553421 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:51:56 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-c53f200a-f633-4d22-9165-31244900bc90 tempest-CreateVolumesFromSnapshotTest-1505214100 None] Lock "cinder-73f7b46a-3d73-4d25-a34d-eaf493b38559-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:51:56 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [req-0859ef05-7997-42f9-b9ec-9149c813b504 req-bf891471-06ed-41a3-9617-32f267cb0e0c tempest-TestInstancesWithCinderVolumes-793553421 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.027s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:51:56 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-c53f200a-f633-4d22-9165-31244900bc90 tempest-CreateVolumesFromSnapshotTest-1505214100 None] Acquiring lock "cinder-quobyte-73f7b46a-3d73-4d25-a34d-eaf493b38559" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:51:56 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [req-0859ef05-7997-42f9-b9ec-9149c813b504 req-bf891471-06ed-41a3-9617-32f267cb0e0c tempest-TestInstancesWithCinderVolumes-793553421 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31', 'name': 'volume-964bd87b-df78-4c57-810a-6fa48f8d9257', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'cbbb1415-058b-40c4-a4a3-de08a324b33e', 'enforce_multipath': True} {{(pid=86212) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 22 15:51:56 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-c53f200a-f633-4d22-9165-31244900bc90 tempest-CreateVolumesFromSnapshotTest-1505214100 None] Lock "cinder-quobyte-73f7b46a-3d73-4d25-a34d-eaf493b38559" acquired by "delete_volume" :: waited 0.023s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:51:56 devstack sudo[100692]: pam_unix(sudo:session): session closed for user root Sep 22 15:51:56 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-50f7a0a7-3606-46ae-a943-573aa09bb2ab tempest-CreateVolumesFromSnapshotTest-1505214100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc" returned: 0 in 0.304s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:51:56 devstack cinder-volume[86212]: DEBUG cinder.manager [None req-50f7a0a7-3606-46ae-a943-573aa09bb2ab tempest-CreateVolumesFromSnapshotTest-1505214100 None] Notifying Schedulers of capabilities ... {{(pid=86212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 15:51:56 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-50f7a0a7-3606-46ae-a943-573aa09bb2ab tempest-CreateVolumesFromSnapshotTest-1505214100 None] Deleted volume successfully. Sep 22 15:51:56 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d24e369-1bbb-47fe-b52d-ec4d4c3972b6]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:51:56 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-c53f200a-f633-4d22-9165-31244900bc90 tempest-CreateVolumesFromSnapshotTest-1505214100 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-73f7b46a-3d73-4d25-a34d-eaf493b38559 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:51:56 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-50f7a0a7-3606-46ae-a943-573aa09bb2ab tempest-CreateVolumesFromSnapshotTest-1505214100 None] Lock "cinder-c226badf-0d19-464d-bc97-826a20774648-delete_volume" released by "delete_volume" :: held 1.409s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:51:56 devstack cinder-volume[86212]: INFO cinder.volume.manager [req-0859ef05-7997-42f9-b9ec-9149c813b504 req-bf891471-06ed-41a3-9617-32f267cb0e0c tempest-TestInstancesWithCinderVolumes-793553421 None] attachment_update completed successfully. Sep 22 15:51:56 devstack sudo[100696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-73f7b46a-3d73-4d25-a34d-eaf493b38559 Sep 22 15:51:56 devstack sudo[100696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:51:56 devstack sudo[100696]: pam_unix(sudo:session): session closed for user root Sep 22 15:51:56 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-c53f200a-f633-4d22-9165-31244900bc90 tempest-CreateVolumesFromSnapshotTest-1505214100 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-73f7b46a-3d73-4d25-a34d-eaf493b38559" returned: 0 in 0.500s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:51:56 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-c53f200a-f633-4d22-9165-31244900bc90 tempest-CreateVolumesFromSnapshotTest-1505214100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-73f7b46a-3d73-4d25-a34d-eaf493b38559 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:51:56 devstack sudo[100703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-73f7b46a-3d73-4d25-a34d-eaf493b38559 Sep 22 15:51:56 devstack sudo[100703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:51:57 devstack sudo[100703]: pam_unix(sudo:session): session closed for user root Sep 22 15:51:57 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-c53f200a-f633-4d22-9165-31244900bc90 tempest-CreateVolumesFromSnapshotTest-1505214100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-73f7b46a-3d73-4d25-a34d-eaf493b38559" returned: 0 in 0.290s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:51:57 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-c53f200a-f633-4d22-9165-31244900bc90 tempest-CreateVolumesFromSnapshotTest-1505214100 None] Lock "cinder-quobyte-73f7b46a-3d73-4d25-a34d-eaf493b38559" released by "delete_volume" :: held 0.854s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:51:57 devstack cinder-volume[86212]: DEBUG cinder.quota [None req-c53f200a-f633-4d22-9165-31244900bc90 tempest-CreateVolumesFromSnapshotTest-1505214100 None] Created reservations ['46b98635-f734-4a8d-8d6d-903898509802', '7e0f3ccc-4d43-47f4-8fec-2c78ca8237fc', '5d0ef74c-3f4b-4393-bc4b-343ef6ea9bea', '39fbc3a7-f8a4-4c52-905d-bec8fde1f6c1'] {{(pid=86212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 15:51:57 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-c53f200a-f633-4d22-9165-31244900bc90 tempest-CreateVolumesFromSnapshotTest-1505214100 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:51:57 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-c53f200a-f633-4d22-9165-31244900bc90 tempest-CreateVolumesFromSnapshotTest-1505214100 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:51:57 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-c53f200a-f633-4d22-9165-31244900bc90 tempest-CreateVolumesFromSnapshotTest-1505214100 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:51:57 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-c53f200a-f633-4d22-9165-31244900bc90 tempest-CreateVolumesFromSnapshotTest-1505214100 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:51:57 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-c53f200a-f633-4d22-9165-31244900bc90 tempest-CreateVolumesFromSnapshotTest-1505214100 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:51:57 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-c53f200a-f633-4d22-9165-31244900bc90 tempest-CreateVolumesFromSnapshotTest-1505214100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:51:57 devstack sudo[100706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc Sep 22 15:51:57 devstack sudo[100706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:51:57 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-c41dd688-96d8-4fb7-b761-9b4271dbde8f tempest-CreateVolumesFromSnapshotTest-1505214100 None] Acquiring lock "cinder-6fb11329-8054-42ad-8564-e100b8026768-delete_volume" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:51:57 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-c41dd688-96d8-4fb7-b761-9b4271dbde8f tempest-CreateVolumesFromSnapshotTest-1505214100 None] Lock "cinder-6fb11329-8054-42ad-8564-e100b8026768-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:51:57 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-c41dd688-96d8-4fb7-b761-9b4271dbde8f tempest-CreateVolumesFromSnapshotTest-1505214100 None] Acquiring lock "cinder-quobyte-6fb11329-8054-42ad-8564-e100b8026768" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:51:57 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-c41dd688-96d8-4fb7-b761-9b4271dbde8f tempest-CreateVolumesFromSnapshotTest-1505214100 None] Lock "cinder-quobyte-6fb11329-8054-42ad-8564-e100b8026768" acquired by "delete_volume" :: waited 0.024s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:51:57 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5e50228-fa08-4fc2-96cf-f14715fa732b]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:51:57 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-c41dd688-96d8-4fb7-b761-9b4271dbde8f tempest-CreateVolumesFromSnapshotTest-1505214100 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-6fb11329-8054-42ad-8564-e100b8026768 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:51:57 devstack sudo[100706]: pam_unix(sudo:session): session closed for user root Sep 22 15:51:57 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-c53f200a-f633-4d22-9165-31244900bc90 tempest-CreateVolumesFromSnapshotTest-1505214100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc" returned: 0 in 0.292s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:51:57 devstack cinder-volume[86212]: DEBUG cinder.manager [None req-c53f200a-f633-4d22-9165-31244900bc90 tempest-CreateVolumesFromSnapshotTest-1505214100 None] Notifying Schedulers of capabilities ... {{(pid=86212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 15:51:57 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-c53f200a-f633-4d22-9165-31244900bc90 tempest-CreateVolumesFromSnapshotTest-1505214100 None] Deleted volume successfully. Sep 22 15:51:57 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-c53f200a-f633-4d22-9165-31244900bc90 tempest-CreateVolumesFromSnapshotTest-1505214100 None] Lock "cinder-73f7b46a-3d73-4d25-a34d-eaf493b38559-delete_volume" released by "delete_volume" :: held 1.406s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:51:57 devstack sudo[100708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-6fb11329-8054-42ad-8564-e100b8026768 Sep 22 15:51:57 devstack sudo[100708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:51:58 devstack sudo[100708]: pam_unix(sudo:session): session closed for user root Sep 22 15:51:58 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-c41dd688-96d8-4fb7-b761-9b4271dbde8f tempest-CreateVolumesFromSnapshotTest-1505214100 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-6fb11329-8054-42ad-8564-e100b8026768" returned: 0 in 0.447s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:51:58 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-c41dd688-96d8-4fb7-b761-9b4271dbde8f tempest-CreateVolumesFromSnapshotTest-1505214100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-6fb11329-8054-42ad-8564-e100b8026768 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:51:58 devstack sudo[100715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-6fb11329-8054-42ad-8564-e100b8026768 Sep 22 15:51:58 devstack sudo[100715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:51:58 devstack sudo[100715]: pam_unix(sudo:session): session closed for user root Sep 22 15:51:58 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-c41dd688-96d8-4fb7-b761-9b4271dbde8f tempest-CreateVolumesFromSnapshotTest-1505214100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-6fb11329-8054-42ad-8564-e100b8026768" returned: 0 in 0.277s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:51:58 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-c41dd688-96d8-4fb7-b761-9b4271dbde8f tempest-CreateVolumesFromSnapshotTest-1505214100 None] Lock "cinder-quobyte-6fb11329-8054-42ad-8564-e100b8026768" released by "delete_volume" :: held 0.778s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:51:58 devstack cinder-volume[86212]: DEBUG cinder.quota [None req-c41dd688-96d8-4fb7-b761-9b4271dbde8f tempest-CreateVolumesFromSnapshotTest-1505214100 None] Created reservations ['9924a414-8bff-41c9-9848-3111369beab3', '1f9a7a55-4f6d-4921-99b4-829282f5def7', '615ad63f-0c15-4468-bbbd-49d0c761ed06', '59cddc40-17ed-436a-939f-26ccf771b456'] {{(pid=86212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 15:51:58 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-c41dd688-96d8-4fb7-b761-9b4271dbde8f tempest-CreateVolumesFromSnapshotTest-1505214100 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:51:58 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-c41dd688-96d8-4fb7-b761-9b4271dbde8f tempest-CreateVolumesFromSnapshotTest-1505214100 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:51:58 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-c41dd688-96d8-4fb7-b761-9b4271dbde8f tempest-CreateVolumesFromSnapshotTest-1505214100 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:51:58 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-c41dd688-96d8-4fb7-b761-9b4271dbde8f tempest-CreateVolumesFromSnapshotTest-1505214100 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:51:58 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-c41dd688-96d8-4fb7-b761-9b4271dbde8f tempest-CreateVolumesFromSnapshotTest-1505214100 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:51:58 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-c41dd688-96d8-4fb7-b761-9b4271dbde8f tempest-CreateVolumesFromSnapshotTest-1505214100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:51:58 devstack sudo[100722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc Sep 22 15:51:58 devstack sudo[100722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:51:58 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-2a879b0a-ece4-474d-ba73-791f720743b7 tempest-CreateVolumesFromSnapshotTest-1505214100 None] Acquiring lock "cinder-62bee25b-4771-497e-8fba-cb147fc0fc65-delete_volume" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:51:58 devstack sudo[100722]: pam_unix(sudo:session): session closed for user root Sep 22 15:51:58 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-c41dd688-96d8-4fb7-b761-9b4271dbde8f tempest-CreateVolumesFromSnapshotTest-1505214100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc" returned: 0 in 0.292s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:51:58 devstack cinder-volume[86212]: DEBUG cinder.manager [None req-c41dd688-96d8-4fb7-b761-9b4271dbde8f tempest-CreateVolumesFromSnapshotTest-1505214100 None] Notifying Schedulers of capabilities ... {{(pid=86212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 15:51:58 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-c41dd688-96d8-4fb7-b761-9b4271dbde8f tempest-CreateVolumesFromSnapshotTest-1505214100 None] Deleted volume successfully. Sep 22 15:51:58 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-2a879b0a-ece4-474d-ba73-791f720743b7 tempest-CreateVolumesFromSnapshotTest-1505214100 None] Lock "cinder-62bee25b-4771-497e-8fba-cb147fc0fc65-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:51:58 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-c41dd688-96d8-4fb7-b761-9b4271dbde8f tempest-CreateVolumesFromSnapshotTest-1505214100 None] Lock "cinder-6fb11329-8054-42ad-8564-e100b8026768-delete_volume" released by "delete_volume" :: held 1.315s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:51:58 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-2a879b0a-ece4-474d-ba73-791f720743b7 tempest-CreateVolumesFromSnapshotTest-1505214100 None] Acquiring lock "cinder-quobyte-62bee25b-4771-497e-8fba-cb147fc0fc65" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:51:58 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-2a879b0a-ece4-474d-ba73-791f720743b7 tempest-CreateVolumesFromSnapshotTest-1505214100 None] Lock "cinder-quobyte-62bee25b-4771-497e-8fba-cb147fc0fc65" acquired by "delete_volume" :: waited 0.018s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:51:58 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ce33699-2f2f-4118-808a-0cb812dadd60]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:51:58 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-2a879b0a-ece4-474d-ba73-791f720743b7 tempest-CreateVolumesFromSnapshotTest-1505214100 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-62bee25b-4771-497e-8fba-cb147fc0fc65 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:51:59 devstack sudo[100730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-62bee25b-4771-497e-8fba-cb147fc0fc65 Sep 22 15:51:59 devstack sudo[100730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:51:59 devstack sudo[100730]: pam_unix(sudo:session): session closed for user root Sep 22 15:51:59 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-2a879b0a-ece4-474d-ba73-791f720743b7 tempest-CreateVolumesFromSnapshotTest-1505214100 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-62bee25b-4771-497e-8fba-cb147fc0fc65" returned: 0 in 0.477s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:51:59 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-2a879b0a-ece4-474d-ba73-791f720743b7 tempest-CreateVolumesFromSnapshotTest-1505214100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-62bee25b-4771-497e-8fba-cb147fc0fc65 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:51:59 devstack sudo[100740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-62bee25b-4771-497e-8fba-cb147fc0fc65 Sep 22 15:51:59 devstack sudo[100740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:51:59 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [req-6b4402a4-d8df-453d-b1ef-4b5aa8e0c8ec req-bf0788dd-ac1b-499b-9896-2a5171a03665 tempest-TestInstancesWithCinderVolumes-793553421 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:51:59 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [req-6b4402a4-d8df-453d-b1ef-4b5aa8e0c8ec req-bf0788dd-ac1b-499b-9896-2a5171a03665 tempest-TestInstancesWithCinderVolumes-793553421 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:51:59 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [req-6b4402a4-d8df-453d-b1ef-4b5aa8e0c8ec req-bf0788dd-ac1b-499b-9896-2a5171a03665 tempest-TestInstancesWithCinderVolumes-793553421 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:51:59 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [req-6b4402a4-d8df-453d-b1ef-4b5aa8e0c8ec req-bf0788dd-ac1b-499b-9896-2a5171a03665 tempest-TestInstancesWithCinderVolumes-793553421 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31', 'name': 'volume-7c028b07-9b81-4b00-8a2f-4fad0385253b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6d89f811-3808-4076-9ac5-42d47417c664', 'enforce_multipath': True} {{(pid=86212) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 22 15:51:59 devstack sudo[100740]: pam_unix(sudo:session): session closed for user root Sep 22 15:51:59 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-2a879b0a-ece4-474d-ba73-791f720743b7 tempest-CreateVolumesFromSnapshotTest-1505214100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-62bee25b-4771-497e-8fba-cb147fc0fc65" returned: 0 in 0.293s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:51:59 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-2a879b0a-ece4-474d-ba73-791f720743b7 tempest-CreateVolumesFromSnapshotTest-1505214100 None] Lock "cinder-quobyte-62bee25b-4771-497e-8fba-cb147fc0fc65" released by "delete_volume" :: held 0.830s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:51:59 devstack cinder-volume[86212]: INFO cinder.volume.manager [req-6b4402a4-d8df-453d-b1ef-4b5aa8e0c8ec req-bf0788dd-ac1b-499b-9896-2a5171a03665 tempest-TestInstancesWithCinderVolumes-793553421 None] attachment_update completed successfully. Sep 22 15:51:59 devstack cinder-volume[86212]: DEBUG cinder.quota [None req-2a879b0a-ece4-474d-ba73-791f720743b7 tempest-CreateVolumesFromSnapshotTest-1505214100 None] Created reservations ['0999fbeb-edad-4d9a-96fa-8cb1a989f040', '7ea9712e-af16-41d9-a6c0-065446d1aa54', 'bc711aca-4fab-45d8-b923-e6f8e227d5f9', 'c9239cd0-c42b-4259-9b2b-6fe29cc6c57b'] {{(pid=86212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 15:51:59 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-2a879b0a-ece4-474d-ba73-791f720743b7 tempest-CreateVolumesFromSnapshotTest-1505214100 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:51:59 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-2a879b0a-ece4-474d-ba73-791f720743b7 tempest-CreateVolumesFromSnapshotTest-1505214100 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:51:59 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-2a879b0a-ece4-474d-ba73-791f720743b7 tempest-CreateVolumesFromSnapshotTest-1505214100 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:51:59 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-2a879b0a-ece4-474d-ba73-791f720743b7 tempest-CreateVolumesFromSnapshotTest-1505214100 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:51:59 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-2a879b0a-ece4-474d-ba73-791f720743b7 tempest-CreateVolumesFromSnapshotTest-1505214100 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:51:59 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-2a879b0a-ece4-474d-ba73-791f720743b7 tempest-CreateVolumesFromSnapshotTest-1505214100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:51:59 devstack sudo[100748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc Sep 22 15:51:59 devstack sudo[100748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:51:59 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-10d783ec-6f63-484c-b07e-9b0f4a0e41e2 tempest-CreateVolumesFromSnapshotTest-1505214100 None] Acquiring lock "cinder-585b834f-197e-4c2b-8c1c-aaa56faa6873-delete_snapshot" by "delete_snapshot" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:52:00 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-10d783ec-6f63-484c-b07e-9b0f4a0e41e2 tempest-CreateVolumesFromSnapshotTest-1505214100 None] Lock "cinder-585b834f-197e-4c2b-8c1c-aaa56faa6873-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:52:00 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-10d783ec-6f63-484c-b07e-9b0f4a0e41e2 tempest-CreateVolumesFromSnapshotTest-1505214100 None] Acquiring lock "cinder-quobyte-9ef27155-7ade-4993-90cb-89db13255902" by "delete_snapshot" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:52:00 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-10d783ec-6f63-484c-b07e-9b0f4a0e41e2 tempest-CreateVolumesFromSnapshotTest-1505214100 None] Lock "cinder-quobyte-9ef27155-7ade-4993-90cb-89db13255902" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:52:00 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-10d783ec-6f63-484c-b07e-9b0f4a0e41e2 tempest-CreateVolumesFromSnapshotTest-1505214100 None] Acquiring lock "cinder-quobyte-585b834f-197e-4c2b-8c1c-aaa56faa6873" by "_delete_snapshot" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:52:00 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-10d783ec-6f63-484c-b07e-9b0f4a0e41e2 tempest-CreateVolumesFromSnapshotTest-1505214100 None] Lock "cinder-quobyte-585b834f-197e-4c2b-8c1c-aaa56faa6873" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:52:00 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-10d783ec-6f63-484c-b07e-9b0f4a0e41e2 tempest-CreateVolumesFromSnapshotTest-1505214100 None] Deleting offline snapshot 585b834f-197e-4c2b-8c1c-aaa56faa6873 of volume 9ef27155-7ade-4993-90cb-89db13255902 {{(pid=86212) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 22 15:52:00 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-10d783ec-6f63-484c-b07e-9b0f4a0e41e2 tempest-CreateVolumesFromSnapshotTest-1505214100 None] snapshot_file for this snap is: volume-9ef27155-7ade-4993-90cb-89db13255902.585b834f-197e-4c2b-8c1c-aaa56faa6873 {{(pid=86212) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 22 15:52:00 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d139975-dbae-4d41-941c-8f12373ac92c]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:52:00 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-10d783ec-6f63-484c-b07e-9b0f4a0e41e2 tempest-CreateVolumesFromSnapshotTest-1505214100 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-9ef27155-7ade-4993-90cb-89db13255902.585b834f-197e-4c2b-8c1c-aaa56faa6873 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:52:00 devstack sudo[100748]: pam_unix(sudo:session): session closed for user root Sep 22 15:52:00 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-2a879b0a-ece4-474d-ba73-791f720743b7 tempest-CreateVolumesFromSnapshotTest-1505214100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc" returned: 0 in 0.315s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:52:00 devstack cinder-volume[86212]: DEBUG cinder.manager [None req-2a879b0a-ece4-474d-ba73-791f720743b7 tempest-CreateVolumesFromSnapshotTest-1505214100 None] Notifying Schedulers of capabilities ... {{(pid=86212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 15:52:00 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-2a879b0a-ece4-474d-ba73-791f720743b7 tempest-CreateVolumesFromSnapshotTest-1505214100 None] Deleted volume successfully. Sep 22 15:52:00 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-2a879b0a-ece4-474d-ba73-791f720743b7 tempest-CreateVolumesFromSnapshotTest-1505214100 None] Lock "cinder-62bee25b-4771-497e-8fba-cb147fc0fc65-delete_volume" released by "delete_volume" :: held 1.467s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:52:00 devstack sudo[100750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-9ef27155-7ade-4993-90cb-89db13255902.585b834f-197e-4c2b-8c1c-aaa56faa6873 Sep 22 15:52:00 devstack sudo[100750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:52:00 devstack sudo[100750]: pam_unix(sudo:session): session closed for user root Sep 22 15:52:00 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-10d783ec-6f63-484c-b07e-9b0f4a0e41e2 tempest-CreateVolumesFromSnapshotTest-1505214100 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-9ef27155-7ade-4993-90cb-89db13255902.585b834f-197e-4c2b-8c1c-aaa56faa6873" returned: 0 in 0.453s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:52:00 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-10d783ec-6f63-484c-b07e-9b0f4a0e41e2 tempest-CreateVolumesFromSnapshotTest-1505214100 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9ef27155-7ade-4993-90cb-89db13255902(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86212) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 22 15:52:00 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d9d1059-e8f1-476b-bc7d-3eb0cdccd9a6]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:52:00 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-10d783ec-6f63-484c-b07e-9b0f4a0e41e2 tempest-CreateVolumesFromSnapshotTest-1505214100 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-9ef27155-7ade-4993-90cb-89db13255902 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:52:00 devstack sudo[100757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-9ef27155-7ade-4993-90cb-89db13255902 Sep 22 15:52:00 devstack sudo[100757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:52:01 devstack sudo[100757]: pam_unix(sudo:session): session closed for user root Sep 22 15:52:01 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-10d783ec-6f63-484c-b07e-9b0f4a0e41e2 tempest-CreateVolumesFromSnapshotTest-1505214100 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-9ef27155-7ade-4993-90cb-89db13255902" returned: 0 in 0.403s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:52:01 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-10d783ec-6f63-484c-b07e-9b0f4a0e41e2 tempest-CreateVolumesFromSnapshotTest-1505214100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-9ef27155-7ade-4993-90cb-89db13255902.585b834f-197e-4c2b-8c1c-aaa56faa6873 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:52:01 devstack sudo[100762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-9ef27155-7ade-4993-90cb-89db13255902.585b834f-197e-4c2b-8c1c-aaa56faa6873 Sep 22 15:52:01 devstack sudo[100762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:52:01 devstack sudo[100762]: pam_unix(sudo:session): session closed for user root Sep 22 15:52:01 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-10d783ec-6f63-484c-b07e-9b0f4a0e41e2 tempest-CreateVolumesFromSnapshotTest-1505214100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-9ef27155-7ade-4993-90cb-89db13255902.585b834f-197e-4c2b-8c1c-aaa56faa6873" returned: 0 in 0.351s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:52:01 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-10d783ec-6f63-484c-b07e-9b0f4a0e41e2 tempest-CreateVolumesFromSnapshotTest-1505214100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-9ef27155-7ade-4993-90cb-89db13255902.585b834f-197e-4c2b-8c1c-aaa56faa6873 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:52:01 devstack sudo[100767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-9ef27155-7ade-4993-90cb-89db13255902.585b834f-197e-4c2b-8c1c-aaa56faa6873 Sep 22 15:52:01 devstack sudo[100767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:52:01 devstack sudo[100767]: pam_unix(sudo:session): session closed for user root Sep 22 15:52:01 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-10d783ec-6f63-484c-b07e-9b0f4a0e41e2 tempest-CreateVolumesFromSnapshotTest-1505214100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-9ef27155-7ade-4993-90cb-89db13255902.585b834f-197e-4c2b-8c1c-aaa56faa6873" returned: 0 in 0.273s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:52:01 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-10d783ec-6f63-484c-b07e-9b0f4a0e41e2 tempest-CreateVolumesFromSnapshotTest-1505214100 None] Lock "cinder-quobyte-585b834f-197e-4c2b-8c1c-aaa56faa6873" released by "_delete_snapshot" :: held 1.653s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:52:01 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-10d783ec-6f63-484c-b07e-9b0f4a0e41e2 tempest-CreateVolumesFromSnapshotTest-1505214100 None] Lock "cinder-quobyte-9ef27155-7ade-4993-90cb-89db13255902" released by "delete_snapshot" :: held 1.683s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:52:01 devstack cinder-volume[86212]: DEBUG cinder.quota [None req-10d783ec-6f63-484c-b07e-9b0f4a0e41e2 tempest-CreateVolumesFromSnapshotTest-1505214100 None] Created reservations ['442549b6-9c6c-494e-ba4e-21f0927fe1ef', '754265e3-d917-4df4-9ee6-624886840a39', 'f53347a9-ef3c-4d20-b114-0653e34884f1', '10b7d1da-882e-4237-a0ce-8a9932f76cf7'] {{(pid=86212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 15:52:01 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-10d783ec-6f63-484c-b07e-9b0f4a0e41e2 tempest-CreateVolumesFromSnapshotTest-1505214100 None] Delete snapshot completed successfully. Sep 22 15:52:01 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-10d783ec-6f63-484c-b07e-9b0f4a0e41e2 tempest-CreateVolumesFromSnapshotTest-1505214100 None] Lock "cinder-585b834f-197e-4c2b-8c1c-aaa56faa6873-delete_snapshot" released by "delete_snapshot" :: held 1.965s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:52:02 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-6c1882b6-ec67-4301-a832-b009229dfd24 tempest-CreateVolumesFromSnapshotTest-1505214100 None] Acquiring lock "cinder-9ef27155-7ade-4993-90cb-89db13255902-delete_volume" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:52:02 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-6c1882b6-ec67-4301-a832-b009229dfd24 tempest-CreateVolumesFromSnapshotTest-1505214100 None] Lock "cinder-9ef27155-7ade-4993-90cb-89db13255902-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:52:02 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-6c1882b6-ec67-4301-a832-b009229dfd24 tempest-CreateVolumesFromSnapshotTest-1505214100 None] Acquiring lock "cinder-quobyte-9ef27155-7ade-4993-90cb-89db13255902" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:52:02 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-6c1882b6-ec67-4301-a832-b009229dfd24 tempest-CreateVolumesFromSnapshotTest-1505214100 None] Lock "cinder-quobyte-9ef27155-7ade-4993-90cb-89db13255902" acquired by "delete_volume" :: waited 0.022s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:52:02 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[7270ad4e-19ed-4b9c-8941-b6ac5848096b]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:52:02 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-6c1882b6-ec67-4301-a832-b009229dfd24 tempest-CreateVolumesFromSnapshotTest-1505214100 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-9ef27155-7ade-4993-90cb-89db13255902 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:52:02 devstack sudo[100778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-9ef27155-7ade-4993-90cb-89db13255902 Sep 22 15:52:02 devstack sudo[100778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:52:02 devstack sudo[100778]: pam_unix(sudo:session): session closed for user root Sep 22 15:52:02 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-6c1882b6-ec67-4301-a832-b009229dfd24 tempest-CreateVolumesFromSnapshotTest-1505214100 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-9ef27155-7ade-4993-90cb-89db13255902" returned: 0 in 0.474s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:52:02 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-6c1882b6-ec67-4301-a832-b009229dfd24 tempest-CreateVolumesFromSnapshotTest-1505214100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-9ef27155-7ade-4993-90cb-89db13255902 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:52:02 devstack sudo[100783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-9ef27155-7ade-4993-90cb-89db13255902 Sep 22 15:52:02 devstack sudo[100783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:52:03 devstack sudo[100783]: pam_unix(sudo:session): session closed for user root Sep 22 15:52:03 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-6c1882b6-ec67-4301-a832-b009229dfd24 tempest-CreateVolumesFromSnapshotTest-1505214100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-9ef27155-7ade-4993-90cb-89db13255902" returned: 0 in 0.326s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:52:03 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-6c1882b6-ec67-4301-a832-b009229dfd24 tempest-CreateVolumesFromSnapshotTest-1505214100 None] Lock "cinder-quobyte-9ef27155-7ade-4993-90cb-89db13255902" released by "delete_volume" :: held 0.885s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:52:03 devstack cinder-volume[86212]: DEBUG cinder.quota [None req-6c1882b6-ec67-4301-a832-b009229dfd24 tempest-CreateVolumesFromSnapshotTest-1505214100 None] Created reservations ['aeed5a38-8e71-44ff-a761-accdd1bc7f88', 'ca8321d9-e76a-4ee0-9029-dd7e27babe2f', '5519ad67-4dc6-4bb7-b40f-773b6747025d', 'e1041ecb-6b17-4467-bad1-fdc36ddfca2a'] {{(pid=86212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 15:52:03 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-6c1882b6-ec67-4301-a832-b009229dfd24 tempest-CreateVolumesFromSnapshotTest-1505214100 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:52:03 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-6c1882b6-ec67-4301-a832-b009229dfd24 tempest-CreateVolumesFromSnapshotTest-1505214100 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:52:03 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-6c1882b6-ec67-4301-a832-b009229dfd24 tempest-CreateVolumesFromSnapshotTest-1505214100 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:52:03 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-6c1882b6-ec67-4301-a832-b009229dfd24 tempest-CreateVolumesFromSnapshotTest-1505214100 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:52:03 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-6c1882b6-ec67-4301-a832-b009229dfd24 tempest-CreateVolumesFromSnapshotTest-1505214100 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:52:03 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-6c1882b6-ec67-4301-a832-b009229dfd24 tempest-CreateVolumesFromSnapshotTest-1505214100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:52:03 devstack sudo[100786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc Sep 22 15:52:03 devstack sudo[100786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:52:03 devstack sudo[100786]: pam_unix(sudo:session): session closed for user root Sep 22 15:52:03 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-6c1882b6-ec67-4301-a832-b009229dfd24 tempest-CreateVolumesFromSnapshotTest-1505214100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc" returned: 0 in 0.326s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:52:03 devstack cinder-volume[86212]: DEBUG cinder.manager [None req-6c1882b6-ec67-4301-a832-b009229dfd24 tempest-CreateVolumesFromSnapshotTest-1505214100 None] Notifying Schedulers of capabilities ... {{(pid=86212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 15:52:03 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-6c1882b6-ec67-4301-a832-b009229dfd24 tempest-CreateVolumesFromSnapshotTest-1505214100 None] Deleted volume successfully. Sep 22 15:52:03 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-6c1882b6-ec67-4301-a832-b009229dfd24 tempest-CreateVolumesFromSnapshotTest-1505214100 None] Lock "cinder-9ef27155-7ade-4993-90cb-89db13255902-delete_volume" released by "delete_volume" :: held 1.652s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:52:07 devstack cinder-volume[86212]: INFO cinder.volume.manager [req-6e048f08-3345-40bc-899d-144dcb17f2fd req-0f1422f2-e8cf-450b-8e27-cd18d32f1f92 tempest-TestInstancesWithCinderVolumes-793553421 None] Terminate volume connection completed successfully. Sep 22 15:52:07 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [req-6e048f08-3345-40bc-899d-144dcb17f2fd req-0f1422f2-e8cf-450b-8e27-cd18d32f1f92 tempest-TestInstancesWithCinderVolumes-793553421 None] Deleting attachment cbbb1415-058b-40c4-a4a3-de08a324b33e. {{(pid=86212) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 22 15:52:09 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-a5cb11f9-27f7-41c1-9f90-1d264efc358e tempest-TestInstancesWithCinderVolumes-793553421 None] Acquiring lock "cinder-964bd87b-df78-4c57-810a-6fa48f8d9257-delete_volume" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:52:09 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-a5cb11f9-27f7-41c1-9f90-1d264efc358e tempest-TestInstancesWithCinderVolumes-793553421 None] Lock "cinder-964bd87b-df78-4c57-810a-6fa48f8d9257-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:52:09 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-a5cb11f9-27f7-41c1-9f90-1d264efc358e tempest-TestInstancesWithCinderVolumes-793553421 None] Acquiring lock "cinder-quobyte-964bd87b-df78-4c57-810a-6fa48f8d9257" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:52:09 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-a5cb11f9-27f7-41c1-9f90-1d264efc358e tempest-TestInstancesWithCinderVolumes-793553421 None] Lock "cinder-quobyte-964bd87b-df78-4c57-810a-6fa48f8d9257" acquired by "delete_volume" :: waited 0.015s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:52:09 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[262e2922-3245-4571-984f-ad6954c3d5de]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:52:09 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-a5cb11f9-27f7-41c1-9f90-1d264efc358e tempest-TestInstancesWithCinderVolumes-793553421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-964bd87b-df78-4c57-810a-6fa48f8d9257 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:52:09 devstack sudo[100821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-964bd87b-df78-4c57-810a-6fa48f8d9257 Sep 22 15:52:09 devstack sudo[100821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:52:10 devstack sudo[100821]: pam_unix(sudo:session): session closed for user root Sep 22 15:52:10 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-a5cb11f9-27f7-41c1-9f90-1d264efc358e tempest-TestInstancesWithCinderVolumes-793553421 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-964bd87b-df78-4c57-810a-6fa48f8d9257" returned: 0 in 0.563s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:52:10 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-a5cb11f9-27f7-41c1-9f90-1d264efc358e tempest-TestInstancesWithCinderVolumes-793553421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-964bd87b-df78-4c57-810a-6fa48f8d9257 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:52:10 devstack sudo[100827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-964bd87b-df78-4c57-810a-6fa48f8d9257 Sep 22 15:52:10 devstack sudo[100827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:52:10 devstack cinder-volume[86212]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa3929e7-b2c3-4bf5-8a89-c51e06fd289e tempest-CinderUnicodeTest-283431876 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 15:52:10 devstack sudo[100827]: pam_unix(sudo:session): session closed for user root Sep 22 15:52:10 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-aa3929e7-b2c3-4bf5-8a89-c51e06fd289e tempest-CinderUnicodeTest-283431876 None] Flow 'volume_create_manager' (53097044-4df0-4886-ad3d-1832a5c30aa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:52:10 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-aa3929e7-b2c3-4bf5-8a89-c51e06fd289e tempest-CinderUnicodeTest-283431876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed73d38c-5bc7-44b6-bb3b-674467bd9a3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:52:10 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-a5cb11f9-27f7-41c1-9f90-1d264efc358e tempest-TestInstancesWithCinderVolumes-793553421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-964bd87b-df78-4c57-810a-6fa48f8d9257" returned: 0 in 0.440s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:52:10 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-aa3929e7-b2c3-4bf5-8a89-c51e06fd289e tempest-CinderUnicodeTest-283431876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed73d38c-5bc7-44b6-bb3b-674467bd9a3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:52:10Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab913df3-6423-486f-9f02-0f4559655bbb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b1e1f4095534ffab791a82923c394f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:52:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:52:11Z,use_quota=True,user_id='0c0ee0cbdd0247c7bdcf9994c72d58f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:52:10 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-aa3929e7-b2c3-4bf5-8a89-c51e06fd289e tempest-CinderUnicodeTest-283431876 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e85eea5-d2b9-4645-8f59-a7d80aca71e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:52:10 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-aa3929e7-b2c3-4bf5-8a89-c51e06fd289e tempest-CinderUnicodeTest-283431876 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e85eea5-d2b9-4645-8f59-a7d80aca71e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:52:10 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-aa3929e7-b2c3-4bf5-8a89-c51e06fd289e tempest-CinderUnicodeTest-283431876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb94c378-31e4-4edd-adf9-0e51f9485f6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:52:10 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-aa3929e7-b2c3-4bf5-8a89-c51e06fd289e tempest-CinderUnicodeTest-283431876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb94c378-31e4-4edd-adf9-0e51f9485f6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab913df3-6423-486f-9f02-0f4559655bbb', 'volume_name': 'volume-ab913df3-6423-486f-9f02-0f4559655bbb', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:52:10 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-aa3929e7-b2c3-4bf5-8a89-c51e06fd289e tempest-CinderUnicodeTest-283431876 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6883792-99d1-4a10-8357-07624a1d8e77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:52:10 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-aa3929e7-b2c3-4bf5-8a89-c51e06fd289e tempest-CinderUnicodeTest-283431876 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6883792-99d1-4a10-8357-07624a1d8e77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:52:10 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-aa3929e7-b2c3-4bf5-8a89-c51e06fd289e tempest-CinderUnicodeTest-283431876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77642a77-0996-4db8-a9e0-406346083a16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:52:10 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-aa3929e7-b2c3-4bf5-8a89-c51e06fd289e tempest-CinderUnicodeTest-283431876 None] Volume ab913df3-6423-486f-9f02-0f4559655bbb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab913df3-6423-486f-9f02-0f4559655bbb', 'volume_size': 1} Sep 22 15:52:10 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-aa3929e7-b2c3-4bf5-8a89-c51e06fd289e tempest-CinderUnicodeTest-283431876 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:52:10 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-aa3929e7-b2c3-4bf5-8a89-c51e06fd289e tempest-CinderUnicodeTest-283431876 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:52:10 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-aa3929e7-b2c3-4bf5-8a89-c51e06fd289e tempest-CinderUnicodeTest-283431876 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:52:10Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab913df3-6423-486f-9f02-0f4559655bbb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b1e1f4095534ffab791a82923c394f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:52:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:52:11Z,use_quota=True,user_id='0c0ee0cbdd0247c7bdcf9994c72d58f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)}" {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 15:52:10 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-aa3929e7-b2c3-4bf5-8a89-c51e06fd289e tempest-CinderUnicodeTest-283431876 None] Creating volume ab913df3-6423-486f-9f02-0f4559655bbb {{(pid=86212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 15:52:10 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-aa3929e7-b2c3-4bf5-8a89-c51e06fd289e tempest-CinderUnicodeTest-283431876 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:52:10 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-aa3929e7-b2c3-4bf5-8a89-c51e06fd289e tempest-CinderUnicodeTest-283431876 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:52:10 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-aa3929e7-b2c3-4bf5-8a89-c51e06fd289e tempest-CinderUnicodeTest-283431876 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:52:10 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-aa3929e7-b2c3-4bf5-8a89-c51e06fd289e tempest-CinderUnicodeTest-283431876 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:52:10 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-aa3929e7-b2c3-4bf5-8a89-c51e06fd289e tempest-CinderUnicodeTest-283431876 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:52:10 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-aa3929e7-b2c3-4bf5-8a89-c51e06fd289e tempest-CinderUnicodeTest-283431876 None] Selected osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 as target Quobyte volume. {{(pid=86212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 15:52:10 devstack cinder-volume[86212]: INFO cinder.volume.drivers.remotefs [None req-aa3929e7-b2c3-4bf5-8a89-c51e06fd289e tempest-CinderUnicodeTest-283431876 None] casted to osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 Sep 22 15:52:10 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-aa3929e7-b2c3-4bf5-8a89-c51e06fd289e tempest-CinderUnicodeTest-283431876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-ab913df3-6423-486f-9f02-0f4559655bbb 1073741824 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:52:10 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-a5cb11f9-27f7-41c1-9f90-1d264efc358e tempest-TestInstancesWithCinderVolumes-793553421 None] Lock "cinder-quobyte-964bd87b-df78-4c57-810a-6fa48f8d9257" released by "delete_volume" :: held 1.142s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:52:10 devstack sudo[100830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-ab913df3-6423-486f-9f02-0f4559655bbb 1073741824 Sep 22 15:52:10 devstack sudo[100830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:52:10 devstack cinder-volume[86212]: WARNING cinder.quota [None req-a5cb11f9-27f7-41c1-9f90-1d264efc358e tempest-TestInstancesWithCinderVolumes-793553421 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1192623403-298095023 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1192623403-298095023, it is now deprecated. Please use the default quota class for default quota. Sep 22 15:52:10 devstack cinder-volume[86212]: WARNING cinder.quota [None req-a5cb11f9-27f7-41c1-9f90-1d264efc358e tempest-TestInstancesWithCinderVolumes-793553421 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1192623403-298095023 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1192623403-298095023, it is now deprecated. Please use the default quota class for default quota. Sep 22 15:52:10 devstack cinder-volume[86212]: DEBUG cinder.quota [None req-a5cb11f9-27f7-41c1-9f90-1d264efc358e tempest-TestInstancesWithCinderVolumes-793553421 None] Created reservations ['b7d5b24a-54fa-4c08-b017-45819af29a02', '4c1f67ac-479f-4e7f-af24-a63f08383b28', '931752c9-6f82-4977-be3d-0fec62fcf847', '8efc0730-9c4a-43f3-a917-3b4dfd6bbca8'] {{(pid=86212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 15:52:11 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-a5cb11f9-27f7-41c1-9f90-1d264efc358e tempest-TestInstancesWithCinderVolumes-793553421 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:52:11 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-a5cb11f9-27f7-41c1-9f90-1d264efc358e tempest-TestInstancesWithCinderVolumes-793553421 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:52:11 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-a5cb11f9-27f7-41c1-9f90-1d264efc358e tempest-TestInstancesWithCinderVolumes-793553421 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:52:11 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-a5cb11f9-27f7-41c1-9f90-1d264efc358e tempest-TestInstancesWithCinderVolumes-793553421 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:52:11 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-a5cb11f9-27f7-41c1-9f90-1d264efc358e tempest-TestInstancesWithCinderVolumes-793553421 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:52:11 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-a5cb11f9-27f7-41c1-9f90-1d264efc358e tempest-TestInstancesWithCinderVolumes-793553421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:52:11 devstack sudo[100832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc Sep 22 15:52:11 devstack sudo[100832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:52:11 devstack sudo[100832]: pam_unix(sudo:session): session closed for user root Sep 22 15:52:11 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-a5cb11f9-27f7-41c1-9f90-1d264efc358e tempest-TestInstancesWithCinderVolumes-793553421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc" returned: 0 in 0.336s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:52:11 devstack cinder-volume[86212]: DEBUG cinder.manager [None req-a5cb11f9-27f7-41c1-9f90-1d264efc358e tempest-TestInstancesWithCinderVolumes-793553421 None] Notifying Schedulers of capabilities ... {{(pid=86212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 15:52:11 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-a5cb11f9-27f7-41c1-9f90-1d264efc358e tempest-TestInstancesWithCinderVolumes-793553421 None] Deleted volume successfully. Sep 22 15:52:11 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-a5cb11f9-27f7-41c1-9f90-1d264efc358e tempest-TestInstancesWithCinderVolumes-793553421 None] Lock "cinder-964bd87b-df78-4c57-810a-6fa48f8d9257-delete_volume" released by "delete_volume" :: held 1.858s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:52:11 devstack sudo[100830]: pam_unix(sudo:session): session closed for user root Sep 22 15:52:11 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-aa3929e7-b2c3-4bf5-8a89-c51e06fd289e tempest-CinderUnicodeTest-283431876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-ab913df3-6423-486f-9f02-0f4559655bbb 1073741824" returned: 0 in 0.572s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:52:11 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-aa3929e7-b2c3-4bf5-8a89-c51e06fd289e tempest-CinderUnicodeTest-283431876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-ab913df3-6423-486f-9f02-0f4559655bbb {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:52:11 devstack sudo[100839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-ab913df3-6423-486f-9f02-0f4559655bbb Sep 22 15:52:11 devstack sudo[100839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:52:11 devstack sudo[100839]: pam_unix(sudo:session): session closed for user root Sep 22 15:52:11 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-aa3929e7-b2c3-4bf5-8a89-c51e06fd289e tempest-CinderUnicodeTest-283431876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-ab913df3-6423-486f-9f02-0f4559655bbb" returned: 0 in 0.271s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:52:11 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-aa3929e7-b2c3-4bf5-8a89-c51e06fd289e tempest-CinderUnicodeTest-283431876 None] <== create_volume: return (892ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'} {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 15:52:11 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-aa3929e7-b2c3-4bf5-8a89-c51e06fd289e tempest-CinderUnicodeTest-283431876 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.895s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:52:11 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-aa3929e7-b2c3-4bf5-8a89-c51e06fd289e tempest-CinderUnicodeTest-283431876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77642a77-0996-4db8-a9e0-406346083a16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab913df3-6423-486f-9f02-0f4559655bbb', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:52:11 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-aa3929e7-b2c3-4bf5-8a89-c51e06fd289e tempest-CinderUnicodeTest-283431876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd5a4346-dd99-4df5-857a-dca7de6bf59f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:52:11 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-aa3929e7-b2c3-4bf5-8a89-c51e06fd289e tempest-CinderUnicodeTest-283431876 None] Volume volume-ab913df3-6423-486f-9f02-0f4559655bbb (ab913df3-6423-486f-9f02-0f4559655bbb): created successfully Sep 22 15:52:11 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-aa3929e7-b2c3-4bf5-8a89-c51e06fd289e tempest-CinderUnicodeTest-283431876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd5a4346-dd99-4df5-857a-dca7de6bf59f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:52:11 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-aa3929e7-b2c3-4bf5-8a89-c51e06fd289e tempest-CinderUnicodeTest-283431876 None] Flow 'volume_create_manager' (53097044-4df0-4886-ad3d-1832a5c30aa3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:52:11 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-aa3929e7-b2c3-4bf5-8a89-c51e06fd289e tempest-CinderUnicodeTest-283431876 None] Created volume successfully. Sep 22 15:52:13 devstack cinder-volume[86212]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ce4b2cf-e926-4c24-8faf-593c80b5ebcc tempest-CinderUnicodeTest-283431876 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 15:52:13 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-5ce4b2cf-e926-4c24-8faf-593c80b5ebcc tempest-CinderUnicodeTest-283431876 None] Flow 'volume_create_manager' (861ccbe2-9f53-47fe-8078-21edeae9976b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:52:13 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-5ce4b2cf-e926-4c24-8faf-593c80b5ebcc tempest-CinderUnicodeTest-283431876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7825703-dd49-4e41-a98c-abee45b4bdce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:52:13 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-5ce4b2cf-e926-4c24-8faf-593c80b5ebcc tempest-CinderUnicodeTest-283431876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7825703-dd49-4e41-a98c-abee45b4bdce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:52:13Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-268293368',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15bb4251-bbb6-43b4-ad4f-b477369ca03c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b1e1f4095534ffab791a82923c394f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:52:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:52:13Z,use_quota=True,user_id='0c0ee0cbdd0247c7bdcf9994c72d58f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:52:13 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-5ce4b2cf-e926-4c24-8faf-593c80b5ebcc tempest-CinderUnicodeTest-283431876 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (989adb15-9996-424e-af03-8e6bcf3fec0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:52:13 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-5ce4b2cf-e926-4c24-8faf-593c80b5ebcc tempest-CinderUnicodeTest-283431876 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (989adb15-9996-424e-af03-8e6bcf3fec0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:52:13 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-5ce4b2cf-e926-4c24-8faf-593c80b5ebcc tempest-CinderUnicodeTest-283431876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a61d527-1edd-41e7-9962-5f14865af616) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:52:13 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-5ce4b2cf-e926-4c24-8faf-593c80b5ebcc tempest-CinderUnicodeTest-283431876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a61d527-1edd-41e7-9962-5f14865af616) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '15bb4251-bbb6-43b4-ad4f-b477369ca03c', 'volume_name': 'volume-15bb4251-bbb6-43b4-ad4f-b477369ca03c', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:52:13 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-5ce4b2cf-e926-4c24-8faf-593c80b5ebcc tempest-CinderUnicodeTest-283431876 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8aceee32-adba-47ad-8c0a-d8d45c047e79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:52:13 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-5ce4b2cf-e926-4c24-8faf-593c80b5ebcc tempest-CinderUnicodeTest-283431876 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8aceee32-adba-47ad-8c0a-d8d45c047e79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:52:13 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-5ce4b2cf-e926-4c24-8faf-593c80b5ebcc tempest-CinderUnicodeTest-283431876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00881e86-bbe0-4591-86c1-dbda80bee57b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:52:13 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-5ce4b2cf-e926-4c24-8faf-593c80b5ebcc tempest-CinderUnicodeTest-283431876 None] Volume 15bb4251-bbb6-43b4-ad4f-b477369ca03c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-15bb4251-bbb6-43b4-ad4f-b477369ca03c', 'volume_size': 1} Sep 22 15:52:13 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-5ce4b2cf-e926-4c24-8faf-593c80b5ebcc tempest-CinderUnicodeTest-283431876 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:52:13 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-5ce4b2cf-e926-4c24-8faf-593c80b5ebcc tempest-CinderUnicodeTest-283431876 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:52:13 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-5ce4b2cf-e926-4c24-8faf-593c80b5ebcc tempest-CinderUnicodeTest-283431876 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:52:13Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-268293368',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15bb4251-bbb6-43b4-ad4f-b477369ca03c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b1e1f4095534ffab791a82923c394f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:52:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:52:13Z,use_quota=True,user_id='0c0ee0cbdd0247c7bdcf9994c72d58f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)}" {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 15:52:13 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-5ce4b2cf-e926-4c24-8faf-593c80b5ebcc tempest-CinderUnicodeTest-283431876 None] Creating volume 15bb4251-bbb6-43b4-ad4f-b477369ca03c {{(pid=86212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 15:52:13 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-5ce4b2cf-e926-4c24-8faf-593c80b5ebcc tempest-CinderUnicodeTest-283431876 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:52:13 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-5ce4b2cf-e926-4c24-8faf-593c80b5ebcc tempest-CinderUnicodeTest-283431876 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:52:13 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-5ce4b2cf-e926-4c24-8faf-593c80b5ebcc tempest-CinderUnicodeTest-283431876 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:52:13 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-5ce4b2cf-e926-4c24-8faf-593c80b5ebcc tempest-CinderUnicodeTest-283431876 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:52:13 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-5ce4b2cf-e926-4c24-8faf-593c80b5ebcc tempest-CinderUnicodeTest-283431876 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:52:13 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-5ce4b2cf-e926-4c24-8faf-593c80b5ebcc tempest-CinderUnicodeTest-283431876 None] Selected osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 as target Quobyte volume. {{(pid=86212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 15:52:13 devstack cinder-volume[86212]: INFO cinder.volume.drivers.remotefs [None req-5ce4b2cf-e926-4c24-8faf-593c80b5ebcc tempest-CinderUnicodeTest-283431876 None] casted to osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 Sep 22 15:52:13 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-5ce4b2cf-e926-4c24-8faf-593c80b5ebcc tempest-CinderUnicodeTest-283431876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-15bb4251-bbb6-43b4-ad4f-b477369ca03c 1073741824 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:52:13 devstack sudo[100862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-15bb4251-bbb6-43b4-ad4f-b477369ca03c 1073741824 Sep 22 15:52:13 devstack sudo[100862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:52:14 devstack cinder-volume[86212]: INFO cinder.volume.manager [req-9f2c5081-21bc-4e4a-8b0b-2db883a623de req-daa331b9-cfd4-4439-b9d7-8d5d59a39348 tempest-TestInstancesWithCinderVolumes-793553421 None] Terminate volume connection completed successfully. Sep 22 15:52:14 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [req-9f2c5081-21bc-4e4a-8b0b-2db883a623de req-daa331b9-cfd4-4439-b9d7-8d5d59a39348 tempest-TestInstancesWithCinderVolumes-793553421 None] Deleting attachment 6d89f811-3808-4076-9ac5-42d47417c664. {{(pid=86212) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 22 15:52:14 devstack sudo[100862]: pam_unix(sudo:session): session closed for user root Sep 22 15:52:14 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-5ce4b2cf-e926-4c24-8faf-593c80b5ebcc tempest-CinderUnicodeTest-283431876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-15bb4251-bbb6-43b4-ad4f-b477369ca03c 1073741824" returned: 0 in 0.583s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:52:14 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-5ce4b2cf-e926-4c24-8faf-593c80b5ebcc tempest-CinderUnicodeTest-283431876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-15bb4251-bbb6-43b4-ad4f-b477369ca03c {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:52:14 devstack sudo[100870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-15bb4251-bbb6-43b4-ad4f-b477369ca03c Sep 22 15:52:14 devstack sudo[100870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:52:14 devstack sudo[100870]: pam_unix(sudo:session): session closed for user root Sep 22 15:52:14 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-5ce4b2cf-e926-4c24-8faf-593c80b5ebcc tempest-CinderUnicodeTest-283431876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-15bb4251-bbb6-43b4-ad4f-b477369ca03c" returned: 0 in 0.342s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:52:14 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-5ce4b2cf-e926-4c24-8faf-593c80b5ebcc tempest-CinderUnicodeTest-283431876 None] <== create_volume: return (980ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'} {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 15:52:14 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-5ce4b2cf-e926-4c24-8faf-593c80b5ebcc tempest-CinderUnicodeTest-283431876 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.984s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:52:14 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-5ce4b2cf-e926-4c24-8faf-593c80b5ebcc tempest-CinderUnicodeTest-283431876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00881e86-bbe0-4591-86c1-dbda80bee57b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-15bb4251-bbb6-43b4-ad4f-b477369ca03c', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:52:14 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-5ce4b2cf-e926-4c24-8faf-593c80b5ebcc tempest-CinderUnicodeTest-283431876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53a4d6ee-c627-4bd7-a6ba-29c121e028fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:52:14 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-5ce4b2cf-e926-4c24-8faf-593c80b5ebcc tempest-CinderUnicodeTest-283431876 None] Volume volume-15bb4251-bbb6-43b4-ad4f-b477369ca03c (15bb4251-bbb6-43b4-ad4f-b477369ca03c): created successfully Sep 22 15:52:14 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-5ce4b2cf-e926-4c24-8faf-593c80b5ebcc tempest-CinderUnicodeTest-283431876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53a4d6ee-c627-4bd7-a6ba-29c121e028fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:52:14 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-5ce4b2cf-e926-4c24-8faf-593c80b5ebcc tempest-CinderUnicodeTest-283431876 None] Flow 'volume_create_manager' (861ccbe2-9f53-47fe-8078-21edeae9976b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:52:14 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-5ce4b2cf-e926-4c24-8faf-593c80b5ebcc tempest-CinderUnicodeTest-283431876 None] Created volume successfully. Sep 22 15:52:14 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-978b9dea-ff5c-454e-a2f2-4b78900477c4 tempest-TestInstancesWithCinderVolumes-793553421 None] Acquiring lock "cinder-7c028b07-9b81-4b00-8a2f-4fad0385253b-delete_volume" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:52:14 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-978b9dea-ff5c-454e-a2f2-4b78900477c4 tempest-TestInstancesWithCinderVolumes-793553421 None] Lock "cinder-7c028b07-9b81-4b00-8a2f-4fad0385253b-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:52:14 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-978b9dea-ff5c-454e-a2f2-4b78900477c4 tempest-TestInstancesWithCinderVolumes-793553421 None] Acquiring lock "cinder-quobyte-7c028b07-9b81-4b00-8a2f-4fad0385253b" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:52:14 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-978b9dea-ff5c-454e-a2f2-4b78900477c4 tempest-TestInstancesWithCinderVolumes-793553421 None] Lock "cinder-quobyte-7c028b07-9b81-4b00-8a2f-4fad0385253b" acquired by "delete_volume" :: waited 0.019s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:52:14 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[65d9ddc6-2b68-42d7-ba02-369d0f6194e8]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:52:15 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-978b9dea-ff5c-454e-a2f2-4b78900477c4 tempest-TestInstancesWithCinderVolumes-793553421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-7c028b07-9b81-4b00-8a2f-4fad0385253b {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:52:15 devstack sudo[100873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-7c028b07-9b81-4b00-8a2f-4fad0385253b Sep 22 15:52:15 devstack sudo[100873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:52:15 devstack sudo[100873]: pam_unix(sudo:session): session closed for user root Sep 22 15:52:15 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-978b9dea-ff5c-454e-a2f2-4b78900477c4 tempest-TestInstancesWithCinderVolumes-793553421 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-7c028b07-9b81-4b00-8a2f-4fad0385253b" returned: 0 in 0.432s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:52:15 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-978b9dea-ff5c-454e-a2f2-4b78900477c4 tempest-TestInstancesWithCinderVolumes-793553421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-7c028b07-9b81-4b00-8a2f-4fad0385253b {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:52:15 devstack sudo[100880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-7c028b07-9b81-4b00-8a2f-4fad0385253b Sep 22 15:52:15 devstack sudo[100880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:52:15 devstack sudo[100880]: pam_unix(sudo:session): session closed for user root Sep 22 15:52:15 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-978b9dea-ff5c-454e-a2f2-4b78900477c4 tempest-TestInstancesWithCinderVolumes-793553421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-7c028b07-9b81-4b00-8a2f-4fad0385253b" returned: 0 in 0.394s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:52:15 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-978b9dea-ff5c-454e-a2f2-4b78900477c4 tempest-TestInstancesWithCinderVolumes-793553421 None] Lock "cinder-quobyte-7c028b07-9b81-4b00-8a2f-4fad0385253b" released by "delete_volume" :: held 0.891s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:52:15 devstack cinder-volume[86212]: WARNING cinder.quota [None req-978b9dea-ff5c-454e-a2f2-4b78900477c4 tempest-TestInstancesWithCinderVolumes-793553421 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1640092356-495457826 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1640092356-495457826, it is now deprecated. Please use the default quota class for default quota. Sep 22 15:52:15 devstack cinder-volume[86212]: WARNING cinder.quota [None req-978b9dea-ff5c-454e-a2f2-4b78900477c4 tempest-TestInstancesWithCinderVolumes-793553421 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1640092356-495457826 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1640092356-495457826, it is now deprecated. Please use the default quota class for default quota. Sep 22 15:52:15 devstack cinder-volume[86212]: DEBUG cinder.quota [None req-978b9dea-ff5c-454e-a2f2-4b78900477c4 tempest-TestInstancesWithCinderVolumes-793553421 None] Created reservations ['957e879b-23eb-47b1-8923-b9e42b8585e4', 'f85ae2b2-1d95-4888-b700-0fb2e9318521', '2ed7ee51-fbc2-40a8-ae6e-222b56046bf6', '5435234f-a8cf-48ba-8c38-05d3b8e120ad'] {{(pid=86212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 15:52:16 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-978b9dea-ff5c-454e-a2f2-4b78900477c4 tempest-TestInstancesWithCinderVolumes-793553421 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:52:16 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-978b9dea-ff5c-454e-a2f2-4b78900477c4 tempest-TestInstancesWithCinderVolumes-793553421 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:52:16 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-978b9dea-ff5c-454e-a2f2-4b78900477c4 tempest-TestInstancesWithCinderVolumes-793553421 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:52:16 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-978b9dea-ff5c-454e-a2f2-4b78900477c4 tempest-TestInstancesWithCinderVolumes-793553421 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:52:16 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-978b9dea-ff5c-454e-a2f2-4b78900477c4 tempest-TestInstancesWithCinderVolumes-793553421 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:52:16 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-978b9dea-ff5c-454e-a2f2-4b78900477c4 tempest-TestInstancesWithCinderVolumes-793553421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:52:16 devstack sudo[100883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc Sep 22 15:52:16 devstack sudo[100883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:52:16 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-5ea7ca14-b40d-4a11-86d4-2da1e2dfd7e2 tempest-CinderUnicodeTest-283431876 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:52:16 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-5ea7ca14-b40d-4a11-86d4-2da1e2dfd7e2 tempest-CinderUnicodeTest-283431876 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:52:16 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-5ea7ca14-b40d-4a11-86d4-2da1e2dfd7e2 tempest-CinderUnicodeTest-283431876 None] Creating offline snapshot 401fc6d7-5fe3-472e-9fd5-0134b7c76435 of volume 15bb4251-bbb6-43b4-ad4f-b477369ca03c {{(pid=86212) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 22 15:52:16 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[44a6b7a0-9ce8-481f-ae09-ad517d1ffa1a]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:52:16 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-5ea7ca14-b40d-4a11-86d4-2da1e2dfd7e2 tempest-CinderUnicodeTest-283431876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-15bb4251-bbb6-43b4-ad4f-b477369ca03c {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:52:16 devstack sudo[100883]: pam_unix(sudo:session): session closed for user root Sep 22 15:52:16 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-978b9dea-ff5c-454e-a2f2-4b78900477c4 tempest-TestInstancesWithCinderVolumes-793553421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc" returned: 0 in 0.309s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:52:16 devstack cinder-volume[86212]: DEBUG cinder.manager [None req-978b9dea-ff5c-454e-a2f2-4b78900477c4 tempest-TestInstancesWithCinderVolumes-793553421 None] Notifying Schedulers of capabilities ... {{(pid=86212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 15:52:16 devstack sudo[100885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-15bb4251-bbb6-43b4-ad4f-b477369ca03c Sep 22 15:52:16 devstack sudo[100885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:52:16 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-978b9dea-ff5c-454e-a2f2-4b78900477c4 tempest-TestInstancesWithCinderVolumes-793553421 None] Deleted volume successfully. Sep 22 15:52:16 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-978b9dea-ff5c-454e-a2f2-4b78900477c4 tempest-TestInstancesWithCinderVolumes-793553421 None] Lock "cinder-7c028b07-9b81-4b00-8a2f-4fad0385253b-delete_volume" released by "delete_volume" :: held 1.550s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:52:16 devstack sudo[100885]: pam_unix(sudo:session): session closed for user root Sep 22 15:52:16 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-5ea7ca14-b40d-4a11-86d4-2da1e2dfd7e2 tempest-CinderUnicodeTest-283431876 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-15bb4251-bbb6-43b4-ad4f-b477369ca03c" returned: 0 in 0.511s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:52:16 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-5ea7ca14-b40d-4a11-86d4-2da1e2dfd7e2 tempest-CinderUnicodeTest-283431876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-15bb4251-bbb6-43b4-ad4f-b477369ca03c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-15bb4251-bbb6-43b4-ad4f-b477369ca03c.401fc6d7-5fe3-472e-9fd5-0134b7c76435 1G {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:52:16 devstack sudo[100891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-15bb4251-bbb6-43b4-ad4f-b477369ca03c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-15bb4251-bbb6-43b4-ad4f-b477369ca03c.401fc6d7-5fe3-472e-9fd5-0134b7c76435 1G Sep 22 15:52:16 devstack sudo[100891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:52:17 devstack sudo[100891]: pam_unix(sudo:session): session closed for user root Sep 22 15:52:17 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-5ea7ca14-b40d-4a11-86d4-2da1e2dfd7e2 tempest-CinderUnicodeTest-283431876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-15bb4251-bbb6-43b4-ad4f-b477369ca03c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-15bb4251-bbb6-43b4-ad4f-b477369ca03c.401fc6d7-5fe3-472e-9fd5-0134b7c76435 1G" returned: 0 in 0.576s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:52:17 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-5ea7ca14-b40d-4a11-86d4-2da1e2dfd7e2 tempest-CinderUnicodeTest-283431876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-15bb4251-bbb6-43b4-ad4f-b477369ca03c -F qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-15bb4251-bbb6-43b4-ad4f-b477369ca03c.401fc6d7-5fe3-472e-9fd5-0134b7c76435 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:52:17 devstack sudo[100897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-15bb4251-bbb6-43b4-ad4f-b477369ca03c -F qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-15bb4251-bbb6-43b4-ad4f-b477369ca03c.401fc6d7-5fe3-472e-9fd5-0134b7c76435 Sep 22 15:52:17 devstack sudo[100897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:52:17 devstack sudo[100897]: pam_unix(sudo:session): session closed for user root Sep 22 15:52:17 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-5ea7ca14-b40d-4a11-86d4-2da1e2dfd7e2 tempest-CinderUnicodeTest-283431876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-15bb4251-bbb6-43b4-ad4f-b477369ca03c -F qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-15bb4251-bbb6-43b4-ad4f-b477369ca03c.401fc6d7-5fe3-472e-9fd5-0134b7c76435" returned: 0 in 0.376s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:52:17 devstack cinder-volume[86212]: WARNING cinder.volume.drivers.remotefs [None req-5ea7ca14-b40d-4a11-86d4-2da1e2dfd7e2 tempest-CinderUnicodeTest-283431876 None] /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-15bb4251-bbb6-43b4-ad4f-b477369ca03c.401fc6d7-5fe3-472e-9fd5-0134b7c76435 is being set with open permissions: ugo+rw Sep 22 15:52:17 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-5ea7ca14-b40d-4a11-86d4-2da1e2dfd7e2 tempest-CinderUnicodeTest-283431876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-15bb4251-bbb6-43b4-ad4f-b477369ca03c.401fc6d7-5fe3-472e-9fd5-0134b7c76435 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:52:17 devstack sudo[100902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-15bb4251-bbb6-43b4-ad4f-b477369ca03c.401fc6d7-5fe3-472e-9fd5-0134b7c76435 Sep 22 15:52:17 devstack sudo[100902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:52:18 devstack sudo[100902]: pam_unix(sudo:session): session closed for user root Sep 22 15:52:18 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-5ea7ca14-b40d-4a11-86d4-2da1e2dfd7e2 tempest-CinderUnicodeTest-283431876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-15bb4251-bbb6-43b4-ad4f-b477369ca03c.401fc6d7-5fe3-472e-9fd5-0134b7c76435" returned: 0 in 0.383s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:52:18 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-5ea7ca14-b40d-4a11-86d4-2da1e2dfd7e2 tempest-CinderUnicodeTest-283431876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-15bb4251-bbb6-43b4-ad4f-b477369ca03c.info {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:52:18 devstack sudo[100906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-15bb4251-bbb6-43b4-ad4f-b477369ca03c.info Sep 22 15:52:18 devstack sudo[100906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:52:18 devstack sudo[100906]: pam_unix(sudo:session): session closed for user root Sep 22 15:52:18 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-5ea7ca14-b40d-4a11-86d4-2da1e2dfd7e2 tempest-CinderUnicodeTest-283431876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-15bb4251-bbb6-43b4-ad4f-b477369ca03c.info" returned: 0 in 0.312s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:52:18 devstack cinder-volume[86212]: WARNING cinder.volume.drivers.remotefs [None req-5ea7ca14-b40d-4a11-86d4-2da1e2dfd7e2 tempest-CinderUnicodeTest-283431876 None] /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-15bb4251-bbb6-43b4-ad4f-b477369ca03c.info is being set with open permissions: ugo+rw Sep 22 15:52:18 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-5ea7ca14-b40d-4a11-86d4-2da1e2dfd7e2 tempest-CinderUnicodeTest-283431876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-15bb4251-bbb6-43b4-ad4f-b477369ca03c.info {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:52:18 devstack sudo[100909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-15bb4251-bbb6-43b4-ad4f-b477369ca03c.info Sep 22 15:52:18 devstack sudo[100909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:52:18 devstack sudo[100909]: pam_unix(sudo:session): session closed for user root Sep 22 15:52:18 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-5ea7ca14-b40d-4a11-86d4-2da1e2dfd7e2 tempest-CinderUnicodeTest-283431876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-15bb4251-bbb6-43b4-ad4f-b477369ca03c.info" returned: 0 in 0.312s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:52:18 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-5ea7ca14-b40d-4a11-86d4-2da1e2dfd7e2 tempest-CinderUnicodeTest-283431876 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.629s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:52:18 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-5ea7ca14-b40d-4a11-86d4-2da1e2dfd7e2 tempest-CinderUnicodeTest-283431876 None] Create snapshot completed successfully Sep 22 15:52:19 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-9dd1455a-3170-471f-8ef7-4cd5424ee20b tempest-CinderUnicodeTest-283431876 None] Acquiring lock "cinder-401fc6d7-5fe3-472e-9fd5-0134b7c76435-delete_snapshot" by "delete_snapshot" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:52:19 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-9dd1455a-3170-471f-8ef7-4cd5424ee20b tempest-CinderUnicodeTest-283431876 None] Lock "cinder-401fc6d7-5fe3-472e-9fd5-0134b7c76435-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:52:19 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-9dd1455a-3170-471f-8ef7-4cd5424ee20b tempest-CinderUnicodeTest-283431876 None] Acquiring lock "cinder-quobyte-15bb4251-bbb6-43b4-ad4f-b477369ca03c" by "delete_snapshot" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:52:19 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-9dd1455a-3170-471f-8ef7-4cd5424ee20b tempest-CinderUnicodeTest-283431876 None] Lock "cinder-quobyte-15bb4251-bbb6-43b4-ad4f-b477369ca03c" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:52:19 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-9dd1455a-3170-471f-8ef7-4cd5424ee20b tempest-CinderUnicodeTest-283431876 None] Acquiring lock "cinder-quobyte-401fc6d7-5fe3-472e-9fd5-0134b7c76435" by "_delete_snapshot" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:52:19 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-9dd1455a-3170-471f-8ef7-4cd5424ee20b tempest-CinderUnicodeTest-283431876 None] Lock "cinder-quobyte-401fc6d7-5fe3-472e-9fd5-0134b7c76435" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:52:19 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-9dd1455a-3170-471f-8ef7-4cd5424ee20b tempest-CinderUnicodeTest-283431876 None] Deleting offline snapshot 401fc6d7-5fe3-472e-9fd5-0134b7c76435 of volume 15bb4251-bbb6-43b4-ad4f-b477369ca03c {{(pid=86212) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 22 15:52:19 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-9dd1455a-3170-471f-8ef7-4cd5424ee20b tempest-CinderUnicodeTest-283431876 None] snapshot_file for this snap is: volume-15bb4251-bbb6-43b4-ad4f-b477369ca03c.401fc6d7-5fe3-472e-9fd5-0134b7c76435 {{(pid=86212) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 22 15:52:19 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[d09db45d-5b71-408e-a117-c1a0adfdd871]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:52:19 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-9dd1455a-3170-471f-8ef7-4cd5424ee20b tempest-CinderUnicodeTest-283431876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-15bb4251-bbb6-43b4-ad4f-b477369ca03c.401fc6d7-5fe3-472e-9fd5-0134b7c76435 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:52:19 devstack sudo[100912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-15bb4251-bbb6-43b4-ad4f-b477369ca03c.401fc6d7-5fe3-472e-9fd5-0134b7c76435 Sep 22 15:52:19 devstack sudo[100912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:52:20 devstack sudo[100912]: pam_unix(sudo:session): session closed for user root Sep 22 15:52:20 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-9dd1455a-3170-471f-8ef7-4cd5424ee20b tempest-CinderUnicodeTest-283431876 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-15bb4251-bbb6-43b4-ad4f-b477369ca03c.401fc6d7-5fe3-472e-9fd5-0134b7c76435" returned: 0 in 0.528s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:52:20 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-9dd1455a-3170-471f-8ef7-4cd5424ee20b tempest-CinderUnicodeTest-283431876 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-15bb4251-bbb6-43b4-ad4f-b477369ca03c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86212) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 22 15:52:20 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8a06bfa-a774-449b-992a-e071c777475e]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:52:20 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-9dd1455a-3170-471f-8ef7-4cd5424ee20b tempest-CinderUnicodeTest-283431876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-15bb4251-bbb6-43b4-ad4f-b477369ca03c {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:52:20 devstack sudo[100918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-15bb4251-bbb6-43b4-ad4f-b477369ca03c Sep 22 15:52:20 devstack sudo[100918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:52:20 devstack sudo[100918]: pam_unix(sudo:session): session closed for user root Sep 22 15:52:20 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-9dd1455a-3170-471f-8ef7-4cd5424ee20b tempest-CinderUnicodeTest-283431876 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-15bb4251-bbb6-43b4-ad4f-b477369ca03c" returned: 0 in 0.694s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:52:20 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-9dd1455a-3170-471f-8ef7-4cd5424ee20b tempest-CinderUnicodeTest-283431876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-15bb4251-bbb6-43b4-ad4f-b477369ca03c.401fc6d7-5fe3-472e-9fd5-0134b7c76435 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:52:20 devstack sudo[100925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-15bb4251-bbb6-43b4-ad4f-b477369ca03c.401fc6d7-5fe3-472e-9fd5-0134b7c76435 Sep 22 15:52:20 devstack sudo[100925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:52:21 devstack sudo[100925]: pam_unix(sudo:session): session closed for user root Sep 22 15:52:21 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-9dd1455a-3170-471f-8ef7-4cd5424ee20b tempest-CinderUnicodeTest-283431876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-15bb4251-bbb6-43b4-ad4f-b477369ca03c.401fc6d7-5fe3-472e-9fd5-0134b7c76435" returned: 0 in 0.653s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:52:21 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-9dd1455a-3170-471f-8ef7-4cd5424ee20b tempest-CinderUnicodeTest-283431876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-15bb4251-bbb6-43b4-ad4f-b477369ca03c.401fc6d7-5fe3-472e-9fd5-0134b7c76435 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:52:21 devstack sudo[100950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-15bb4251-bbb6-43b4-ad4f-b477369ca03c.401fc6d7-5fe3-472e-9fd5-0134b7c76435 Sep 22 15:52:21 devstack sudo[100950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:52:21 devstack sudo[100950]: pam_unix(sudo:session): session closed for user root Sep 22 15:52:21 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-9dd1455a-3170-471f-8ef7-4cd5424ee20b tempest-CinderUnicodeTest-283431876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-15bb4251-bbb6-43b4-ad4f-b477369ca03c.401fc6d7-5fe3-472e-9fd5-0134b7c76435" returned: 0 in 0.297s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:52:21 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-9dd1455a-3170-471f-8ef7-4cd5424ee20b tempest-CinderUnicodeTest-283431876 None] Lock "cinder-quobyte-401fc6d7-5fe3-472e-9fd5-0134b7c76435" released by "_delete_snapshot" :: held 2.353s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:52:21 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-9dd1455a-3170-471f-8ef7-4cd5424ee20b tempest-CinderUnicodeTest-283431876 None] Lock "cinder-quobyte-15bb4251-bbb6-43b4-ad4f-b477369ca03c" released by "delete_snapshot" :: held 2.396s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:52:21 devstack cinder-volume[86212]: DEBUG cinder.quota [None req-9dd1455a-3170-471f-8ef7-4cd5424ee20b tempest-CinderUnicodeTest-283431876 None] Created reservations ['fc34c3f1-ff0b-4c81-bcdf-4fffbe1dc4ef', '29d1bde7-839c-4b83-82ed-d8e4da71cb44', 'f2a9aee8-630f-4d1d-ab31-704009b56dc2', '40106215-b996-43e7-a406-bde6a9c95ddf'] {{(pid=86212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 15:52:22 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-9dd1455a-3170-471f-8ef7-4cd5424ee20b tempest-CinderUnicodeTest-283431876 None] Delete snapshot completed successfully. Sep 22 15:52:22 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-9dd1455a-3170-471f-8ef7-4cd5424ee20b tempest-CinderUnicodeTest-283431876 None] Lock "cinder-401fc6d7-5fe3-472e-9fd5-0134b7c76435-delete_snapshot" released by "delete_snapshot" :: held 2.585s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:52:22 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-7ab2b2fd-97a6-44a6-8229-ec2d1734962c tempest-CinderUnicodeTest-283431876 None] Acquiring lock "cinder-15bb4251-bbb6-43b4-ad4f-b477369ca03c-delete_volume" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:52:22 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-7ab2b2fd-97a6-44a6-8229-ec2d1734962c tempest-CinderUnicodeTest-283431876 None] Lock "cinder-15bb4251-bbb6-43b4-ad4f-b477369ca03c-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:52:22 devstack cinder-volume[86212]: DEBUG dbcounter [-] [86212] Writing DB stats cinder:UPDATE=119,cinder:SELECT=103,cinder:INSERT=23,cinder:DELETE=13 {{(pid=86212) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 22 15:52:22 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-7ab2b2fd-97a6-44a6-8229-ec2d1734962c tempest-CinderUnicodeTest-283431876 None] Acquiring lock "cinder-quobyte-15bb4251-bbb6-43b4-ad4f-b477369ca03c" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:52:22 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-7ab2b2fd-97a6-44a6-8229-ec2d1734962c tempest-CinderUnicodeTest-283431876 None] Lock "cinder-quobyte-15bb4251-bbb6-43b4-ad4f-b477369ca03c" acquired by "delete_volume" :: waited 0.029s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:52:22 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7173313-3e0d-403e-bd2d-57cc6f3caabb]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:52:22 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-7ab2b2fd-97a6-44a6-8229-ec2d1734962c tempest-CinderUnicodeTest-283431876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-15bb4251-bbb6-43b4-ad4f-b477369ca03c {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:52:23 devstack sudo[100954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-15bb4251-bbb6-43b4-ad4f-b477369ca03c Sep 22 15:52:23 devstack sudo[100954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:52:23 devstack cinder-volume[86212]: INFO cinder.volume.manager [req-22984408-112b-4075-bbab-e062408ab2da req-c666dddd-05a3-4f40-86a4-0d4529fcb18f tempest-TestInstancesWithCinderVolumes-793553421 None] Terminate volume connection completed successfully. Sep 22 15:52:23 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [req-22984408-112b-4075-bbab-e062408ab2da req-c666dddd-05a3-4f40-86a4-0d4529fcb18f tempest-TestInstancesWithCinderVolumes-793553421 None] Deleting attachment 61e0b7f6-ad29-4a28-a365-5746ded8c320. {{(pid=86212) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 22 15:52:23 devstack sudo[100954]: pam_unix(sudo:session): session closed for user root Sep 22 15:52:23 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-7ab2b2fd-97a6-44a6-8229-ec2d1734962c tempest-CinderUnicodeTest-283431876 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-15bb4251-bbb6-43b4-ad4f-b477369ca03c" returned: 0 in 0.565s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:52:23 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-7ab2b2fd-97a6-44a6-8229-ec2d1734962c tempest-CinderUnicodeTest-283431876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-15bb4251-bbb6-43b4-ad4f-b477369ca03c {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:52:23 devstack sudo[100960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-15bb4251-bbb6-43b4-ad4f-b477369ca03c Sep 22 15:52:23 devstack sudo[100960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:52:23 devstack sudo[100960]: pam_unix(sudo:session): session closed for user root Sep 22 15:52:23 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-7ab2b2fd-97a6-44a6-8229-ec2d1734962c tempest-CinderUnicodeTest-283431876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-15bb4251-bbb6-43b4-ad4f-b477369ca03c" returned: 0 in 0.368s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:52:23 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-7ab2b2fd-97a6-44a6-8229-ec2d1734962c tempest-CinderUnicodeTest-283431876 None] Lock "cinder-quobyte-15bb4251-bbb6-43b4-ad4f-b477369ca03c" released by "delete_volume" :: held 1.027s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:52:23 devstack cinder-volume[86212]: DEBUG cinder.quota [None req-7ab2b2fd-97a6-44a6-8229-ec2d1734962c tempest-CinderUnicodeTest-283431876 None] Created reservations ['4db810ed-0c01-488f-9d88-ebf137c88491', 'c068183d-fbe6-4985-9fb9-4846cebe4fe5', '84e9e83c-f259-4468-8b20-e7b1c72f47b4', 'ac35c1b7-afc5-4fc5-b306-a33410a1d62d'] {{(pid=86212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 15:52:24 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-7ab2b2fd-97a6-44a6-8229-ec2d1734962c tempest-CinderUnicodeTest-283431876 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:52:24 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-7ab2b2fd-97a6-44a6-8229-ec2d1734962c tempest-CinderUnicodeTest-283431876 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:52:24 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-7ab2b2fd-97a6-44a6-8229-ec2d1734962c tempest-CinderUnicodeTest-283431876 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:52:24 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-7ab2b2fd-97a6-44a6-8229-ec2d1734962c tempest-CinderUnicodeTest-283431876 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:52:24 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-7ab2b2fd-97a6-44a6-8229-ec2d1734962c tempest-CinderUnicodeTest-283431876 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:52:24 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-7ab2b2fd-97a6-44a6-8229-ec2d1734962c tempest-CinderUnicodeTest-283431876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:52:24 devstack sudo[100963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc Sep 22 15:52:24 devstack sudo[100963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:52:24 devstack sudo[100963]: pam_unix(sudo:session): session closed for user root Sep 22 15:52:24 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-7ab2b2fd-97a6-44a6-8229-ec2d1734962c tempest-CinderUnicodeTest-283431876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc" returned: 0 in 0.293s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:52:24 devstack cinder-volume[86212]: DEBUG cinder.manager [None req-7ab2b2fd-97a6-44a6-8229-ec2d1734962c tempest-CinderUnicodeTest-283431876 None] Notifying Schedulers of capabilities ... {{(pid=86212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 15:52:24 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-7ab2b2fd-97a6-44a6-8229-ec2d1734962c tempest-CinderUnicodeTest-283431876 None] Deleted volume successfully. Sep 22 15:52:24 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-7ab2b2fd-97a6-44a6-8229-ec2d1734962c tempest-CinderUnicodeTest-283431876 None] Lock "cinder-15bb4251-bbb6-43b4-ad4f-b477369ca03c-delete_volume" released by "delete_volume" :: held 1.588s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:52:24 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-35715e0c-aa47-4511-9fb9-061c6ddd615d tempest-TestInstancesWithCinderVolumes-793553421 None] Acquiring lock "cinder-485d3f7a-f7bc-4cbc-a362-858f126f010e-delete_volume" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:52:24 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-35715e0c-aa47-4511-9fb9-061c6ddd615d tempest-TestInstancesWithCinderVolumes-793553421 None] Lock "cinder-485d3f7a-f7bc-4cbc-a362-858f126f010e-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:52:24 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-35715e0c-aa47-4511-9fb9-061c6ddd615d tempest-TestInstancesWithCinderVolumes-793553421 None] Acquiring lock "cinder-quobyte-485d3f7a-f7bc-4cbc-a362-858f126f010e" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:52:24 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-35715e0c-aa47-4511-9fb9-061c6ddd615d tempest-TestInstancesWithCinderVolumes-793553421 None] Lock "cinder-quobyte-485d3f7a-f7bc-4cbc-a362-858f126f010e" acquired by "delete_volume" :: waited 0.022s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:52:24 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8968e9d-ad0f-412d-9a8c-0dc9c154a236]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:52:24 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-35715e0c-aa47-4511-9fb9-061c6ddd615d tempest-TestInstancesWithCinderVolumes-793553421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-485d3f7a-f7bc-4cbc-a362-858f126f010e {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:52:24 devstack sudo[100966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-485d3f7a-f7bc-4cbc-a362-858f126f010e Sep 22 15:52:24 devstack sudo[100966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:52:24 devstack cinder-volume[86212]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0fb5e3b-835a-4e21-b83e-9cc6f12563c6 tempest-TestStampPattern-847195903 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 15:52:24 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-c0fb5e3b-835a-4e21-b83e-9cc6f12563c6 tempest-TestStampPattern-847195903 None] Flow 'volume_create_manager' (fa253273-87ee-4627-9e48-f65cf07914c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:52:24 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-c0fb5e3b-835a-4e21-b83e-9cc6f12563c6 tempest-TestStampPattern-847195903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6cb011ae-e62e-4c59-b1db-e64a64d6e40b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:52:24 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-c0fb5e3b-835a-4e21-b83e-9cc6f12563c6 tempest-TestStampPattern-847195903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6cb011ae-e62e-4c59-b1db-e64a64d6e40b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:52:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1721775914',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d7da764-b91f-4c44-9d97-30dc4b0b94d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='549a7d6b228d429fb842bb6fdbe05541',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:52:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:52:25Z,use_quota=True,user_id='e49de96255ae4eaf815a4f28a2169394',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:52:24 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-c0fb5e3b-835a-4e21-b83e-9cc6f12563c6 tempest-TestStampPattern-847195903 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19987900-55a7-4c90-a4a9-a1a14699b9d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:52:24 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-c0fb5e3b-835a-4e21-b83e-9cc6f12563c6 tempest-TestStampPattern-847195903 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19987900-55a7-4c90-a4a9-a1a14699b9d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:52:24 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-c0fb5e3b-835a-4e21-b83e-9cc6f12563c6 tempest-TestStampPattern-847195903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d23c6aa6-eb0b-4c7a-a21c-b77726ea3a9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:52:24 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-c0fb5e3b-835a-4e21-b83e-9cc6f12563c6 tempest-TestStampPattern-847195903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d23c6aa6-eb0b-4c7a-a21c-b77726ea3a9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8d7da764-b91f-4c44-9d97-30dc4b0b94d0', 'volume_name': 'volume-8d7da764-b91f-4c44-9d97-30dc4b0b94d0', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:52:24 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-c0fb5e3b-835a-4e21-b83e-9cc6f12563c6 tempest-TestStampPattern-847195903 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9904b091-3a50-4a92-b015-138be594b3cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:52:24 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-c0fb5e3b-835a-4e21-b83e-9cc6f12563c6 tempest-TestStampPattern-847195903 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9904b091-3a50-4a92-b015-138be594b3cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:52:24 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-c0fb5e3b-835a-4e21-b83e-9cc6f12563c6 tempest-TestStampPattern-847195903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a43160e8-6eb1-4458-bf93-1a7296d3420c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:52:24 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-c0fb5e3b-835a-4e21-b83e-9cc6f12563c6 tempest-TestStampPattern-847195903 None] Volume 8d7da764-b91f-4c44-9d97-30dc4b0b94d0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8d7da764-b91f-4c44-9d97-30dc4b0b94d0', 'volume_size': 1} Sep 22 15:52:24 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-c0fb5e3b-835a-4e21-b83e-9cc6f12563c6 tempest-TestStampPattern-847195903 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:52:24 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-c0fb5e3b-835a-4e21-b83e-9cc6f12563c6 tempest-TestStampPattern-847195903 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:52:24 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-c0fb5e3b-835a-4e21-b83e-9cc6f12563c6 tempest-TestStampPattern-847195903 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:52:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1721775914',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d7da764-b91f-4c44-9d97-30dc4b0b94d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='549a7d6b228d429fb842bb6fdbe05541',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:52:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:52:25Z,use_quota=True,user_id='e49de96255ae4eaf815a4f28a2169394',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)}" {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 15:52:24 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-c0fb5e3b-835a-4e21-b83e-9cc6f12563c6 tempest-TestStampPattern-847195903 None] Creating volume 8d7da764-b91f-4c44-9d97-30dc4b0b94d0 {{(pid=86212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 15:52:24 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-c0fb5e3b-835a-4e21-b83e-9cc6f12563c6 tempest-TestStampPattern-847195903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:52:24 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-c0fb5e3b-835a-4e21-b83e-9cc6f12563c6 tempest-TestStampPattern-847195903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:52:24 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-c0fb5e3b-835a-4e21-b83e-9cc6f12563c6 tempest-TestStampPattern-847195903 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:52:24 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-c0fb5e3b-835a-4e21-b83e-9cc6f12563c6 tempest-TestStampPattern-847195903 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:52:24 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-c0fb5e3b-835a-4e21-b83e-9cc6f12563c6 tempest-TestStampPattern-847195903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:52:24 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-c0fb5e3b-835a-4e21-b83e-9cc6f12563c6 tempest-TestStampPattern-847195903 None] Selected osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 as target Quobyte volume. {{(pid=86212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 15:52:24 devstack cinder-volume[86212]: INFO cinder.volume.drivers.remotefs [None req-c0fb5e3b-835a-4e21-b83e-9cc6f12563c6 tempest-TestStampPattern-847195903 None] casted to osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 Sep 22 15:52:24 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-c0fb5e3b-835a-4e21-b83e-9cc6f12563c6 tempest-TestStampPattern-847195903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8d7da764-b91f-4c44-9d97-30dc4b0b94d0 1073741824 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:52:24 devstack sudo[100970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8d7da764-b91f-4c44-9d97-30dc4b0b94d0 1073741824 Sep 22 15:52:24 devstack sudo[100970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:52:25 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-2aa076f9-e69e-4589-a7aa-56af91592a93 tempest-CinderUnicodeTest-283431876 None] Acquiring lock "cinder-ab913df3-6423-486f-9f02-0f4559655bbb-delete_volume" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:52:25 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-2aa076f9-e69e-4589-a7aa-56af91592a93 tempest-CinderUnicodeTest-283431876 None] Lock "cinder-ab913df3-6423-486f-9f02-0f4559655bbb-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:52:25 devstack sudo[100966]: pam_unix(sudo:session): session closed for user root Sep 22 15:52:25 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-35715e0c-aa47-4511-9fb9-061c6ddd615d tempest-TestInstancesWithCinderVolumes-793553421 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-485d3f7a-f7bc-4cbc-a362-858f126f010e" returned: 0 in 0.535s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:52:25 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-2aa076f9-e69e-4589-a7aa-56af91592a93 tempest-CinderUnicodeTest-283431876 None] Acquiring lock "cinder-quobyte-ab913df3-6423-486f-9f02-0f4559655bbb" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:52:25 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-35715e0c-aa47-4511-9fb9-061c6ddd615d tempest-TestInstancesWithCinderVolumes-793553421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-485d3f7a-f7bc-4cbc-a362-858f126f010e {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:52:25 devstack sudo[100975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-485d3f7a-f7bc-4cbc-a362-858f126f010e Sep 22 15:52:25 devstack sudo[100975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:52:25 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-2aa076f9-e69e-4589-a7aa-56af91592a93 tempest-CinderUnicodeTest-283431876 None] Lock "cinder-quobyte-ab913df3-6423-486f-9f02-0f4559655bbb" acquired by "delete_volume" :: waited 0.059s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:52:25 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[86e44099-07c8-4156-8fc5-b09d47d901f4]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:52:25 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-2aa076f9-e69e-4589-a7aa-56af91592a93 tempest-CinderUnicodeTest-283431876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-ab913df3-6423-486f-9f02-0f4559655bbb {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:52:25 devstack sudo[100979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-ab913df3-6423-486f-9f02-0f4559655bbb Sep 22 15:52:25 devstack sudo[100979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:52:25 devstack sudo[100975]: pam_unix(sudo:session): session closed for user root Sep 22 15:52:25 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-35715e0c-aa47-4511-9fb9-061c6ddd615d tempest-TestInstancesWithCinderVolumes-793553421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-485d3f7a-f7bc-4cbc-a362-858f126f010e" returned: 0 in 0.365s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:52:25 devstack sudo[100970]: pam_unix(sudo:session): session closed for user root Sep 22 15:52:25 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-c0fb5e3b-835a-4e21-b83e-9cc6f12563c6 tempest-TestStampPattern-847195903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8d7da764-b91f-4c44-9d97-30dc4b0b94d0 1073741824" returned: 0 in 0.616s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:52:25 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-35715e0c-aa47-4511-9fb9-061c6ddd615d tempest-TestInstancesWithCinderVolumes-793553421 None] Lock "cinder-quobyte-485d3f7a-f7bc-4cbc-a362-858f126f010e" released by "delete_volume" :: held 0.976s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:52:25 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-c0fb5e3b-835a-4e21-b83e-9cc6f12563c6 tempest-TestStampPattern-847195903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8d7da764-b91f-4c44-9d97-30dc4b0b94d0 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:52:25 devstack cinder-volume[86212]: WARNING cinder.quota [None req-35715e0c-aa47-4511-9fb9-061c6ddd615d tempest-TestInstancesWithCinderVolumes-793553421 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-922137065-1846051495 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-922137065-1846051495, it is now deprecated. Please use the default quota class for default quota. Sep 22 15:52:25 devstack cinder-volume[86212]: WARNING cinder.quota [None req-35715e0c-aa47-4511-9fb9-061c6ddd615d tempest-TestInstancesWithCinderVolumes-793553421 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-922137065-1846051495 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-922137065-1846051495, it is now deprecated. Please use the default quota class for default quota. Sep 22 15:52:25 devstack sudo[100984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8d7da764-b91f-4c44-9d97-30dc4b0b94d0 Sep 22 15:52:25 devstack cinder-volume[86212]: DEBUG cinder.quota [None req-35715e0c-aa47-4511-9fb9-061c6ddd615d tempest-TestInstancesWithCinderVolumes-793553421 None] Created reservations ['416cf90e-93ae-4d51-874d-077068aab107', 'ccdd3cf9-18fb-43b8-8aa1-7dca3441cea1', 'c610044a-48c7-4207-9a2a-896d0cc42c06', '01b7a26a-4509-4727-aed3-dd063e035fa1'] {{(pid=86212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 15:52:25 devstack sudo[100984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:52:25 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-35715e0c-aa47-4511-9fb9-061c6ddd615d tempest-TestInstancesWithCinderVolumes-793553421 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:52:25 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-35715e0c-aa47-4511-9fb9-061c6ddd615d tempest-TestInstancesWithCinderVolumes-793553421 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:52:25 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-35715e0c-aa47-4511-9fb9-061c6ddd615d tempest-TestInstancesWithCinderVolumes-793553421 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:52:25 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-35715e0c-aa47-4511-9fb9-061c6ddd615d tempest-TestInstancesWithCinderVolumes-793553421 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:52:25 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-35715e0c-aa47-4511-9fb9-061c6ddd615d tempest-TestInstancesWithCinderVolumes-793553421 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:52:25 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-35715e0c-aa47-4511-9fb9-061c6ddd615d tempest-TestInstancesWithCinderVolumes-793553421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:52:25 devstack sudo[100979]: pam_unix(sudo:session): session closed for user root Sep 22 15:52:25 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-2aa076f9-e69e-4589-a7aa-56af91592a93 tempest-CinderUnicodeTest-283431876 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-ab913df3-6423-486f-9f02-0f4559655bbb" returned: 0 in 0.524s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:52:25 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-2aa076f9-e69e-4589-a7aa-56af91592a93 tempest-CinderUnicodeTest-283431876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-ab913df3-6423-486f-9f02-0f4559655bbb {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:52:25 devstack sudo[100990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc Sep 22 15:52:25 devstack sudo[100990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:52:25 devstack sudo[100992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-ab913df3-6423-486f-9f02-0f4559655bbb Sep 22 15:52:25 devstack sudo[100992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:52:25 devstack sudo[100984]: pam_unix(sudo:session): session closed for user root Sep 22 15:52:25 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-c0fb5e3b-835a-4e21-b83e-9cc6f12563c6 tempest-TestStampPattern-847195903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8d7da764-b91f-4c44-9d97-30dc4b0b94d0" returned: 0 in 0.364s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:52:25 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-c0fb5e3b-835a-4e21-b83e-9cc6f12563c6 tempest-TestStampPattern-847195903 None] <== create_volume: return (1063ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'} {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 15:52:25 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-c0fb5e3b-835a-4e21-b83e-9cc6f12563c6 tempest-TestStampPattern-847195903 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.066s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:52:26 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-c0fb5e3b-835a-4e21-b83e-9cc6f12563c6 tempest-TestStampPattern-847195903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a43160e8-6eb1-4458-bf93-1a7296d3420c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d7da764-b91f-4c44-9d97-30dc4b0b94d0', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:52:26 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-c0fb5e3b-835a-4e21-b83e-9cc6f12563c6 tempest-TestStampPattern-847195903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56216612-27be-4ed4-9d79-4b1ab553cbb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:52:26 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-c0fb5e3b-835a-4e21-b83e-9cc6f12563c6 tempest-TestStampPattern-847195903 None] Volume volume-8d7da764-b91f-4c44-9d97-30dc4b0b94d0 (8d7da764-b91f-4c44-9d97-30dc4b0b94d0): created successfully Sep 22 15:52:26 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-c0fb5e3b-835a-4e21-b83e-9cc6f12563c6 tempest-TestStampPattern-847195903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56216612-27be-4ed4-9d79-4b1ab553cbb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:52:26 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-c0fb5e3b-835a-4e21-b83e-9cc6f12563c6 tempest-TestStampPattern-847195903 None] Flow 'volume_create_manager' (fa253273-87ee-4627-9e48-f65cf07914c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:52:26 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-c0fb5e3b-835a-4e21-b83e-9cc6f12563c6 tempest-TestStampPattern-847195903 None] Created volume successfully. Sep 22 15:52:26 devstack sudo[100992]: pam_unix(sudo:session): session closed for user root Sep 22 15:52:26 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-2aa076f9-e69e-4589-a7aa-56af91592a93 tempest-CinderUnicodeTest-283431876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-ab913df3-6423-486f-9f02-0f4559655bbb" returned: 0 in 0.314s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:52:26 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-2aa076f9-e69e-4589-a7aa-56af91592a93 tempest-CinderUnicodeTest-283431876 None] Lock "cinder-quobyte-ab913df3-6423-486f-9f02-0f4559655bbb" released by "delete_volume" :: held 0.910s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:52:26 devstack sudo[100990]: pam_unix(sudo:session): session closed for user root Sep 22 15:52:26 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-35715e0c-aa47-4511-9fb9-061c6ddd615d tempest-TestInstancesWithCinderVolumes-793553421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc" returned: 0 in 0.398s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:52:26 devstack cinder-volume[86212]: DEBUG cinder.manager [None req-35715e0c-aa47-4511-9fb9-061c6ddd615d tempest-TestInstancesWithCinderVolumes-793553421 None] Notifying Schedulers of capabilities ... {{(pid=86212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 15:52:26 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-35715e0c-aa47-4511-9fb9-061c6ddd615d tempest-TestInstancesWithCinderVolumes-793553421 None] Deleted volume successfully. Sep 22 15:52:26 devstack cinder-volume[86212]: DEBUG cinder.quota [None req-2aa076f9-e69e-4589-a7aa-56af91592a93 tempest-CinderUnicodeTest-283431876 None] Created reservations ['89c0cae2-fb89-44cd-8f33-a1e5bbc509f0', '821cf478-9613-4ee7-91ea-9a1f642828c2', '00a71c1c-7fd9-4ffb-8fef-7d5d3407381b', '93be402f-ab09-4a2c-8fbc-4d9703e48bf2'] {{(pid=86212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 15:52:26 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-35715e0c-aa47-4511-9fb9-061c6ddd615d tempest-TestInstancesWithCinderVolumes-793553421 None] Lock "cinder-485d3f7a-f7bc-4cbc-a362-858f126f010e-delete_volume" released by "delete_volume" :: held 1.696s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:52:26 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-2aa076f9-e69e-4589-a7aa-56af91592a93 tempest-CinderUnicodeTest-283431876 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:52:26 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-2aa076f9-e69e-4589-a7aa-56af91592a93 tempest-CinderUnicodeTest-283431876 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:52:26 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-2aa076f9-e69e-4589-a7aa-56af91592a93 tempest-CinderUnicodeTest-283431876 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:52:26 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-2aa076f9-e69e-4589-a7aa-56af91592a93 tempest-CinderUnicodeTest-283431876 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:52:26 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-2aa076f9-e69e-4589-a7aa-56af91592a93 tempest-CinderUnicodeTest-283431876 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:52:26 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-2aa076f9-e69e-4589-a7aa-56af91592a93 tempest-CinderUnicodeTest-283431876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:52:26 devstack sudo[101000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc Sep 22 15:52:26 devstack sudo[101000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:52:26 devstack sudo[101000]: pam_unix(sudo:session): session closed for user root Sep 22 15:52:26 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-2aa076f9-e69e-4589-a7aa-56af91592a93 tempest-CinderUnicodeTest-283431876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc" returned: 0 in 0.266s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:52:26 devstack cinder-volume[86212]: DEBUG cinder.manager [None req-2aa076f9-e69e-4589-a7aa-56af91592a93 tempest-CinderUnicodeTest-283431876 None] Notifying Schedulers of capabilities ... {{(pid=86212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 15:52:26 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-2aa076f9-e69e-4589-a7aa-56af91592a93 tempest-CinderUnicodeTest-283431876 None] Deleted volume successfully. Sep 22 15:52:26 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-2aa076f9-e69e-4589-a7aa-56af91592a93 tempest-CinderUnicodeTest-283431876 None] Lock "cinder-ab913df3-6423-486f-9f02-0f4559655bbb-delete_volume" released by "delete_volume" :: held 1.509s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:52:36 devstack cinder-volume[86212]: DEBUG dbcounter [-] [86212] Writing DB stats cinder:SELECT=18,cinder:INSERT=5,cinder:UPDATE=28,cinder:DELETE=1 {{(pid=86212) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 22 15:52:36 devstack cinder-volume[86212]: DEBUG dbcounter [-] [86212] Writing DB stats cinder:SELECT=117,cinder:UPDATE=142,cinder:INSERT=40,cinder:DELETE=9 {{(pid=86212) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 22 15:52:38 devstack cinder-volume[86212]: DEBUG oslo_service.periodic_task [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86212) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 22 15:52:38 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:52:38 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:52:38 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:52:38 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:52:38 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:52:38 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:52:38 devstack sudo[101099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc Sep 22 15:52:38 devstack sudo[101099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:52:38 devstack sudo[101099]: pam_unix(sudo:session): session closed for user root Sep 22 15:52:38 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc" returned: 0 in 0.475s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:52:38 devstack cinder-volume[86212]: DEBUG cinder.manager [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] Notifying Schedulers of capabilities ... {{(pid=86212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 15:52:38 devstack cinder-volume[86212]: DEBUG oslo_service.periodic_task [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] Running periodic task VolumeManager._thread_info {{(pid=86212) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 22 15:52:38 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] thread count: 29 {{(pid=86212) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 22 15:52:38 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] thread info: [<_MainThread(MainThread, started 136163191222400)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86212) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 22 15:52:58 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [req-56f46391-2d39-4a90-b0fa-efb328c0aa7c req-7de61ffa-41d2-41bd-be11-b132d5172ee8 tempest-TestStampPattern-847195903 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:52:58 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [req-56f46391-2d39-4a90-b0fa-efb328c0aa7c req-7de61ffa-41d2-41bd-be11-b132d5172ee8 tempest-TestStampPattern-847195903 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:52:58 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [req-56f46391-2d39-4a90-b0fa-efb328c0aa7c req-7de61ffa-41d2-41bd-be11-b132d5172ee8 tempest-TestStampPattern-847195903 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:52:58 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [req-56f46391-2d39-4a90-b0fa-efb328c0aa7c req-7de61ffa-41d2-41bd-be11-b132d5172ee8 tempest-TestStampPattern-847195903 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31', 'name': 'volume-8d7da764-b91f-4c44-9d97-30dc4b0b94d0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2aa97c9f-b286-4c8a-aca6-447666d39049', 'enforce_multipath': True} {{(pid=86212) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 22 15:52:58 devstack cinder-volume[86212]: INFO cinder.volume.manager [req-56f46391-2d39-4a90-b0fa-efb328c0aa7c req-7de61ffa-41d2-41bd-be11-b132d5172ee8 tempest-TestStampPattern-847195903 None] attachment_update completed successfully. Sep 22 15:53:04 devstack cinder-volume[86212]: INFO cinder.volume.manager [req-51247f29-6102-474e-a753-6e1f34c3e9fc req-05d7a6b5-be17-4937-8566-b18f9e2228f4 tempest-TestStampPattern-847195903 None] Terminate volume connection completed successfully. Sep 22 15:53:04 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [req-51247f29-6102-474e-a753-6e1f34c3e9fc req-05d7a6b5-be17-4937-8566-b18f9e2228f4 tempest-TestStampPattern-847195903 None] Deleting attachment 2aa97c9f-b286-4c8a-aca6-447666d39049. {{(pid=86212) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 22 15:53:04 devstack cinder-volume[86212]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9d55f84-c05d-4963-90db-c2baf3deed2b tempest-TestShelveInstance-61784584 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 15:53:04 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-d9d55f84-c05d-4963-90db-c2baf3deed2b tempest-TestShelveInstance-61784584 None] Flow 'volume_create_manager' (7bbdc642-d410-422c-9028-7338c7bd2aaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:53:04 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-d9d55f84-c05d-4963-90db-c2baf3deed2b tempest-TestShelveInstance-61784584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf399b3d-125d-49b0-9333-ba6b5222013c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:53:04 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-d9d55f84-c05d-4963-90db-c2baf3deed2b tempest-TestShelveInstance-61784584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf399b3d-125d-49b0-9333-ba6b5222013c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:53:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1584402312',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5663054-b6ae-42b1-94d1-2f7b1ab62cb7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e596fb295c541288560495cac974a4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:53:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:53:05Z,use_quota=True,user_id='151f71459cc04c1782d2002ae463083e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:53:04 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-d9d55f84-c05d-4963-90db-c2baf3deed2b tempest-TestShelveInstance-61784584 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35083831-2572-4c5d-80c4-d4d8daa95eed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:53:04 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-d9d55f84-c05d-4963-90db-c2baf3deed2b tempest-TestShelveInstance-61784584 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35083831-2572-4c5d-80c4-d4d8daa95eed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:53:04 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-d9d55f84-c05d-4963-90db-c2baf3deed2b tempest-TestShelveInstance-61784584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d6bbb16-d11f-4cc8-b186-6c73f53b22ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:53:04 devstack cinder-volume[86212]: DEBUG cinder.image.glance [None req-d9d55f84-c05d-4963-90db-c2baf3deed2b tempest-TestShelveInstance-61784584 None] Creating Keystone auth plugin from conf {{(pid=86212) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 22 15:53:04 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-d9d55f84-c05d-4963-90db-c2baf3deed2b tempest-TestShelveInstance-61784584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d6bbb16-d11f-4cc8-b186-6c73f53b22ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f5663054-b6ae-42b1-94d1-2f7b1ab62cb7', 'volume_name': 'volume-f5663054-b6ae-42b1-94d1-2f7b1ab62cb7', 'volume_size': 1, 'image_id': '6995c6ae-03d1-45bf-bf55-00575d1858e8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6995c6ae-03d1-45bf-bf55-00575d1858e8', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '28219d994ba546ed905a95ed90257a43', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6995c6ae-03d1-45bf-bf55-00575d1858e8', 'created_at': datetime.datetime(2026, 9, 22, 13, 30, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 13, 30, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6995c6ae-03d1-45bf-bf55-00575d1858e8/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:53:04 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-d9d55f84-c05d-4963-90db-c2baf3deed2b tempest-TestShelveInstance-61784584 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf0f0ad0-530f-4510-a6d9-e047fa864e03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:53:04 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-d9d55f84-c05d-4963-90db-c2baf3deed2b tempest-TestShelveInstance-61784584 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf0f0ad0-530f-4510-a6d9-e047fa864e03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:53:04 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-d9d55f84-c05d-4963-90db-c2baf3deed2b tempest-TestShelveInstance-61784584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c81c0882-4661-416a-8f81-9fa02a67e6b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:53:04 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-d9d55f84-c05d-4963-90db-c2baf3deed2b tempest-TestShelveInstance-61784584 None] Volume f5663054-b6ae-42b1-94d1-2f7b1ab62cb7: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f5663054-b6ae-42b1-94d1-2f7b1ab62cb7', 'volume_size': 1, 'image_id': '6995c6ae-03d1-45bf-bf55-00575d1858e8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6995c6ae-03d1-45bf-bf55-00575d1858e8', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '28219d994ba546ed905a95ed90257a43', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6995c6ae-03d1-45bf-bf55-00575d1858e8', 'created_at': datetime.datetime(2026, 9, 22, 13, 30, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 13, 30, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6995c6ae-03d1-45bf-bf55-00575d1858e8/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 22 15:53:04 devstack cinder-volume[86212]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9d55f84-c05d-4963-90db-c2baf3deed2b tempest-TestShelveInstance-61784584 None] Trying to clone f5663054-b6ae-42b1-94d1-2f7b1ab62cb7 from image 6995c6ae-03d1-45bf-bf55-00575d1858e8 at location (None, [{'url': 'file:///opt/stack/data/glance/images/6995c6ae-03d1-45bf-bf55-00575d1858e8', 'metadata': {}}]). {{(pid=86212) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 22 15:53:05 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-ace32fed-d9e1-46e4-b292-a92a87e44494 tempest-TestStampPattern-847195903 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:53:05 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-ace32fed-d9e1-46e4-b292-a92a87e44494 tempest-TestStampPattern-847195903 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:53:05 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-ace32fed-d9e1-46e4-b292-a92a87e44494 tempest-TestStampPattern-847195903 None] Creating offline snapshot 68e7033c-807d-4060-8162-0c37ad207056 of volume 8d7da764-b91f-4c44-9d97-30dc4b0b94d0 {{(pid=86212) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 22 15:53:05 devstack cinder-volume[86212]: DEBUG cinder.image.image_utils [None req-d9d55f84-c05d-4963-90db-c2baf3deed2b tempest-TestShelveInstance-61784584 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_6995c6ae-03d1-45bf-bf55-00575d1858e8_ubrxwzqpdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86212) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 22 15:53:05 devstack cinder-volume[86212]: INFO cinder.image.image_utils [None req-d9d55f84-c05d-4963-90db-c2baf3deed2b tempest-TestShelveInstance-61784584 None] Image download 20.69 MB at 20.69 MB/s Sep 22 15:53:05 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[886cabc2-8392-4cd9-9f08-7f0490383c02]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:53:05 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-ace32fed-d9e1-46e4-b292-a92a87e44494 tempest-TestStampPattern-847195903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8d7da764-b91f-4c44-9d97-30dc4b0b94d0 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:53:05 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[6afe7078-32fd-4eab-a8b1-d32d932d01b6]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:53:05 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-d9d55f84-c05d-4963-90db-c2baf3deed2b tempest-TestShelveInstance-61784584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6995c6ae-03d1-45bf-bf55-00575d1858e8_ubrxwzqpdevstack@QuobyteHD {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:53:05 devstack sudo[101650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8d7da764-b91f-4c44-9d97-30dc4b0b94d0 Sep 22 15:53:05 devstack sudo[101650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:53:05 devstack sudo[101651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6995c6ae-03d1-45bf-bf55-00575d1858e8_ubrxwzqpdevstack@QuobyteHD Sep 22 15:53:05 devstack sudo[101651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:53:05 devstack sudo[101651]: pam_unix(sudo:session): session closed for user root Sep 22 15:53:05 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-d9d55f84-c05d-4963-90db-c2baf3deed2b tempest-TestShelveInstance-61784584 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6995c6ae-03d1-45bf-bf55-00575d1858e8_ubrxwzqpdevstack@QuobyteHD" returned: 0 in 0.344s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:53:05 devstack cinder-volume[86212]: DEBUG cinder.image.image_utils [None req-d9d55f84-c05d-4963-90db-c2baf3deed2b tempest-TestShelveInstance-61784584 None] Temporary image 6995c6ae-03d1-45bf-bf55-00575d1858e8 is fetched for user 151f71459cc04c1782d2002ae463083e. {{(pid=86212) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 22 15:53:05 devstack sudo[101650]: pam_unix(sudo:session): session closed for user root Sep 22 15:53:05 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-ace32fed-d9e1-46e4-b292-a92a87e44494 tempest-TestStampPattern-847195903 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8d7da764-b91f-4c44-9d97-30dc4b0b94d0" returned: 0 in 0.413s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:53:05 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-ace32fed-d9e1-46e4-b292-a92a87e44494 tempest-TestStampPattern-847195903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8d7da764-b91f-4c44-9d97-30dc4b0b94d0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8d7da764-b91f-4c44-9d97-30dc4b0b94d0.68e7033c-807d-4060-8162-0c37ad207056 1G {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:53:05 devstack sudo[101660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8d7da764-b91f-4c44-9d97-30dc4b0b94d0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8d7da764-b91f-4c44-9d97-30dc4b0b94d0.68e7033c-807d-4060-8162-0c37ad207056 1G Sep 22 15:53:05 devstack sudo[101660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:53:05 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[06c7c79d-31fd-4c0c-961e-a5f1497ce24d]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:53:05 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-d9d55f84-c05d-4963-90db-c2baf3deed2b tempest-TestShelveInstance-61784584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6995c6ae-03d1-45bf-bf55-00575d1858e8_ubrxwzqpdevstack@QuobyteHD {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:53:05 devstack sudo[101662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6995c6ae-03d1-45bf-bf55-00575d1858e8_ubrxwzqpdevstack@QuobyteHD Sep 22 15:53:05 devstack sudo[101662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:53:06 devstack sudo[101660]: pam_unix(sudo:session): session closed for user root Sep 22 15:53:06 devstack sudo[101662]: pam_unix(sudo:session): session closed for user root Sep 22 15:53:06 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-ace32fed-d9e1-46e4-b292-a92a87e44494 tempest-TestStampPattern-847195903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8d7da764-b91f-4c44-9d97-30dc4b0b94d0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8d7da764-b91f-4c44-9d97-30dc4b0b94d0.68e7033c-807d-4060-8162-0c37ad207056 1G" returned: 0 in 0.404s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:53:06 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-ace32fed-d9e1-46e4-b292-a92a87e44494 tempest-TestStampPattern-847195903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8d7da764-b91f-4c44-9d97-30dc4b0b94d0 -F qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8d7da764-b91f-4c44-9d97-30dc4b0b94d0.68e7033c-807d-4060-8162-0c37ad207056 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:53:06 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-d9d55f84-c05d-4963-90db-c2baf3deed2b tempest-TestShelveInstance-61784584 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6995c6ae-03d1-45bf-bf55-00575d1858e8_ubrxwzqpdevstack@QuobyteHD" returned: 0 in 0.353s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:53:06 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-d9d55f84-c05d-4963-90db-c2baf3deed2b tempest-TestShelveInstance-61784584 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:53:06 devstack sudo[101670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8d7da764-b91f-4c44-9d97-30dc4b0b94d0 -F qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8d7da764-b91f-4c44-9d97-30dc4b0b94d0.68e7033c-807d-4060-8162-0c37ad207056 Sep 22 15:53:06 devstack sudo[101670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:53:06 devstack sudo[101670]: pam_unix(sudo:session): session closed for user root Sep 22 15:53:06 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-ace32fed-d9e1-46e4-b292-a92a87e44494 tempest-TestStampPattern-847195903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8d7da764-b91f-4c44-9d97-30dc4b0b94d0 -F qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8d7da764-b91f-4c44-9d97-30dc4b0b94d0.68e7033c-807d-4060-8162-0c37ad207056" returned: 0 in 0.282s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:53:06 devstack cinder-volume[86212]: WARNING cinder.volume.drivers.remotefs [None req-ace32fed-d9e1-46e4-b292-a92a87e44494 tempest-TestStampPattern-847195903 None] /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8d7da764-b91f-4c44-9d97-30dc4b0b94d0.68e7033c-807d-4060-8162-0c37ad207056 is being set with open permissions: ugo+rw Sep 22 15:53:06 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-ace32fed-d9e1-46e4-b292-a92a87e44494 tempest-TestStampPattern-847195903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8d7da764-b91f-4c44-9d97-30dc4b0b94d0.68e7033c-807d-4060-8162-0c37ad207056 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:53:06 devstack sudo[101676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8d7da764-b91f-4c44-9d97-30dc4b0b94d0.68e7033c-807d-4060-8162-0c37ad207056 Sep 22 15:53:06 devstack sudo[101676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:53:06 devstack sudo[101676]: pam_unix(sudo:session): session closed for user root Sep 22 15:53:06 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-ace32fed-d9e1-46e4-b292-a92a87e44494 tempest-TestStampPattern-847195903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8d7da764-b91f-4c44-9d97-30dc4b0b94d0.68e7033c-807d-4060-8162-0c37ad207056" returned: 0 in 0.244s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:53:06 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-ace32fed-d9e1-46e4-b292-a92a87e44494 tempest-TestStampPattern-847195903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8d7da764-b91f-4c44-9d97-30dc4b0b94d0.info {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:53:06 devstack sudo[101679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8d7da764-b91f-4c44-9d97-30dc4b0b94d0.info Sep 22 15:53:06 devstack sudo[101679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:53:06 devstack sudo[101679]: pam_unix(sudo:session): session closed for user root Sep 22 15:53:06 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-ace32fed-d9e1-46e4-b292-a92a87e44494 tempest-TestStampPattern-847195903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8d7da764-b91f-4c44-9d97-30dc4b0b94d0.info" returned: 0 in 0.250s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:53:06 devstack cinder-volume[86212]: WARNING cinder.volume.drivers.remotefs [None req-ace32fed-d9e1-46e4-b292-a92a87e44494 tempest-TestStampPattern-847195903 None] /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8d7da764-b91f-4c44-9d97-30dc4b0b94d0.info is being set with open permissions: ugo+rw Sep 22 15:53:06 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-ace32fed-d9e1-46e4-b292-a92a87e44494 tempest-TestStampPattern-847195903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8d7da764-b91f-4c44-9d97-30dc4b0b94d0.info {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:53:06 devstack sudo[101682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8d7da764-b91f-4c44-9d97-30dc4b0b94d0.info Sep 22 15:53:06 devstack sudo[101682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:53:07 devstack sudo[101682]: pam_unix(sudo:session): session closed for user root Sep 22 15:53:07 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-ace32fed-d9e1-46e4-b292-a92a87e44494 tempest-TestStampPattern-847195903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8d7da764-b91f-4c44-9d97-30dc4b0b94d0.info" returned: 0 in 0.242s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:53:07 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-ace32fed-d9e1-46e4-b292-a92a87e44494 tempest-TestStampPattern-847195903 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.968s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:53:07 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-d9d55f84-c05d-4963-90db-c2baf3deed2b tempest-TestShelveInstance-61784584 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.062s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:53:07 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-d9d55f84-c05d-4963-90db-c2baf3deed2b tempest-TestShelveInstance-61784584 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:53:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1584402312',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5663054-b6ae-42b1-94d1-2f7b1ab62cb7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e596fb295c541288560495cac974a4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:53:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:53:05Z,use_quota=True,user_id='151f71459cc04c1782d2002ae463083e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)}" {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 15:53:07 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-d9d55f84-c05d-4963-90db-c2baf3deed2b tempest-TestShelveInstance-61784584 None] Creating volume f5663054-b6ae-42b1-94d1-2f7b1ab62cb7 {{(pid=86212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 15:53:07 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-d9d55f84-c05d-4963-90db-c2baf3deed2b tempest-TestShelveInstance-61784584 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:53:07 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-d9d55f84-c05d-4963-90db-c2baf3deed2b tempest-TestShelveInstance-61784584 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:53:07 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-d9d55f84-c05d-4963-90db-c2baf3deed2b tempest-TestShelveInstance-61784584 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:53:07 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-d9d55f84-c05d-4963-90db-c2baf3deed2b tempest-TestShelveInstance-61784584 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:53:07 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-d9d55f84-c05d-4963-90db-c2baf3deed2b tempest-TestShelveInstance-61784584 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:53:07 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-d9d55f84-c05d-4963-90db-c2baf3deed2b tempest-TestShelveInstance-61784584 None] Selected osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 as target Quobyte volume. {{(pid=86212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 15:53:07 devstack cinder-volume[86212]: INFO cinder.volume.drivers.remotefs [None req-d9d55f84-c05d-4963-90db-c2baf3deed2b tempest-TestShelveInstance-61784584 None] casted to osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 Sep 22 15:53:07 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-d9d55f84-c05d-4963-90db-c2baf3deed2b tempest-TestShelveInstance-61784584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-f5663054-b6ae-42b1-94d1-2f7b1ab62cb7 1073741824 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:53:07 devstack sudo[101685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-f5663054-b6ae-42b1-94d1-2f7b1ab62cb7 1073741824 Sep 22 15:53:07 devstack sudo[101685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:53:07 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-ace32fed-d9e1-46e4-b292-a92a87e44494 tempest-TestStampPattern-847195903 None] Create snapshot completed successfully Sep 22 15:53:07 devstack sudo[101685]: pam_unix(sudo:session): session closed for user root Sep 22 15:53:07 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-d9d55f84-c05d-4963-90db-c2baf3deed2b tempest-TestShelveInstance-61784584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-f5663054-b6ae-42b1-94d1-2f7b1ab62cb7 1073741824" returned: 0 in 0.416s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:53:07 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-d9d55f84-c05d-4963-90db-c2baf3deed2b tempest-TestShelveInstance-61784584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-f5663054-b6ae-42b1-94d1-2f7b1ab62cb7 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:53:07 devstack sudo[101691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-f5663054-b6ae-42b1-94d1-2f7b1ab62cb7 Sep 22 15:53:07 devstack sudo[101691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:53:07 devstack sudo[101691]: pam_unix(sudo:session): session closed for user root Sep 22 15:53:07 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-d9d55f84-c05d-4963-90db-c2baf3deed2b tempest-TestShelveInstance-61784584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-f5663054-b6ae-42b1-94d1-2f7b1ab62cb7" returned: 0 in 0.261s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:53:07 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-d9d55f84-c05d-4963-90db-c2baf3deed2b tempest-TestShelveInstance-61784584 None] <== create_volume: return (718ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'} {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 15:53:07 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-d9d55f84-c05d-4963-90db-c2baf3deed2b tempest-TestShelveInstance-61784584 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.722s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:53:07 devstack cinder-volume[86212]: DEBUG cinder.volume.volume_utils [None req-d9d55f84-c05d-4963-90db-c2baf3deed2b tempest-TestShelveInstance-61784584 None] Attempting download of 6995c6ae-03d1-45bf-bf55-00575d1858e8 ((None, [{'url': 'file:///opt/stack/data/glance/images/6995c6ae-03d1-45bf-bf55-00575d1858e8', 'metadata': {}}])) to volume f5663054-b6ae-42b1-94d1-2f7b1ab62cb7. {{(pid=86212) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 22 15:53:08 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[44acf88a-d7be-4a5d-9cef-c1e22c721564]: (4, 'raw') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:53:08 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-d9d55f84-c05d-4963-90db-c2baf3deed2b tempest-TestShelveInstance-61784584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6995c6ae-03d1-45bf-bf55-00575d1858e8_iyk7dpfh {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:53:08 devstack sudo[101695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6995c6ae-03d1-45bf-bf55-00575d1858e8_iyk7dpfh Sep 22 15:53:08 devstack sudo[101695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:53:08 devstack sudo[101695]: pam_unix(sudo:session): session closed for user root Sep 22 15:53:08 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-d9d55f84-c05d-4963-90db-c2baf3deed2b tempest-TestShelveInstance-61784584 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6995c6ae-03d1-45bf-bf55-00575d1858e8_iyk7dpfh" returned: 0 in 0.330s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:53:08 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-d9d55f84-c05d-4963-90db-c2baf3deed2b tempest-TestShelveInstance-61784584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6995c6ae-03d1-45bf-bf55-00575d1858e8_iyk7dpfh {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:53:08 devstack sudo[101699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6995c6ae-03d1-45bf-bf55-00575d1858e8_iyk7dpfh Sep 22 15:53:08 devstack sudo[101699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:53:08 devstack sudo[101699]: pam_unix(sudo:session): session closed for user root Sep 22 15:53:08 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-d9d55f84-c05d-4963-90db-c2baf3deed2b tempest-TestShelveInstance-61784584 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6995c6ae-03d1-45bf-bf55-00575d1858e8_iyk7dpfh" returned: 1 in 0.334s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:53:08 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-d9d55f84-c05d-4963-90db-c2baf3deed2b tempest-TestShelveInstance-61784584 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6995c6ae-03d1-45bf-bf55-00575d1858e8_iyk7dpfh' failed. Not Retrying. {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 22 15:53:08 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b08c453-6087-4a61-8410-742f7300d127]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:53:08 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-d9d55f84-c05d-4963-90db-c2baf3deed2b tempest-TestShelveInstance-61784584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6995c6ae-03d1-45bf-bf55-00575d1858e8_ubrxwzqpdevstack@QuobyteHD {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:53:08 devstack sudo[101703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6995c6ae-03d1-45bf-bf55-00575d1858e8_ubrxwzqpdevstack@QuobyteHD Sep 22 15:53:08 devstack sudo[101703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:53:09 devstack sudo[101703]: pam_unix(sudo:session): session closed for user root Sep 22 15:53:09 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-d9d55f84-c05d-4963-90db-c2baf3deed2b tempest-TestShelveInstance-61784584 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6995c6ae-03d1-45bf-bf55-00575d1858e8_ubrxwzqpdevstack@QuobyteHD" returned: 0 in 0.332s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:53:09 devstack cinder-volume[86212]: DEBUG cinder.image.image_utils [None req-d9d55f84-c05d-4963-90db-c2baf3deed2b tempest-TestShelveInstance-61784584 None] 6995c6ae-03d1-45bf-bf55-00575d1858e8 was qcow2, converting to qcow2 {{(pid=86212) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 22 15:53:09 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-d9d55f84-c05d-4963-90db-c2baf3deed2b tempest-TestShelveInstance-61784584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6995c6ae-03d1-45bf-bf55-00575d1858e8_ubrxwzqpdevstack@QuobyteHD /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-f5663054-b6ae-42b1-94d1-2f7b1ab62cb7 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:53:09 devstack sudo[101708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6995c6ae-03d1-45bf-bf55-00575d1858e8_ubrxwzqpdevstack@QuobyteHD /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-f5663054-b6ae-42b1-94d1-2f7b1ab62cb7 Sep 22 15:53:09 devstack sudo[101708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:53:11 devstack sudo[101708]: pam_unix(sudo:session): session closed for user root Sep 22 15:53:11 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-d9d55f84-c05d-4963-90db-c2baf3deed2b tempest-TestShelveInstance-61784584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6995c6ae-03d1-45bf-bf55-00575d1858e8_ubrxwzqpdevstack@QuobyteHD /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-f5663054-b6ae-42b1-94d1-2f7b1ab62cb7" returned: 0 in 1.968s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:53:11 devstack cinder-volume[86212]: DEBUG cinder.image.image_utils [None req-d9d55f84-c05d-4963-90db-c2baf3deed2b tempest-TestShelveInstance-61784584 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_6995c6ae-03d1-45bf-bf55-00575d1858e8_ubrxwzqpdevstack@QuobyteHD, size 112.00 MB, duration 1.97 sec, destination /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-f5663054-b6ae-42b1-94d1-2f7b1ab62cb7 {{(pid=86212) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 22 15:53:11 devstack cinder-volume[86212]: INFO cinder.image.image_utils [None req-d9d55f84-c05d-4963-90db-c2baf3deed2b tempest-TestShelveInstance-61784584 None] Converted 112.00 MB image at 56.86 MB/s Sep 22 15:53:11 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-d9d55f84-c05d-4963-90db-c2baf3deed2b tempest-TestShelveInstance-61784584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-f5663054-b6ae-42b1-94d1-2f7b1ab62cb7 1G {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:53:11 devstack sudo[101740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-f5663054-b6ae-42b1-94d1-2f7b1ab62cb7 1G Sep 22 15:53:11 devstack sudo[101740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:53:11 devstack sudo[101740]: pam_unix(sudo:session): session closed for user root Sep 22 15:53:11 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-d9d55f84-c05d-4963-90db-c2baf3deed2b tempest-TestShelveInstance-61784584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-f5663054-b6ae-42b1-94d1-2f7b1ab62cb7 1G" returned: 0 in 0.351s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:53:11 devstack cinder-volume[86212]: DEBUG cinder.volume.volume_utils [None req-d9d55f84-c05d-4963-90db-c2baf3deed2b tempest-TestShelveInstance-61784584 None] Downloaded image 6995c6ae-03d1-45bf-bf55-00575d1858e8 ((None, [{'url': 'file:///opt/stack/data/glance/images/6995c6ae-03d1-45bf-bf55-00575d1858e8', 'metadata': {}}])) to volume f5663054-b6ae-42b1-94d1-2f7b1ab62cb7 successfully. {{(pid=86212) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 22 15:53:11 devstack cinder-volume[86212]: DEBUG cinder.image.image_utils [None req-d9d55f84-c05d-4963-90db-c2baf3deed2b tempest-TestShelveInstance-61784584 None] Temporary image 6995c6ae-03d1-45bf-bf55-00575d1858e8 for user 151f71459cc04c1782d2002ae463083e is deleted. {{(pid=86212) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 22 15:53:11 devstack cinder-volume[86212]: DEBUG cinder.volume.volume_utils [None req-d9d55f84-c05d-4963-90db-c2baf3deed2b tempest-TestShelveInstance-61784584 None] Marking volume f5663054-b6ae-42b1-94d1-2f7b1ab62cb7 as bootable. {{(pid=86212) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 22 15:53:11 devstack cinder-volume[86212]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9d55f84-c05d-4963-90db-c2baf3deed2b tempest-TestShelveInstance-61784584 None] Copying metadata from image 6995c6ae-03d1-45bf-bf55-00575d1858e8 to f5663054-b6ae-42b1-94d1-2f7b1ab62cb7. {{(pid=86212) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 22 15:53:11 devstack cinder-volume[86212]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9d55f84-c05d-4963-90db-c2baf3deed2b tempest-TestShelveInstance-61784584 None] Creating volume glance metadata for volume f5663054-b6ae-42b1-94d1-2f7b1ab62cb7 backed by image 6995c6ae-03d1-45bf-bf55-00575d1858e8 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '6995c6ae-03d1-45bf-bf55-00575d1858e8', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86212) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 22 15:53:11 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-d9d55f84-c05d-4963-90db-c2baf3deed2b tempest-TestShelveInstance-61784584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c81c0882-4661-416a-8f81-9fa02a67e6b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f5663054-b6ae-42b1-94d1-2f7b1ab62cb7', 'volume_size': 1, 'image_id': '6995c6ae-03d1-45bf-bf55-00575d1858e8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6995c6ae-03d1-45bf-bf55-00575d1858e8', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '28219d994ba546ed905a95ed90257a43', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6995c6ae-03d1-45bf-bf55-00575d1858e8', 'created_at': datetime.datetime(2026, 9, 22, 13, 30, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 13, 30, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6995c6ae-03d1-45bf-bf55-00575d1858e8/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:53:11 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-d9d55f84-c05d-4963-90db-c2baf3deed2b tempest-TestShelveInstance-61784584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4a1b117-2b09-4aa1-98aa-6e1f1e7203e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:53:11 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-d9d55f84-c05d-4963-90db-c2baf3deed2b tempest-TestShelveInstance-61784584 None] Volume volume-f5663054-b6ae-42b1-94d1-2f7b1ab62cb7 (f5663054-b6ae-42b1-94d1-2f7b1ab62cb7): created successfully Sep 22 15:53:11 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-d9d55f84-c05d-4963-90db-c2baf3deed2b tempest-TestShelveInstance-61784584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4a1b117-2b09-4aa1-98aa-6e1f1e7203e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:53:11 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-d9d55f84-c05d-4963-90db-c2baf3deed2b tempest-TestShelveInstance-61784584 None] Flow 'volume_create_manager' (7bbdc642-d410-422c-9028-7338c7bd2aaa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:53:11 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-d9d55f84-c05d-4963-90db-c2baf3deed2b tempest-TestShelveInstance-61784584 None] Created volume successfully. Sep 22 15:53:14 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [req-0c1c0775-404a-4d50-888d-71565a885fe2 req-c595aaf5-c575-4f89-984e-93293fc248d2 tempest-TestShelveInstance-61784584 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:53:14 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [req-0c1c0775-404a-4d50-888d-71565a885fe2 req-c595aaf5-c575-4f89-984e-93293fc248d2 tempest-TestShelveInstance-61784584 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:53:14 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [req-0c1c0775-404a-4d50-888d-71565a885fe2 req-c595aaf5-c575-4f89-984e-93293fc248d2 tempest-TestShelveInstance-61784584 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.030s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:53:14 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [req-0c1c0775-404a-4d50-888d-71565a885fe2 req-c595aaf5-c575-4f89-984e-93293fc248d2 tempest-TestShelveInstance-61784584 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31', 'name': 'volume-f5663054-b6ae-42b1-94d1-2f7b1ab62cb7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0eac3c21-94b3-4e71-828d-bc3684108377', 'enforce_multipath': True} {{(pid=86212) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 22 15:53:14 devstack cinder-volume[86212]: INFO cinder.volume.manager [req-0c1c0775-404a-4d50-888d-71565a885fe2 req-c595aaf5-c575-4f89-984e-93293fc248d2 tempest-TestShelveInstance-61784584 None] attachment_update completed successfully. Sep 22 15:53:15 devstack cinder-volume[86212]: DEBUG cinder.volume.flows.manager.create_volume [None req-682b6074-ec30-4c06-923e-7c9fb6e5bf86 tempest-TestStampPattern-847195903 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 15:53:15 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-682b6074-ec30-4c06-923e-7c9fb6e5bf86 tempest-TestStampPattern-847195903 None] Flow 'volume_create_manager' (04ff73ed-02ed-4c27-8f18-bdfd8d38c93e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:53:15 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-682b6074-ec30-4c06-923e-7c9fb6e5bf86 tempest-TestStampPattern-847195903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (268171f8-ba80-4080-864b-fd36fbf85715) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:53:15 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-682b6074-ec30-4c06-923e-7c9fb6e5bf86 tempest-TestStampPattern-847195903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (268171f8-ba80-4080-864b-fd36fbf85715) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:53:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1127831495',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4dc6d16-0d4a-4272-aa4a-442671412b41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='549a7d6b228d429fb842bb6fdbe05541',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:53:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=68e7033c-807d-4060-8162-0c37ad207056,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:53:15Z,use_quota=True,user_id='e49de96255ae4eaf815a4f28a2169394',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:53:15 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-682b6074-ec30-4c06-923e-7c9fb6e5bf86 tempest-TestStampPattern-847195903 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (082c7ee0-ff49-42d2-86db-e20561a7b233) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:53:15 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-682b6074-ec30-4c06-923e-7c9fb6e5bf86 tempest-TestStampPattern-847195903 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (082c7ee0-ff49-42d2-86db-e20561a7b233) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:53:15 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-682b6074-ec30-4c06-923e-7c9fb6e5bf86 tempest-TestStampPattern-847195903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a8dc28c-606a-423f-8c5f-4d7cacfad688) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:53:15 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-682b6074-ec30-4c06-923e-7c9fb6e5bf86 tempest-TestStampPattern-847195903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a8dc28c-606a-423f-8c5f-4d7cacfad688) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'd4dc6d16-0d4a-4272-aa4a-442671412b41', 'volume_name': 'volume-d4dc6d16-0d4a-4272-aa4a-442671412b41', 'volume_size': 1, 'snapshot_id': '68e7033c-807d-4060-8162-0c37ad207056'}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:53:15 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-682b6074-ec30-4c06-923e-7c9fb6e5bf86 tempest-TestStampPattern-847195903 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a35d49e-4471-48db-b0b2-16f42b2ab1f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:53:15 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-682b6074-ec30-4c06-923e-7c9fb6e5bf86 tempest-TestStampPattern-847195903 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a35d49e-4471-48db-b0b2-16f42b2ab1f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:53:15 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-682b6074-ec30-4c06-923e-7c9fb6e5bf86 tempest-TestStampPattern-847195903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (857d65a9-6f08-485c-9b9d-97ae03bc0ba1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:53:15 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-682b6074-ec30-4c06-923e-7c9fb6e5bf86 tempest-TestStampPattern-847195903 None] Volume d4dc6d16-0d4a-4272-aa4a-442671412b41: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-d4dc6d16-0d4a-4272-aa4a-442671412b41', 'volume_size': 1, 'snapshot_id': '68e7033c-807d-4060-8162-0c37ad207056'} Sep 22 15:53:15 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-682b6074-ec30-4c06-923e-7c9fb6e5bf86 tempest-TestStampPattern-847195903 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:53:15 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-682b6074-ec30-4c06-923e-7c9fb6e5bf86 tempest-TestStampPattern-847195903 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:53:15 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-682b6074-ec30-4c06-923e-7c9fb6e5bf86 tempest-TestStampPattern-847195903 None] Acquiring lock "cinder-quobyte-68e7033c-807d-4060-8162-0c37ad207056-d4dc6d16-0d4a-4272-aa4a-442671412b41" by "_create_volume_from_snapshot" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:53:15 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-682b6074-ec30-4c06-923e-7c9fb6e5bf86 tempest-TestStampPattern-847195903 None] Lock "cinder-quobyte-68e7033c-807d-4060-8162-0c37ad207056-d4dc6d16-0d4a-4272-aa4a-442671412b41" acquired by "_create_volume_from_snapshot" :: waited 0.022s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:53:15 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-682b6074-ec30-4c06-923e-7c9fb6e5bf86 tempest-TestStampPattern-847195903 None] Creating volume d4dc6d16-0d4a-4272-aa4a-442671412b41 from snapshot 68e7033c-807d-4060-8162-0c37ad207056 {{(pid=86212) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 22 15:53:15 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-682b6074-ec30-4c06-923e-7c9fb6e5bf86 tempest-TestStampPattern-847195903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:53:15 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-682b6074-ec30-4c06-923e-7c9fb6e5bf86 tempest-TestStampPattern-847195903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:53:15 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-682b6074-ec30-4c06-923e-7c9fb6e5bf86 tempest-TestStampPattern-847195903 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:53:15 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-682b6074-ec30-4c06-923e-7c9fb6e5bf86 tempest-TestStampPattern-847195903 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:53:15 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-682b6074-ec30-4c06-923e-7c9fb6e5bf86 tempest-TestStampPattern-847195903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:53:15 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-682b6074-ec30-4c06-923e-7c9fb6e5bf86 tempest-TestStampPattern-847195903 None] Selected osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 as target Quobyte volume. {{(pid=86212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 15:53:15 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-682b6074-ec30-4c06-923e-7c9fb6e5bf86 tempest-TestStampPattern-847195903 None] Acquiring lock "cinder-quobyte-d4dc6d16-0d4a-4272-aa4a-442671412b41" by "_copy_volume_from_snapshot" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:53:15 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-682b6074-ec30-4c06-923e-7c9fb6e5bf86 tempest-TestStampPattern-847195903 None] Lock "cinder-quobyte-d4dc6d16-0d4a-4272-aa4a-442671412b41" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:53:15 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-682b6074-ec30-4c06-923e-7c9fb6e5bf86 tempest-TestStampPattern-847195903 None] snapshot: 68e7033c-807d-4060-8162-0c37ad207056, volume: d4dc6d16-0d4a-4272-aa4a-442671412b41, {{(pid=86212) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 22 15:53:15 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-682b6074-ec30-4c06-923e-7c9fb6e5bf86 tempest-TestStampPattern-847195903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:53:15 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-682b6074-ec30-4c06-923e-7c9fb6e5bf86 tempest-TestStampPattern-847195903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:53:15 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-682b6074-ec30-4c06-923e-7c9fb6e5bf86 tempest-TestStampPattern-847195903 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:53:15 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-682b6074-ec30-4c06-923e-7c9fb6e5bf86 tempest-TestStampPattern-847195903 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:53:15 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-682b6074-ec30-4c06-923e-7c9fb6e5bf86 tempest-TestStampPattern-847195903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:53:15 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[f25199d3-7525-4a40-953e-03b59d18b918]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:53:15 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-682b6074-ec30-4c06-923e-7c9fb6e5bf86 tempest-TestStampPattern-847195903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8d7da764-b91f-4c44-9d97-30dc4b0b94d0.68e7033c-807d-4060-8162-0c37ad207056 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:53:15 devstack sudo[101757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8d7da764-b91f-4c44-9d97-30dc4b0b94d0.68e7033c-807d-4060-8162-0c37ad207056 Sep 22 15:53:15 devstack sudo[101757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:53:15 devstack sudo[101757]: pam_unix(sudo:session): session closed for user root Sep 22 15:53:15 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-682b6074-ec30-4c06-923e-7c9fb6e5bf86 tempest-TestStampPattern-847195903 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8d7da764-b91f-4c44-9d97-30dc4b0b94d0.68e7033c-807d-4060-8162-0c37ad207056" returned: 0 in 0.406s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:53:15 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-682b6074-ec30-4c06-923e-7c9fb6e5bf86 tempest-TestStampPattern-847195903 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8d7da764-b91f-4c44-9d97-30dc4b0b94d0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86212) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 22 15:53:16 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d0a9039-1612-4ebd-9044-0c0d1846ad26]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:53:16 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-682b6074-ec30-4c06-923e-7c9fb6e5bf86 tempest-TestStampPattern-847195903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8d7da764-b91f-4c44-9d97-30dc4b0b94d0 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:53:16 devstack sudo[101762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8d7da764-b91f-4c44-9d97-30dc4b0b94d0 Sep 22 15:53:16 devstack sudo[101762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:53:16 devstack sudo[101762]: pam_unix(sudo:session): session closed for user root Sep 22 15:53:16 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-682b6074-ec30-4c06-923e-7c9fb6e5bf86 tempest-TestStampPattern-847195903 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8d7da764-b91f-4c44-9d97-30dc4b0b94d0" returned: 0 in 0.431s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:53:16 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-682b6074-ec30-4c06-923e-7c9fb6e5bf86 tempest-TestStampPattern-847195903 None] will copy from snapshot at /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8d7da764-b91f-4c44-9d97-30dc4b0b94d0 {{(pid=86212) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 22 15:53:16 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-682b6074-ec30-4c06-923e-7c9fb6e5bf86 tempest-TestStampPattern-847195903 None] Creating direct copy from snapshot {{(pid=86212) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 22 15:53:16 devstack cinder-volume[86212]: DEBUG cinder.utils [None req-682b6074-ec30-4c06-923e-7c9fb6e5bf86 tempest-TestStampPattern-847195903 None] Path /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-d4dc6d16-0d4a-4272-aa4a-442671412b41 not found in is_blk_device check {{(pid=86212) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 22 15:53:16 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-682b6074-ec30-4c06-923e-7c9fb6e5bf86 tempest-TestStampPattern-847195903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8d7da764-b91f-4c44-9d97-30dc4b0b94d0 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-d4dc6d16-0d4a-4272-aa4a-442671412b41 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:53:16 devstack sudo[101770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8d7da764-b91f-4c44-9d97-30dc4b0b94d0 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-d4dc6d16-0d4a-4272-aa4a-442671412b41 Sep 22 15:53:16 devstack sudo[101770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:53:25 devstack cinder-volume[86212]: DEBUG dbcounter [-] [86212] Writing DB stats cinder:SELECT=32,cinder:UPDATE=11,cinder:INSERT=4,cinder:DELETE=1 {{(pid=86212) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 22 15:53:25 devstack cinder-volume[86212]: DEBUG dbcounter [-] [86212] Writing DB stats cinder:SELECT=26,cinder:UPDATE=8,cinder:INSERT=11,cinder:DELETE=1 {{(pid=86212) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 22 15:53:28 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-682b6074-ec30-4c06-923e-7c9fb6e5bf86 tempest-TestStampPattern-847195903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8d7da764-b91f-4c44-9d97-30dc4b0b94d0 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-d4dc6d16-0d4a-4272-aa4a-442671412b41" returned: 0 in 12.512s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:53:28 devstack cinder-volume[86212]: DEBUG cinder.image.image_utils [None req-682b6074-ec30-4c06-923e-7c9fb6e5bf86 tempest-TestStampPattern-847195903 None] Image conversion details: src /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8d7da764-b91f-4c44-9d97-30dc4b0b94d0, size 1024.00 MB, duration 12.51 sec, destination /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-d4dc6d16-0d4a-4272-aa4a-442671412b41 {{(pid=86212) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 22 15:53:28 devstack cinder-volume[86212]: INFO cinder.image.image_utils [None req-682b6074-ec30-4c06-923e-7c9fb6e5bf86 tempest-TestStampPattern-847195903 None] Converted 1024.00 MB image at 81.84 MB/s Sep 22 15:53:28 devstack cinder-volume[86212]: WARNING cinder.volume.drivers.remotefs [None req-682b6074-ec30-4c06-923e-7c9fb6e5bf86 tempest-TestStampPattern-847195903 None] /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-d4dc6d16-0d4a-4272-aa4a-442671412b41 is being set with open permissions: ugo+rw Sep 22 15:53:28 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-682b6074-ec30-4c06-923e-7c9fb6e5bf86 tempest-TestStampPattern-847195903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-d4dc6d16-0d4a-4272-aa4a-442671412b41 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:53:29 devstack sudo[102299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-d4dc6d16-0d4a-4272-aa4a-442671412b41 Sep 22 15:53:29 devstack sudo[102299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:53:29 devstack sudo[102299]: pam_unix(sudo:session): session closed for user root Sep 22 15:53:29 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-682b6074-ec30-4c06-923e-7c9fb6e5bf86 tempest-TestStampPattern-847195903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-d4dc6d16-0d4a-4272-aa4a-442671412b41" returned: 0 in 0.778s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:53:29 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-682b6074-ec30-4c06-923e-7c9fb6e5bf86 tempest-TestStampPattern-847195903 None] Lock "cinder-quobyte-d4dc6d16-0d4a-4272-aa4a-442671412b41" released by "_copy_volume_from_snapshot" :: held 14.267s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:53:29 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-682b6074-ec30-4c06-923e-7c9fb6e5bf86 tempest-TestStampPattern-847195903 None] Lock "cinder-quobyte-68e7033c-807d-4060-8162-0c37ad207056-d4dc6d16-0d4a-4272-aa4a-442671412b41" released by "_create_volume_from_snapshot" :: held 14.357s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:53:29 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-682b6074-ec30-4c06-923e-7c9fb6e5bf86 tempest-TestStampPattern-847195903 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 14.381s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:53:29 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-682b6074-ec30-4c06-923e-7c9fb6e5bf86 tempest-TestStampPattern-847195903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (857d65a9-6f08-485c-9b9d-97ae03bc0ba1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d4dc6d16-0d4a-4272-aa4a-442671412b41', 'volume_size': 1, 'snapshot_id': '68e7033c-807d-4060-8162-0c37ad207056'}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:53:29 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-682b6074-ec30-4c06-923e-7c9fb6e5bf86 tempest-TestStampPattern-847195903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aae1e2d2-7a0a-42e4-95a6-1c3c5de3af77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:53:29 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-682b6074-ec30-4c06-923e-7c9fb6e5bf86 tempest-TestStampPattern-847195903 None] Volume volume-d4dc6d16-0d4a-4272-aa4a-442671412b41 (d4dc6d16-0d4a-4272-aa4a-442671412b41): created successfully Sep 22 15:53:29 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-682b6074-ec30-4c06-923e-7c9fb6e5bf86 tempest-TestStampPattern-847195903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aae1e2d2-7a0a-42e4-95a6-1c3c5de3af77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:53:29 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-682b6074-ec30-4c06-923e-7c9fb6e5bf86 tempest-TestStampPattern-847195903 None] Flow 'volume_create_manager' (04ff73ed-02ed-4c27-8f18-bdfd8d38c93e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:53:29 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-682b6074-ec30-4c06-923e-7c9fb6e5bf86 tempest-TestStampPattern-847195903 None] Created volume successfully. Sep 22 15:53:38 devstack cinder-volume[86212]: DEBUG oslo_service.periodic_task [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86212) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 22 15:53:38 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:53:38 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:53:38 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:53:38 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:53:38 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:53:38 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:53:38 devstack sudo[102369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc Sep 22 15:53:38 devstack sudo[102369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:53:38 devstack sudo[102369]: pam_unix(sudo:session): session closed for user root Sep 22 15:53:38 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc" returned: 0 in 0.268s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:53:38 devstack cinder-volume[86212]: DEBUG cinder.manager [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] Notifying Schedulers of capabilities ... {{(pid=86212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 15:53:38 devstack cinder-volume[86212]: DEBUG oslo_service.periodic_task [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] Running periodic task VolumeManager._thread_info {{(pid=86212) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 22 15:53:38 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] thread count: 29 {{(pid=86212) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 22 15:53:38 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] thread info: [<_MainThread(MainThread, started 136163191222400)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86212) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 22 15:53:41 devstack cinder-volume[86212]: DEBUG dbcounter [-] [86212] Writing DB stats cinder:UPDATE=3,cinder:SELECT=2,cinder:DELETE=1 {{(pid=86212) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 22 15:53:41 devstack cinder-volume[86212]: DEBUG dbcounter [-] [86212] Writing DB stats cinder:SELECT=2,cinder:UPDATE=3,cinder:INSERT=1 {{(pid=86212) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 22 15:53:53 devstack cinder-volume[86212]: INFO cinder.volume.manager [req-707d3dda-fe04-4253-becc-92e4fe468327 req-47400e3f-dd96-4d8b-bb70-2c5eed2b7df4 tempest-TestShelveInstance-61784584 None] Terminate volume connection completed successfully. Sep 22 15:53:53 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [req-707d3dda-fe04-4253-becc-92e4fe468327 req-47400e3f-dd96-4d8b-bb70-2c5eed2b7df4 tempest-TestShelveInstance-61784584 None] Deleting attachment 0eac3c21-94b3-4e71-828d-bc3684108377. {{(pid=86212) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 22 15:53:55 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [req-194582dc-b12d-4ae6-8901-8e95e80117ba req-fcdb007a-c09f-4fab-a4d5-37d88c14ca11 tempest-TestShelveInstance-61784584 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:53:55 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [req-194582dc-b12d-4ae6-8901-8e95e80117ba req-fcdb007a-c09f-4fab-a4d5-37d88c14ca11 tempest-TestShelveInstance-61784584 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:53:55 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [req-194582dc-b12d-4ae6-8901-8e95e80117ba req-fcdb007a-c09f-4fab-a4d5-37d88c14ca11 tempest-TestShelveInstance-61784584 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.010s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:53:55 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [req-194582dc-b12d-4ae6-8901-8e95e80117ba req-fcdb007a-c09f-4fab-a4d5-37d88c14ca11 tempest-TestShelveInstance-61784584 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31', 'name': 'volume-f5663054-b6ae-42b1-94d1-2f7b1ab62cb7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c5952015-5daa-4644-94c8-9da362084d67', 'enforce_multipath': True} {{(pid=86212) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 22 15:53:55 devstack cinder-volume[86212]: INFO cinder.volume.manager [req-194582dc-b12d-4ae6-8901-8e95e80117ba req-fcdb007a-c09f-4fab-a4d5-37d88c14ca11 tempest-TestShelveInstance-61784584 None] attachment_update completed successfully. Sep 22 15:54:05 devstack cinder-volume[86212]: DEBUG dbcounter [-] [86212] Writing DB stats cinder:SELECT=4,cinder:UPDATE=3 {{(pid=86212) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 22 15:54:05 devstack cinder-volume[86212]: DEBUG dbcounter [-] [86212] Writing DB stats cinder:SELECT=11 {{(pid=86212) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 22 15:54:12 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [req-94097e10-a21b-403d-80bf-2acd798d4ab0 req-5e14531e-c591-4787-9c70-394b6d39ee91 tempest-TestStampPattern-847195903 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:54:12 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [req-94097e10-a21b-403d-80bf-2acd798d4ab0 req-5e14531e-c591-4787-9c70-394b6d39ee91 tempest-TestStampPattern-847195903 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:54:12 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [req-94097e10-a21b-403d-80bf-2acd798d4ab0 req-5e14531e-c591-4787-9c70-394b6d39ee91 tempest-TestStampPattern-847195903 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:54:12 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [req-94097e10-a21b-403d-80bf-2acd798d4ab0 req-5e14531e-c591-4787-9c70-394b6d39ee91 tempest-TestStampPattern-847195903 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31', 'name': 'volume-d4dc6d16-0d4a-4272-aa4a-442671412b41', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c31795de-6630-40ca-b646-0dd5d9d90850', 'enforce_multipath': True} {{(pid=86212) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 22 15:54:12 devstack cinder-volume[86212]: INFO cinder.volume.manager [req-94097e10-a21b-403d-80bf-2acd798d4ab0 req-5e14531e-c591-4787-9c70-394b6d39ee91 tempest-TestStampPattern-847195903 None] attachment_update completed successfully. Sep 22 15:54:14 devstack cinder-volume[86212]: INFO cinder.volume.manager [req-866a4748-b085-4891-8dcc-a31bfc3d8e31 req-84d0b60a-e754-4dad-92ab-82d181f19b2a tempest-TestStampPattern-847195903 None] Terminate volume connection completed successfully. Sep 22 15:54:14 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [req-866a4748-b085-4891-8dcc-a31bfc3d8e31 req-84d0b60a-e754-4dad-92ab-82d181f19b2a tempest-TestStampPattern-847195903 None] Deleting attachment c31795de-6630-40ca-b646-0dd5d9d90850. {{(pid=86212) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 22 15:54:18 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-693074b5-72e0-40ad-bf9c-47be2e1dc34f tempest-TestStampPattern-847195903 None] Acquiring lock "cinder-d4dc6d16-0d4a-4272-aa4a-442671412b41-delete_volume" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:54:18 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-693074b5-72e0-40ad-bf9c-47be2e1dc34f tempest-TestStampPattern-847195903 None] Lock "cinder-d4dc6d16-0d4a-4272-aa4a-442671412b41-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:54:18 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-693074b5-72e0-40ad-bf9c-47be2e1dc34f tempest-TestStampPattern-847195903 None] Acquiring lock "cinder-quobyte-d4dc6d16-0d4a-4272-aa4a-442671412b41" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:54:18 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-693074b5-72e0-40ad-bf9c-47be2e1dc34f tempest-TestStampPattern-847195903 None] Lock "cinder-quobyte-d4dc6d16-0d4a-4272-aa4a-442671412b41" acquired by "delete_volume" :: waited 0.015s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:54:18 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a5dc681-a5bb-4bd8-8f94-f4567ed2a0ec]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:54:18 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-693074b5-72e0-40ad-bf9c-47be2e1dc34f tempest-TestStampPattern-847195903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-d4dc6d16-0d4a-4272-aa4a-442671412b41 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:54:18 devstack sudo[103087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-d4dc6d16-0d4a-4272-aa4a-442671412b41 Sep 22 15:54:18 devstack sudo[103087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:54:19 devstack sudo[103087]: pam_unix(sudo:session): session closed for user root Sep 22 15:54:19 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-693074b5-72e0-40ad-bf9c-47be2e1dc34f tempest-TestStampPattern-847195903 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-d4dc6d16-0d4a-4272-aa4a-442671412b41" returned: 0 in 0.366s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:54:19 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-693074b5-72e0-40ad-bf9c-47be2e1dc34f tempest-TestStampPattern-847195903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-d4dc6d16-0d4a-4272-aa4a-442671412b41 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:54:19 devstack sudo[103092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-d4dc6d16-0d4a-4272-aa4a-442671412b41 Sep 22 15:54:19 devstack sudo[103092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:54:19 devstack sudo[103092]: pam_unix(sudo:session): session closed for user root Sep 22 15:54:19 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-693074b5-72e0-40ad-bf9c-47be2e1dc34f tempest-TestStampPattern-847195903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-d4dc6d16-0d4a-4272-aa4a-442671412b41" returned: 0 in 0.253s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:54:19 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-693074b5-72e0-40ad-bf9c-47be2e1dc34f tempest-TestStampPattern-847195903 None] Lock "cinder-quobyte-d4dc6d16-0d4a-4272-aa4a-442671412b41" released by "delete_volume" :: held 0.659s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:54:19 devstack cinder-volume[86212]: DEBUG cinder.quota [None req-693074b5-72e0-40ad-bf9c-47be2e1dc34f tempest-TestStampPattern-847195903 None] Created reservations ['81c4cf85-8d36-492e-9e72-ab1e80a2d4eb', '371cb2d3-ff15-4471-a5be-b8783b566d0e', '4f83b7f2-58e6-41f3-8067-5ec5adb84a72', '7e56e5b0-dc57-4e66-a63e-185dce88b932'] {{(pid=86212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 15:54:19 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-693074b5-72e0-40ad-bf9c-47be2e1dc34f tempest-TestStampPattern-847195903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:54:19 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-693074b5-72e0-40ad-bf9c-47be2e1dc34f tempest-TestStampPattern-847195903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:54:19 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-693074b5-72e0-40ad-bf9c-47be2e1dc34f tempest-TestStampPattern-847195903 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:54:19 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-693074b5-72e0-40ad-bf9c-47be2e1dc34f tempest-TestStampPattern-847195903 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:54:19 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-693074b5-72e0-40ad-bf9c-47be2e1dc34f tempest-TestStampPattern-847195903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:54:19 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-693074b5-72e0-40ad-bf9c-47be2e1dc34f tempest-TestStampPattern-847195903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:54:19 devstack sudo[103095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc Sep 22 15:54:19 devstack sudo[103095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:54:19 devstack sudo[103095]: pam_unix(sudo:session): session closed for user root Sep 22 15:54:19 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-693074b5-72e0-40ad-bf9c-47be2e1dc34f tempest-TestStampPattern-847195903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc" returned: 0 in 0.243s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:54:19 devstack cinder-volume[86212]: DEBUG cinder.manager [None req-693074b5-72e0-40ad-bf9c-47be2e1dc34f tempest-TestStampPattern-847195903 None] Notifying Schedulers of capabilities ... {{(pid=86212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 15:54:19 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-693074b5-72e0-40ad-bf9c-47be2e1dc34f tempest-TestStampPattern-847195903 None] Deleted volume successfully. Sep 22 15:54:19 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-693074b5-72e0-40ad-bf9c-47be2e1dc34f tempest-TestStampPattern-847195903 None] Lock "cinder-d4dc6d16-0d4a-4272-aa4a-442671412b41-delete_volume" released by "delete_volume" :: held 1.092s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:54:20 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-754341ae-9700-4bc9-8184-9fbf2e878339 tempest-TestStampPattern-847195903 None] Acquiring lock "cinder-68e7033c-807d-4060-8162-0c37ad207056-delete_snapshot" by "delete_snapshot" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:54:20 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-754341ae-9700-4bc9-8184-9fbf2e878339 tempest-TestStampPattern-847195903 None] Lock "cinder-68e7033c-807d-4060-8162-0c37ad207056-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:54:20 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-754341ae-9700-4bc9-8184-9fbf2e878339 tempest-TestStampPattern-847195903 None] Acquiring lock "cinder-quobyte-8d7da764-b91f-4c44-9d97-30dc4b0b94d0" by "delete_snapshot" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:54:20 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-754341ae-9700-4bc9-8184-9fbf2e878339 tempest-TestStampPattern-847195903 None] Lock "cinder-quobyte-8d7da764-b91f-4c44-9d97-30dc4b0b94d0" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:54:20 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-754341ae-9700-4bc9-8184-9fbf2e878339 tempest-TestStampPattern-847195903 None] Acquiring lock "cinder-quobyte-68e7033c-807d-4060-8162-0c37ad207056" by "_delete_snapshot" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:54:20 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-754341ae-9700-4bc9-8184-9fbf2e878339 tempest-TestStampPattern-847195903 None] Lock "cinder-quobyte-68e7033c-807d-4060-8162-0c37ad207056" acquired by "_delete_snapshot" :: waited 0.061s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:54:20 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-754341ae-9700-4bc9-8184-9fbf2e878339 tempest-TestStampPattern-847195903 None] Deleting offline snapshot 68e7033c-807d-4060-8162-0c37ad207056 of volume 8d7da764-b91f-4c44-9d97-30dc4b0b94d0 {{(pid=86212) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 22 15:54:20 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-754341ae-9700-4bc9-8184-9fbf2e878339 tempest-TestStampPattern-847195903 None] snapshot_file for this snap is: volume-8d7da764-b91f-4c44-9d97-30dc4b0b94d0.68e7033c-807d-4060-8162-0c37ad207056 {{(pid=86212) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 22 15:54:20 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[36013185-45c4-40e4-911c-446515fc2107]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:54:20 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-754341ae-9700-4bc9-8184-9fbf2e878339 tempest-TestStampPattern-847195903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8d7da764-b91f-4c44-9d97-30dc4b0b94d0.68e7033c-807d-4060-8162-0c37ad207056 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:54:20 devstack sudo[103098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8d7da764-b91f-4c44-9d97-30dc4b0b94d0.68e7033c-807d-4060-8162-0c37ad207056 Sep 22 15:54:20 devstack sudo[103098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:54:20 devstack sudo[103098]: pam_unix(sudo:session): session closed for user root Sep 22 15:54:20 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-754341ae-9700-4bc9-8184-9fbf2e878339 tempest-TestStampPattern-847195903 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8d7da764-b91f-4c44-9d97-30dc4b0b94d0.68e7033c-807d-4060-8162-0c37ad207056" returned: 0 in 0.360s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:54:20 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-754341ae-9700-4bc9-8184-9fbf2e878339 tempest-TestStampPattern-847195903 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8d7da764-b91f-4c44-9d97-30dc4b0b94d0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86212) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 22 15:54:20 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[6507b60e-8c9c-4cfa-834c-69523d0bb6d5]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:54:20 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-754341ae-9700-4bc9-8184-9fbf2e878339 tempest-TestStampPattern-847195903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8d7da764-b91f-4c44-9d97-30dc4b0b94d0 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:54:20 devstack sudo[103103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8d7da764-b91f-4c44-9d97-30dc4b0b94d0 Sep 22 15:54:20 devstack sudo[103103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:54:21 devstack sudo[103103]: pam_unix(sudo:session): session closed for user root Sep 22 15:54:21 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-754341ae-9700-4bc9-8184-9fbf2e878339 tempest-TestStampPattern-847195903 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8d7da764-b91f-4c44-9d97-30dc4b0b94d0" returned: 0 in 0.561s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:54:21 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-754341ae-9700-4bc9-8184-9fbf2e878339 tempest-TestStampPattern-847195903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8d7da764-b91f-4c44-9d97-30dc4b0b94d0.68e7033c-807d-4060-8162-0c37ad207056 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:54:21 devstack sudo[103108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8d7da764-b91f-4c44-9d97-30dc4b0b94d0.68e7033c-807d-4060-8162-0c37ad207056 Sep 22 15:54:21 devstack sudo[103108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:54:21 devstack sudo[103108]: pam_unix(sudo:session): session closed for user root Sep 22 15:54:21 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-754341ae-9700-4bc9-8184-9fbf2e878339 tempest-TestStampPattern-847195903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8d7da764-b91f-4c44-9d97-30dc4b0b94d0.68e7033c-807d-4060-8162-0c37ad207056" returned: 0 in 0.356s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:54:21 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-754341ae-9700-4bc9-8184-9fbf2e878339 tempest-TestStampPattern-847195903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8d7da764-b91f-4c44-9d97-30dc4b0b94d0.68e7033c-807d-4060-8162-0c37ad207056 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:54:21 devstack sudo[103113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8d7da764-b91f-4c44-9d97-30dc4b0b94d0.68e7033c-807d-4060-8162-0c37ad207056 Sep 22 15:54:21 devstack sudo[103113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:54:21 devstack sudo[103113]: pam_unix(sudo:session): session closed for user root Sep 22 15:54:21 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-754341ae-9700-4bc9-8184-9fbf2e878339 tempest-TestStampPattern-847195903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8d7da764-b91f-4c44-9d97-30dc4b0b94d0.68e7033c-807d-4060-8162-0c37ad207056" returned: 0 in 0.265s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:54:21 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-754341ae-9700-4bc9-8184-9fbf2e878339 tempest-TestStampPattern-847195903 None] Lock "cinder-quobyte-68e7033c-807d-4060-8162-0c37ad207056" released by "_delete_snapshot" :: held 1.647s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:54:21 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-754341ae-9700-4bc9-8184-9fbf2e878339 tempest-TestStampPattern-847195903 None] Lock "cinder-quobyte-8d7da764-b91f-4c44-9d97-30dc4b0b94d0" released by "delete_snapshot" :: held 1.715s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:54:21 devstack cinder-volume[86212]: DEBUG cinder.quota [None req-754341ae-9700-4bc9-8184-9fbf2e878339 tempest-TestStampPattern-847195903 None] Created reservations ['2be6ce16-8124-4fec-8e5c-1de703925362', '579bc1ad-4fbc-44fb-bfd6-3340bb595bc4', '8f03abfe-2874-46ca-91da-6011a6cb3086', '146cbd0a-5828-4a7a-83bc-34505f2b4264'] {{(pid=86212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 15:54:21 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-754341ae-9700-4bc9-8184-9fbf2e878339 tempest-TestStampPattern-847195903 None] Delete snapshot completed successfully. Sep 22 15:54:21 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-754341ae-9700-4bc9-8184-9fbf2e878339 tempest-TestStampPattern-847195903 None] Lock "cinder-68e7033c-807d-4060-8162-0c37ad207056-delete_snapshot" released by "delete_snapshot" :: held 1.853s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:54:25 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-c6a1d9e7-5d21-44a4-a753-859a7897293b tempest-TestStampPattern-847195903 None] Acquiring lock "cinder-8d7da764-b91f-4c44-9d97-30dc4b0b94d0-delete_volume" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:54:25 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-c6a1d9e7-5d21-44a4-a753-859a7897293b tempest-TestStampPattern-847195903 None] Lock "cinder-8d7da764-b91f-4c44-9d97-30dc4b0b94d0-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:54:25 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-c6a1d9e7-5d21-44a4-a753-859a7897293b tempest-TestStampPattern-847195903 None] Acquiring lock "cinder-quobyte-8d7da764-b91f-4c44-9d97-30dc4b0b94d0" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:54:25 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-c6a1d9e7-5d21-44a4-a753-859a7897293b tempest-TestStampPattern-847195903 None] Lock "cinder-quobyte-8d7da764-b91f-4c44-9d97-30dc4b0b94d0" acquired by "delete_volume" :: waited 0.024s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:54:25 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[44dde1f9-d844-4069-95f0-8b9d1bdc9950]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:54:25 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-c6a1d9e7-5d21-44a4-a753-859a7897293b tempest-TestStampPattern-847195903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8d7da764-b91f-4c44-9d97-30dc4b0b94d0 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:54:25 devstack sudo[103145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8d7da764-b91f-4c44-9d97-30dc4b0b94d0 Sep 22 15:54:25 devstack sudo[103145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:54:26 devstack sudo[103145]: pam_unix(sudo:session): session closed for user root Sep 22 15:54:26 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-c6a1d9e7-5d21-44a4-a753-859a7897293b tempest-TestStampPattern-847195903 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8d7da764-b91f-4c44-9d97-30dc4b0b94d0" returned: 0 in 0.345s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:54:26 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-c6a1d9e7-5d21-44a4-a753-859a7897293b tempest-TestStampPattern-847195903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8d7da764-b91f-4c44-9d97-30dc4b0b94d0 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:54:26 devstack sudo[103150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8d7da764-b91f-4c44-9d97-30dc4b0b94d0 Sep 22 15:54:26 devstack sudo[103150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:54:26 devstack sudo[103150]: pam_unix(sudo:session): session closed for user root Sep 22 15:54:26 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-c6a1d9e7-5d21-44a4-a753-859a7897293b tempest-TestStampPattern-847195903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8d7da764-b91f-4c44-9d97-30dc4b0b94d0" returned: 0 in 0.250s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:54:26 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-c6a1d9e7-5d21-44a4-a753-859a7897293b tempest-TestStampPattern-847195903 None] Lock "cinder-quobyte-8d7da764-b91f-4c44-9d97-30dc4b0b94d0" released by "delete_volume" :: held 0.651s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:54:26 devstack cinder-volume[86212]: DEBUG cinder.quota [None req-c6a1d9e7-5d21-44a4-a753-859a7897293b tempest-TestStampPattern-847195903 None] Created reservations ['5f6237a5-2da0-416f-aded-67c402648ac2', 'eb952fd4-1cd5-48dc-b218-bb41468fdfc5', '0143cdf5-b11c-41be-a9d8-daa1d67e0260', '372c2fa0-4769-49b9-917b-0d16c2535018'] {{(pid=86212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 15:54:26 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-c6a1d9e7-5d21-44a4-a753-859a7897293b tempest-TestStampPattern-847195903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:54:26 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-c6a1d9e7-5d21-44a4-a753-859a7897293b tempest-TestStampPattern-847195903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:54:26 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-c6a1d9e7-5d21-44a4-a753-859a7897293b tempest-TestStampPattern-847195903 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:54:26 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-c6a1d9e7-5d21-44a4-a753-859a7897293b tempest-TestStampPattern-847195903 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:54:26 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-c6a1d9e7-5d21-44a4-a753-859a7897293b tempest-TestStampPattern-847195903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:54:26 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-c6a1d9e7-5d21-44a4-a753-859a7897293b tempest-TestStampPattern-847195903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:54:26 devstack sudo[103154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc Sep 22 15:54:26 devstack sudo[103154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:54:26 devstack sudo[103154]: pam_unix(sudo:session): session closed for user root Sep 22 15:54:26 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-c6a1d9e7-5d21-44a4-a753-859a7897293b tempest-TestStampPattern-847195903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc" returned: 0 in 0.254s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:54:26 devstack cinder-volume[86212]: DEBUG cinder.manager [None req-c6a1d9e7-5d21-44a4-a753-859a7897293b tempest-TestStampPattern-847195903 None] Notifying Schedulers of capabilities ... {{(pid=86212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 15:54:26 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-c6a1d9e7-5d21-44a4-a753-859a7897293b tempest-TestStampPattern-847195903 None] Deleted volume successfully. Sep 22 15:54:26 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-c6a1d9e7-5d21-44a4-a753-859a7897293b tempest-TestStampPattern-847195903 None] Lock "cinder-8d7da764-b91f-4c44-9d97-30dc4b0b94d0-delete_volume" released by "delete_volume" :: held 1.115s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:54:36 devstack cinder-volume[86212]: DEBUG dbcounter [-] [86212] Writing DB stats cinder:SELECT=26,cinder:UPDATE=21,cinder:INSERT=7,cinder:DELETE=1 {{(pid=86212) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 22 15:54:36 devstack cinder-volume[86212]: DEBUG dbcounter [-] [86212] Writing DB stats cinder:SELECT=20,cinder:UPDATE=25,cinder:INSERT=5,cinder:DELETE=1 {{(pid=86212) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 22 15:54:38 devstack cinder-volume[86212]: DEBUG oslo_service.periodic_task [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86212) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 22 15:54:38 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:54:38 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:54:38 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:54:38 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:54:38 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.045s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:54:38 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:54:38 devstack sudo[103184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc Sep 22 15:54:38 devstack sudo[103184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:54:38 devstack sudo[103184]: pam_unix(sudo:session): session closed for user root Sep 22 15:54:38 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc" returned: 0 in 0.439s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:54:38 devstack cinder-volume[86212]: DEBUG cinder.manager [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] Notifying Schedulers of capabilities ... {{(pid=86212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 15:54:38 devstack cinder-volume[86212]: DEBUG oslo_service.periodic_task [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] Running periodic task VolumeManager._thread_info {{(pid=86212) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 22 15:54:38 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] thread count: 29 {{(pid=86212) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 22 15:54:38 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] thread info: [<_MainThread(MainThread, started 136163191222400)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86212) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 22 15:54:39 devstack cinder-volume[86212]: INFO cinder.volume.manager [req-32feacc9-2466-43ee-ac7f-948cd06e98a6 req-b9053d79-fc6c-461a-8fd8-bbf198ea22aa tempest-TestShelveInstance-61784584 None] Terminate volume connection completed successfully. Sep 22 15:54:39 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [req-32feacc9-2466-43ee-ac7f-948cd06e98a6 req-b9053d79-fc6c-461a-8fd8-bbf198ea22aa tempest-TestShelveInstance-61784584 None] Deleting attachment c5952015-5daa-4644-94c8-9da362084d67. {{(pid=86212) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 22 15:54:40 devstack cinder-volume[86212]: DEBUG cinder.coordination [req-32feacc9-2466-43ee-ac7f-948cd06e98a6 req-cafd60c0-e138-4f76-8a56-cc8f8b645b1b tempest-TestShelveInstance-61784584 None] Acquiring lock "cinder-f5663054-b6ae-42b1-94d1-2f7b1ab62cb7-delete_volume" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:54:40 devstack cinder-volume[86212]: DEBUG cinder.coordination [req-32feacc9-2466-43ee-ac7f-948cd06e98a6 req-cafd60c0-e138-4f76-8a56-cc8f8b645b1b tempest-TestShelveInstance-61784584 None] Lock "cinder-f5663054-b6ae-42b1-94d1-2f7b1ab62cb7-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:54:40 devstack cinder-volume[86212]: DEBUG cinder.coordination [req-32feacc9-2466-43ee-ac7f-948cd06e98a6 req-cafd60c0-e138-4f76-8a56-cc8f8b645b1b tempest-TestShelveInstance-61784584 None] Acquiring lock "cinder-quobyte-f5663054-b6ae-42b1-94d1-2f7b1ab62cb7" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:54:40 devstack cinder-volume[86212]: DEBUG cinder.coordination [req-32feacc9-2466-43ee-ac7f-948cd06e98a6 req-cafd60c0-e138-4f76-8a56-cc8f8b645b1b tempest-TestShelveInstance-61784584 None] Lock "cinder-quobyte-f5663054-b6ae-42b1-94d1-2f7b1ab62cb7" acquired by "delete_volume" :: waited 0.022s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:54:40 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4ad788f-6ec2-46b2-b69f-4bb819a62db7]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:54:40 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [req-32feacc9-2466-43ee-ac7f-948cd06e98a6 req-cafd60c0-e138-4f76-8a56-cc8f8b645b1b tempest-TestShelveInstance-61784584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-f5663054-b6ae-42b1-94d1-2f7b1ab62cb7 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:54:40 devstack sudo[103196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-f5663054-b6ae-42b1-94d1-2f7b1ab62cb7 Sep 22 15:54:40 devstack sudo[103196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:54:40 devstack sudo[103196]: pam_unix(sudo:session): session closed for user root Sep 22 15:54:40 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [req-32feacc9-2466-43ee-ac7f-948cd06e98a6 req-cafd60c0-e138-4f76-8a56-cc8f8b645b1b tempest-TestShelveInstance-61784584 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-f5663054-b6ae-42b1-94d1-2f7b1ab62cb7" returned: 0 in 0.445s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:54:40 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [req-32feacc9-2466-43ee-ac7f-948cd06e98a6 req-cafd60c0-e138-4f76-8a56-cc8f8b645b1b tempest-TestShelveInstance-61784584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-f5663054-b6ae-42b1-94d1-2f7b1ab62cb7 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:54:40 devstack sudo[103201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-f5663054-b6ae-42b1-94d1-2f7b1ab62cb7 Sep 22 15:54:40 devstack sudo[103201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:54:40 devstack sudo[103201]: pam_unix(sudo:session): session closed for user root Sep 22 15:54:40 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [req-32feacc9-2466-43ee-ac7f-948cd06e98a6 req-cafd60c0-e138-4f76-8a56-cc8f8b645b1b tempest-TestShelveInstance-61784584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-f5663054-b6ae-42b1-94d1-2f7b1ab62cb7" returned: 0 in 0.312s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:54:40 devstack cinder-volume[86212]: DEBUG cinder.coordination [req-32feacc9-2466-43ee-ac7f-948cd06e98a6 req-cafd60c0-e138-4f76-8a56-cc8f8b645b1b tempest-TestShelveInstance-61784584 None] Lock "cinder-quobyte-f5663054-b6ae-42b1-94d1-2f7b1ab62cb7" released by "delete_volume" :: held 0.828s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:54:41 devstack cinder-volume[86212]: DEBUG cinder.quota [req-32feacc9-2466-43ee-ac7f-948cd06e98a6 req-cafd60c0-e138-4f76-8a56-cc8f8b645b1b tempest-TestShelveInstance-61784584 None] Created reservations ['2882f20d-5668-4296-80e5-2542f9883cbf', '4ca90a33-2d64-4cd0-bf2f-c0df7fbfd85d', 'ffd90aa5-95da-499d-85f1-775d18c8f225', '73e68126-f9d3-43c6-9a3b-60a1abc71eec'] {{(pid=86212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 15:54:41 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [req-32feacc9-2466-43ee-ac7f-948cd06e98a6 req-cafd60c0-e138-4f76-8a56-cc8f8b645b1b tempest-TestShelveInstance-61784584 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:54:41 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [req-32feacc9-2466-43ee-ac7f-948cd06e98a6 req-cafd60c0-e138-4f76-8a56-cc8f8b645b1b tempest-TestShelveInstance-61784584 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:54:41 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [req-32feacc9-2466-43ee-ac7f-948cd06e98a6 req-cafd60c0-e138-4f76-8a56-cc8f8b645b1b tempest-TestShelveInstance-61784584 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:54:41 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [req-32feacc9-2466-43ee-ac7f-948cd06e98a6 req-cafd60c0-e138-4f76-8a56-cc8f8b645b1b tempest-TestShelveInstance-61784584 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:54:41 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [req-32feacc9-2466-43ee-ac7f-948cd06e98a6 req-cafd60c0-e138-4f76-8a56-cc8f8b645b1b tempest-TestShelveInstance-61784584 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:54:41 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [req-32feacc9-2466-43ee-ac7f-948cd06e98a6 req-cafd60c0-e138-4f76-8a56-cc8f8b645b1b tempest-TestShelveInstance-61784584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:54:41 devstack sudo[103204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc Sep 22 15:54:41 devstack sudo[103204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:54:41 devstack sudo[103204]: pam_unix(sudo:session): session closed for user root Sep 22 15:54:41 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [req-32feacc9-2466-43ee-ac7f-948cd06e98a6 req-cafd60c0-e138-4f76-8a56-cc8f8b645b1b tempest-TestShelveInstance-61784584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc" returned: 0 in 0.264s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:54:41 devstack cinder-volume[86212]: DEBUG cinder.manager [req-32feacc9-2466-43ee-ac7f-948cd06e98a6 req-cafd60c0-e138-4f76-8a56-cc8f8b645b1b tempest-TestShelveInstance-61784584 None] Notifying Schedulers of capabilities ... {{(pid=86212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 15:54:41 devstack cinder-volume[86212]: INFO cinder.volume.manager [req-32feacc9-2466-43ee-ac7f-948cd06e98a6 req-cafd60c0-e138-4f76-8a56-cc8f8b645b1b tempest-TestShelveInstance-61784584 None] Deleted volume successfully. Sep 22 15:54:41 devstack cinder-volume[86212]: DEBUG cinder.coordination [req-32feacc9-2466-43ee-ac7f-948cd06e98a6 req-cafd60c0-e138-4f76-8a56-cc8f8b645b1b tempest-TestShelveInstance-61784584 None] Lock "cinder-f5663054-b6ae-42b1-94d1-2f7b1ab62cb7-delete_volume" released by "delete_volume" :: held 1.390s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:54:42 devstack cinder-volume[86212]: DEBUG cinder.volume.flows.manager.create_volume [None req-716a517f-afdb-40af-991f-821b48a4dd5a tempest-VolumeAndVolumeTypeFromImageTest-233657515 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 15:54:42 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-716a517f-afdb-40af-991f-821b48a4dd5a tempest-VolumeAndVolumeTypeFromImageTest-233657515 None] Flow 'volume_create_manager' (8a693126-6a85-447b-8db1-505d5f307be4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:54:42 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-716a517f-afdb-40af-991f-821b48a4dd5a tempest-VolumeAndVolumeTypeFromImageTest-233657515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2fccfd8b-3e06-46e9-80f6-e2db1a2c1c48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:54:42 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-716a517f-afdb-40af-991f-821b48a4dd5a tempest-VolumeAndVolumeTypeFromImageTest-233657515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2fccfd8b-3e06-46e9-80f6-e2db1a2c1c48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:54:42Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=169f3bab-1358-4348-a3da-7ba66ded9e98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c149b71878e04b29a45ed2be0383b6e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:54:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:54:42Z,use_quota=True,user_id='a9eed60542c4488a909cad3edea69562',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9fffe779-5e3e-431b-a000-148e8793d613),volume_type_id=9fffe779-5e3e-431b-a000-148e8793d613)' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:54:42 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-716a517f-afdb-40af-991f-821b48a4dd5a tempest-VolumeAndVolumeTypeFromImageTest-233657515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7ff169e-8621-401f-a04e-9ca692c977bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:54:42 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-716a517f-afdb-40af-991f-821b48a4dd5a tempest-VolumeAndVolumeTypeFromImageTest-233657515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7ff169e-8621-401f-a04e-9ca692c977bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:54:42 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-716a517f-afdb-40af-991f-821b48a4dd5a tempest-VolumeAndVolumeTypeFromImageTest-233657515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d922cd06-6854-4e31-b28d-9c8a253f69f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:54:42 devstack cinder-volume[86212]: DEBUG cinder.image.glance [None req-716a517f-afdb-40af-991f-821b48a4dd5a tempest-VolumeAndVolumeTypeFromImageTest-233657515 None] Creating Keystone auth plugin from conf {{(pid=86212) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 22 15:54:42 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-716a517f-afdb-40af-991f-821b48a4dd5a tempest-VolumeAndVolumeTypeFromImageTest-233657515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d922cd06-6854-4e31-b28d-9c8a253f69f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '169f3bab-1358-4348-a3da-7ba66ded9e98', 'volume_name': 'volume-169f3bab-1358-4348-a3da-7ba66ded9e98', 'volume_size': 1, 'image_id': '844a3b78-d9ce-497b-9ca0-564dc91aaf39', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/844a3b78-d9ce-497b-9ca0-564dc91aaf39', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'fabbb3e0046cb4408210f2616a21cd16', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'c149b71878e04b29a45ed2be0383b6e6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd56d8204d74e36ade5947233cc8bc990c10e54fda75f1e894e38b3bd9ca71c64fedf2fc423e83c8bb30833da5ee80dc6bb58a39f9197d6ac265774e4447d3d0d', 'id': '844a3b78-d9ce-497b-9ca0-564dc91aaf39', 'created_at': datetime.datetime(2026, 9, 22, 13, 54, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 13, 54, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/844a3b78-d9ce-497b-9ca0-564dc91aaf39/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:54:42 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-716a517f-afdb-40af-991f-821b48a4dd5a tempest-VolumeAndVolumeTypeFromImageTest-233657515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea0e73cf-86db-4cd1-836b-e4c527afb385) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:54:42 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-716a517f-afdb-40af-991f-821b48a4dd5a tempest-VolumeAndVolumeTypeFromImageTest-233657515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea0e73cf-86db-4cd1-836b-e4c527afb385) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:54:42 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-716a517f-afdb-40af-991f-821b48a4dd5a tempest-VolumeAndVolumeTypeFromImageTest-233657515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87840f7d-ab55-45e1-8506-5e20da2f77d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:54:42 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-716a517f-afdb-40af-991f-821b48a4dd5a tempest-VolumeAndVolumeTypeFromImageTest-233657515 None] Volume 169f3bab-1358-4348-a3da-7ba66ded9e98: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-169f3bab-1358-4348-a3da-7ba66ded9e98', 'volume_size': 1, 'image_id': '844a3b78-d9ce-497b-9ca0-564dc91aaf39', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/844a3b78-d9ce-497b-9ca0-564dc91aaf39', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'fabbb3e0046cb4408210f2616a21cd16', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'c149b71878e04b29a45ed2be0383b6e6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd56d8204d74e36ade5947233cc8bc990c10e54fda75f1e894e38b3bd9ca71c64fedf2fc423e83c8bb30833da5ee80dc6bb58a39f9197d6ac265774e4447d3d0d', 'id': '844a3b78-d9ce-497b-9ca0-564dc91aaf39', 'created_at': datetime.datetime(2026, 9, 22, 13, 54, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 13, 54, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/844a3b78-d9ce-497b-9ca0-564dc91aaf39/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 22 15:54:42 devstack cinder-volume[86212]: DEBUG cinder.volume.flows.manager.create_volume [None req-716a517f-afdb-40af-991f-821b48a4dd5a tempest-VolumeAndVolumeTypeFromImageTest-233657515 None] Trying to clone 169f3bab-1358-4348-a3da-7ba66ded9e98 from image 844a3b78-d9ce-497b-9ca0-564dc91aaf39 at location (None, [{'url': 'file:///opt/stack/data/glance/images/844a3b78-d9ce-497b-9ca0-564dc91aaf39', 'metadata': {}}]). {{(pid=86212) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 22 15:54:42 devstack cinder-volume[86212]: DEBUG cinder.image.image_utils [None req-716a517f-afdb-40af-991f-821b48a4dd5a tempest-VolumeAndVolumeTypeFromImageTest-233657515 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_844a3b78-d9ce-497b-9ca0-564dc91aaf39_x4m1w8rodevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86212) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 22 15:54:42 devstack cinder-volume[86212]: INFO cinder.image.image_utils [None req-716a517f-afdb-40af-991f-821b48a4dd5a tempest-VolumeAndVolumeTypeFromImageTest-233657515 None] Image download 0.00 MB at 0.00 MB/s Sep 22 15:54:43 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfe8a9ce-fe20-4f10-a8af-2477c2af945a]: (4, 'raw') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:54:43 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-716a517f-afdb-40af-991f-821b48a4dd5a tempest-VolumeAndVolumeTypeFromImageTest-233657515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_844a3b78-d9ce-497b-9ca0-564dc91aaf39_x4m1w8rodevstack@QuobyteHD {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:54:43 devstack sudo[103244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_844a3b78-d9ce-497b-9ca0-564dc91aaf39_x4m1w8rodevstack@QuobyteHD Sep 22 15:54:43 devstack sudo[103244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:54:43 devstack sudo[103244]: pam_unix(sudo:session): session closed for user root Sep 22 15:54:43 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-716a517f-afdb-40af-991f-821b48a4dd5a tempest-VolumeAndVolumeTypeFromImageTest-233657515 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_844a3b78-d9ce-497b-9ca0-564dc91aaf39_x4m1w8rodevstack@QuobyteHD" returned: 0 in 0.326s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:54:43 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-716a517f-afdb-40af-991f-821b48a4dd5a tempest-VolumeAndVolumeTypeFromImageTest-233657515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_844a3b78-d9ce-497b-9ca0-564dc91aaf39_x4m1w8rodevstack@QuobyteHD {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:54:43 devstack sudo[103248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_844a3b78-d9ce-497b-9ca0-564dc91aaf39_x4m1w8rodevstack@QuobyteHD Sep 22 15:54:43 devstack sudo[103248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:54:43 devstack sudo[103248]: pam_unix(sudo:session): session closed for user root Sep 22 15:54:43 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-716a517f-afdb-40af-991f-821b48a4dd5a tempest-VolumeAndVolumeTypeFromImageTest-233657515 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_844a3b78-d9ce-497b-9ca0-564dc91aaf39_x4m1w8rodevstack@QuobyteHD" returned: 1 in 0.366s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:54:43 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-716a517f-afdb-40af-991f-821b48a4dd5a tempest-VolumeAndVolumeTypeFromImageTest-233657515 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_844a3b78-d9ce-497b-9ca0-564dc91aaf39_x4m1w8rodevstack@QuobyteHD' failed. Not Retrying. {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 22 15:54:43 devstack cinder-volume[86212]: DEBUG cinder.image.image_utils [None req-716a517f-afdb-40af-991f-821b48a4dd5a tempest-VolumeAndVolumeTypeFromImageTest-233657515 None] Temporary image 844a3b78-d9ce-497b-9ca0-564dc91aaf39 is fetched for user a9eed60542c4488a909cad3edea69562. {{(pid=86212) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 22 15:54:43 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeb33b06-d105-4d44-9f46-9f10aa206bbc]: (4, 'raw') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:54:43 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-716a517f-afdb-40af-991f-821b48a4dd5a tempest-VolumeAndVolumeTypeFromImageTest-233657515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_844a3b78-d9ce-497b-9ca0-564dc91aaf39_x4m1w8rodevstack@QuobyteHD {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:54:43 devstack sudo[103253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_844a3b78-d9ce-497b-9ca0-564dc91aaf39_x4m1w8rodevstack@QuobyteHD Sep 22 15:54:43 devstack sudo[103253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:54:44 devstack sudo[103253]: pam_unix(sudo:session): session closed for user root Sep 22 15:54:44 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-716a517f-afdb-40af-991f-821b48a4dd5a tempest-VolumeAndVolumeTypeFromImageTest-233657515 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_844a3b78-d9ce-497b-9ca0-564dc91aaf39_x4m1w8rodevstack@QuobyteHD" returned: 0 in 0.338s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:54:44 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-716a517f-afdb-40af-991f-821b48a4dd5a tempest-VolumeAndVolumeTypeFromImageTest-233657515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_844a3b78-d9ce-497b-9ca0-564dc91aaf39_x4m1w8rodevstack@QuobyteHD {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:54:44 devstack sudo[103257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_844a3b78-d9ce-497b-9ca0-564dc91aaf39_x4m1w8rodevstack@QuobyteHD Sep 22 15:54:44 devstack sudo[103257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:54:44 devstack sudo[103257]: pam_unix(sudo:session): session closed for user root Sep 22 15:54:44 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-716a517f-afdb-40af-991f-821b48a4dd5a tempest-VolumeAndVolumeTypeFromImageTest-233657515 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_844a3b78-d9ce-497b-9ca0-564dc91aaf39_x4m1w8rodevstack@QuobyteHD" returned: 1 in 0.357s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:54:44 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-716a517f-afdb-40af-991f-821b48a4dd5a tempest-VolumeAndVolumeTypeFromImageTest-233657515 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_844a3b78-d9ce-497b-9ca0-564dc91aaf39_x4m1w8rodevstack@QuobyteHD' failed. Not Retrying. {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 22 15:54:44 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-716a517f-afdb-40af-991f-821b48a4dd5a tempest-VolumeAndVolumeTypeFromImageTest-233657515 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:54:44 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-716a517f-afdb-40af-991f-821b48a4dd5a tempest-VolumeAndVolumeTypeFromImageTest-233657515 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:54:44 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-716a517f-afdb-40af-991f-821b48a4dd5a tempest-VolumeAndVolumeTypeFromImageTest-233657515 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:54:42Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=169f3bab-1358-4348-a3da-7ba66ded9e98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c149b71878e04b29a45ed2be0383b6e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:54:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:54:42Z,use_quota=True,user_id='a9eed60542c4488a909cad3edea69562',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9fffe779-5e3e-431b-a000-148e8793d613),volume_type_id=9fffe779-5e3e-431b-a000-148e8793d613)}" {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 15:54:44 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-716a517f-afdb-40af-991f-821b48a4dd5a tempest-VolumeAndVolumeTypeFromImageTest-233657515 None] Creating volume 169f3bab-1358-4348-a3da-7ba66ded9e98 {{(pid=86212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 15:54:44 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-716a517f-afdb-40af-991f-821b48a4dd5a tempest-VolumeAndVolumeTypeFromImageTest-233657515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:54:44 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-716a517f-afdb-40af-991f-821b48a4dd5a tempest-VolumeAndVolumeTypeFromImageTest-233657515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:54:44 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-716a517f-afdb-40af-991f-821b48a4dd5a tempest-VolumeAndVolumeTypeFromImageTest-233657515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:54:44 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-716a517f-afdb-40af-991f-821b48a4dd5a tempest-VolumeAndVolumeTypeFromImageTest-233657515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:54:44 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-716a517f-afdb-40af-991f-821b48a4dd5a tempest-VolumeAndVolumeTypeFromImageTest-233657515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:54:44 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-716a517f-afdb-40af-991f-821b48a4dd5a tempest-VolumeAndVolumeTypeFromImageTest-233657515 None] Selected osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 as target Quobyte volume. {{(pid=86212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 15:54:44 devstack cinder-volume[86212]: INFO cinder.volume.drivers.remotefs [None req-716a517f-afdb-40af-991f-821b48a4dd5a tempest-VolumeAndVolumeTypeFromImageTest-233657515 None] casted to osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 Sep 22 15:54:44 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-716a517f-afdb-40af-991f-821b48a4dd5a tempest-VolumeAndVolumeTypeFromImageTest-233657515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-169f3bab-1358-4348-a3da-7ba66ded9e98 1073741824 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:54:44 devstack sudo[103262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-169f3bab-1358-4348-a3da-7ba66ded9e98 1073741824 Sep 22 15:54:44 devstack sudo[103262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:54:44 devstack sudo[103262]: pam_unix(sudo:session): session closed for user root Sep 22 15:54:44 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-716a517f-afdb-40af-991f-821b48a4dd5a tempest-VolumeAndVolumeTypeFromImageTest-233657515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-169f3bab-1358-4348-a3da-7ba66ded9e98 1073741824" returned: 0 in 0.427s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:54:44 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-716a517f-afdb-40af-991f-821b48a4dd5a tempest-VolumeAndVolumeTypeFromImageTest-233657515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-169f3bab-1358-4348-a3da-7ba66ded9e98 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:54:44 devstack sudo[103267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-169f3bab-1358-4348-a3da-7ba66ded9e98 Sep 22 15:54:44 devstack sudo[103267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:54:45 devstack sudo[103267]: pam_unix(sudo:session): session closed for user root Sep 22 15:54:45 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-716a517f-afdb-40af-991f-821b48a4dd5a tempest-VolumeAndVolumeTypeFromImageTest-233657515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-169f3bab-1358-4348-a3da-7ba66ded9e98" returned: 0 in 0.244s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:54:45 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-716a517f-afdb-40af-991f-821b48a4dd5a tempest-VolumeAndVolumeTypeFromImageTest-233657515 None] <== create_volume: return (715ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'} {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 15:54:45 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-716a517f-afdb-40af-991f-821b48a4dd5a tempest-VolumeAndVolumeTypeFromImageTest-233657515 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.718s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:54:45 devstack cinder-volume[86212]: DEBUG cinder.volume.volume_utils [None req-716a517f-afdb-40af-991f-821b48a4dd5a tempest-VolumeAndVolumeTypeFromImageTest-233657515 None] Attempting download of 844a3b78-d9ce-497b-9ca0-564dc91aaf39 ((None, [{'url': 'file:///opt/stack/data/glance/images/844a3b78-d9ce-497b-9ca0-564dc91aaf39', 'metadata': {}}])) to volume 169f3bab-1358-4348-a3da-7ba66ded9e98. {{(pid=86212) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 22 15:54:45 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ab3f09d-0b07-45ad-9158-2a38526413cf]: (4, 'raw') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:54:45 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-716a517f-afdb-40af-991f-821b48a4dd5a tempest-VolumeAndVolumeTypeFromImageTest-233657515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_844a3b78-d9ce-497b-9ca0-564dc91aaf39_43hzsaca {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:54:45 devstack sudo[103270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_844a3b78-d9ce-497b-9ca0-564dc91aaf39_43hzsaca Sep 22 15:54:45 devstack sudo[103270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:54:45 devstack sudo[103270]: pam_unix(sudo:session): session closed for user root Sep 22 15:54:45 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-716a517f-afdb-40af-991f-821b48a4dd5a tempest-VolumeAndVolumeTypeFromImageTest-233657515 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_844a3b78-d9ce-497b-9ca0-564dc91aaf39_43hzsaca" returned: 0 in 0.399s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:54:45 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-716a517f-afdb-40af-991f-821b48a4dd5a tempest-VolumeAndVolumeTypeFromImageTest-233657515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_844a3b78-d9ce-497b-9ca0-564dc91aaf39_43hzsaca {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:54:45 devstack sudo[103274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_844a3b78-d9ce-497b-9ca0-564dc91aaf39_43hzsaca Sep 22 15:54:45 devstack sudo[103274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:54:46 devstack sudo[103274]: pam_unix(sudo:session): session closed for user root Sep 22 15:54:46 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-716a517f-afdb-40af-991f-821b48a4dd5a tempest-VolumeAndVolumeTypeFromImageTest-233657515 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_844a3b78-d9ce-497b-9ca0-564dc91aaf39_43hzsaca" returned: 1 in 0.329s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:54:46 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-716a517f-afdb-40af-991f-821b48a4dd5a tempest-VolumeAndVolumeTypeFromImageTest-233657515 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_844a3b78-d9ce-497b-9ca0-564dc91aaf39_43hzsaca' failed. Not Retrying. {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 22 15:54:46 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[02588ec3-d4ad-40fa-bfc0-2591a1839de7]: (4, 'raw') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:54:46 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-716a517f-afdb-40af-991f-821b48a4dd5a tempest-VolumeAndVolumeTypeFromImageTest-233657515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_844a3b78-d9ce-497b-9ca0-564dc91aaf39_x4m1w8rodevstack@QuobyteHD {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:54:46 devstack sudo[103278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_844a3b78-d9ce-497b-9ca0-564dc91aaf39_x4m1w8rodevstack@QuobyteHD Sep 22 15:54:46 devstack sudo[103278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:54:46 devstack sudo[103278]: pam_unix(sudo:session): session closed for user root Sep 22 15:54:46 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-716a517f-afdb-40af-991f-821b48a4dd5a tempest-VolumeAndVolumeTypeFromImageTest-233657515 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_844a3b78-d9ce-497b-9ca0-564dc91aaf39_x4m1w8rodevstack@QuobyteHD" returned: 0 in 0.341s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:54:46 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-716a517f-afdb-40af-991f-821b48a4dd5a tempest-VolumeAndVolumeTypeFromImageTest-233657515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_844a3b78-d9ce-497b-9ca0-564dc91aaf39_x4m1w8rodevstack@QuobyteHD {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:54:46 devstack sudo[103283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_844a3b78-d9ce-497b-9ca0-564dc91aaf39_x4m1w8rodevstack@QuobyteHD Sep 22 15:54:46 devstack sudo[103283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:54:46 devstack sudo[103283]: pam_unix(sudo:session): session closed for user root Sep 22 15:54:46 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-716a517f-afdb-40af-991f-821b48a4dd5a tempest-VolumeAndVolumeTypeFromImageTest-233657515 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_844a3b78-d9ce-497b-9ca0-564dc91aaf39_x4m1w8rodevstack@QuobyteHD" returned: 1 in 0.337s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:54:46 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-716a517f-afdb-40af-991f-821b48a4dd5a tempest-VolumeAndVolumeTypeFromImageTest-233657515 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_844a3b78-d9ce-497b-9ca0-564dc91aaf39_x4m1w8rodevstack@QuobyteHD' failed. Not Retrying. {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 22 15:54:46 devstack cinder-volume[86212]: DEBUG cinder.image.image_utils [None req-716a517f-afdb-40af-991f-821b48a4dd5a tempest-VolumeAndVolumeTypeFromImageTest-233657515 None] 844a3b78-d9ce-497b-9ca0-564dc91aaf39 was raw, converting to qcow2 {{(pid=86212) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 22 15:54:46 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-716a517f-afdb-40af-991f-821b48a4dd5a tempest-VolumeAndVolumeTypeFromImageTest-233657515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_844a3b78-d9ce-497b-9ca0-564dc91aaf39_x4m1w8rodevstack@QuobyteHD /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-169f3bab-1358-4348-a3da-7ba66ded9e98 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:54:46 devstack sudo[103288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_844a3b78-d9ce-497b-9ca0-564dc91aaf39_x4m1w8rodevstack@QuobyteHD /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-169f3bab-1358-4348-a3da-7ba66ded9e98 Sep 22 15:54:46 devstack sudo[103288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:54:47 devstack sudo[103288]: pam_unix(sudo:session): session closed for user root Sep 22 15:54:47 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-716a517f-afdb-40af-991f-821b48a4dd5a tempest-VolumeAndVolumeTypeFromImageTest-233657515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_844a3b78-d9ce-497b-9ca0-564dc91aaf39_x4m1w8rodevstack@QuobyteHD /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-169f3bab-1358-4348-a3da-7ba66ded9e98" returned: 0 in 0.572s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:54:47 devstack cinder-volume[86212]: DEBUG cinder.image.image_utils [None req-716a517f-afdb-40af-991f-821b48a4dd5a tempest-VolumeAndVolumeTypeFromImageTest-233657515 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_844a3b78-d9ce-497b-9ca0-564dc91aaf39_x4m1w8rodevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-169f3bab-1358-4348-a3da-7ba66ded9e98 {{(pid=86212) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 22 15:54:47 devstack cinder-volume[86212]: INFO cinder.image.image_utils [None req-716a517f-afdb-40af-991f-821b48a4dd5a tempest-VolumeAndVolumeTypeFromImageTest-233657515 None] Converted 0.00 MB image at 0.00 MB/s Sep 22 15:54:47 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-716a517f-afdb-40af-991f-821b48a4dd5a tempest-VolumeAndVolumeTypeFromImageTest-233657515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-169f3bab-1358-4348-a3da-7ba66ded9e98 1G {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:54:47 devstack sudo[103296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-169f3bab-1358-4348-a3da-7ba66ded9e98 1G Sep 22 15:54:47 devstack sudo[103296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:54:47 devstack sudo[103296]: pam_unix(sudo:session): session closed for user root Sep 22 15:54:47 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-716a517f-afdb-40af-991f-821b48a4dd5a tempest-VolumeAndVolumeTypeFromImageTest-233657515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-169f3bab-1358-4348-a3da-7ba66ded9e98 1G" returned: 0 in 0.315s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:54:47 devstack cinder-volume[86212]: DEBUG cinder.volume.volume_utils [None req-716a517f-afdb-40af-991f-821b48a4dd5a tempest-VolumeAndVolumeTypeFromImageTest-233657515 None] Downloaded image 844a3b78-d9ce-497b-9ca0-564dc91aaf39 ((None, [{'url': 'file:///opt/stack/data/glance/images/844a3b78-d9ce-497b-9ca0-564dc91aaf39', 'metadata': {}}])) to volume 169f3bab-1358-4348-a3da-7ba66ded9e98 successfully. {{(pid=86212) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 22 15:54:47 devstack cinder-volume[86212]: DEBUG cinder.image.image_utils [None req-716a517f-afdb-40af-991f-821b48a4dd5a tempest-VolumeAndVolumeTypeFromImageTest-233657515 None] Temporary image 844a3b78-d9ce-497b-9ca0-564dc91aaf39 for user a9eed60542c4488a909cad3edea69562 is deleted. {{(pid=86212) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 22 15:54:47 devstack cinder-volume[86212]: DEBUG cinder.volume.volume_utils [None req-716a517f-afdb-40af-991f-821b48a4dd5a tempest-VolumeAndVolumeTypeFromImageTest-233657515 None] Marking volume 169f3bab-1358-4348-a3da-7ba66ded9e98 as bootable. {{(pid=86212) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 22 15:54:47 devstack cinder-volume[86212]: DEBUG cinder.volume.flows.manager.create_volume [None req-716a517f-afdb-40af-991f-821b48a4dd5a tempest-VolumeAndVolumeTypeFromImageTest-233657515 None] Copying metadata from image 844a3b78-d9ce-497b-9ca0-564dc91aaf39 to 169f3bab-1358-4348-a3da-7ba66ded9e98. {{(pid=86212) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 22 15:54:47 devstack cinder-volume[86212]: DEBUG cinder.volume.flows.manager.create_volume [None req-716a517f-afdb-40af-991f-821b48a4dd5a tempest-VolumeAndVolumeTypeFromImageTest-233657515 None] Creating volume glance metadata for volume 169f3bab-1358-4348-a3da-7ba66ded9e98 backed by image 844a3b78-d9ce-497b-9ca0-564dc91aaf39 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '844a3b78-d9ce-497b-9ca0-564dc91aaf39', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'fabbb3e0046cb4408210f2616a21cd16', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86212) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 22 15:54:47 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-716a517f-afdb-40af-991f-821b48a4dd5a tempest-VolumeAndVolumeTypeFromImageTest-233657515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87840f7d-ab55-45e1-8506-5e20da2f77d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-169f3bab-1358-4348-a3da-7ba66ded9e98', 'volume_size': 1, 'image_id': '844a3b78-d9ce-497b-9ca0-564dc91aaf39', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/844a3b78-d9ce-497b-9ca0-564dc91aaf39', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'fabbb3e0046cb4408210f2616a21cd16', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'c149b71878e04b29a45ed2be0383b6e6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd56d8204d74e36ade5947233cc8bc990c10e54fda75f1e894e38b3bd9ca71c64fedf2fc423e83c8bb30833da5ee80dc6bb58a39f9197d6ac265774e4447d3d0d', 'id': '844a3b78-d9ce-497b-9ca0-564dc91aaf39', 'created_at': datetime.datetime(2026, 9, 22, 13, 54, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 13, 54, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/844a3b78-d9ce-497b-9ca0-564dc91aaf39/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:54:47 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-716a517f-afdb-40af-991f-821b48a4dd5a tempest-VolumeAndVolumeTypeFromImageTest-233657515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c80bebc2-09d8-4fb9-a356-289609f305ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:54:47 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-716a517f-afdb-40af-991f-821b48a4dd5a tempest-VolumeAndVolumeTypeFromImageTest-233657515 None] Volume volume-169f3bab-1358-4348-a3da-7ba66ded9e98 (169f3bab-1358-4348-a3da-7ba66ded9e98): created successfully Sep 22 15:54:47 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-716a517f-afdb-40af-991f-821b48a4dd5a tempest-VolumeAndVolumeTypeFromImageTest-233657515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c80bebc2-09d8-4fb9-a356-289609f305ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:54:47 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-716a517f-afdb-40af-991f-821b48a4dd5a tempest-VolumeAndVolumeTypeFromImageTest-233657515 None] Flow 'volume_create_manager' (8a693126-6a85-447b-8db1-505d5f307be4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:54:47 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-716a517f-afdb-40af-991f-821b48a4dd5a tempest-VolumeAndVolumeTypeFromImageTest-233657515 None] Created volume successfully. Sep 22 15:54:47 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-cd8015c8-f453-47b1-b6fc-8e440c019fca tempest-VolumeAndVolumeTypeFromImageTest-233657515 None] Acquiring lock "cinder-169f3bab-1358-4348-a3da-7ba66ded9e98-delete_volume" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:54:47 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-cd8015c8-f453-47b1-b6fc-8e440c019fca tempest-VolumeAndVolumeTypeFromImageTest-233657515 None] Lock "cinder-169f3bab-1358-4348-a3da-7ba66ded9e98-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:54:47 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-cd8015c8-f453-47b1-b6fc-8e440c019fca tempest-VolumeAndVolumeTypeFromImageTest-233657515 None] Acquiring lock "cinder-quobyte-169f3bab-1358-4348-a3da-7ba66ded9e98" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:54:47 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-cd8015c8-f453-47b1-b6fc-8e440c019fca tempest-VolumeAndVolumeTypeFromImageTest-233657515 None] Lock "cinder-quobyte-169f3bab-1358-4348-a3da-7ba66ded9e98" acquired by "delete_volume" :: waited 0.020s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:54:47 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[47f135d4-226a-4301-9718-638477817b84]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:54:47 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-cd8015c8-f453-47b1-b6fc-8e440c019fca tempest-VolumeAndVolumeTypeFromImageTest-233657515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-169f3bab-1358-4348-a3da-7ba66ded9e98 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:54:48 devstack sudo[103304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-169f3bab-1358-4348-a3da-7ba66ded9e98 Sep 22 15:54:48 devstack sudo[103304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:54:48 devstack sudo[103304]: pam_unix(sudo:session): session closed for user root Sep 22 15:54:48 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-cd8015c8-f453-47b1-b6fc-8e440c019fca tempest-VolumeAndVolumeTypeFromImageTest-233657515 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-169f3bab-1358-4348-a3da-7ba66ded9e98" returned: 0 in 0.383s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:54:48 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-cd8015c8-f453-47b1-b6fc-8e440c019fca tempest-VolumeAndVolumeTypeFromImageTest-233657515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-169f3bab-1358-4348-a3da-7ba66ded9e98 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:54:48 devstack sudo[103309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-169f3bab-1358-4348-a3da-7ba66ded9e98 Sep 22 15:54:48 devstack sudo[103309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:54:48 devstack sudo[103309]: pam_unix(sudo:session): session closed for user root Sep 22 15:54:48 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-cd8015c8-f453-47b1-b6fc-8e440c019fca tempest-VolumeAndVolumeTypeFromImageTest-233657515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-169f3bab-1358-4348-a3da-7ba66ded9e98" returned: 0 in 0.257s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:54:48 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-cd8015c8-f453-47b1-b6fc-8e440c019fca tempest-VolumeAndVolumeTypeFromImageTest-233657515 None] Lock "cinder-quobyte-169f3bab-1358-4348-a3da-7ba66ded9e98" released by "delete_volume" :: held 0.706s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:54:48 devstack cinder-volume[86212]: WARNING cinder.quota [None req-cd8015c8-f453-47b1-b6fc-8e440c019fca tempest-VolumeAndVolumeTypeFromImageTest-233657515 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 22 15:54:48 devstack cinder-volume[86212]: WARNING cinder.quota [None req-cd8015c8-f453-47b1-b6fc-8e440c019fca tempest-VolumeAndVolumeTypeFromImageTest-233657515 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 22 15:54:48 devstack cinder-volume[86212]: DEBUG cinder.quota [None req-cd8015c8-f453-47b1-b6fc-8e440c019fca tempest-VolumeAndVolumeTypeFromImageTest-233657515 None] Created reservations ['c0c3aab4-b232-4d30-8e06-b07c45fcea3f', 'b13cecb9-e122-4f6b-bb3f-ed92f3cb16bf', 'c9ef2864-b72c-4ff7-8a84-af08b3cfd4ee', 'ccfa4c8e-b4a9-44f0-bb2a-13534fc2f8b4'] {{(pid=86212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 15:54:48 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-cd8015c8-f453-47b1-b6fc-8e440c019fca tempest-VolumeAndVolumeTypeFromImageTest-233657515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:54:48 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-cd8015c8-f453-47b1-b6fc-8e440c019fca tempest-VolumeAndVolumeTypeFromImageTest-233657515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:54:48 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-cd8015c8-f453-47b1-b6fc-8e440c019fca tempest-VolumeAndVolumeTypeFromImageTest-233657515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:54:48 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-cd8015c8-f453-47b1-b6fc-8e440c019fca tempest-VolumeAndVolumeTypeFromImageTest-233657515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:54:48 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-cd8015c8-f453-47b1-b6fc-8e440c019fca tempest-VolumeAndVolumeTypeFromImageTest-233657515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:54:48 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-cd8015c8-f453-47b1-b6fc-8e440c019fca tempest-VolumeAndVolumeTypeFromImageTest-233657515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:54:48 devstack sudo[103312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc Sep 22 15:54:48 devstack sudo[103312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:54:49 devstack sudo[103312]: pam_unix(sudo:session): session closed for user root Sep 22 15:54:49 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-cd8015c8-f453-47b1-b6fc-8e440c019fca tempest-VolumeAndVolumeTypeFromImageTest-233657515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc" returned: 0 in 0.283s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:54:49 devstack cinder-volume[86212]: DEBUG cinder.manager [None req-cd8015c8-f453-47b1-b6fc-8e440c019fca tempest-VolumeAndVolumeTypeFromImageTest-233657515 None] Notifying Schedulers of capabilities ... {{(pid=86212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 15:54:49 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-cd8015c8-f453-47b1-b6fc-8e440c019fca tempest-VolumeAndVolumeTypeFromImageTest-233657515 None] Deleted volume successfully. Sep 22 15:54:49 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-cd8015c8-f453-47b1-b6fc-8e440c019fca tempest-VolumeAndVolumeTypeFromImageTest-233657515 None] Lock "cinder-169f3bab-1358-4348-a3da-7ba66ded9e98-delete_volume" released by "delete_volume" :: held 1.221s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:54:53 devstack cinder-volume[86212]: DEBUG cinder.volume.flows.manager.create_volume [None req-30f2d36e-7de1-4844-9b74-69b06c0de5b6 tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 15:54:53 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-30f2d36e-7de1-4844-9b74-69b06c0de5b6 tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Flow 'volume_create_manager' (c5e7a4b6-9326-43b3-bab6-ef89e4b470bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:54:53 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-30f2d36e-7de1-4844-9b74-69b06c0de5b6 tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42f7492f-5ed1-46d8-ac81-3c78cd82663a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:54:53 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-30f2d36e-7de1-4844-9b74-69b06c0de5b6 tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42f7492f-5ed1-46d8-ac81-3c78cd82663a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:54:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1994264160',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8be52f9e-3b5f-40d0-84ef-bd02dd28a048,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82ab233b34e2400fb93ab6b0aac0088d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:54:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:54:54Z,use_quota=True,user_id='af0afe9a1b034c12b018fb6be00858bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:54:53 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-30f2d36e-7de1-4844-9b74-69b06c0de5b6 tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c36e2ed-e60b-4385-ab5f-ce1b5dcd6ae9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:54:53 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-30f2d36e-7de1-4844-9b74-69b06c0de5b6 tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c36e2ed-e60b-4385-ab5f-ce1b5dcd6ae9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:54:53 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-30f2d36e-7de1-4844-9b74-69b06c0de5b6 tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (961dbcc5-8834-46a2-8795-2cdc88319365) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:54:53 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-30f2d36e-7de1-4844-9b74-69b06c0de5b6 tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (961dbcc5-8834-46a2-8795-2cdc88319365) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8be52f9e-3b5f-40d0-84ef-bd02dd28a048', 'volume_name': 'volume-8be52f9e-3b5f-40d0-84ef-bd02dd28a048', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:54:53 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-30f2d36e-7de1-4844-9b74-69b06c0de5b6 tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf83ad79-0383-41ea-b614-244779ec9cc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:54:53 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-30f2d36e-7de1-4844-9b74-69b06c0de5b6 tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf83ad79-0383-41ea-b614-244779ec9cc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:54:53 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-30f2d36e-7de1-4844-9b74-69b06c0de5b6 tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e41a4a3a-19d8-4ea5-bf57-b052fb679818) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:54:53 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-30f2d36e-7de1-4844-9b74-69b06c0de5b6 tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Volume 8be52f9e-3b5f-40d0-84ef-bd02dd28a048: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8be52f9e-3b5f-40d0-84ef-bd02dd28a048', 'volume_size': 1} Sep 22 15:54:53 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-30f2d36e-7de1-4844-9b74-69b06c0de5b6 tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:54:53 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-30f2d36e-7de1-4844-9b74-69b06c0de5b6 tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:54:53 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-30f2d36e-7de1-4844-9b74-69b06c0de5b6 tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:54:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1994264160',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8be52f9e-3b5f-40d0-84ef-bd02dd28a048,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82ab233b34e2400fb93ab6b0aac0088d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:54:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:54:54Z,use_quota=True,user_id='af0afe9a1b034c12b018fb6be00858bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)}" {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 15:54:53 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-30f2d36e-7de1-4844-9b74-69b06c0de5b6 tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Creating volume 8be52f9e-3b5f-40d0-84ef-bd02dd28a048 {{(pid=86212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 15:54:53 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-30f2d36e-7de1-4844-9b74-69b06c0de5b6 tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:54:53 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-30f2d36e-7de1-4844-9b74-69b06c0de5b6 tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:54:53 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-30f2d36e-7de1-4844-9b74-69b06c0de5b6 tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:54:53 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-30f2d36e-7de1-4844-9b74-69b06c0de5b6 tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:54:53 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-30f2d36e-7de1-4844-9b74-69b06c0de5b6 tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:54:53 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-30f2d36e-7de1-4844-9b74-69b06c0de5b6 tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Selected osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 as target Quobyte volume. {{(pid=86212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 15:54:53 devstack cinder-volume[86212]: INFO cinder.volume.drivers.remotefs [None req-30f2d36e-7de1-4844-9b74-69b06c0de5b6 tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] casted to osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 Sep 22 15:54:53 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-30f2d36e-7de1-4844-9b74-69b06c0de5b6 tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8be52f9e-3b5f-40d0-84ef-bd02dd28a048 1073741824 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:54:53 devstack sudo[103323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8be52f9e-3b5f-40d0-84ef-bd02dd28a048 1073741824 Sep 22 15:54:53 devstack sudo[103323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:54:54 devstack sudo[103323]: pam_unix(sudo:session): session closed for user root Sep 22 15:54:54 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-30f2d36e-7de1-4844-9b74-69b06c0de5b6 tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8be52f9e-3b5f-40d0-84ef-bd02dd28a048 1073741824" returned: 0 in 0.460s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:54:54 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-30f2d36e-7de1-4844-9b74-69b06c0de5b6 tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8be52f9e-3b5f-40d0-84ef-bd02dd28a048 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:54:54 devstack sudo[103330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8be52f9e-3b5f-40d0-84ef-bd02dd28a048 Sep 22 15:54:54 devstack sudo[103330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:54:54 devstack cinder-volume[86212]: DEBUG cinder.volume.flows.manager.create_volume [None req-eab31bb4-9a70-493b-ac77-df5cf4989166 tempest-CreateVolumesFromImageTest-205263675 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 15:54:54 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-eab31bb4-9a70-493b-ac77-df5cf4989166 tempest-CreateVolumesFromImageTest-205263675 None] Flow 'volume_create_manager' (69270554-a97d-4390-925e-c1be1e9eb2c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:54:54 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-eab31bb4-9a70-493b-ac77-df5cf4989166 tempest-CreateVolumesFromImageTest-205263675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa5bf352-1df9-40aa-bbe2-921c32368dd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:54:54 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-eab31bb4-9a70-493b-ac77-df5cf4989166 tempest-CreateVolumesFromImageTest-205263675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa5bf352-1df9-40aa-bbe2-921c32368dd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:54:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1287666821',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0c173a5-94d6-4fc6-a8e7-26f89bcd30b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='253ee7f14ad540f19dc6d43274168980',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:54:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:54:54Z,use_quota=True,user_id='4da14fc83b634a3a9adc757285470ea5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:54:54 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-eab31bb4-9a70-493b-ac77-df5cf4989166 tempest-CreateVolumesFromImageTest-205263675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (248cbdd1-93cd-4a8d-b10d-10e85ef66946) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:54:54 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-eab31bb4-9a70-493b-ac77-df5cf4989166 tempest-CreateVolumesFromImageTest-205263675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (248cbdd1-93cd-4a8d-b10d-10e85ef66946) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:54:54 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-eab31bb4-9a70-493b-ac77-df5cf4989166 tempest-CreateVolumesFromImageTest-205263675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dea77bfe-2572-493a-a5cd-015f173315e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:54:54 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-eab31bb4-9a70-493b-ac77-df5cf4989166 tempest-CreateVolumesFromImageTest-205263675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dea77bfe-2572-493a-a5cd-015f173315e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a0c173a5-94d6-4fc6-a8e7-26f89bcd30b4', 'volume_name': 'volume-a0c173a5-94d6-4fc6-a8e7-26f89bcd30b4', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:54:54 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-eab31bb4-9a70-493b-ac77-df5cf4989166 tempest-CreateVolumesFromImageTest-205263675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68112d10-7892-475e-84f3-58c8bf838efa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:54:54 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-eab31bb4-9a70-493b-ac77-df5cf4989166 tempest-CreateVolumesFromImageTest-205263675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68112d10-7892-475e-84f3-58c8bf838efa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:54:54 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-eab31bb4-9a70-493b-ac77-df5cf4989166 tempest-CreateVolumesFromImageTest-205263675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b27fd31b-cb1b-460f-92f8-4523331dfaef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:54:54 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-eab31bb4-9a70-493b-ac77-df5cf4989166 tempest-CreateVolumesFromImageTest-205263675 None] Volume a0c173a5-94d6-4fc6-a8e7-26f89bcd30b4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a0c173a5-94d6-4fc6-a8e7-26f89bcd30b4', 'volume_size': 1} Sep 22 15:54:54 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-eab31bb4-9a70-493b-ac77-df5cf4989166 tempest-CreateVolumesFromImageTest-205263675 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:54:54 devstack sudo[103330]: pam_unix(sudo:session): session closed for user root Sep 22 15:54:54 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-30f2d36e-7de1-4844-9b74-69b06c0de5b6 tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8be52f9e-3b5f-40d0-84ef-bd02dd28a048" returned: 0 in 0.277s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:54:54 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-30f2d36e-7de1-4844-9b74-69b06c0de5b6 tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] <== create_volume: return (782ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'} {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 15:54:54 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-30f2d36e-7de1-4844-9b74-69b06c0de5b6 tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.784s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:54:54 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-eab31bb4-9a70-493b-ac77-df5cf4989166 tempest-CreateVolumesFromImageTest-205263675 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.076s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:54:54 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-eab31bb4-9a70-493b-ac77-df5cf4989166 tempest-CreateVolumesFromImageTest-205263675 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:54:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1287666821',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0c173a5-94d6-4fc6-a8e7-26f89bcd30b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='253ee7f14ad540f19dc6d43274168980',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:54:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:54:54Z,use_quota=True,user_id='4da14fc83b634a3a9adc757285470ea5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)}" {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 15:54:54 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-eab31bb4-9a70-493b-ac77-df5cf4989166 tempest-CreateVolumesFromImageTest-205263675 None] Creating volume a0c173a5-94d6-4fc6-a8e7-26f89bcd30b4 {{(pid=86212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 15:54:54 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-eab31bb4-9a70-493b-ac77-df5cf4989166 tempest-CreateVolumesFromImageTest-205263675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:54:54 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-eab31bb4-9a70-493b-ac77-df5cf4989166 tempest-CreateVolumesFromImageTest-205263675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:54:54 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-eab31bb4-9a70-493b-ac77-df5cf4989166 tempest-CreateVolumesFromImageTest-205263675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:54:54 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-eab31bb4-9a70-493b-ac77-df5cf4989166 tempest-CreateVolumesFromImageTest-205263675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:54:54 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-eab31bb4-9a70-493b-ac77-df5cf4989166 tempest-CreateVolumesFromImageTest-205263675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:54:54 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-eab31bb4-9a70-493b-ac77-df5cf4989166 tempest-CreateVolumesFromImageTest-205263675 None] Selected osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 as target Quobyte volume. {{(pid=86212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 15:54:54 devstack cinder-volume[86212]: INFO cinder.volume.drivers.remotefs [None req-eab31bb4-9a70-493b-ac77-df5cf4989166 tempest-CreateVolumesFromImageTest-205263675 None] casted to osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 Sep 22 15:54:54 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-eab31bb4-9a70-493b-ac77-df5cf4989166 tempest-CreateVolumesFromImageTest-205263675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a0c173a5-94d6-4fc6-a8e7-26f89bcd30b4 1073741824 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:54:54 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-30f2d36e-7de1-4844-9b74-69b06c0de5b6 tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e41a4a3a-19d8-4ea5-bf57-b052fb679818) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8be52f9e-3b5f-40d0-84ef-bd02dd28a048', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:54:54 devstack sudo[103333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a0c173a5-94d6-4fc6-a8e7-26f89bcd30b4 1073741824 Sep 22 15:54:54 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-30f2d36e-7de1-4844-9b74-69b06c0de5b6 tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (597c1294-bb0f-47fd-b404-a0eb9d073806) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:54:54 devstack sudo[103333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:54:54 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-30f2d36e-7de1-4844-9b74-69b06c0de5b6 tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Volume volume-8be52f9e-3b5f-40d0-84ef-bd02dd28a048 (8be52f9e-3b5f-40d0-84ef-bd02dd28a048): created successfully Sep 22 15:54:54 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-30f2d36e-7de1-4844-9b74-69b06c0de5b6 tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (597c1294-bb0f-47fd-b404-a0eb9d073806) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:54:54 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-30f2d36e-7de1-4844-9b74-69b06c0de5b6 tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Flow 'volume_create_manager' (c5e7a4b6-9326-43b3-bab6-ef89e4b470bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:54:54 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-30f2d36e-7de1-4844-9b74-69b06c0de5b6 tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Created volume successfully. Sep 22 15:54:54 devstack cinder-volume[86212]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a913b47-da99-4885-aee8-7b2e44d8e256 tempest-CreateVolumesFromImageTest-205263675 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 15:54:54 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-8a913b47-da99-4885-aee8-7b2e44d8e256 tempest-CreateVolumesFromImageTest-205263675 None] Flow 'volume_create_manager' (2c94f1bb-c195-436b-ba40-eb6da90d5981) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:54:54 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-8a913b47-da99-4885-aee8-7b2e44d8e256 tempest-CreateVolumesFromImageTest-205263675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a1c9b0b-1e73-48ee-805d-28e7943b14ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:54:54 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-8a913b47-da99-4885-aee8-7b2e44d8e256 tempest-CreateVolumesFromImageTest-205263675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a1c9b0b-1e73-48ee-805d-28e7943b14ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:54:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2140071498',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=452292cd-a8d8-48da-9fdd-a8b3c03c00b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='253ee7f14ad540f19dc6d43274168980',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:54:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:54:55Z,use_quota=True,user_id='4da14fc83b634a3a9adc757285470ea5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:54:54 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-8a913b47-da99-4885-aee8-7b2e44d8e256 tempest-CreateVolumesFromImageTest-205263675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (322da84d-f868-4a7f-b321-93f288766c75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:54:54 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-8a913b47-da99-4885-aee8-7b2e44d8e256 tempest-CreateVolumesFromImageTest-205263675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (322da84d-f868-4a7f-b321-93f288766c75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:54:54 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-8a913b47-da99-4885-aee8-7b2e44d8e256 tempest-CreateVolumesFromImageTest-205263675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0550f8b-bb39-45e2-a414-a1e61a43ebf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:54:54 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-8a913b47-da99-4885-aee8-7b2e44d8e256 tempest-CreateVolumesFromImageTest-205263675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0550f8b-bb39-45e2-a414-a1e61a43ebf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '452292cd-a8d8-48da-9fdd-a8b3c03c00b4', 'volume_name': 'volume-452292cd-a8d8-48da-9fdd-a8b3c03c00b4', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:54:54 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-8a913b47-da99-4885-aee8-7b2e44d8e256 tempest-CreateVolumesFromImageTest-205263675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e9680a5-909a-4fe3-b879-2220ac8ad27b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:54:54 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-8a913b47-da99-4885-aee8-7b2e44d8e256 tempest-CreateVolumesFromImageTest-205263675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e9680a5-909a-4fe3-b879-2220ac8ad27b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:54:54 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-8a913b47-da99-4885-aee8-7b2e44d8e256 tempest-CreateVolumesFromImageTest-205263675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (caa6dd3b-e3b5-43b2-a56b-f7845d0f84f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:54:55 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-8a913b47-da99-4885-aee8-7b2e44d8e256 tempest-CreateVolumesFromImageTest-205263675 None] Volume 452292cd-a8d8-48da-9fdd-a8b3c03c00b4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-452292cd-a8d8-48da-9fdd-a8b3c03c00b4', 'volume_size': 1} Sep 22 15:54:55 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-8a913b47-da99-4885-aee8-7b2e44d8e256 tempest-CreateVolumesFromImageTest-205263675 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:54:55 devstack sudo[103333]: pam_unix(sudo:session): session closed for user root Sep 22 15:54:55 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-eab31bb4-9a70-493b-ac77-df5cf4989166 tempest-CreateVolumesFromImageTest-205263675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a0c173a5-94d6-4fc6-a8e7-26f89bcd30b4 1073741824" returned: 0 in 0.549s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:54:55 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-eab31bb4-9a70-493b-ac77-df5cf4989166 tempest-CreateVolumesFromImageTest-205263675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a0c173a5-94d6-4fc6-a8e7-26f89bcd30b4 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:54:55 devstack cinder-volume[86212]: DEBUG cinder.volume.flows.manager.create_volume [None req-6970b337-4cd7-4f23-9cc5-2488d94dc09c tempest-CreateVolumesFromImageTest-205263675 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 15:54:55 devstack sudo[103339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a0c173a5-94d6-4fc6-a8e7-26f89bcd30b4 Sep 22 15:54:55 devstack sudo[103339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:54:55 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-6970b337-4cd7-4f23-9cc5-2488d94dc09c tempest-CreateVolumesFromImageTest-205263675 None] Flow 'volume_create_manager' (9e2597a9-ca45-4162-880b-0afdd51c7448) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:54:55 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-6970b337-4cd7-4f23-9cc5-2488d94dc09c tempest-CreateVolumesFromImageTest-205263675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb0772c8-0419-460b-9f64-43ef5790a2a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:54:55 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-6970b337-4cd7-4f23-9cc5-2488d94dc09c tempest-CreateVolumesFromImageTest-205263675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb0772c8-0419-460b-9f64-43ef5790a2a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:54:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1011955185',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07852a37-9ffc-4c4f-878e-c147ad90fa85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='253ee7f14ad540f19dc6d43274168980',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:54:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:54:55Z,use_quota=True,user_id='4da14fc83b634a3a9adc757285470ea5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:54:55 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-6970b337-4cd7-4f23-9cc5-2488d94dc09c tempest-CreateVolumesFromImageTest-205263675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e8b6b90-db50-4a25-9c23-18afaf5542bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:54:55 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-6970b337-4cd7-4f23-9cc5-2488d94dc09c tempest-CreateVolumesFromImageTest-205263675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e8b6b90-db50-4a25-9c23-18afaf5542bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:54:55 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-6970b337-4cd7-4f23-9cc5-2488d94dc09c tempest-CreateVolumesFromImageTest-205263675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (162a1b9b-d4dd-493e-a7a1-b59ce6e42de2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:54:55 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-6970b337-4cd7-4f23-9cc5-2488d94dc09c tempest-CreateVolumesFromImageTest-205263675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (162a1b9b-d4dd-493e-a7a1-b59ce6e42de2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '07852a37-9ffc-4c4f-878e-c147ad90fa85', 'volume_name': 'volume-07852a37-9ffc-4c4f-878e-c147ad90fa85', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:54:55 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-6970b337-4cd7-4f23-9cc5-2488d94dc09c tempest-CreateVolumesFromImageTest-205263675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39099d50-5e7c-4747-bd85-71a709c8ba59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:54:55 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-6970b337-4cd7-4f23-9cc5-2488d94dc09c tempest-CreateVolumesFromImageTest-205263675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39099d50-5e7c-4747-bd85-71a709c8ba59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:54:55 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-6970b337-4cd7-4f23-9cc5-2488d94dc09c tempest-CreateVolumesFromImageTest-205263675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8be1097-d36d-49d4-86c0-a5e34a7d7521) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:54:55 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-6970b337-4cd7-4f23-9cc5-2488d94dc09c tempest-CreateVolumesFromImageTest-205263675 None] Volume 07852a37-9ffc-4c4f-878e-c147ad90fa85: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-07852a37-9ffc-4c4f-878e-c147ad90fa85', 'volume_size': 1} Sep 22 15:54:55 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-6970b337-4cd7-4f23-9cc5-2488d94dc09c tempest-CreateVolumesFromImageTest-205263675 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:54:55 devstack sudo[103339]: pam_unix(sudo:session): session closed for user root Sep 22 15:54:55 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-eab31bb4-9a70-493b-ac77-df5cf4989166 tempest-CreateVolumesFromImageTest-205263675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a0c173a5-94d6-4fc6-a8e7-26f89bcd30b4" returned: 0 in 0.275s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:54:55 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-eab31bb4-9a70-493b-ac77-df5cf4989166 tempest-CreateVolumesFromImageTest-205263675 None] <== create_volume: return (876ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'} {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 15:54:55 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-eab31bb4-9a70-493b-ac77-df5cf4989166 tempest-CreateVolumesFromImageTest-205263675 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.878s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:54:55 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-8a913b47-da99-4885-aee8-7b2e44d8e256 tempest-CreateVolumesFromImageTest-205263675 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.600s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:54:55 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-8a913b47-da99-4885-aee8-7b2e44d8e256 tempest-CreateVolumesFromImageTest-205263675 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:54:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2140071498',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=452292cd-a8d8-48da-9fdd-a8b3c03c00b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='253ee7f14ad540f19dc6d43274168980',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:54:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:54:55Z,use_quota=True,user_id='4da14fc83b634a3a9adc757285470ea5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)}" {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 15:54:55 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-8a913b47-da99-4885-aee8-7b2e44d8e256 tempest-CreateVolumesFromImageTest-205263675 None] Creating volume 452292cd-a8d8-48da-9fdd-a8b3c03c00b4 {{(pid=86212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 15:54:55 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-8a913b47-da99-4885-aee8-7b2e44d8e256 tempest-CreateVolumesFromImageTest-205263675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:54:55 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-8a913b47-da99-4885-aee8-7b2e44d8e256 tempest-CreateVolumesFromImageTest-205263675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:54:55 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-8a913b47-da99-4885-aee8-7b2e44d8e256 tempest-CreateVolumesFromImageTest-205263675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:54:55 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-8a913b47-da99-4885-aee8-7b2e44d8e256 tempest-CreateVolumesFromImageTest-205263675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:54:55 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-8a913b47-da99-4885-aee8-7b2e44d8e256 tempest-CreateVolumesFromImageTest-205263675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:54:55 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-8a913b47-da99-4885-aee8-7b2e44d8e256 tempest-CreateVolumesFromImageTest-205263675 None] Selected osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 as target Quobyte volume. {{(pid=86212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 15:54:55 devstack cinder-volume[86212]: INFO cinder.volume.drivers.remotefs [None req-8a913b47-da99-4885-aee8-7b2e44d8e256 tempest-CreateVolumesFromImageTest-205263675 None] casted to osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 Sep 22 15:54:55 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-8a913b47-da99-4885-aee8-7b2e44d8e256 tempest-CreateVolumesFromImageTest-205263675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-452292cd-a8d8-48da-9fdd-a8b3c03c00b4 1073741824 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:54:55 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-eab31bb4-9a70-493b-ac77-df5cf4989166 tempest-CreateVolumesFromImageTest-205263675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b27fd31b-cb1b-460f-92f8-4523331dfaef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a0c173a5-94d6-4fc6-a8e7-26f89bcd30b4', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:54:55 devstack sudo[103342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-452292cd-a8d8-48da-9fdd-a8b3c03c00b4 1073741824 Sep 22 15:54:55 devstack sudo[103342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:54:55 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-eab31bb4-9a70-493b-ac77-df5cf4989166 tempest-CreateVolumesFromImageTest-205263675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8852fca0-1331-4641-96ef-eed26052b335) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:54:55 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-eab31bb4-9a70-493b-ac77-df5cf4989166 tempest-CreateVolumesFromImageTest-205263675 None] Volume volume-a0c173a5-94d6-4fc6-a8e7-26f89bcd30b4 (a0c173a5-94d6-4fc6-a8e7-26f89bcd30b4): created successfully Sep 22 15:54:55 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-eab31bb4-9a70-493b-ac77-df5cf4989166 tempest-CreateVolumesFromImageTest-205263675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8852fca0-1331-4641-96ef-eed26052b335) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:54:55 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-eab31bb4-9a70-493b-ac77-df5cf4989166 tempest-CreateVolumesFromImageTest-205263675 None] Flow 'volume_create_manager' (69270554-a97d-4390-925e-c1be1e9eb2c1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:54:55 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-eab31bb4-9a70-493b-ac77-df5cf4989166 tempest-CreateVolumesFromImageTest-205263675 None] Created volume successfully. Sep 22 15:54:55 devstack cinder-volume[86212]: DEBUG cinder.volume.flows.manager.create_volume [None req-784216f5-2fb5-4cde-b627-5737b92d7541 tempest-CreateVolumesFromImageTest-205263675 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 15:54:55 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-784216f5-2fb5-4cde-b627-5737b92d7541 tempest-CreateVolumesFromImageTest-205263675 None] Flow 'volume_create_manager' (ea80c113-39aa-494a-a6bc-3bf37a31f546) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:54:55 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-784216f5-2fb5-4cde-b627-5737b92d7541 tempest-CreateVolumesFromImageTest-205263675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8247273e-5525-4876-b218-a4aea9090f1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:54:55 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-784216f5-2fb5-4cde-b627-5737b92d7541 tempest-CreateVolumesFromImageTest-205263675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8247273e-5525-4876-b218-a4aea9090f1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:54:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1702395504',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca0023f6-9a80-4c0d-8b1f-cb2e5c8c674c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='253ee7f14ad540f19dc6d43274168980',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:54:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:54:56Z,use_quota=True,user_id='4da14fc83b634a3a9adc757285470ea5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:54:55 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-784216f5-2fb5-4cde-b627-5737b92d7541 tempest-CreateVolumesFromImageTest-205263675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac0a770f-29dc-418a-a17f-908973c1bf53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:54:55 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-784216f5-2fb5-4cde-b627-5737b92d7541 tempest-CreateVolumesFromImageTest-205263675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac0a770f-29dc-418a-a17f-908973c1bf53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:54:55 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-784216f5-2fb5-4cde-b627-5737b92d7541 tempest-CreateVolumesFromImageTest-205263675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f62ea369-de0a-4144-8200-2f1b3e413f6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:54:55 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-784216f5-2fb5-4cde-b627-5737b92d7541 tempest-CreateVolumesFromImageTest-205263675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f62ea369-de0a-4144-8200-2f1b3e413f6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ca0023f6-9a80-4c0d-8b1f-cb2e5c8c674c', 'volume_name': 'volume-ca0023f6-9a80-4c0d-8b1f-cb2e5c8c674c', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:54:55 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-784216f5-2fb5-4cde-b627-5737b92d7541 tempest-CreateVolumesFromImageTest-205263675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6769a30f-5184-4531-8395-6c507e3e9388) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:54:55 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-784216f5-2fb5-4cde-b627-5737b92d7541 tempest-CreateVolumesFromImageTest-205263675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6769a30f-5184-4531-8395-6c507e3e9388) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:54:55 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-784216f5-2fb5-4cde-b627-5737b92d7541 tempest-CreateVolumesFromImageTest-205263675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (048251df-08bc-436c-b4f6-ab3d6c6d341d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:54:55 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-784216f5-2fb5-4cde-b627-5737b92d7541 tempest-CreateVolumesFromImageTest-205263675 None] Volume ca0023f6-9a80-4c0d-8b1f-cb2e5c8c674c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ca0023f6-9a80-4c0d-8b1f-cb2e5c8c674c', 'volume_size': 1} Sep 22 15:54:55 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-784216f5-2fb5-4cde-b627-5737b92d7541 tempest-CreateVolumesFromImageTest-205263675 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:54:56 devstack cinder-volume[86212]: DEBUG cinder.volume.flows.manager.create_volume [None req-60b84507-1cce-416d-9034-920d9de56514 tempest-CreateVolumesFromImageTest-205263675 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 15:54:56 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-60b84507-1cce-416d-9034-920d9de56514 tempest-CreateVolumesFromImageTest-205263675 None] Flow 'volume_create_manager' (23ecc068-9aa3-4163-975b-c34471d13843) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:54:56 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-60b84507-1cce-416d-9034-920d9de56514 tempest-CreateVolumesFromImageTest-205263675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28a90b4a-301d-43d8-99b6-ecef7722e7c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:54:56 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-60b84507-1cce-416d-9034-920d9de56514 tempest-CreateVolumesFromImageTest-205263675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28a90b4a-301d-43d8-99b6-ecef7722e7c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:54:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2137024948',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb472749-92c2-4631-91de-f84cf04f4b64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='253ee7f14ad540f19dc6d43274168980',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:54:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:54:56Z,use_quota=True,user_id='4da14fc83b634a3a9adc757285470ea5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:54:56 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-60b84507-1cce-416d-9034-920d9de56514 tempest-CreateVolumesFromImageTest-205263675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e2639ef-86ff-4def-b2cd-20b568369ac9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:54:56 devstack sudo[103342]: pam_unix(sudo:session): session closed for user root Sep 22 15:54:56 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-60b84507-1cce-416d-9034-920d9de56514 tempest-CreateVolumesFromImageTest-205263675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e2639ef-86ff-4def-b2cd-20b568369ac9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:54:56 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-60b84507-1cce-416d-9034-920d9de56514 tempest-CreateVolumesFromImageTest-205263675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (858e4274-1e0e-49d6-9b05-396bc8cf29d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:54:56 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-60b84507-1cce-416d-9034-920d9de56514 tempest-CreateVolumesFromImageTest-205263675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (858e4274-1e0e-49d6-9b05-396bc8cf29d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bb472749-92c2-4631-91de-f84cf04f4b64', 'volume_name': 'volume-bb472749-92c2-4631-91de-f84cf04f4b64', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:54:56 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-60b84507-1cce-416d-9034-920d9de56514 tempest-CreateVolumesFromImageTest-205263675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8bd04cad-b911-489b-9ad1-2f48dd9a46fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:54:56 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-60b84507-1cce-416d-9034-920d9de56514 tempest-CreateVolumesFromImageTest-205263675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8bd04cad-b911-489b-9ad1-2f48dd9a46fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:54:56 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-60b84507-1cce-416d-9034-920d9de56514 tempest-CreateVolumesFromImageTest-205263675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14fbbf08-1eeb-46f8-bff8-a9e10f9d68dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:54:56 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-60b84507-1cce-416d-9034-920d9de56514 tempest-CreateVolumesFromImageTest-205263675 None] Volume bb472749-92c2-4631-91de-f84cf04f4b64: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bb472749-92c2-4631-91de-f84cf04f4b64', 'volume_size': 1} Sep 22 15:54:56 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-60b84507-1cce-416d-9034-920d9de56514 tempest-CreateVolumesFromImageTest-205263675 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:54:56 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-8a913b47-da99-4885-aee8-7b2e44d8e256 tempest-CreateVolumesFromImageTest-205263675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-452292cd-a8d8-48da-9fdd-a8b3c03c00b4 1073741824" returned: 0 in 0.660s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:54:56 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-8a913b47-da99-4885-aee8-7b2e44d8e256 tempest-CreateVolumesFromImageTest-205263675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-452292cd-a8d8-48da-9fdd-a8b3c03c00b4 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:54:56 devstack sudo[103348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-452292cd-a8d8-48da-9fdd-a8b3c03c00b4 Sep 22 15:54:56 devstack sudo[103348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:54:56 devstack cinder-volume[86212]: DEBUG cinder.volume.flows.manager.create_volume [None req-75e11723-facb-4071-b597-6e0f960d6a47 tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 15:54:56 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-75e11723-facb-4071-b597-6e0f960d6a47 tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Flow 'volume_create_manager' (67561555-a159-42c2-8fef-ba132d04e350) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:54:56 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-75e11723-facb-4071-b597-6e0f960d6a47 tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46baa848-a14e-4cd1-905a-4b1e4c9cc726) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:54:56 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-75e11723-facb-4071-b597-6e0f960d6a47 tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46baa848-a14e-4cd1-905a-4b1e4c9cc726) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:54:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-706429526',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a6d22b1-ac6c-434e-ac75-260edaa390f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82ab233b34e2400fb93ab6b0aac0088d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:54:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:54:56Z,use_quota=True,user_id='af0afe9a1b034c12b018fb6be00858bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:54:56 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-75e11723-facb-4071-b597-6e0f960d6a47 tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9dd96cb9-80d4-4e3d-85bb-de6aa561cbe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:54:56 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-75e11723-facb-4071-b597-6e0f960d6a47 tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9dd96cb9-80d4-4e3d-85bb-de6aa561cbe4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:54:56 devstack sudo[103348]: pam_unix(sudo:session): session closed for user root Sep 22 15:54:56 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-75e11723-facb-4071-b597-6e0f960d6a47 tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e7e9561-8131-4b9e-a81c-6beae0b83f4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:54:56 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-75e11723-facb-4071-b597-6e0f960d6a47 tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e7e9561-8131-4b9e-a81c-6beae0b83f4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3a6d22b1-ac6c-434e-ac75-260edaa390f2', 'volume_name': 'volume-3a6d22b1-ac6c-434e-ac75-260edaa390f2', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:54:56 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-75e11723-facb-4071-b597-6e0f960d6a47 tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e059edb8-f748-47ec-a4d6-18e8fc8b00a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:54:56 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-75e11723-facb-4071-b597-6e0f960d6a47 tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e059edb8-f748-47ec-a4d6-18e8fc8b00a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:54:56 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-75e11723-facb-4071-b597-6e0f960d6a47 tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b16b285c-4e7d-431c-8459-a43bddcba1a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:54:56 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-75e11723-facb-4071-b597-6e0f960d6a47 tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Volume 3a6d22b1-ac6c-434e-ac75-260edaa390f2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3a6d22b1-ac6c-434e-ac75-260edaa390f2', 'volume_size': 1} Sep 22 15:54:56 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-75e11723-facb-4071-b597-6e0f960d6a47 tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:54:56 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-8a913b47-da99-4885-aee8-7b2e44d8e256 tempest-CreateVolumesFromImageTest-205263675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-452292cd-a8d8-48da-9fdd-a8b3c03c00b4" returned: 0 in 0.302s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:54:56 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-8a913b47-da99-4885-aee8-7b2e44d8e256 tempest-CreateVolumesFromImageTest-205263675 None] <== create_volume: return (1004ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'} {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 15:54:56 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-8a913b47-da99-4885-aee8-7b2e44d8e256 tempest-CreateVolumesFromImageTest-205263675 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.007s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:54:56 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-6970b337-4cd7-4f23-9cc5-2488d94dc09c tempest-CreateVolumesFromImageTest-205263675 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.185s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:54:56 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-6970b337-4cd7-4f23-9cc5-2488d94dc09c tempest-CreateVolumesFromImageTest-205263675 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:54:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1011955185',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07852a37-9ffc-4c4f-878e-c147ad90fa85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='253ee7f14ad540f19dc6d43274168980',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:54:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:54:55Z,use_quota=True,user_id='4da14fc83b634a3a9adc757285470ea5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)}" {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 15:54:56 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-6970b337-4cd7-4f23-9cc5-2488d94dc09c tempest-CreateVolumesFromImageTest-205263675 None] Creating volume 07852a37-9ffc-4c4f-878e-c147ad90fa85 {{(pid=86212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 15:54:56 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-6970b337-4cd7-4f23-9cc5-2488d94dc09c tempest-CreateVolumesFromImageTest-205263675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:54:56 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-6970b337-4cd7-4f23-9cc5-2488d94dc09c tempest-CreateVolumesFromImageTest-205263675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:54:56 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-6970b337-4cd7-4f23-9cc5-2488d94dc09c tempest-CreateVolumesFromImageTest-205263675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:54:56 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-6970b337-4cd7-4f23-9cc5-2488d94dc09c tempest-CreateVolumesFromImageTest-205263675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:54:56 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-6970b337-4cd7-4f23-9cc5-2488d94dc09c tempest-CreateVolumesFromImageTest-205263675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:54:56 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-6970b337-4cd7-4f23-9cc5-2488d94dc09c tempest-CreateVolumesFromImageTest-205263675 None] Selected osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 as target Quobyte volume. {{(pid=86212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 15:54:56 devstack cinder-volume[86212]: INFO cinder.volume.drivers.remotefs [None req-6970b337-4cd7-4f23-9cc5-2488d94dc09c tempest-CreateVolumesFromImageTest-205263675 None] casted to osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 Sep 22 15:54:56 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-6970b337-4cd7-4f23-9cc5-2488d94dc09c tempest-CreateVolumesFromImageTest-205263675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-07852a37-9ffc-4c4f-878e-c147ad90fa85 1073741824 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:54:56 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-8a913b47-da99-4885-aee8-7b2e44d8e256 tempest-CreateVolumesFromImageTest-205263675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (caa6dd3b-e3b5-43b2-a56b-f7845d0f84f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-452292cd-a8d8-48da-9fdd-a8b3c03c00b4', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:54:56 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-8a913b47-da99-4885-aee8-7b2e44d8e256 tempest-CreateVolumesFromImageTest-205263675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03f989f3-be66-415b-9d3e-b8a0b8aac366) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:54:56 devstack sudo[103351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-07852a37-9ffc-4c4f-878e-c147ad90fa85 1073741824 Sep 22 15:54:56 devstack sudo[103351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:54:56 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-8a913b47-da99-4885-aee8-7b2e44d8e256 tempest-CreateVolumesFromImageTest-205263675 None] Volume volume-452292cd-a8d8-48da-9fdd-a8b3c03c00b4 (452292cd-a8d8-48da-9fdd-a8b3c03c00b4): created successfully Sep 22 15:54:56 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-8a913b47-da99-4885-aee8-7b2e44d8e256 tempest-CreateVolumesFromImageTest-205263675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03f989f3-be66-415b-9d3e-b8a0b8aac366) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:54:56 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-8a913b47-da99-4885-aee8-7b2e44d8e256 tempest-CreateVolumesFromImageTest-205263675 None] Flow 'volume_create_manager' (2c94f1bb-c195-436b-ba40-eb6da90d5981) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:54:56 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-8a913b47-da99-4885-aee8-7b2e44d8e256 tempest-CreateVolumesFromImageTest-205263675 None] Created volume successfully. Sep 22 15:54:57 devstack cinder-volume[86212]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8a80447-6c16-40f1-b2df-81a656dcd305 tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 15:54:57 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-e8a80447-6c16-40f1-b2df-81a656dcd305 tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Flow 'volume_create_manager' (0c0c1e93-df6f-4e4f-aae1-f384e29f60ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:54:57 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-e8a80447-6c16-40f1-b2df-81a656dcd305 tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ddd10ace-936d-40e4-9a45-8dc71ae89029) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:54:57 devstack sudo[103351]: pam_unix(sudo:session): session closed for user root Sep 22 15:54:57 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-6970b337-4cd7-4f23-9cc5-2488d94dc09c tempest-CreateVolumesFromImageTest-205263675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-07852a37-9ffc-4c4f-878e-c147ad90fa85 1073741824" returned: 0 in 0.553s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:54:57 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-e8a80447-6c16-40f1-b2df-81a656dcd305 tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ddd10ace-936d-40e4-9a45-8dc71ae89029) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:54:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1853478693',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14f05c92-60a8-44ab-870f-93f09ff0a022,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82ab233b34e2400fb93ab6b0aac0088d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:54:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:54:57Z,use_quota=True,user_id='af0afe9a1b034c12b018fb6be00858bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:54:57 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-e8a80447-6c16-40f1-b2df-81a656dcd305 tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15b4d4cc-c826-412e-b070-dadd008e002e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:54:57 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-e8a80447-6c16-40f1-b2df-81a656dcd305 tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15b4d4cc-c826-412e-b070-dadd008e002e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:54:57 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-e8a80447-6c16-40f1-b2df-81a656dcd305 tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5342663e-1190-4783-bf2d-0c42c34e1bda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:54:57 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-e8a80447-6c16-40f1-b2df-81a656dcd305 tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5342663e-1190-4783-bf2d-0c42c34e1bda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '14f05c92-60a8-44ab-870f-93f09ff0a022', 'volume_name': 'volume-14f05c92-60a8-44ab-870f-93f09ff0a022', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:54:57 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-e8a80447-6c16-40f1-b2df-81a656dcd305 tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df7bc162-35d6-4066-ae67-5edf4af2db28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:54:57 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-e8a80447-6c16-40f1-b2df-81a656dcd305 tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df7bc162-35d6-4066-ae67-5edf4af2db28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:54:57 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-e8a80447-6c16-40f1-b2df-81a656dcd305 tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c577945-c581-4067-94a8-8882e8a55802) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:54:57 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-e8a80447-6c16-40f1-b2df-81a656dcd305 tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Volume 14f05c92-60a8-44ab-870f-93f09ff0a022: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-14f05c92-60a8-44ab-870f-93f09ff0a022', 'volume_size': 1} Sep 22 15:54:57 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-e8a80447-6c16-40f1-b2df-81a656dcd305 tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:54:57 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-6970b337-4cd7-4f23-9cc5-2488d94dc09c tempest-CreateVolumesFromImageTest-205263675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-07852a37-9ffc-4c4f-878e-c147ad90fa85 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:54:57 devstack sudo[103357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-07852a37-9ffc-4c4f-878e-c147ad90fa85 Sep 22 15:54:57 devstack sudo[103357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:54:57 devstack cinder-volume[86212]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1cfcf3d-5046-4440-96c8-074c2c9ba388 tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 15:54:57 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-b1cfcf3d-5046-4440-96c8-074c2c9ba388 tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Flow 'volume_create_manager' (3be0f8f3-fcfc-4299-91ac-45d47233b405) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:54:57 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-b1cfcf3d-5046-4440-96c8-074c2c9ba388 tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (050df85a-e7df-4370-a3d7-94eeec06c771) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:54:57 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-b1cfcf3d-5046-4440-96c8-074c2c9ba388 tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (050df85a-e7df-4370-a3d7-94eeec06c771) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:54:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-359353913',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1144177a-9dbb-4493-80bf-45a79f34c816,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82ab233b34e2400fb93ab6b0aac0088d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:54:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:54:57Z,use_quota=True,user_id='af0afe9a1b034c12b018fb6be00858bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:54:57 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-b1cfcf3d-5046-4440-96c8-074c2c9ba388 tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24308492-fcc6-4492-a557-1b887c71370d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:54:57 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-b1cfcf3d-5046-4440-96c8-074c2c9ba388 tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24308492-fcc6-4492-a557-1b887c71370d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:54:57 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-b1cfcf3d-5046-4440-96c8-074c2c9ba388 tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b05251d-7c14-41f8-a058-29c3da5f8248) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:54:57 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-b1cfcf3d-5046-4440-96c8-074c2c9ba388 tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b05251d-7c14-41f8-a058-29c3da5f8248) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1144177a-9dbb-4493-80bf-45a79f34c816', 'volume_name': 'volume-1144177a-9dbb-4493-80bf-45a79f34c816', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:54:57 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-b1cfcf3d-5046-4440-96c8-074c2c9ba388 tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39e00a88-02f3-4127-8bf2-c5cad427a0a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:54:57 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-b1cfcf3d-5046-4440-96c8-074c2c9ba388 tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39e00a88-02f3-4127-8bf2-c5cad427a0a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:54:57 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-b1cfcf3d-5046-4440-96c8-074c2c9ba388 tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a267a2c0-8c66-4c84-a25d-9d820ab86fdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:54:57 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-b1cfcf3d-5046-4440-96c8-074c2c9ba388 tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Volume 1144177a-9dbb-4493-80bf-45a79f34c816: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1144177a-9dbb-4493-80bf-45a79f34c816', 'volume_size': 1} Sep 22 15:54:57 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-b1cfcf3d-5046-4440-96c8-074c2c9ba388 tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:54:57 devstack sudo[103357]: pam_unix(sudo:session): session closed for user root Sep 22 15:54:57 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-6970b337-4cd7-4f23-9cc5-2488d94dc09c tempest-CreateVolumesFromImageTest-205263675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-07852a37-9ffc-4c4f-878e-c147ad90fa85" returned: 0 in 0.304s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:54:57 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-6970b337-4cd7-4f23-9cc5-2488d94dc09c tempest-CreateVolumesFromImageTest-205263675 None] <== create_volume: return (949ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'} {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 15:54:57 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-6970b337-4cd7-4f23-9cc5-2488d94dc09c tempest-CreateVolumesFromImageTest-205263675 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.953s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:54:57 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-784216f5-2fb5-4cde-b627-5737b92d7541 tempest-CreateVolumesFromImageTest-205263675 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.687s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:54:57 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-784216f5-2fb5-4cde-b627-5737b92d7541 tempest-CreateVolumesFromImageTest-205263675 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:54:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1702395504',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca0023f6-9a80-4c0d-8b1f-cb2e5c8c674c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='253ee7f14ad540f19dc6d43274168980',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:54:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:54:56Z,use_quota=True,user_id='4da14fc83b634a3a9adc757285470ea5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)}" {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 15:54:57 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-784216f5-2fb5-4cde-b627-5737b92d7541 tempest-CreateVolumesFromImageTest-205263675 None] Creating volume ca0023f6-9a80-4c0d-8b1f-cb2e5c8c674c {{(pid=86212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 15:54:57 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-784216f5-2fb5-4cde-b627-5737b92d7541 tempest-CreateVolumesFromImageTest-205263675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:54:57 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-784216f5-2fb5-4cde-b627-5737b92d7541 tempest-CreateVolumesFromImageTest-205263675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:54:57 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-784216f5-2fb5-4cde-b627-5737b92d7541 tempest-CreateVolumesFromImageTest-205263675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:54:57 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-784216f5-2fb5-4cde-b627-5737b92d7541 tempest-CreateVolumesFromImageTest-205263675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:54:57 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-784216f5-2fb5-4cde-b627-5737b92d7541 tempest-CreateVolumesFromImageTest-205263675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:54:57 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-784216f5-2fb5-4cde-b627-5737b92d7541 tempest-CreateVolumesFromImageTest-205263675 None] Selected osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 as target Quobyte volume. {{(pid=86212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 15:54:57 devstack cinder-volume[86212]: INFO cinder.volume.drivers.remotefs [None req-784216f5-2fb5-4cde-b627-5737b92d7541 tempest-CreateVolumesFromImageTest-205263675 None] casted to osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 Sep 22 15:54:57 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-784216f5-2fb5-4cde-b627-5737b92d7541 tempest-CreateVolumesFromImageTest-205263675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-ca0023f6-9a80-4c0d-8b1f-cb2e5c8c674c 1073741824 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:54:57 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-6970b337-4cd7-4f23-9cc5-2488d94dc09c tempest-CreateVolumesFromImageTest-205263675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8be1097-d36d-49d4-86c0-a5e34a7d7521) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-07852a37-9ffc-4c4f-878e-c147ad90fa85', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:54:57 devstack sudo[103360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-ca0023f6-9a80-4c0d-8b1f-cb2e5c8c674c 1073741824 Sep 22 15:54:57 devstack sudo[103360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:54:57 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-6970b337-4cd7-4f23-9cc5-2488d94dc09c tempest-CreateVolumesFromImageTest-205263675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09d0f48b-9fdc-4a70-a85c-b28ae79e9d95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:54:57 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-6970b337-4cd7-4f23-9cc5-2488d94dc09c tempest-CreateVolumesFromImageTest-205263675 None] Volume volume-07852a37-9ffc-4c4f-878e-c147ad90fa85 (07852a37-9ffc-4c4f-878e-c147ad90fa85): created successfully Sep 22 15:54:57 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-6970b337-4cd7-4f23-9cc5-2488d94dc09c tempest-CreateVolumesFromImageTest-205263675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09d0f48b-9fdc-4a70-a85c-b28ae79e9d95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:54:57 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-6970b337-4cd7-4f23-9cc5-2488d94dc09c tempest-CreateVolumesFromImageTest-205263675 None] Flow 'volume_create_manager' (9e2597a9-ca45-4162-880b-0afdd51c7448) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:54:57 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-6970b337-4cd7-4f23-9cc5-2488d94dc09c tempest-CreateVolumesFromImageTest-205263675 None] Created volume successfully. Sep 22 15:54:57 devstack cinder-volume[86212]: DEBUG cinder.volume.flows.manager.create_volume [None req-d1a110f2-03ad-42d8-8793-55d6809bb9d8 tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 15:54:57 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-d1a110f2-03ad-42d8-8793-55d6809bb9d8 tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Flow 'volume_create_manager' (91108a4d-d3e2-4e64-af4e-84b7af879a6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:54:57 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-d1a110f2-03ad-42d8-8793-55d6809bb9d8 tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (134b2e98-9f48-4184-b107-d3c32119cca4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:54:57 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-d1a110f2-03ad-42d8-8793-55d6809bb9d8 tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (134b2e98-9f48-4184-b107-d3c32119cca4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:54:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1802174978',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27a1da87-4f05-4a3c-bbe7-1f4db9da1128,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82ab233b34e2400fb93ab6b0aac0088d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:54:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:54:58Z,use_quota=True,user_id='af0afe9a1b034c12b018fb6be00858bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:54:57 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-d1a110f2-03ad-42d8-8793-55d6809bb9d8 tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0abe2c07-4df0-4728-934f-f7939d0da687) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:54:57 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-d1a110f2-03ad-42d8-8793-55d6809bb9d8 tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0abe2c07-4df0-4728-934f-f7939d0da687) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:54:57 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-d1a110f2-03ad-42d8-8793-55d6809bb9d8 tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6dd63055-8c61-4e4d-8872-7d3bae933e41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:54:57 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-d1a110f2-03ad-42d8-8793-55d6809bb9d8 tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6dd63055-8c61-4e4d-8872-7d3bae933e41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '27a1da87-4f05-4a3c-bbe7-1f4db9da1128', 'volume_name': 'volume-27a1da87-4f05-4a3c-bbe7-1f4db9da1128', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:54:57 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-d1a110f2-03ad-42d8-8793-55d6809bb9d8 tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07bb4704-ffd0-4fa2-aba8-5f93abbe7445) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:54:57 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-d1a110f2-03ad-42d8-8793-55d6809bb9d8 tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07bb4704-ffd0-4fa2-aba8-5f93abbe7445) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:54:57 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-d1a110f2-03ad-42d8-8793-55d6809bb9d8 tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1834686c-7dde-41a6-850b-19855c61058e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:54:57 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-d1a110f2-03ad-42d8-8793-55d6809bb9d8 tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Volume 27a1da87-4f05-4a3c-bbe7-1f4db9da1128: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-27a1da87-4f05-4a3c-bbe7-1f4db9da1128', 'volume_size': 1} Sep 22 15:54:57 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-d1a110f2-03ad-42d8-8793-55d6809bb9d8 tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:54:58 devstack sudo[103360]: pam_unix(sudo:session): session closed for user root Sep 22 15:54:58 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-784216f5-2fb5-4cde-b627-5737b92d7541 tempest-CreateVolumesFromImageTest-205263675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-ca0023f6-9a80-4c0d-8b1f-cb2e5c8c674c 1073741824" returned: 0 in 0.540s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:54:58 devstack cinder-volume[86212]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb70703c-abf9-4082-8bbf-9455c842bc6c tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 15:54:58 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-cb70703c-abf9-4082-8bbf-9455c842bc6c tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Flow 'volume_create_manager' (90fc147c-14fa-4aa3-b795-3908971fed51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:54:58 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-cb70703c-abf9-4082-8bbf-9455c842bc6c tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23a344b8-2510-4759-bd8f-8374d81c6691) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:54:58 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-cb70703c-abf9-4082-8bbf-9455c842bc6c tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23a344b8-2510-4759-bd8f-8374d81c6691) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:54:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1836619155',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5c536cf-35a4-4160-85d8-9045a0fe6450,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82ab233b34e2400fb93ab6b0aac0088d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:54:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:54:58Z,use_quota=True,user_id='af0afe9a1b034c12b018fb6be00858bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:54:58 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-cb70703c-abf9-4082-8bbf-9455c842bc6c tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d2ae542-eaa5-453c-aeeb-6d649770f98f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:54:58 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-cb70703c-abf9-4082-8bbf-9455c842bc6c tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d2ae542-eaa5-453c-aeeb-6d649770f98f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:54:58 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-cb70703c-abf9-4082-8bbf-9455c842bc6c tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4d1275e-879e-4c56-904e-56753c7fa58d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:54:58 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-cb70703c-abf9-4082-8bbf-9455c842bc6c tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4d1275e-879e-4c56-904e-56753c7fa58d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a5c536cf-35a4-4160-85d8-9045a0fe6450', 'volume_name': 'volume-a5c536cf-35a4-4160-85d8-9045a0fe6450', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:54:58 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-cb70703c-abf9-4082-8bbf-9455c842bc6c tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f3a9b09-daf2-4491-8e9c-b768f3d02f45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:54:58 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-cb70703c-abf9-4082-8bbf-9455c842bc6c tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f3a9b09-daf2-4491-8e9c-b768f3d02f45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:54:58 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-cb70703c-abf9-4082-8bbf-9455c842bc6c tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23274112-1126-4794-84d0-75396dc19a8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:54:58 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-cb70703c-abf9-4082-8bbf-9455c842bc6c tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Volume a5c536cf-35a4-4160-85d8-9045a0fe6450: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a5c536cf-35a4-4160-85d8-9045a0fe6450', 'volume_size': 1} Sep 22 15:54:58 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-cb70703c-abf9-4082-8bbf-9455c842bc6c tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:54:58 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-784216f5-2fb5-4cde-b627-5737b92d7541 tempest-CreateVolumesFromImageTest-205263675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-ca0023f6-9a80-4c0d-8b1f-cb2e5c8c674c {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:54:58 devstack sudo[103366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-ca0023f6-9a80-4c0d-8b1f-cb2e5c8c674c Sep 22 15:54:58 devstack sudo[103366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:54:58 devstack sudo[103366]: pam_unix(sudo:session): session closed for user root Sep 22 15:54:58 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-784216f5-2fb5-4cde-b627-5737b92d7541 tempest-CreateVolumesFromImageTest-205263675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-ca0023f6-9a80-4c0d-8b1f-cb2e5c8c674c" returned: 0 in 0.271s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:54:58 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-784216f5-2fb5-4cde-b627-5737b92d7541 tempest-CreateVolumesFromImageTest-205263675 None] <== create_volume: return (938ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'} {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 15:54:58 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-784216f5-2fb5-4cde-b627-5737b92d7541 tempest-CreateVolumesFromImageTest-205263675 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.940s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:54:58 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-60b84507-1cce-416d-9034-920d9de56514 tempest-CreateVolumesFromImageTest-205263675 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.239s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:54:58 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-60b84507-1cce-416d-9034-920d9de56514 tempest-CreateVolumesFromImageTest-205263675 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:54:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2137024948',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb472749-92c2-4631-91de-f84cf04f4b64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='253ee7f14ad540f19dc6d43274168980',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:54:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:54:56Z,use_quota=True,user_id='4da14fc83b634a3a9adc757285470ea5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)}" {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 15:54:58 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-60b84507-1cce-416d-9034-920d9de56514 tempest-CreateVolumesFromImageTest-205263675 None] Creating volume bb472749-92c2-4631-91de-f84cf04f4b64 {{(pid=86212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 15:54:58 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-60b84507-1cce-416d-9034-920d9de56514 tempest-CreateVolumesFromImageTest-205263675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:54:58 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-60b84507-1cce-416d-9034-920d9de56514 tempest-CreateVolumesFromImageTest-205263675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:54:58 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-60b84507-1cce-416d-9034-920d9de56514 tempest-CreateVolumesFromImageTest-205263675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:54:58 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-60b84507-1cce-416d-9034-920d9de56514 tempest-CreateVolumesFromImageTest-205263675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:54:58 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-60b84507-1cce-416d-9034-920d9de56514 tempest-CreateVolumesFromImageTest-205263675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:54:58 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-60b84507-1cce-416d-9034-920d9de56514 tempest-CreateVolumesFromImageTest-205263675 None] Selected osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 as target Quobyte volume. {{(pid=86212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 15:54:58 devstack cinder-volume[86212]: INFO cinder.volume.drivers.remotefs [None req-60b84507-1cce-416d-9034-920d9de56514 tempest-CreateVolumesFromImageTest-205263675 None] casted to osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 Sep 22 15:54:58 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-60b84507-1cce-416d-9034-920d9de56514 tempest-CreateVolumesFromImageTest-205263675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-bb472749-92c2-4631-91de-f84cf04f4b64 1073741824 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:54:58 devstack sudo[103369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-bb472749-92c2-4631-91de-f84cf04f4b64 1073741824 Sep 22 15:54:58 devstack sudo[103369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:54:58 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-784216f5-2fb5-4cde-b627-5737b92d7541 tempest-CreateVolumesFromImageTest-205263675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (048251df-08bc-436c-b4f6-ab3d6c6d341d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ca0023f6-9a80-4c0d-8b1f-cb2e5c8c674c', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:54:58 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-784216f5-2fb5-4cde-b627-5737b92d7541 tempest-CreateVolumesFromImageTest-205263675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68f984e3-0b2d-42fd-9e69-219aa99dad33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:54:58 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-784216f5-2fb5-4cde-b627-5737b92d7541 tempest-CreateVolumesFromImageTest-205263675 None] Volume volume-ca0023f6-9a80-4c0d-8b1f-cb2e5c8c674c (ca0023f6-9a80-4c0d-8b1f-cb2e5c8c674c): created successfully Sep 22 15:54:58 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-784216f5-2fb5-4cde-b627-5737b92d7541 tempest-CreateVolumesFromImageTest-205263675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68f984e3-0b2d-42fd-9e69-219aa99dad33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:54:58 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-784216f5-2fb5-4cde-b627-5737b92d7541 tempest-CreateVolumesFromImageTest-205263675 None] Flow 'volume_create_manager' (ea80c113-39aa-494a-a6bc-3bf37a31f546) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:54:58 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-784216f5-2fb5-4cde-b627-5737b92d7541 tempest-CreateVolumesFromImageTest-205263675 None] Created volume successfully. Sep 22 15:54:58 devstack sudo[103369]: pam_unix(sudo:session): session closed for user root Sep 22 15:54:58 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-60b84507-1cce-416d-9034-920d9de56514 tempest-CreateVolumesFromImageTest-205263675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-bb472749-92c2-4631-91de-f84cf04f4b64 1073741824" returned: 0 in 0.461s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:54:59 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-60b84507-1cce-416d-9034-920d9de56514 tempest-CreateVolumesFromImageTest-205263675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-bb472749-92c2-4631-91de-f84cf04f4b64 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:54:59 devstack sudo[103375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-bb472749-92c2-4631-91de-f84cf04f4b64 Sep 22 15:54:59 devstack sudo[103375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:54:59 devstack sudo[103375]: pam_unix(sudo:session): session closed for user root Sep 22 15:54:59 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-60b84507-1cce-416d-9034-920d9de56514 tempest-CreateVolumesFromImageTest-205263675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-bb472749-92c2-4631-91de-f84cf04f4b64" returned: 0 in 0.255s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:54:59 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-60b84507-1cce-416d-9034-920d9de56514 tempest-CreateVolumesFromImageTest-205263675 None] <== create_volume: return (799ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'} {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 15:54:59 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-60b84507-1cce-416d-9034-920d9de56514 tempest-CreateVolumesFromImageTest-205263675 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.803s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:54:59 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-75e11723-facb-4071-b597-6e0f960d6a47 tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.713s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:54:59 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-75e11723-facb-4071-b597-6e0f960d6a47 tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:54:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-706429526',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a6d22b1-ac6c-434e-ac75-260edaa390f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82ab233b34e2400fb93ab6b0aac0088d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:54:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:54:56Z,use_quota=True,user_id='af0afe9a1b034c12b018fb6be00858bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)}" {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 15:54:59 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-75e11723-facb-4071-b597-6e0f960d6a47 tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Creating volume 3a6d22b1-ac6c-434e-ac75-260edaa390f2 {{(pid=86212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 15:54:59 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-75e11723-facb-4071-b597-6e0f960d6a47 tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:54:59 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-75e11723-facb-4071-b597-6e0f960d6a47 tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:54:59 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-75e11723-facb-4071-b597-6e0f960d6a47 tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:54:59 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-75e11723-facb-4071-b597-6e0f960d6a47 tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:54:59 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-75e11723-facb-4071-b597-6e0f960d6a47 tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:54:59 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-75e11723-facb-4071-b597-6e0f960d6a47 tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Selected osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 as target Quobyte volume. {{(pid=86212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 15:54:59 devstack cinder-volume[86212]: INFO cinder.volume.drivers.remotefs [None req-75e11723-facb-4071-b597-6e0f960d6a47 tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] casted to osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 Sep 22 15:54:59 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-75e11723-facb-4071-b597-6e0f960d6a47 tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-3a6d22b1-ac6c-434e-ac75-260edaa390f2 1073741824 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:54:59 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-60b84507-1cce-416d-9034-920d9de56514 tempest-CreateVolumesFromImageTest-205263675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14fbbf08-1eeb-46f8-bff8-a9e10f9d68dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb472749-92c2-4631-91de-f84cf04f4b64', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:54:59 devstack sudo[103378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-3a6d22b1-ac6c-434e-ac75-260edaa390f2 1073741824 Sep 22 15:54:59 devstack sudo[103378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:54:59 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-60b84507-1cce-416d-9034-920d9de56514 tempest-CreateVolumesFromImageTest-205263675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78636b97-f9dc-440a-a203-b1ef7aaf2523) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:54:59 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-60b84507-1cce-416d-9034-920d9de56514 tempest-CreateVolumesFromImageTest-205263675 None] Volume volume-bb472749-92c2-4631-91de-f84cf04f4b64 (bb472749-92c2-4631-91de-f84cf04f4b64): created successfully Sep 22 15:54:59 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-60b84507-1cce-416d-9034-920d9de56514 tempest-CreateVolumesFromImageTest-205263675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78636b97-f9dc-440a-a203-b1ef7aaf2523) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:54:59 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-60b84507-1cce-416d-9034-920d9de56514 tempest-CreateVolumesFromImageTest-205263675 None] Flow 'volume_create_manager' (23ecc068-9aa3-4163-975b-c34471d13843) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:54:59 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-60b84507-1cce-416d-9034-920d9de56514 tempest-CreateVolumesFromImageTest-205263675 None] Created volume successfully. Sep 22 15:54:59 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-f1ebfefb-dfce-4e9f-873f-68a51d71cad4 tempest-CreateVolumesFromImageTest-205263675 None] Acquiring lock "cinder-bb472749-92c2-4631-91de-f84cf04f4b64-delete_volume" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:54:59 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-f1ebfefb-dfce-4e9f-873f-68a51d71cad4 tempest-CreateVolumesFromImageTest-205263675 None] Lock "cinder-bb472749-92c2-4631-91de-f84cf04f4b64-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:54:59 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-f1ebfefb-dfce-4e9f-873f-68a51d71cad4 tempest-CreateVolumesFromImageTest-205263675 None] Acquiring lock "cinder-quobyte-bb472749-92c2-4631-91de-f84cf04f4b64" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:54:59 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-f1ebfefb-dfce-4e9f-873f-68a51d71cad4 tempest-CreateVolumesFromImageTest-205263675 None] Lock "cinder-quobyte-bb472749-92c2-4631-91de-f84cf04f4b64" acquired by "delete_volume" :: waited 0.016s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:54:59 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[08fd0f43-a0a5-4fb0-983f-973277dc19bc]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:54:59 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-f1ebfefb-dfce-4e9f-873f-68a51d71cad4 tempest-CreateVolumesFromImageTest-205263675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-bb472749-92c2-4631-91de-f84cf04f4b64 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:54:59 devstack sudo[103378]: pam_unix(sudo:session): session closed for user root Sep 22 15:54:59 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-75e11723-facb-4071-b597-6e0f960d6a47 tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-3a6d22b1-ac6c-434e-ac75-260edaa390f2 1073741824" returned: 0 in 0.524s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:54:59 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-75e11723-facb-4071-b597-6e0f960d6a47 tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-3a6d22b1-ac6c-434e-ac75-260edaa390f2 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:54:59 devstack sudo[103384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-bb472749-92c2-4631-91de-f84cf04f4b64 Sep 22 15:54:59 devstack sudo[103384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:54:59 devstack sudo[103385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-3a6d22b1-ac6c-434e-ac75-260edaa390f2 Sep 22 15:54:59 devstack sudo[103385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:55:00 devstack sudo[103385]: pam_unix(sudo:session): session closed for user root Sep 22 15:55:00 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-75e11723-facb-4071-b597-6e0f960d6a47 tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-3a6d22b1-ac6c-434e-ac75-260edaa390f2" returned: 0 in 0.263s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:55:00 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-75e11723-facb-4071-b597-6e0f960d6a47 tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] <== create_volume: return (832ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'} {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 15:55:00 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-75e11723-facb-4071-b597-6e0f960d6a47 tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.835s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:55:00 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-e8a80447-6c16-40f1-b2df-81a656dcd305 tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.931s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:55:00 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-e8a80447-6c16-40f1-b2df-81a656dcd305 tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:54:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1853478693',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14f05c92-60a8-44ab-870f-93f09ff0a022,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82ab233b34e2400fb93ab6b0aac0088d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:54:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:54:57Z,use_quota=True,user_id='af0afe9a1b034c12b018fb6be00858bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)}" {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 15:55:00 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-e8a80447-6c16-40f1-b2df-81a656dcd305 tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Creating volume 14f05c92-60a8-44ab-870f-93f09ff0a022 {{(pid=86212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 15:55:00 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-e8a80447-6c16-40f1-b2df-81a656dcd305 tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:55:00 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-e8a80447-6c16-40f1-b2df-81a656dcd305 tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:55:00 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-e8a80447-6c16-40f1-b2df-81a656dcd305 tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:55:00 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-e8a80447-6c16-40f1-b2df-81a656dcd305 tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:55:00 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-e8a80447-6c16-40f1-b2df-81a656dcd305 tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:55:00 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-e8a80447-6c16-40f1-b2df-81a656dcd305 tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Selected osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 as target Quobyte volume. {{(pid=86212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 15:55:00 devstack cinder-volume[86212]: INFO cinder.volume.drivers.remotefs [None req-e8a80447-6c16-40f1-b2df-81a656dcd305 tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] casted to osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 Sep 22 15:55:00 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-e8a80447-6c16-40f1-b2df-81a656dcd305 tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-14f05c92-60a8-44ab-870f-93f09ff0a022 1073741824 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:55:00 devstack sudo[103384]: pam_unix(sudo:session): session closed for user root Sep 22 15:55:00 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-f1ebfefb-dfce-4e9f-873f-68a51d71cad4 tempest-CreateVolumesFromImageTest-205263675 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-bb472749-92c2-4631-91de-f84cf04f4b64" returned: 0 in 0.408s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:55:00 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-f1ebfefb-dfce-4e9f-873f-68a51d71cad4 tempest-CreateVolumesFromImageTest-205263675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-bb472749-92c2-4631-91de-f84cf04f4b64 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:55:00 devstack sudo[103393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-14f05c92-60a8-44ab-870f-93f09ff0a022 1073741824 Sep 22 15:55:00 devstack sudo[103393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:55:00 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-75e11723-facb-4071-b597-6e0f960d6a47 tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b16b285c-4e7d-431c-8459-a43bddcba1a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a6d22b1-ac6c-434e-ac75-260edaa390f2', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:55:00 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-75e11723-facb-4071-b597-6e0f960d6a47 tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b6ecc44-d659-48d9-994d-5a7415951989) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:55:00 devstack sudo[103394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-bb472749-92c2-4631-91de-f84cf04f4b64 Sep 22 15:55:00 devstack sudo[103394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:55:00 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-75e11723-facb-4071-b597-6e0f960d6a47 tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Volume volume-3a6d22b1-ac6c-434e-ac75-260edaa390f2 (3a6d22b1-ac6c-434e-ac75-260edaa390f2): created successfully Sep 22 15:55:00 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-75e11723-facb-4071-b597-6e0f960d6a47 tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b6ecc44-d659-48d9-994d-5a7415951989) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:55:00 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-75e11723-facb-4071-b597-6e0f960d6a47 tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Flow 'volume_create_manager' (67561555-a159-42c2-8fef-ba132d04e350) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:55:00 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-75e11723-facb-4071-b597-6e0f960d6a47 tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Created volume successfully. Sep 22 15:55:00 devstack sudo[103394]: pam_unix(sudo:session): session closed for user root Sep 22 15:55:00 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-f1ebfefb-dfce-4e9f-873f-68a51d71cad4 tempest-CreateVolumesFromImageTest-205263675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-bb472749-92c2-4631-91de-f84cf04f4b64" returned: 0 in 0.262s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:55:00 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-f1ebfefb-dfce-4e9f-873f-68a51d71cad4 tempest-CreateVolumesFromImageTest-205263675 None] Lock "cinder-quobyte-bb472749-92c2-4631-91de-f84cf04f4b64" released by "delete_volume" :: held 0.717s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:55:00 devstack cinder-volume[86212]: DEBUG cinder.quota [None req-f1ebfefb-dfce-4e9f-873f-68a51d71cad4 tempest-CreateVolumesFromImageTest-205263675 None] Created reservations ['a975c158-36ef-423d-a224-e08157d06861', 'a1ce4c4e-620f-4c8e-a80a-7e545083d574', 'a0b6c0a9-78cb-465c-8a73-7b8ec19d54bb', 'fc31c768-38f8-4c8d-95d4-f4ebd694518a'] {{(pid=86212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 15:55:00 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-f1ebfefb-dfce-4e9f-873f-68a51d71cad4 tempest-CreateVolumesFromImageTest-205263675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:55:00 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-f1ebfefb-dfce-4e9f-873f-68a51d71cad4 tempest-CreateVolumesFromImageTest-205263675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:55:00 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-f1ebfefb-dfce-4e9f-873f-68a51d71cad4 tempest-CreateVolumesFromImageTest-205263675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:55:00 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-f1ebfefb-dfce-4e9f-873f-68a51d71cad4 tempest-CreateVolumesFromImageTest-205263675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:55:00 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-f1ebfefb-dfce-4e9f-873f-68a51d71cad4 tempest-CreateVolumesFromImageTest-205263675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:55:00 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-f1ebfefb-dfce-4e9f-873f-68a51d71cad4 tempest-CreateVolumesFromImageTest-205263675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:55:00 devstack sudo[103402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc Sep 22 15:55:00 devstack sudo[103402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:55:00 devstack sudo[103393]: pam_unix(sudo:session): session closed for user root Sep 22 15:55:00 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-e8a80447-6c16-40f1-b2df-81a656dcd305 tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-14f05c92-60a8-44ab-870f-93f09ff0a022 1073741824" returned: 0 in 0.474s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:55:00 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-e8a80447-6c16-40f1-b2df-81a656dcd305 tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-14f05c92-60a8-44ab-870f-93f09ff0a022 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:55:00 devstack sudo[103404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-14f05c92-60a8-44ab-870f-93f09ff0a022 Sep 22 15:55:00 devstack sudo[103404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:55:00 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-13ff8141-b573-42d1-a7d5-a7c62e101109 tempest-CreateVolumesFromImageTest-205263675 None] Acquiring lock "cinder-ca0023f6-9a80-4c0d-8b1f-cb2e5c8c674c-delete_volume" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:55:00 devstack sudo[103402]: pam_unix(sudo:session): session closed for user root Sep 22 15:55:00 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-f1ebfefb-dfce-4e9f-873f-68a51d71cad4 tempest-CreateVolumesFromImageTest-205263675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc" returned: 0 in 0.297s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:55:00 devstack cinder-volume[86212]: DEBUG cinder.manager [None req-f1ebfefb-dfce-4e9f-873f-68a51d71cad4 tempest-CreateVolumesFromImageTest-205263675 None] Notifying Schedulers of capabilities ... {{(pid=86212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 15:55:00 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-13ff8141-b573-42d1-a7d5-a7c62e101109 tempest-CreateVolumesFromImageTest-205263675 None] Lock "cinder-ca0023f6-9a80-4c0d-8b1f-cb2e5c8c674c-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:55:00 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-f1ebfefb-dfce-4e9f-873f-68a51d71cad4 tempest-CreateVolumesFromImageTest-205263675 None] Deleted volume successfully. Sep 22 15:55:00 devstack sudo[103404]: pam_unix(sudo:session): session closed for user root Sep 22 15:55:00 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-f1ebfefb-dfce-4e9f-873f-68a51d71cad4 tempest-CreateVolumesFromImageTest-205263675 None] Lock "cinder-bb472749-92c2-4631-91de-f84cf04f4b64-delete_volume" released by "delete_volume" :: held 1.258s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:55:00 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-e8a80447-6c16-40f1-b2df-81a656dcd305 tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-14f05c92-60a8-44ab-870f-93f09ff0a022" returned: 0 in 0.281s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:55:00 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-e8a80447-6c16-40f1-b2df-81a656dcd305 tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] <== create_volume: return (814ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'} {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 15:55:00 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-e8a80447-6c16-40f1-b2df-81a656dcd305 tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.817s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:55:00 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-b1cfcf3d-5046-4440-96c8-074c2c9ba388 tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.565s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:55:00 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-b1cfcf3d-5046-4440-96c8-074c2c9ba388 tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:54:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-359353913',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1144177a-9dbb-4493-80bf-45a79f34c816,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82ab233b34e2400fb93ab6b0aac0088d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:54:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:54:57Z,use_quota=True,user_id='af0afe9a1b034c12b018fb6be00858bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)}" {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 15:55:00 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-b1cfcf3d-5046-4440-96c8-074c2c9ba388 tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Creating volume 1144177a-9dbb-4493-80bf-45a79f34c816 {{(pid=86212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 15:55:00 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-b1cfcf3d-5046-4440-96c8-074c2c9ba388 tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:55:00 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-b1cfcf3d-5046-4440-96c8-074c2c9ba388 tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:55:00 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-b1cfcf3d-5046-4440-96c8-074c2c9ba388 tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:55:00 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-b1cfcf3d-5046-4440-96c8-074c2c9ba388 tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:55:00 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-b1cfcf3d-5046-4440-96c8-074c2c9ba388 tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:55:00 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-b1cfcf3d-5046-4440-96c8-074c2c9ba388 tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Selected osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 as target Quobyte volume. {{(pid=86212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 15:55:00 devstack cinder-volume[86212]: INFO cinder.volume.drivers.remotefs [None req-b1cfcf3d-5046-4440-96c8-074c2c9ba388 tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] casted to osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 Sep 22 15:55:00 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-b1cfcf3d-5046-4440-96c8-074c2c9ba388 tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-1144177a-9dbb-4493-80bf-45a79f34c816 1073741824 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:55:01 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-13ff8141-b573-42d1-a7d5-a7c62e101109 tempest-CreateVolumesFromImageTest-205263675 None] Acquiring lock "cinder-quobyte-ca0023f6-9a80-4c0d-8b1f-cb2e5c8c674c" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:55:01 devstack sudo[103408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-1144177a-9dbb-4493-80bf-45a79f34c816 1073741824 Sep 22 15:55:01 devstack sudo[103408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:55:01 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-e8a80447-6c16-40f1-b2df-81a656dcd305 tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c577945-c581-4067-94a8-8882e8a55802) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-14f05c92-60a8-44ab-870f-93f09ff0a022', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:55:01 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-e8a80447-6c16-40f1-b2df-81a656dcd305 tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1c6d7c4-9ec4-4e6f-abbc-7e4f9b9ebdfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:55:01 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-13ff8141-b573-42d1-a7d5-a7c62e101109 tempest-CreateVolumesFromImageTest-205263675 None] Lock "cinder-quobyte-ca0023f6-9a80-4c0d-8b1f-cb2e5c8c674c" acquired by "delete_volume" :: waited 0.029s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:55:01 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-e8a80447-6c16-40f1-b2df-81a656dcd305 tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Volume volume-14f05c92-60a8-44ab-870f-93f09ff0a022 (14f05c92-60a8-44ab-870f-93f09ff0a022): created successfully Sep 22 15:55:01 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-e8a80447-6c16-40f1-b2df-81a656dcd305 tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1c6d7c4-9ec4-4e6f-abbc-7e4f9b9ebdfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:55:01 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-e8a80447-6c16-40f1-b2df-81a656dcd305 tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Flow 'volume_create_manager' (0c0c1e93-df6f-4e4f-aae1-f384e29f60ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:55:01 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6b4fa3b-e221-4553-8b87-eabdcfdf62ab]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:55:01 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-13ff8141-b573-42d1-a7d5-a7c62e101109 tempest-CreateVolumesFromImageTest-205263675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-ca0023f6-9a80-4c0d-8b1f-cb2e5c8c674c {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:55:01 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-e8a80447-6c16-40f1-b2df-81a656dcd305 tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Created volume successfully. Sep 22 15:55:01 devstack sudo[103410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-ca0023f6-9a80-4c0d-8b1f-cb2e5c8c674c Sep 22 15:55:01 devstack sudo[103410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:55:01 devstack sudo[103410]: pam_unix(sudo:session): session closed for user root Sep 22 15:55:01 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-13ff8141-b573-42d1-a7d5-a7c62e101109 tempest-CreateVolumesFromImageTest-205263675 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-ca0023f6-9a80-4c0d-8b1f-cb2e5c8c674c" returned: 0 in 0.422s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:55:01 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-13ff8141-b573-42d1-a7d5-a7c62e101109 tempest-CreateVolumesFromImageTest-205263675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-ca0023f6-9a80-4c0d-8b1f-cb2e5c8c674c {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:55:01 devstack sudo[103408]: pam_unix(sudo:session): session closed for user root Sep 22 15:55:01 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-b1cfcf3d-5046-4440-96c8-074c2c9ba388 tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-1144177a-9dbb-4493-80bf-45a79f34c816 1073741824" returned: 0 in 0.520s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:55:01 devstack sudo[103421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-ca0023f6-9a80-4c0d-8b1f-cb2e5c8c674c Sep 22 15:55:01 devstack sudo[103421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:55:01 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-b1cfcf3d-5046-4440-96c8-074c2c9ba388 tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-1144177a-9dbb-4493-80bf-45a79f34c816 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:55:01 devstack sudo[103433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-1144177a-9dbb-4493-80bf-45a79f34c816 Sep 22 15:55:01 devstack sudo[103433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:55:01 devstack sudo[103421]: pam_unix(sudo:session): session closed for user root Sep 22 15:55:01 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-13ff8141-b573-42d1-a7d5-a7c62e101109 tempest-CreateVolumesFromImageTest-205263675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-ca0023f6-9a80-4c0d-8b1f-cb2e5c8c674c" returned: 0 in 0.289s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:55:01 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-13ff8141-b573-42d1-a7d5-a7c62e101109 tempest-CreateVolumesFromImageTest-205263675 None] Lock "cinder-quobyte-ca0023f6-9a80-4c0d-8b1f-cb2e5c8c674c" released by "delete_volume" :: held 0.770s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:55:01 devstack sudo[103433]: pam_unix(sudo:session): session closed for user root Sep 22 15:55:01 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-b1cfcf3d-5046-4440-96c8-074c2c9ba388 tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-1144177a-9dbb-4493-80bf-45a79f34c816" returned: 0 in 0.279s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:55:01 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-b1cfcf3d-5046-4440-96c8-074c2c9ba388 tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] <== create_volume: return (850ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'} {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 15:55:01 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-b1cfcf3d-5046-4440-96c8-074c2c9ba388 tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.853s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:55:01 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-d1a110f2-03ad-42d8-8793-55d6809bb9d8 tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.002s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:55:01 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-d1a110f2-03ad-42d8-8793-55d6809bb9d8 tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:54:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1802174978',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27a1da87-4f05-4a3c-bbe7-1f4db9da1128,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82ab233b34e2400fb93ab6b0aac0088d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:54:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:54:58Z,use_quota=True,user_id='af0afe9a1b034c12b018fb6be00858bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)}" {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 15:55:01 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-d1a110f2-03ad-42d8-8793-55d6809bb9d8 tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Creating volume 27a1da87-4f05-4a3c-bbe7-1f4db9da1128 {{(pid=86212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 15:55:01 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-d1a110f2-03ad-42d8-8793-55d6809bb9d8 tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:55:01 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-d1a110f2-03ad-42d8-8793-55d6809bb9d8 tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:55:01 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-d1a110f2-03ad-42d8-8793-55d6809bb9d8 tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:55:01 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-d1a110f2-03ad-42d8-8793-55d6809bb9d8 tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:55:01 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-d1a110f2-03ad-42d8-8793-55d6809bb9d8 tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:55:01 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-d1a110f2-03ad-42d8-8793-55d6809bb9d8 tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Selected osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 as target Quobyte volume. {{(pid=86212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 15:55:01 devstack cinder-volume[86212]: INFO cinder.volume.drivers.remotefs [None req-d1a110f2-03ad-42d8-8793-55d6809bb9d8 tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] casted to osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 Sep 22 15:55:01 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-d1a110f2-03ad-42d8-8793-55d6809bb9d8 tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-27a1da87-4f05-4a3c-bbe7-1f4db9da1128 1073741824 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:55:01 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-b1cfcf3d-5046-4440-96c8-074c2c9ba388 tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a267a2c0-8c66-4c84-a25d-9d820ab86fdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1144177a-9dbb-4493-80bf-45a79f34c816', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:55:01 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-b1cfcf3d-5046-4440-96c8-074c2c9ba388 tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1cd1d55b-8918-4fe8-be55-39e9a18f610d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:55:01 devstack sudo[103597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-27a1da87-4f05-4a3c-bbe7-1f4db9da1128 1073741824 Sep 22 15:55:01 devstack sudo[103597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:55:01 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-b1cfcf3d-5046-4440-96c8-074c2c9ba388 tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Volume volume-1144177a-9dbb-4493-80bf-45a79f34c816 (1144177a-9dbb-4493-80bf-45a79f34c816): created successfully Sep 22 15:55:01 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-b1cfcf3d-5046-4440-96c8-074c2c9ba388 tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1cd1d55b-8918-4fe8-be55-39e9a18f610d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:55:01 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-b1cfcf3d-5046-4440-96c8-074c2c9ba388 tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Flow 'volume_create_manager' (3be0f8f3-fcfc-4299-91ac-45d47233b405) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:55:01 devstack cinder-volume[86212]: DEBUG cinder.quota [None req-13ff8141-b573-42d1-a7d5-a7c62e101109 tempest-CreateVolumesFromImageTest-205263675 None] Created reservations ['923ff000-04a4-48ca-9abf-e5044fe20eb5', '48bec7ec-55c2-45fb-a7e8-7acf4e6caffe', '6514f7aa-0a95-4b50-8f0f-0a15535c6bce', 'b86c9937-87c7-4a78-8aa2-e2b231a94ba0'] {{(pid=86212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 15:55:01 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-b1cfcf3d-5046-4440-96c8-074c2c9ba388 tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Created volume successfully. Sep 22 15:55:02 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-13ff8141-b573-42d1-a7d5-a7c62e101109 tempest-CreateVolumesFromImageTest-205263675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:55:02 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-13ff8141-b573-42d1-a7d5-a7c62e101109 tempest-CreateVolumesFromImageTest-205263675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:55:02 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-13ff8141-b573-42d1-a7d5-a7c62e101109 tempest-CreateVolumesFromImageTest-205263675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:55:02 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-13ff8141-b573-42d1-a7d5-a7c62e101109 tempest-CreateVolumesFromImageTest-205263675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:55:02 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-13ff8141-b573-42d1-a7d5-a7c62e101109 tempest-CreateVolumesFromImageTest-205263675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:55:02 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-13ff8141-b573-42d1-a7d5-a7c62e101109 tempest-CreateVolumesFromImageTest-205263675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:55:02 devstack sudo[103674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc Sep 22 15:55:02 devstack sudo[103674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:55:02 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-4b570bba-0533-4816-9776-0a088265d16f tempest-CreateVolumesFromImageTest-205263675 None] Acquiring lock "cinder-07852a37-9ffc-4c4f-878e-c147ad90fa85-delete_volume" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:55:02 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-4b570bba-0533-4816-9776-0a088265d16f tempest-CreateVolumesFromImageTest-205263675 None] Lock "cinder-07852a37-9ffc-4c4f-878e-c147ad90fa85-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:55:02 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-4b570bba-0533-4816-9776-0a088265d16f tempest-CreateVolumesFromImageTest-205263675 None] Acquiring lock "cinder-quobyte-07852a37-9ffc-4c4f-878e-c147ad90fa85" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:55:02 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-4b570bba-0533-4816-9776-0a088265d16f tempest-CreateVolumesFromImageTest-205263675 None] Lock "cinder-quobyte-07852a37-9ffc-4c4f-878e-c147ad90fa85" acquired by "delete_volume" :: waited 0.018s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:55:02 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d7e94f4-5b75-4f17-abdd-3889cd47823d]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:55:02 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-4b570bba-0533-4816-9776-0a088265d16f tempest-CreateVolumesFromImageTest-205263675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-07852a37-9ffc-4c4f-878e-c147ad90fa85 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:55:02 devstack sudo[103674]: pam_unix(sudo:session): session closed for user root Sep 22 15:55:02 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-13ff8141-b573-42d1-a7d5-a7c62e101109 tempest-CreateVolumesFromImageTest-205263675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc" returned: 0 in 0.300s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:55:02 devstack cinder-volume[86212]: DEBUG cinder.manager [None req-13ff8141-b573-42d1-a7d5-a7c62e101109 tempest-CreateVolumesFromImageTest-205263675 None] Notifying Schedulers of capabilities ... {{(pid=86212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 15:55:02 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-13ff8141-b573-42d1-a7d5-a7c62e101109 tempest-CreateVolumesFromImageTest-205263675 None] Deleted volume successfully. Sep 22 15:55:02 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-13ff8141-b573-42d1-a7d5-a7c62e101109 tempest-CreateVolumesFromImageTest-205263675 None] Lock "cinder-ca0023f6-9a80-4c0d-8b1f-cb2e5c8c674c-delete_volume" released by "delete_volume" :: held 1.452s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:55:02 devstack sudo[103753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-07852a37-9ffc-4c4f-878e-c147ad90fa85 Sep 22 15:55:02 devstack sudo[103753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:55:02 devstack sudo[103597]: pam_unix(sudo:session): session closed for user root Sep 22 15:55:02 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-d1a110f2-03ad-42d8-8793-55d6809bb9d8 tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-27a1da87-4f05-4a3c-bbe7-1f4db9da1128 1073741824" returned: 0 in 0.591s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:55:02 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-d1a110f2-03ad-42d8-8793-55d6809bb9d8 tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-27a1da87-4f05-4a3c-bbe7-1f4db9da1128 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:55:02 devstack sudo[103766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-27a1da87-4f05-4a3c-bbe7-1f4db9da1128 Sep 22 15:55:02 devstack sudo[103766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:55:02 devstack sudo[103753]: pam_unix(sudo:session): session closed for user root Sep 22 15:55:02 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-4b570bba-0533-4816-9776-0a088265d16f tempest-CreateVolumesFromImageTest-205263675 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-07852a37-9ffc-4c4f-878e-c147ad90fa85" returned: 0 in 0.440s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:55:02 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-4b570bba-0533-4816-9776-0a088265d16f tempest-CreateVolumesFromImageTest-205263675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-07852a37-9ffc-4c4f-878e-c147ad90fa85 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:55:02 devstack sudo[103771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-07852a37-9ffc-4c4f-878e-c147ad90fa85 Sep 22 15:55:02 devstack sudo[103771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:55:02 devstack sudo[103766]: pam_unix(sudo:session): session closed for user root Sep 22 15:55:02 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-d1a110f2-03ad-42d8-8793-55d6809bb9d8 tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-27a1da87-4f05-4a3c-bbe7-1f4db9da1128" returned: 0 in 0.279s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:55:02 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-d1a110f2-03ad-42d8-8793-55d6809bb9d8 tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] <== create_volume: return (920ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'} {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 15:55:02 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-d1a110f2-03ad-42d8-8793-55d6809bb9d8 tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.924s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:55:02 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-cb70703c-abf9-4082-8bbf-9455c842bc6c tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.540s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:55:02 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-cb70703c-abf9-4082-8bbf-9455c842bc6c tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:54:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1836619155',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5c536cf-35a4-4160-85d8-9045a0fe6450,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82ab233b34e2400fb93ab6b0aac0088d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:54:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:54:58Z,use_quota=True,user_id='af0afe9a1b034c12b018fb6be00858bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)}" {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 15:55:02 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-cb70703c-abf9-4082-8bbf-9455c842bc6c tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Creating volume a5c536cf-35a4-4160-85d8-9045a0fe6450 {{(pid=86212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 15:55:02 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-cb70703c-abf9-4082-8bbf-9455c842bc6c tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:55:02 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-cb70703c-abf9-4082-8bbf-9455c842bc6c tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:55:02 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-cb70703c-abf9-4082-8bbf-9455c842bc6c tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:55:02 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-cb70703c-abf9-4082-8bbf-9455c842bc6c tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:55:02 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-cb70703c-abf9-4082-8bbf-9455c842bc6c tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:55:02 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-cb70703c-abf9-4082-8bbf-9455c842bc6c tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Selected osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 as target Quobyte volume. {{(pid=86212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 15:55:02 devstack cinder-volume[86212]: INFO cinder.volume.drivers.remotefs [None req-cb70703c-abf9-4082-8bbf-9455c842bc6c tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] casted to osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 Sep 22 15:55:02 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-cb70703c-abf9-4082-8bbf-9455c842bc6c tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a5c536cf-35a4-4160-85d8-9045a0fe6450 1073741824 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:55:02 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-d1a110f2-03ad-42d8-8793-55d6809bb9d8 tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1834686c-7dde-41a6-850b-19855c61058e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-27a1da87-4f05-4a3c-bbe7-1f4db9da1128', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:55:02 devstack sudo[103774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a5c536cf-35a4-4160-85d8-9045a0fe6450 1073741824 Sep 22 15:55:02 devstack sudo[103774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:55:02 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-d1a110f2-03ad-42d8-8793-55d6809bb9d8 tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f19e4dbf-43ca-447e-8906-deebb522f754) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:55:02 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-d1a110f2-03ad-42d8-8793-55d6809bb9d8 tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Volume volume-27a1da87-4f05-4a3c-bbe7-1f4db9da1128 (27a1da87-4f05-4a3c-bbe7-1f4db9da1128): created successfully Sep 22 15:55:02 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-d1a110f2-03ad-42d8-8793-55d6809bb9d8 tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f19e4dbf-43ca-447e-8906-deebb522f754) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:55:02 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-d1a110f2-03ad-42d8-8793-55d6809bb9d8 tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Flow 'volume_create_manager' (91108a4d-d3e2-4e64-af4e-84b7af879a6f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:55:02 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-d1a110f2-03ad-42d8-8793-55d6809bb9d8 tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Created volume successfully. Sep 22 15:55:02 devstack sudo[103771]: pam_unix(sudo:session): session closed for user root Sep 22 15:55:02 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-4b570bba-0533-4816-9776-0a088265d16f tempest-CreateVolumesFromImageTest-205263675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-07852a37-9ffc-4c4f-878e-c147ad90fa85" returned: 0 in 0.288s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:55:02 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-4b570bba-0533-4816-9776-0a088265d16f tempest-CreateVolumesFromImageTest-205263675 None] Lock "cinder-quobyte-07852a37-9ffc-4c4f-878e-c147ad90fa85" released by "delete_volume" :: held 0.779s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:55:03 devstack cinder-volume[86212]: DEBUG cinder.quota [None req-4b570bba-0533-4816-9776-0a088265d16f tempest-CreateVolumesFromImageTest-205263675 None] Created reservations ['d8b3bbbf-12b7-415d-8980-88a8d422f196', '9f3b9f70-37d6-4aa1-a819-907f7cedb7a7', '4e83d9d9-6d71-4bb8-8534-4225e2e0a84f', '2441d031-87f3-4e46-af86-9468ab4c26cb'] {{(pid=86212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 15:55:03 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-4b570bba-0533-4816-9776-0a088265d16f tempest-CreateVolumesFromImageTest-205263675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:55:03 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-4b570bba-0533-4816-9776-0a088265d16f tempest-CreateVolumesFromImageTest-205263675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:55:03 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-4b570bba-0533-4816-9776-0a088265d16f tempest-CreateVolumesFromImageTest-205263675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:55:03 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-4b570bba-0533-4816-9776-0a088265d16f tempest-CreateVolumesFromImageTest-205263675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:55:03 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-4b570bba-0533-4816-9776-0a088265d16f tempest-CreateVolumesFromImageTest-205263675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:55:03 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-4b570bba-0533-4816-9776-0a088265d16f tempest-CreateVolumesFromImageTest-205263675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:55:03 devstack sudo[103780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc Sep 22 15:55:03 devstack sudo[103780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:55:03 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-e64e615c-e1e4-48c5-a74d-b5bc4e196c54 tempest-CreateVolumesFromImageTest-205263675 None] Acquiring lock "cinder-452292cd-a8d8-48da-9fdd-a8b3c03c00b4-delete_volume" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:55:03 devstack sudo[103774]: pam_unix(sudo:session): session closed for user root Sep 22 15:55:03 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-cb70703c-abf9-4082-8bbf-9455c842bc6c tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a5c536cf-35a4-4160-85d8-9045a0fe6450 1073741824" returned: 0 in 0.552s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:55:03 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-e64e615c-e1e4-48c5-a74d-b5bc4e196c54 tempest-CreateVolumesFromImageTest-205263675 None] Lock "cinder-452292cd-a8d8-48da-9fdd-a8b3c03c00b4-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:55:03 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-cb70703c-abf9-4082-8bbf-9455c842bc6c tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a5c536cf-35a4-4160-85d8-9045a0fe6450 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:55:03 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-e64e615c-e1e4-48c5-a74d-b5bc4e196c54 tempest-CreateVolumesFromImageTest-205263675 None] Acquiring lock "cinder-quobyte-452292cd-a8d8-48da-9fdd-a8b3c03c00b4" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:55:03 devstack sudo[103784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a5c536cf-35a4-4160-85d8-9045a0fe6450 Sep 22 15:55:03 devstack sudo[103784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:55:03 devstack sudo[103780]: pam_unix(sudo:session): session closed for user root Sep 22 15:55:03 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-4b570bba-0533-4816-9776-0a088265d16f tempest-CreateVolumesFromImageTest-205263675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc" returned: 0 in 0.301s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:55:03 devstack cinder-volume[86212]: DEBUG cinder.manager [None req-4b570bba-0533-4816-9776-0a088265d16f tempest-CreateVolumesFromImageTest-205263675 None] Notifying Schedulers of capabilities ... {{(pid=86212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 15:55:03 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-e64e615c-e1e4-48c5-a74d-b5bc4e196c54 tempest-CreateVolumesFromImageTest-205263675 None] Lock "cinder-quobyte-452292cd-a8d8-48da-9fdd-a8b3c03c00b4" acquired by "delete_volume" :: waited 0.028s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:55:03 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-4b570bba-0533-4816-9776-0a088265d16f tempest-CreateVolumesFromImageTest-205263675 None] Deleted volume successfully. Sep 22 15:55:03 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-4b570bba-0533-4816-9776-0a088265d16f tempest-CreateVolumesFromImageTest-205263675 None] Lock "cinder-07852a37-9ffc-4c4f-878e-c147ad90fa85-delete_volume" released by "delete_volume" :: held 1.338s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:55:03 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b4bba5c-d829-4a0b-a97c-5bf0dee14832]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:55:03 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-e64e615c-e1e4-48c5-a74d-b5bc4e196c54 tempest-CreateVolumesFromImageTest-205263675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-452292cd-a8d8-48da-9fdd-a8b3c03c00b4 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:55:03 devstack sudo[103786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-452292cd-a8d8-48da-9fdd-a8b3c03c00b4 Sep 22 15:55:03 devstack sudo[103786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:55:03 devstack sudo[103784]: pam_unix(sudo:session): session closed for user root Sep 22 15:55:03 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-cb70703c-abf9-4082-8bbf-9455c842bc6c tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a5c536cf-35a4-4160-85d8-9045a0fe6450" returned: 0 in 0.274s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:55:03 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-cb70703c-abf9-4082-8bbf-9455c842bc6c tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] <== create_volume: return (888ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'} {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 15:55:03 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-cb70703c-abf9-4082-8bbf-9455c842bc6c tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.890s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:55:03 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-cb70703c-abf9-4082-8bbf-9455c842bc6c tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23274112-1126-4794-84d0-75396dc19a8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a5c536cf-35a4-4160-85d8-9045a0fe6450', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:55:03 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-cb70703c-abf9-4082-8bbf-9455c842bc6c tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (248e88a1-808d-4202-ab4b-2b3ac712c7c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:55:03 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-cb70703c-abf9-4082-8bbf-9455c842bc6c tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Volume volume-a5c536cf-35a4-4160-85d8-9045a0fe6450 (a5c536cf-35a4-4160-85d8-9045a0fe6450): created successfully Sep 22 15:55:03 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-cb70703c-abf9-4082-8bbf-9455c842bc6c tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (248e88a1-808d-4202-ab4b-2b3ac712c7c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:55:03 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-cb70703c-abf9-4082-8bbf-9455c842bc6c tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Flow 'volume_create_manager' (90fc147c-14fa-4aa3-b795-3908971fed51) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:55:03 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-cb70703c-abf9-4082-8bbf-9455c842bc6c tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Created volume successfully. Sep 22 15:55:03 devstack sudo[103786]: pam_unix(sudo:session): session closed for user root Sep 22 15:55:03 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-e64e615c-e1e4-48c5-a74d-b5bc4e196c54 tempest-CreateVolumesFromImageTest-205263675 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-452292cd-a8d8-48da-9fdd-a8b3c03c00b4" returned: 0 in 0.385s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:55:03 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-e64e615c-e1e4-48c5-a74d-b5bc4e196c54 tempest-CreateVolumesFromImageTest-205263675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-452292cd-a8d8-48da-9fdd-a8b3c03c00b4 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:55:03 devstack sudo[103792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-452292cd-a8d8-48da-9fdd-a8b3c03c00b4 Sep 22 15:55:03 devstack sudo[103792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:55:04 devstack sudo[103792]: pam_unix(sudo:session): session closed for user root Sep 22 15:55:04 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-e64e615c-e1e4-48c5-a74d-b5bc4e196c54 tempest-CreateVolumesFromImageTest-205263675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-452292cd-a8d8-48da-9fdd-a8b3c03c00b4" returned: 0 in 0.257s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:55:04 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-e64e615c-e1e4-48c5-a74d-b5bc4e196c54 tempest-CreateVolumesFromImageTest-205263675 None] Lock "cinder-quobyte-452292cd-a8d8-48da-9fdd-a8b3c03c00b4" released by "delete_volume" :: held 0.694s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:55:04 devstack cinder-volume[86212]: DEBUG cinder.quota [None req-e64e615c-e1e4-48c5-a74d-b5bc4e196c54 tempest-CreateVolumesFromImageTest-205263675 None] Created reservations ['94a302eb-a777-42f5-a6fa-4ce000b6e03c', '187a5666-8f78-41ba-988e-5f92fab1a10f', '9f25a504-1c49-4c14-a111-2180f3a94dd9', 'ab2a7336-917d-408d-a39a-1f547202ec6b'] {{(pid=86212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 15:55:04 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-e64e615c-e1e4-48c5-a74d-b5bc4e196c54 tempest-CreateVolumesFromImageTest-205263675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:55:04 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-e64e615c-e1e4-48c5-a74d-b5bc4e196c54 tempest-CreateVolumesFromImageTest-205263675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:55:04 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-e64e615c-e1e4-48c5-a74d-b5bc4e196c54 tempest-CreateVolumesFromImageTest-205263675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:55:04 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-e64e615c-e1e4-48c5-a74d-b5bc4e196c54 tempest-CreateVolumesFromImageTest-205263675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:55:04 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-e64e615c-e1e4-48c5-a74d-b5bc4e196c54 tempest-CreateVolumesFromImageTest-205263675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:55:04 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-e64e615c-e1e4-48c5-a74d-b5bc4e196c54 tempest-CreateVolumesFromImageTest-205263675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:55:04 devstack sudo[103795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc Sep 22 15:55:04 devstack sudo[103795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:55:04 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-023bb746-55f6-4368-8380-0ac21e2ea83a tempest-CreateVolumesFromImageTest-205263675 None] Acquiring lock "cinder-a0c173a5-94d6-4fc6-a8e7-26f89bcd30b4-delete_volume" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:55:04 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-023bb746-55f6-4368-8380-0ac21e2ea83a tempest-CreateVolumesFromImageTest-205263675 None] Lock "cinder-a0c173a5-94d6-4fc6-a8e7-26f89bcd30b4-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:55:04 devstack sudo[103795]: pam_unix(sudo:session): session closed for user root Sep 22 15:55:04 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-e64e615c-e1e4-48c5-a74d-b5bc4e196c54 tempest-CreateVolumesFromImageTest-205263675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc" returned: 0 in 0.289s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:55:04 devstack cinder-volume[86212]: DEBUG cinder.manager [None req-e64e615c-e1e4-48c5-a74d-b5bc4e196c54 tempest-CreateVolumesFromImageTest-205263675 None] Notifying Schedulers of capabilities ... {{(pid=86212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 15:55:04 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-e64e615c-e1e4-48c5-a74d-b5bc4e196c54 tempest-CreateVolumesFromImageTest-205263675 None] Deleted volume successfully. Sep 22 15:55:04 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-023bb746-55f6-4368-8380-0ac21e2ea83a tempest-CreateVolumesFromImageTest-205263675 None] Acquiring lock "cinder-quobyte-a0c173a5-94d6-4fc6-a8e7-26f89bcd30b4" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:55:04 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-023bb746-55f6-4368-8380-0ac21e2ea83a tempest-CreateVolumesFromImageTest-205263675 None] Lock "cinder-quobyte-a0c173a5-94d6-4fc6-a8e7-26f89bcd30b4" acquired by "delete_volume" :: waited 0.019s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:55:04 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-e64e615c-e1e4-48c5-a74d-b5bc4e196c54 tempest-CreateVolumesFromImageTest-205263675 None] Lock "cinder-452292cd-a8d8-48da-9fdd-a8b3c03c00b4-delete_volume" released by "delete_volume" :: held 1.243s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:55:04 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0af90fe-ea48-4c3a-aa49-bf5773e8ffa5]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:55:04 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-023bb746-55f6-4368-8380-0ac21e2ea83a tempest-CreateVolumesFromImageTest-205263675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a0c173a5-94d6-4fc6-a8e7-26f89bcd30b4 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:55:04 devstack sudo[103798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a0c173a5-94d6-4fc6-a8e7-26f89bcd30b4 Sep 22 15:55:04 devstack sudo[103798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:55:04 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-ee1bab85-441e-4639-9ea6-88028a6c7b82 tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Acquiring lock "cinder-a5c536cf-35a4-4160-85d8-9045a0fe6450-delete_volume" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:55:04 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-ee1bab85-441e-4639-9ea6-88028a6c7b82 tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Lock "cinder-a5c536cf-35a4-4160-85d8-9045a0fe6450-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:55:04 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-ee1bab85-441e-4639-9ea6-88028a6c7b82 tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Acquiring lock "cinder-quobyte-a5c536cf-35a4-4160-85d8-9045a0fe6450" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:55:04 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-ee1bab85-441e-4639-9ea6-88028a6c7b82 tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Lock "cinder-quobyte-a5c536cf-35a4-4160-85d8-9045a0fe6450" acquired by "delete_volume" :: waited 0.016s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:55:04 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[82f1d4e9-b601-45c1-b3c9-2144b8a1f608]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:55:04 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-ee1bab85-441e-4639-9ea6-88028a6c7b82 tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a5c536cf-35a4-4160-85d8-9045a0fe6450 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:55:04 devstack sudo[103798]: pam_unix(sudo:session): session closed for user root Sep 22 15:55:05 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-023bb746-55f6-4368-8380-0ac21e2ea83a tempest-CreateVolumesFromImageTest-205263675 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a0c173a5-94d6-4fc6-a8e7-26f89bcd30b4" returned: 0 in 0.412s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:55:05 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-023bb746-55f6-4368-8380-0ac21e2ea83a tempest-CreateVolumesFromImageTest-205263675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a0c173a5-94d6-4fc6-a8e7-26f89bcd30b4 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:55:05 devstack sudo[103804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a0c173a5-94d6-4fc6-a8e7-26f89bcd30b4 Sep 22 15:55:05 devstack sudo[103804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:55:05 devstack sudo[103802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a5c536cf-35a4-4160-85d8-9045a0fe6450 Sep 22 15:55:05 devstack sudo[103802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:55:05 devstack sudo[103804]: pam_unix(sudo:session): session closed for user root Sep 22 15:55:05 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-023bb746-55f6-4368-8380-0ac21e2ea83a tempest-CreateVolumesFromImageTest-205263675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a0c173a5-94d6-4fc6-a8e7-26f89bcd30b4" returned: 0 in 0.270s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:55:05 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-023bb746-55f6-4368-8380-0ac21e2ea83a tempest-CreateVolumesFromImageTest-205263675 None] Lock "cinder-quobyte-a0c173a5-94d6-4fc6-a8e7-26f89bcd30b4" released by "delete_volume" :: held 0.734s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:55:05 devstack sudo[103802]: pam_unix(sudo:session): session closed for user root Sep 22 15:55:05 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-ee1bab85-441e-4639-9ea6-88028a6c7b82 tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a5c536cf-35a4-4160-85d8-9045a0fe6450" returned: 0 in 0.371s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:55:05 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-ee1bab85-441e-4639-9ea6-88028a6c7b82 tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a5c536cf-35a4-4160-85d8-9045a0fe6450 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:55:05 devstack sudo[103811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a5c536cf-35a4-4160-85d8-9045a0fe6450 Sep 22 15:55:05 devstack sudo[103811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:55:05 devstack cinder-volume[86212]: DEBUG cinder.quota [None req-023bb746-55f6-4368-8380-0ac21e2ea83a tempest-CreateVolumesFromImageTest-205263675 None] Created reservations ['7de0df46-a8c2-47a0-9e29-1128f8b9eb8b', 'a3be547d-1d66-462d-886a-02a56d403a1d', 'efc38626-4e49-4de1-9181-dbfb7b7870d0', 'f28530d1-f81e-4d08-80a7-48ae962a5da2'] {{(pid=86212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 15:55:05 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-023bb746-55f6-4368-8380-0ac21e2ea83a tempest-CreateVolumesFromImageTest-205263675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:55:05 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-023bb746-55f6-4368-8380-0ac21e2ea83a tempest-CreateVolumesFromImageTest-205263675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:55:05 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-023bb746-55f6-4368-8380-0ac21e2ea83a tempest-CreateVolumesFromImageTest-205263675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:55:05 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-023bb746-55f6-4368-8380-0ac21e2ea83a tempest-CreateVolumesFromImageTest-205263675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:55:05 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-023bb746-55f6-4368-8380-0ac21e2ea83a tempest-CreateVolumesFromImageTest-205263675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:55:05 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-023bb746-55f6-4368-8380-0ac21e2ea83a tempest-CreateVolumesFromImageTest-205263675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:55:05 devstack sudo[103813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc Sep 22 15:55:05 devstack sudo[103813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:55:05 devstack sudo[103811]: pam_unix(sudo:session): session closed for user root Sep 22 15:55:05 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-ee1bab85-441e-4639-9ea6-88028a6c7b82 tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a5c536cf-35a4-4160-85d8-9045a0fe6450" returned: 0 in 0.257s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:55:05 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-ee1bab85-441e-4639-9ea6-88028a6c7b82 tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Lock "cinder-quobyte-a5c536cf-35a4-4160-85d8-9045a0fe6450" released by "delete_volume" :: held 0.676s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:55:05 devstack cinder-volume[86212]: DEBUG cinder.quota [None req-ee1bab85-441e-4639-9ea6-88028a6c7b82 tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Created reservations ['e2e4415c-2284-4201-8af5-d4f4f2f12c56', '276c0ce7-7254-4393-a3fb-39de218c1100', 'ba328d08-d92e-4c71-96fe-4f7a4f3417f4', 'b3c4cd3a-d939-4215-a497-b7ab50ea006f'] {{(pid=86212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 15:55:05 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-ee1bab85-441e-4639-9ea6-88028a6c7b82 tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:55:05 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-ee1bab85-441e-4639-9ea6-88028a6c7b82 tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:55:05 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-ee1bab85-441e-4639-9ea6-88028a6c7b82 tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:55:05 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-ee1bab85-441e-4639-9ea6-88028a6c7b82 tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:55:05 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-ee1bab85-441e-4639-9ea6-88028a6c7b82 tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:55:05 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-ee1bab85-441e-4639-9ea6-88028a6c7b82 tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:55:05 devstack sudo[103813]: pam_unix(sudo:session): session closed for user root Sep 22 15:55:05 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-023bb746-55f6-4368-8380-0ac21e2ea83a tempest-CreateVolumesFromImageTest-205263675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc" returned: 0 in 0.296s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:55:05 devstack cinder-volume[86212]: DEBUG cinder.manager [None req-023bb746-55f6-4368-8380-0ac21e2ea83a tempest-CreateVolumesFromImageTest-205263675 None] Notifying Schedulers of capabilities ... {{(pid=86212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 15:55:05 devstack sudo[103817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc Sep 22 15:55:05 devstack sudo[103817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:55:05 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-023bb746-55f6-4368-8380-0ac21e2ea83a tempest-CreateVolumesFromImageTest-205263675 None] Deleted volume successfully. Sep 22 15:55:05 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-023bb746-55f6-4368-8380-0ac21e2ea83a tempest-CreateVolumesFromImageTest-205263675 None] Lock "cinder-a0c173a5-94d6-4fc6-a8e7-26f89bcd30b4-delete_volume" released by "delete_volume" :: held 1.309s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:55:06 devstack sudo[103817]: pam_unix(sudo:session): session closed for user root Sep 22 15:55:06 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-66d67c48-866d-4052-b4f4-4a270ce16c1e tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Acquiring lock "cinder-27a1da87-4f05-4a3c-bbe7-1f4db9da1128-delete_volume" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:55:06 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-ee1bab85-441e-4639-9ea6-88028a6c7b82 tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc" returned: 0 in 0.295s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:55:06 devstack cinder-volume[86212]: DEBUG cinder.manager [None req-ee1bab85-441e-4639-9ea6-88028a6c7b82 tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Notifying Schedulers of capabilities ... {{(pid=86212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 15:55:06 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-ee1bab85-441e-4639-9ea6-88028a6c7b82 tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Deleted volume successfully. Sep 22 15:55:06 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-66d67c48-866d-4052-b4f4-4a270ce16c1e tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Lock "cinder-27a1da87-4f05-4a3c-bbe7-1f4db9da1128-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:55:06 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-ee1bab85-441e-4639-9ea6-88028a6c7b82 tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Lock "cinder-a5c536cf-35a4-4160-85d8-9045a0fe6450-delete_volume" released by "delete_volume" :: held 1.254s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:55:06 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-66d67c48-866d-4052-b4f4-4a270ce16c1e tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Acquiring lock "cinder-quobyte-27a1da87-4f05-4a3c-bbe7-1f4db9da1128" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:55:06 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-66d67c48-866d-4052-b4f4-4a270ce16c1e tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Lock "cinder-quobyte-27a1da87-4f05-4a3c-bbe7-1f4db9da1128" acquired by "delete_volume" :: waited 0.017s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:55:06 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6313d33-6dd2-4404-8f54-fd34a7e70667]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:55:06 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-66d67c48-866d-4052-b4f4-4a270ce16c1e tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-27a1da87-4f05-4a3c-bbe7-1f4db9da1128 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:55:06 devstack sudo[103820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-27a1da87-4f05-4a3c-bbe7-1f4db9da1128 Sep 22 15:55:06 devstack sudo[103820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:55:06 devstack sudo[103820]: pam_unix(sudo:session): session closed for user root Sep 22 15:55:06 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-66d67c48-866d-4052-b4f4-4a270ce16c1e tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-27a1da87-4f05-4a3c-bbe7-1f4db9da1128" returned: 0 in 0.401s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:55:06 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-66d67c48-866d-4052-b4f4-4a270ce16c1e tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-27a1da87-4f05-4a3c-bbe7-1f4db9da1128 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:55:06 devstack sudo[103825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-27a1da87-4f05-4a3c-bbe7-1f4db9da1128 Sep 22 15:55:06 devstack sudo[103825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:55:06 devstack sudo[103825]: pam_unix(sudo:session): session closed for user root Sep 22 15:55:06 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-66d67c48-866d-4052-b4f4-4a270ce16c1e tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-27a1da87-4f05-4a3c-bbe7-1f4db9da1128" returned: 0 in 0.295s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:55:06 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-66d67c48-866d-4052-b4f4-4a270ce16c1e tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Lock "cinder-quobyte-27a1da87-4f05-4a3c-bbe7-1f4db9da1128" released by "delete_volume" :: held 0.751s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:55:06 devstack cinder-volume[86212]: DEBUG cinder.quota [None req-66d67c48-866d-4052-b4f4-4a270ce16c1e tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Created reservations ['b388f642-d54f-4c73-964a-7f77cdf5ebbd', 'eeef4419-1636-4a4a-82d6-84ff977a93d9', '7f036a7f-6339-4713-9050-6fbd38cdbd3d', '36199485-57a3-4309-bb1c-2fb41066c3e3'] {{(pid=86212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 15:55:06 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-66d67c48-866d-4052-b4f4-4a270ce16c1e tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:55:06 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-66d67c48-866d-4052-b4f4-4a270ce16c1e tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:55:06 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-66d67c48-866d-4052-b4f4-4a270ce16c1e tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:55:07 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-66d67c48-866d-4052-b4f4-4a270ce16c1e tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:55:07 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-66d67c48-866d-4052-b4f4-4a270ce16c1e tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:55:07 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-66d67c48-866d-4052-b4f4-4a270ce16c1e tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:55:07 devstack sudo[103828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc Sep 22 15:55:07 devstack sudo[103828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:55:07 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-235fcefd-6fd0-4c08-8a5e-ae218d75eec5 tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Acquiring lock "cinder-1144177a-9dbb-4493-80bf-45a79f34c816-delete_volume" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:55:07 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-235fcefd-6fd0-4c08-8a5e-ae218d75eec5 tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Lock "cinder-1144177a-9dbb-4493-80bf-45a79f34c816-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:55:07 devstack sudo[103828]: pam_unix(sudo:session): session closed for user root Sep 22 15:55:07 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-66d67c48-866d-4052-b4f4-4a270ce16c1e tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc" returned: 0 in 0.280s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:55:07 devstack cinder-volume[86212]: DEBUG cinder.manager [None req-66d67c48-866d-4052-b4f4-4a270ce16c1e tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Notifying Schedulers of capabilities ... {{(pid=86212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 15:55:07 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-235fcefd-6fd0-4c08-8a5e-ae218d75eec5 tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Acquiring lock "cinder-quobyte-1144177a-9dbb-4493-80bf-45a79f34c816" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:55:07 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-66d67c48-866d-4052-b4f4-4a270ce16c1e tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Deleted volume successfully. Sep 22 15:55:07 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-235fcefd-6fd0-4c08-8a5e-ae218d75eec5 tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Lock "cinder-quobyte-1144177a-9dbb-4493-80bf-45a79f34c816" acquired by "delete_volume" :: waited 0.023s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:55:07 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-66d67c48-866d-4052-b4f4-4a270ce16c1e tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Lock "cinder-27a1da87-4f05-4a3c-bbe7-1f4db9da1128-delete_volume" released by "delete_volume" :: held 1.290s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:55:07 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[28c483c1-4259-4d16-9ae2-dd7b571d23c2]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:55:07 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-235fcefd-6fd0-4c08-8a5e-ae218d75eec5 tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-1144177a-9dbb-4493-80bf-45a79f34c816 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:55:07 devstack sudo[103831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-1144177a-9dbb-4493-80bf-45a79f34c816 Sep 22 15:55:07 devstack sudo[103831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:55:07 devstack sudo[103831]: pam_unix(sudo:session): session closed for user root Sep 22 15:55:07 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-235fcefd-6fd0-4c08-8a5e-ae218d75eec5 tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-1144177a-9dbb-4493-80bf-45a79f34c816" returned: 0 in 0.429s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:55:07 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-235fcefd-6fd0-4c08-8a5e-ae218d75eec5 tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-1144177a-9dbb-4493-80bf-45a79f34c816 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:55:07 devstack sudo[103836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-1144177a-9dbb-4493-80bf-45a79f34c816 Sep 22 15:55:07 devstack sudo[103836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:55:08 devstack sudo[103836]: pam_unix(sudo:session): session closed for user root Sep 22 15:55:08 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-235fcefd-6fd0-4c08-8a5e-ae218d75eec5 tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-1144177a-9dbb-4493-80bf-45a79f34c816" returned: 0 in 0.255s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:55:08 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-235fcefd-6fd0-4c08-8a5e-ae218d75eec5 tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Lock "cinder-quobyte-1144177a-9dbb-4493-80bf-45a79f34c816" released by "delete_volume" :: held 0.730s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:55:08 devstack cinder-volume[86212]: DEBUG cinder.quota [None req-235fcefd-6fd0-4c08-8a5e-ae218d75eec5 tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Created reservations ['40e81b90-23f5-4af7-9740-51b28aeaa639', '1043dea3-3fd6-4d45-85c9-c602653ed264', 'd74d6a15-10b2-418e-92f6-fd51d1abb36d', 'aa6ad793-512d-4663-8630-e9dab7dae66a'] {{(pid=86212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 15:55:08 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-235fcefd-6fd0-4c08-8a5e-ae218d75eec5 tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:55:08 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-235fcefd-6fd0-4c08-8a5e-ae218d75eec5 tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:55:08 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-235fcefd-6fd0-4c08-8a5e-ae218d75eec5 tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:55:08 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-235fcefd-6fd0-4c08-8a5e-ae218d75eec5 tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:55:08 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-235fcefd-6fd0-4c08-8a5e-ae218d75eec5 tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:55:08 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-235fcefd-6fd0-4c08-8a5e-ae218d75eec5 tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:55:08 devstack sudo[103840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc Sep 22 15:55:08 devstack sudo[103840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:55:08 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-254fc64e-4c50-4786-b9c3-8392871bacd2 tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Acquiring lock "cinder-14f05c92-60a8-44ab-870f-93f09ff0a022-delete_volume" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:55:08 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-254fc64e-4c50-4786-b9c3-8392871bacd2 tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Lock "cinder-14f05c92-60a8-44ab-870f-93f09ff0a022-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:55:08 devstack sudo[103840]: pam_unix(sudo:session): session closed for user root Sep 22 15:55:08 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-235fcefd-6fd0-4c08-8a5e-ae218d75eec5 tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc" returned: 0 in 0.284s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:55:08 devstack cinder-volume[86212]: DEBUG cinder.manager [None req-235fcefd-6fd0-4c08-8a5e-ae218d75eec5 tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Notifying Schedulers of capabilities ... {{(pid=86212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 15:55:08 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-235fcefd-6fd0-4c08-8a5e-ae218d75eec5 tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Deleted volume successfully. Sep 22 15:55:08 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-254fc64e-4c50-4786-b9c3-8392871bacd2 tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Acquiring lock "cinder-quobyte-14f05c92-60a8-44ab-870f-93f09ff0a022" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:55:08 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-235fcefd-6fd0-4c08-8a5e-ae218d75eec5 tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Lock "cinder-1144177a-9dbb-4493-80bf-45a79f34c816-delete_volume" released by "delete_volume" :: held 1.287s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:55:08 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-254fc64e-4c50-4786-b9c3-8392871bacd2 tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Lock "cinder-quobyte-14f05c92-60a8-44ab-870f-93f09ff0a022" acquired by "delete_volume" :: waited 0.021s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:55:08 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[e84f0599-06a9-4216-a0be-f703078d3aed]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:55:08 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-254fc64e-4c50-4786-b9c3-8392871bacd2 tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-14f05c92-60a8-44ab-870f-93f09ff0a022 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:55:08 devstack cinder-volume[86212]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e052c50-3ee5-454d-86e3-a9a2e04c1bad tempest-VolumeDependencyTests-28226350 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 15:55:08 devstack sudo[103843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-14f05c92-60a8-44ab-870f-93f09ff0a022 Sep 22 15:55:08 devstack sudo[103843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:55:08 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-4e052c50-3ee5-454d-86e3-a9a2e04c1bad tempest-VolumeDependencyTests-28226350 None] Flow 'volume_create_manager' (bf4b160f-3531-4b99-9325-5cea34f4b5eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:55:08 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-4e052c50-3ee5-454d-86e3-a9a2e04c1bad tempest-VolumeDependencyTests-28226350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (103764c1-8a8d-4054-a9f1-3942b951b806) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:55:08 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-4e052c50-3ee5-454d-86e3-a9a2e04c1bad tempest-VolumeDependencyTests-28226350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (103764c1-8a8d-4054-a9f1-3942b951b806) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:55:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-162023971',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32d46444-adbd-4dfd-9df9-93867f791b47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c664262894d4e968c31c8128517cc4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:55:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:55:09Z,use_quota=True,user_id='a9a28d43fd6841a9ac21625ae1bd6a11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:55:08 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-4e052c50-3ee5-454d-86e3-a9a2e04c1bad tempest-VolumeDependencyTests-28226350 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f84e2a71-63fd-4ebb-8908-93eb54fe077c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:55:08 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-4e052c50-3ee5-454d-86e3-a9a2e04c1bad tempest-VolumeDependencyTests-28226350 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f84e2a71-63fd-4ebb-8908-93eb54fe077c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:55:08 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-4e052c50-3ee5-454d-86e3-a9a2e04c1bad tempest-VolumeDependencyTests-28226350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (febe2b75-2223-4b24-83f8-7923904e0b3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:55:08 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-4e052c50-3ee5-454d-86e3-a9a2e04c1bad tempest-VolumeDependencyTests-28226350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (febe2b75-2223-4b24-83f8-7923904e0b3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '32d46444-adbd-4dfd-9df9-93867f791b47', 'volume_name': 'volume-32d46444-adbd-4dfd-9df9-93867f791b47', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:55:08 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-4e052c50-3ee5-454d-86e3-a9a2e04c1bad tempest-VolumeDependencyTests-28226350 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ce9a19f-b021-4411-949f-d8d3c13aad44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:55:08 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-4e052c50-3ee5-454d-86e3-a9a2e04c1bad tempest-VolumeDependencyTests-28226350 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ce9a19f-b021-4411-949f-d8d3c13aad44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:55:08 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-4e052c50-3ee5-454d-86e3-a9a2e04c1bad tempest-VolumeDependencyTests-28226350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63d7bc26-c5e5-4bfc-843f-d775a211d215) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:55:08 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-4e052c50-3ee5-454d-86e3-a9a2e04c1bad tempest-VolumeDependencyTests-28226350 None] Volume 32d46444-adbd-4dfd-9df9-93867f791b47: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-32d46444-adbd-4dfd-9df9-93867f791b47', 'volume_size': 1} Sep 22 15:55:08 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-4e052c50-3ee5-454d-86e3-a9a2e04c1bad tempest-VolumeDependencyTests-28226350 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:55:08 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-4e052c50-3ee5-454d-86e3-a9a2e04c1bad tempest-VolumeDependencyTests-28226350 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:55:08 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-4e052c50-3ee5-454d-86e3-a9a2e04c1bad tempest-VolumeDependencyTests-28226350 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:55:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-162023971',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32d46444-adbd-4dfd-9df9-93867f791b47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c664262894d4e968c31c8128517cc4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:55:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:55:09Z,use_quota=True,user_id='a9a28d43fd6841a9ac21625ae1bd6a11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)}" {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 15:55:08 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-4e052c50-3ee5-454d-86e3-a9a2e04c1bad tempest-VolumeDependencyTests-28226350 None] Creating volume 32d46444-adbd-4dfd-9df9-93867f791b47 {{(pid=86212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 15:55:08 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-4e052c50-3ee5-454d-86e3-a9a2e04c1bad tempest-VolumeDependencyTests-28226350 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:55:08 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-4e052c50-3ee5-454d-86e3-a9a2e04c1bad tempest-VolumeDependencyTests-28226350 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:55:08 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-4e052c50-3ee5-454d-86e3-a9a2e04c1bad tempest-VolumeDependencyTests-28226350 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:55:08 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-4e052c50-3ee5-454d-86e3-a9a2e04c1bad tempest-VolumeDependencyTests-28226350 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:55:08 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-4e052c50-3ee5-454d-86e3-a9a2e04c1bad tempest-VolumeDependencyTests-28226350 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:55:08 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-4e052c50-3ee5-454d-86e3-a9a2e04c1bad tempest-VolumeDependencyTests-28226350 None] Selected osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 as target Quobyte volume. {{(pid=86212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 15:55:08 devstack cinder-volume[86212]: INFO cinder.volume.drivers.remotefs [None req-4e052c50-3ee5-454d-86e3-a9a2e04c1bad tempest-VolumeDependencyTests-28226350 None] casted to osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 Sep 22 15:55:08 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-4e052c50-3ee5-454d-86e3-a9a2e04c1bad tempest-VolumeDependencyTests-28226350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-32d46444-adbd-4dfd-9df9-93867f791b47 1073741824 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:55:08 devstack sudo[103845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-32d46444-adbd-4dfd-9df9-93867f791b47 1073741824 Sep 22 15:55:08 devstack sudo[103845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:55:08 devstack sudo[103843]: pam_unix(sudo:session): session closed for user root Sep 22 15:55:08 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-254fc64e-4c50-4786-b9c3-8392871bacd2 tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-14f05c92-60a8-44ab-870f-93f09ff0a022" returned: 0 in 0.408s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:55:08 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-254fc64e-4c50-4786-b9c3-8392871bacd2 tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-14f05c92-60a8-44ab-870f-93f09ff0a022 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:55:09 devstack sudo[103850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-14f05c92-60a8-44ab-870f-93f09ff0a022 Sep 22 15:55:09 devstack sudo[103850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:55:09 devstack sudo[103845]: pam_unix(sudo:session): session closed for user root Sep 22 15:55:09 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-4e052c50-3ee5-454d-86e3-a9a2e04c1bad tempest-VolumeDependencyTests-28226350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-32d46444-adbd-4dfd-9df9-93867f791b47 1073741824" returned: 0 in 0.464s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:55:09 devstack sudo[103850]: pam_unix(sudo:session): session closed for user root Sep 22 15:55:09 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-254fc64e-4c50-4786-b9c3-8392871bacd2 tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-14f05c92-60a8-44ab-870f-93f09ff0a022" returned: 0 in 0.293s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:55:09 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-254fc64e-4c50-4786-b9c3-8392871bacd2 tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Lock "cinder-quobyte-14f05c92-60a8-44ab-870f-93f09ff0a022" released by "delete_volume" :: held 0.751s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:55:09 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-4e052c50-3ee5-454d-86e3-a9a2e04c1bad tempest-VolumeDependencyTests-28226350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-32d46444-adbd-4dfd-9df9-93867f791b47 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:55:09 devstack sudo[103856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-32d46444-adbd-4dfd-9df9-93867f791b47 Sep 22 15:55:09 devstack sudo[103856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:55:09 devstack cinder-volume[86212]: DEBUG cinder.quota [None req-254fc64e-4c50-4786-b9c3-8392871bacd2 tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Created reservations ['5211cb24-b13c-43e8-a075-0ff3f9f256b1', 'd233c8ca-4c58-4b23-85ff-c9b3e6b6ec37', '32d91d87-084d-4e6d-89c7-d96b760d06fe', 'da756de9-30f1-48d1-9c41-13a332e13dee'] {{(pid=86212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 15:55:09 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-254fc64e-4c50-4786-b9c3-8392871bacd2 tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:55:09 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-254fc64e-4c50-4786-b9c3-8392871bacd2 tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:55:09 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-254fc64e-4c50-4786-b9c3-8392871bacd2 tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:55:09 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-254fc64e-4c50-4786-b9c3-8392871bacd2 tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:55:09 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-254fc64e-4c50-4786-b9c3-8392871bacd2 tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:55:09 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-254fc64e-4c50-4786-b9c3-8392871bacd2 tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:55:09 devstack sudo[103858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc Sep 22 15:55:09 devstack sudo[103858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:55:09 devstack sudo[103856]: pam_unix(sudo:session): session closed for user root Sep 22 15:55:09 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-4e052c50-3ee5-454d-86e3-a9a2e04c1bad tempest-VolumeDependencyTests-28226350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-32d46444-adbd-4dfd-9df9-93867f791b47" returned: 0 in 0.276s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:55:09 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-4e052c50-3ee5-454d-86e3-a9a2e04c1bad tempest-VolumeDependencyTests-28226350 None] <== create_volume: return (813ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'} {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 15:55:09 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-4e052c50-3ee5-454d-86e3-a9a2e04c1bad tempest-VolumeDependencyTests-28226350 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.816s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:55:09 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-f266fcb4-33c7-47b7-a218-9d833497145b tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Acquiring lock "cinder-3a6d22b1-ac6c-434e-ac75-260edaa390f2-delete_volume" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:55:09 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-4e052c50-3ee5-454d-86e3-a9a2e04c1bad tempest-VolumeDependencyTests-28226350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63d7bc26-c5e5-4bfc-843f-d775a211d215) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-32d46444-adbd-4dfd-9df9-93867f791b47', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:55:09 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-4e052c50-3ee5-454d-86e3-a9a2e04c1bad tempest-VolumeDependencyTests-28226350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1645e155-daaf-4f63-9882-6fc491b34617) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:55:09 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-f266fcb4-33c7-47b7-a218-9d833497145b tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Lock "cinder-3a6d22b1-ac6c-434e-ac75-260edaa390f2-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:55:09 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-4e052c50-3ee5-454d-86e3-a9a2e04c1bad tempest-VolumeDependencyTests-28226350 None] Volume volume-32d46444-adbd-4dfd-9df9-93867f791b47 (32d46444-adbd-4dfd-9df9-93867f791b47): created successfully Sep 22 15:55:09 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-4e052c50-3ee5-454d-86e3-a9a2e04c1bad tempest-VolumeDependencyTests-28226350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1645e155-daaf-4f63-9882-6fc491b34617) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:55:09 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-4e052c50-3ee5-454d-86e3-a9a2e04c1bad tempest-VolumeDependencyTests-28226350 None] Flow 'volume_create_manager' (bf4b160f-3531-4b99-9325-5cea34f4b5eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:55:09 devstack sudo[103858]: pam_unix(sudo:session): session closed for user root Sep 22 15:55:09 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-254fc64e-4c50-4786-b9c3-8392871bacd2 tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc" returned: 0 in 0.288s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:55:09 devstack cinder-volume[86212]: DEBUG cinder.manager [None req-254fc64e-4c50-4786-b9c3-8392871bacd2 tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Notifying Schedulers of capabilities ... {{(pid=86212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 15:55:09 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-4e052c50-3ee5-454d-86e3-a9a2e04c1bad tempest-VolumeDependencyTests-28226350 None] Created volume successfully. Sep 22 15:55:09 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-254fc64e-4c50-4786-b9c3-8392871bacd2 tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Deleted volume successfully. Sep 22 15:55:09 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-f266fcb4-33c7-47b7-a218-9d833497145b tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Acquiring lock "cinder-quobyte-3a6d22b1-ac6c-434e-ac75-260edaa390f2" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:55:09 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-f266fcb4-33c7-47b7-a218-9d833497145b tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Lock "cinder-quobyte-3a6d22b1-ac6c-434e-ac75-260edaa390f2" acquired by "delete_volume" :: waited 0.037s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:55:09 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-254fc64e-4c50-4786-b9c3-8392871bacd2 tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Lock "cinder-14f05c92-60a8-44ab-870f-93f09ff0a022-delete_volume" released by "delete_volume" :: held 1.352s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:55:09 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[2daee3e2-d113-4fe1-a530-c0f98386ba5f]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:55:09 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-f266fcb4-33c7-47b7-a218-9d833497145b tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-3a6d22b1-ac6c-434e-ac75-260edaa390f2 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:55:09 devstack sudo[103862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-3a6d22b1-ac6c-434e-ac75-260edaa390f2 Sep 22 15:55:09 devstack sudo[103862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:55:10 devstack sudo[103862]: pam_unix(sudo:session): session closed for user root Sep 22 15:55:10 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-f266fcb4-33c7-47b7-a218-9d833497145b tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-3a6d22b1-ac6c-434e-ac75-260edaa390f2" returned: 0 in 0.382s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:55:10 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-f266fcb4-33c7-47b7-a218-9d833497145b tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-3a6d22b1-ac6c-434e-ac75-260edaa390f2 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:55:10 devstack sudo[103867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-3a6d22b1-ac6c-434e-ac75-260edaa390f2 Sep 22 15:55:10 devstack sudo[103867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:55:10 devstack sudo[103867]: pam_unix(sudo:session): session closed for user root Sep 22 15:55:10 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-f266fcb4-33c7-47b7-a218-9d833497145b tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-3a6d22b1-ac6c-434e-ac75-260edaa390f2" returned: 0 in 0.250s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:55:10 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-f266fcb4-33c7-47b7-a218-9d833497145b tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Lock "cinder-quobyte-3a6d22b1-ac6c-434e-ac75-260edaa390f2" released by "delete_volume" :: held 0.685s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:55:10 devstack cinder-volume[86212]: DEBUG cinder.quota [None req-f266fcb4-33c7-47b7-a218-9d833497145b tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Created reservations ['1b69387d-26f8-4744-9540-d121afdfc61d', '4de05e32-366e-4cb6-86bb-36423bdd0340', 'd4ce36ad-72a8-4078-804c-febb894b3eff', '8211d376-70e2-42e2-b697-027c3a2c03d7'] {{(pid=86212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 15:55:10 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-f266fcb4-33c7-47b7-a218-9d833497145b tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:55:10 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-f266fcb4-33c7-47b7-a218-9d833497145b tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:55:10 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-f266fcb4-33c7-47b7-a218-9d833497145b tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:55:10 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-f266fcb4-33c7-47b7-a218-9d833497145b tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:55:10 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-f266fcb4-33c7-47b7-a218-9d833497145b tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:55:10 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-f266fcb4-33c7-47b7-a218-9d833497145b tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:55:10 devstack sudo[103870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc Sep 22 15:55:10 devstack sudo[103870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:55:10 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-38d2c0ce-39a1-439f-88cd-3d6e59b0625e tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Acquiring lock "cinder-8be52f9e-3b5f-40d0-84ef-bd02dd28a048-delete_volume" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:55:10 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-38d2c0ce-39a1-439f-88cd-3d6e59b0625e tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Lock "cinder-8be52f9e-3b5f-40d0-84ef-bd02dd28a048-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:55:10 devstack sudo[103870]: pam_unix(sudo:session): session closed for user root Sep 22 15:55:10 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-f266fcb4-33c7-47b7-a218-9d833497145b tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc" returned: 0 in 0.285s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:55:10 devstack cinder-volume[86212]: DEBUG cinder.manager [None req-f266fcb4-33c7-47b7-a218-9d833497145b tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Notifying Schedulers of capabilities ... {{(pid=86212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 15:55:10 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-f266fcb4-33c7-47b7-a218-9d833497145b tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Deleted volume successfully. Sep 22 15:55:10 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-38d2c0ce-39a1-439f-88cd-3d6e59b0625e tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Acquiring lock "cinder-quobyte-8be52f9e-3b5f-40d0-84ef-bd02dd28a048" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:55:10 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-38d2c0ce-39a1-439f-88cd-3d6e59b0625e tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Lock "cinder-quobyte-8be52f9e-3b5f-40d0-84ef-bd02dd28a048" acquired by "delete_volume" :: waited 0.020s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:55:10 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-f266fcb4-33c7-47b7-a218-9d833497145b tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Lock "cinder-3a6d22b1-ac6c-434e-ac75-260edaa390f2-delete_volume" released by "delete_volume" :: held 1.261s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:55:10 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[8850983a-8ec0-4a69-a24a-9e8f6802ae06]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:55:10 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-38d2c0ce-39a1-439f-88cd-3d6e59b0625e tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8be52f9e-3b5f-40d0-84ef-bd02dd28a048 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:55:11 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-b4a554b4-a79e-420d-be5c-bf65996ddeb6 tempest-VolumeDependencyTests-28226350 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:55:11 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-b4a554b4-a79e-420d-be5c-bf65996ddeb6 tempest-VolumeDependencyTests-28226350 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:55:11 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-b4a554b4-a79e-420d-be5c-bf65996ddeb6 tempest-VolumeDependencyTests-28226350 None] Creating offline snapshot d8587a64-9220-4f70-8fcb-79d49d44e080 of volume 32d46444-adbd-4dfd-9df9-93867f791b47 {{(pid=86212) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 22 15:55:11 devstack sudo[103873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8be52f9e-3b5f-40d0-84ef-bd02dd28a048 Sep 22 15:55:11 devstack sudo[103873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:55:11 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6d16d0f-69e2-4d62-bb35-9b7d453382a9]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:55:11 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-b4a554b4-a79e-420d-be5c-bf65996ddeb6 tempest-VolumeDependencyTests-28226350 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-32d46444-adbd-4dfd-9df9-93867f791b47 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:55:11 devstack sudo[103875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-32d46444-adbd-4dfd-9df9-93867f791b47 Sep 22 15:55:11 devstack sudo[103875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:55:11 devstack sudo[103873]: pam_unix(sudo:session): session closed for user root Sep 22 15:55:11 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-38d2c0ce-39a1-439f-88cd-3d6e59b0625e tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8be52f9e-3b5f-40d0-84ef-bd02dd28a048" returned: 0 in 0.385s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:55:11 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-38d2c0ce-39a1-439f-88cd-3d6e59b0625e tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8be52f9e-3b5f-40d0-84ef-bd02dd28a048 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:55:11 devstack sudo[103880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8be52f9e-3b5f-40d0-84ef-bd02dd28a048 Sep 22 15:55:11 devstack sudo[103880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:55:11 devstack sudo[103875]: pam_unix(sudo:session): session closed for user root Sep 22 15:55:11 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-b4a554b4-a79e-420d-be5c-bf65996ddeb6 tempest-VolumeDependencyTests-28226350 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-32d46444-adbd-4dfd-9df9-93867f791b47" returned: 0 in 0.378s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:55:11 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-b4a554b4-a79e-420d-be5c-bf65996ddeb6 tempest-VolumeDependencyTests-28226350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-32d46444-adbd-4dfd-9df9-93867f791b47,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-32d46444-adbd-4dfd-9df9-93867f791b47.d8587a64-9220-4f70-8fcb-79d49d44e080 1G {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:55:11 devstack sudo[103885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-32d46444-adbd-4dfd-9df9-93867f791b47,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-32d46444-adbd-4dfd-9df9-93867f791b47.d8587a64-9220-4f70-8fcb-79d49d44e080 1G Sep 22 15:55:11 devstack sudo[103885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:55:11 devstack sudo[103880]: pam_unix(sudo:session): session closed for user root Sep 22 15:55:11 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-38d2c0ce-39a1-439f-88cd-3d6e59b0625e tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8be52f9e-3b5f-40d0-84ef-bd02dd28a048" returned: 0 in 0.272s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:55:11 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-38d2c0ce-39a1-439f-88cd-3d6e59b0625e tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Lock "cinder-quobyte-8be52f9e-3b5f-40d0-84ef-bd02dd28a048" released by "delete_volume" :: held 0.705s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:55:11 devstack cinder-volume[86212]: DEBUG cinder.quota [None req-38d2c0ce-39a1-439f-88cd-3d6e59b0625e tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Created reservations ['9139d635-7024-42de-b62f-0333740852c2', 'abdf2128-5c25-45ba-98d4-ad25a5785013', '89807d1e-f26c-489d-b94d-94dfcabfaaab', 'f1be13ca-a698-4784-ae58-b8253f0c9a70'] {{(pid=86212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 15:55:11 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-38d2c0ce-39a1-439f-88cd-3d6e59b0625e tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:55:11 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-38d2c0ce-39a1-439f-88cd-3d6e59b0625e tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:55:11 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-38d2c0ce-39a1-439f-88cd-3d6e59b0625e tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:55:11 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-38d2c0ce-39a1-439f-88cd-3d6e59b0625e tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:55:11 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-38d2c0ce-39a1-439f-88cd-3d6e59b0625e tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:55:11 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-38d2c0ce-39a1-439f-88cd-3d6e59b0625e tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:55:11 devstack sudo[103891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc Sep 22 15:55:11 devstack sudo[103891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:55:11 devstack sudo[103885]: pam_unix(sudo:session): session closed for user root Sep 22 15:55:11 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-b4a554b4-a79e-420d-be5c-bf65996ddeb6 tempest-VolumeDependencyTests-28226350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-32d46444-adbd-4dfd-9df9-93867f791b47,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-32d46444-adbd-4dfd-9df9-93867f791b47.d8587a64-9220-4f70-8fcb-79d49d44e080 1G" returned: 0 in 0.441s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:55:11 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-b4a554b4-a79e-420d-be5c-bf65996ddeb6 tempest-VolumeDependencyTests-28226350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32d46444-adbd-4dfd-9df9-93867f791b47 -F qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-32d46444-adbd-4dfd-9df9-93867f791b47.d8587a64-9220-4f70-8fcb-79d49d44e080 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:55:11 devstack sudo[103894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32d46444-adbd-4dfd-9df9-93867f791b47 -F qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-32d46444-adbd-4dfd-9df9-93867f791b47.d8587a64-9220-4f70-8fcb-79d49d44e080 Sep 22 15:55:11 devstack sudo[103894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:55:12 devstack sudo[103891]: pam_unix(sudo:session): session closed for user root Sep 22 15:55:12 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-38d2c0ce-39a1-439f-88cd-3d6e59b0625e tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc" returned: 0 in 0.266s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:55:12 devstack cinder-volume[86212]: DEBUG cinder.manager [None req-38d2c0ce-39a1-439f-88cd-3d6e59b0625e tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Notifying Schedulers of capabilities ... {{(pid=86212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 15:55:12 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-38d2c0ce-39a1-439f-88cd-3d6e59b0625e tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Deleted volume successfully. Sep 22 15:55:12 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-38d2c0ce-39a1-439f-88cd-3d6e59b0625e tempest-CreateVolumesFromSourceVolumeTest-1929773015 None] Lock "cinder-8be52f9e-3b5f-40d0-84ef-bd02dd28a048-delete_volume" released by "delete_volume" :: held 1.223s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:55:12 devstack sudo[103894]: pam_unix(sudo:session): session closed for user root Sep 22 15:55:12 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-b4a554b4-a79e-420d-be5c-bf65996ddeb6 tempest-VolumeDependencyTests-28226350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32d46444-adbd-4dfd-9df9-93867f791b47 -F qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-32d46444-adbd-4dfd-9df9-93867f791b47.d8587a64-9220-4f70-8fcb-79d49d44e080" returned: 0 in 0.327s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:55:12 devstack cinder-volume[86212]: WARNING cinder.volume.drivers.remotefs [None req-b4a554b4-a79e-420d-be5c-bf65996ddeb6 tempest-VolumeDependencyTests-28226350 None] /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-32d46444-adbd-4dfd-9df9-93867f791b47.d8587a64-9220-4f70-8fcb-79d49d44e080 is being set with open permissions: ugo+rw Sep 22 15:55:12 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-b4a554b4-a79e-420d-be5c-bf65996ddeb6 tempest-VolumeDependencyTests-28226350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-32d46444-adbd-4dfd-9df9-93867f791b47.d8587a64-9220-4f70-8fcb-79d49d44e080 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:55:12 devstack sudo[103900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-32d46444-adbd-4dfd-9df9-93867f791b47.d8587a64-9220-4f70-8fcb-79d49d44e080 Sep 22 15:55:12 devstack sudo[103900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:55:12 devstack sudo[103900]: pam_unix(sudo:session): session closed for user root Sep 22 15:55:12 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-b4a554b4-a79e-420d-be5c-bf65996ddeb6 tempest-VolumeDependencyTests-28226350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-32d46444-adbd-4dfd-9df9-93867f791b47.d8587a64-9220-4f70-8fcb-79d49d44e080" returned: 0 in 0.266s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:55:12 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-b4a554b4-a79e-420d-be5c-bf65996ddeb6 tempest-VolumeDependencyTests-28226350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-32d46444-adbd-4dfd-9df9-93867f791b47.info {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:55:12 devstack sudo[103903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-32d46444-adbd-4dfd-9df9-93867f791b47.info Sep 22 15:55:12 devstack sudo[103903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:55:12 devstack sudo[103903]: pam_unix(sudo:session): session closed for user root Sep 22 15:55:12 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-b4a554b4-a79e-420d-be5c-bf65996ddeb6 tempest-VolumeDependencyTests-28226350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-32d46444-adbd-4dfd-9df9-93867f791b47.info" returned: 0 in 0.287s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:55:12 devstack cinder-volume[86212]: WARNING cinder.volume.drivers.remotefs [None req-b4a554b4-a79e-420d-be5c-bf65996ddeb6 tempest-VolumeDependencyTests-28226350 None] /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-32d46444-adbd-4dfd-9df9-93867f791b47.info is being set with open permissions: ugo+rw Sep 22 15:55:12 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-b4a554b4-a79e-420d-be5c-bf65996ddeb6 tempest-VolumeDependencyTests-28226350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-32d46444-adbd-4dfd-9df9-93867f791b47.info {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:55:12 devstack sudo[103906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-32d46444-adbd-4dfd-9df9-93867f791b47.info Sep 22 15:55:12 devstack sudo[103906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:55:13 devstack sudo[103906]: pam_unix(sudo:session): session closed for user root Sep 22 15:55:13 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-b4a554b4-a79e-420d-be5c-bf65996ddeb6 tempest-VolumeDependencyTests-28226350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-32d46444-adbd-4dfd-9df9-93867f791b47.info" returned: 0 in 0.270s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:55:13 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-b4a554b4-a79e-420d-be5c-bf65996ddeb6 tempest-VolumeDependencyTests-28226350 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.063s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:55:13 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-b4a554b4-a79e-420d-be5c-bf65996ddeb6 tempest-VolumeDependencyTests-28226350 None] Create snapshot completed successfully Sep 22 15:55:14 devstack cinder-volume[86212]: DEBUG cinder.volume.flows.manager.create_volume [None req-5378ae3a-aec7-4838-9b17-5994f7f76803 tempest-VolumeDependencyTests-28226350 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 15:55:14 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-5378ae3a-aec7-4838-9b17-5994f7f76803 tempest-VolumeDependencyTests-28226350 None] Flow 'volume_create_manager' (f1efde0e-8c12-4620-9b7e-a78b7d737be6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:55:14 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-5378ae3a-aec7-4838-9b17-5994f7f76803 tempest-VolumeDependencyTests-28226350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66bd022b-62ea-4b61-a3f9-97c19fdaf0ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:55:14 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-5378ae3a-aec7-4838-9b17-5994f7f76803 tempest-VolumeDependencyTests-28226350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66bd022b-62ea-4b61-a3f9-97c19fdaf0ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:55:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-784826509',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5864284b-5b8a-4b30-b9a2-469d8bddcd9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c664262894d4e968c31c8128517cc4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:55:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=d8587a64-9220-4f70-8fcb-79d49d44e080,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:55:15Z,use_quota=True,user_id='a9a28d43fd6841a9ac21625ae1bd6a11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:55:14 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-5378ae3a-aec7-4838-9b17-5994f7f76803 tempest-VolumeDependencyTests-28226350 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78c2fa9e-789f-4fe2-8094-f20b1166e588) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:55:14 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-5378ae3a-aec7-4838-9b17-5994f7f76803 tempest-VolumeDependencyTests-28226350 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78c2fa9e-789f-4fe2-8094-f20b1166e588) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:55:14 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-5378ae3a-aec7-4838-9b17-5994f7f76803 tempest-VolumeDependencyTests-28226350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c53d3e48-f968-4c35-a35a-15d982c73e99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:55:14 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-5378ae3a-aec7-4838-9b17-5994f7f76803 tempest-VolumeDependencyTests-28226350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c53d3e48-f968-4c35-a35a-15d982c73e99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '5864284b-5b8a-4b30-b9a2-469d8bddcd9b', 'volume_name': 'volume-5864284b-5b8a-4b30-b9a2-469d8bddcd9b', 'volume_size': 1, 'snapshot_id': 'd8587a64-9220-4f70-8fcb-79d49d44e080'}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:55:14 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-5378ae3a-aec7-4838-9b17-5994f7f76803 tempest-VolumeDependencyTests-28226350 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e83c6035-960d-4bac-bb36-dc591349a074) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:55:14 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-5378ae3a-aec7-4838-9b17-5994f7f76803 tempest-VolumeDependencyTests-28226350 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e83c6035-960d-4bac-bb36-dc591349a074) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:55:14 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-5378ae3a-aec7-4838-9b17-5994f7f76803 tempest-VolumeDependencyTests-28226350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97a4a425-2a92-43c9-b10a-dcb8890acd65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:55:14 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-5378ae3a-aec7-4838-9b17-5994f7f76803 tempest-VolumeDependencyTests-28226350 None] Volume 5864284b-5b8a-4b30-b9a2-469d8bddcd9b: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-5864284b-5b8a-4b30-b9a2-469d8bddcd9b', 'volume_size': 1, 'snapshot_id': 'd8587a64-9220-4f70-8fcb-79d49d44e080'} Sep 22 15:55:14 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-5378ae3a-aec7-4838-9b17-5994f7f76803 tempest-VolumeDependencyTests-28226350 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:55:14 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-5378ae3a-aec7-4838-9b17-5994f7f76803 tempest-VolumeDependencyTests-28226350 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:55:14 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-5378ae3a-aec7-4838-9b17-5994f7f76803 tempest-VolumeDependencyTests-28226350 None] Acquiring lock "cinder-quobyte-d8587a64-9220-4f70-8fcb-79d49d44e080-5864284b-5b8a-4b30-b9a2-469d8bddcd9b" by "_create_volume_from_snapshot" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:55:14 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-5378ae3a-aec7-4838-9b17-5994f7f76803 tempest-VolumeDependencyTests-28226350 None] Lock "cinder-quobyte-d8587a64-9220-4f70-8fcb-79d49d44e080-5864284b-5b8a-4b30-b9a2-469d8bddcd9b" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:55:14 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-5378ae3a-aec7-4838-9b17-5994f7f76803 tempest-VolumeDependencyTests-28226350 None] Creating volume 5864284b-5b8a-4b30-b9a2-469d8bddcd9b from snapshot d8587a64-9220-4f70-8fcb-79d49d44e080 {{(pid=86212) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 22 15:55:14 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-5378ae3a-aec7-4838-9b17-5994f7f76803 tempest-VolumeDependencyTests-28226350 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:55:14 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-5378ae3a-aec7-4838-9b17-5994f7f76803 tempest-VolumeDependencyTests-28226350 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:55:14 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-5378ae3a-aec7-4838-9b17-5994f7f76803 tempest-VolumeDependencyTests-28226350 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:55:14 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-5378ae3a-aec7-4838-9b17-5994f7f76803 tempest-VolumeDependencyTests-28226350 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:55:14 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-5378ae3a-aec7-4838-9b17-5994f7f76803 tempest-VolumeDependencyTests-28226350 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:55:14 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-5378ae3a-aec7-4838-9b17-5994f7f76803 tempest-VolumeDependencyTests-28226350 None] Selected osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 as target Quobyte volume. {{(pid=86212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 15:55:14 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-5378ae3a-aec7-4838-9b17-5994f7f76803 tempest-VolumeDependencyTests-28226350 None] Acquiring lock "cinder-quobyte-5864284b-5b8a-4b30-b9a2-469d8bddcd9b" by "_copy_volume_from_snapshot" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:55:14 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-5378ae3a-aec7-4838-9b17-5994f7f76803 tempest-VolumeDependencyTests-28226350 None] Lock "cinder-quobyte-5864284b-5b8a-4b30-b9a2-469d8bddcd9b" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:55:14 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-5378ae3a-aec7-4838-9b17-5994f7f76803 tempest-VolumeDependencyTests-28226350 None] snapshot: d8587a64-9220-4f70-8fcb-79d49d44e080, volume: 5864284b-5b8a-4b30-b9a2-469d8bddcd9b, {{(pid=86212) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 22 15:55:14 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-5378ae3a-aec7-4838-9b17-5994f7f76803 tempest-VolumeDependencyTests-28226350 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:55:14 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-5378ae3a-aec7-4838-9b17-5994f7f76803 tempest-VolumeDependencyTests-28226350 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:55:14 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-5378ae3a-aec7-4838-9b17-5994f7f76803 tempest-VolumeDependencyTests-28226350 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:55:14 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-5378ae3a-aec7-4838-9b17-5994f7f76803 tempest-VolumeDependencyTests-28226350 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:55:14 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-5378ae3a-aec7-4838-9b17-5994f7f76803 tempest-VolumeDependencyTests-28226350 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:55:14 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[f04c7624-f414-4eba-a52c-9c3b002cf172]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:55:14 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-5378ae3a-aec7-4838-9b17-5994f7f76803 tempest-VolumeDependencyTests-28226350 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-32d46444-adbd-4dfd-9df9-93867f791b47.d8587a64-9220-4f70-8fcb-79d49d44e080 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:55:15 devstack sudo[103909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-32d46444-adbd-4dfd-9df9-93867f791b47.d8587a64-9220-4f70-8fcb-79d49d44e080 Sep 22 15:55:15 devstack sudo[103909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:55:15 devstack sudo[103909]: pam_unix(sudo:session): session closed for user root Sep 22 15:55:15 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-5378ae3a-aec7-4838-9b17-5994f7f76803 tempest-VolumeDependencyTests-28226350 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-32d46444-adbd-4dfd-9df9-93867f791b47.d8587a64-9220-4f70-8fcb-79d49d44e080" returned: 0 in 0.401s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:55:15 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-5378ae3a-aec7-4838-9b17-5994f7f76803 tempest-VolumeDependencyTests-28226350 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-32d46444-adbd-4dfd-9df9-93867f791b47(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86212) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 22 15:55:15 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ff1dd89-777c-495a-bce2-851be4392734]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:55:15 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-5378ae3a-aec7-4838-9b17-5994f7f76803 tempest-VolumeDependencyTests-28226350 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-32d46444-adbd-4dfd-9df9-93867f791b47 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:55:15 devstack sudo[103914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-32d46444-adbd-4dfd-9df9-93867f791b47 Sep 22 15:55:15 devstack sudo[103914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:55:15 devstack cinder-volume[86212]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f36cb8e-88df-4d2f-84c4-b3f21c17e826 tempest-ProjectReaderTests-491830598 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 15:55:15 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-3f36cb8e-88df-4d2f-84c4-b3f21c17e826 tempest-ProjectReaderTests-491830598 None] Flow 'volume_create_manager' (563ade05-3dc5-4604-8858-d76591d6760b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:55:15 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-3f36cb8e-88df-4d2f-84c4-b3f21c17e826 tempest-ProjectReaderTests-491830598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db1cae7b-8aac-4cd6-bcbf-a59f76c8cca4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:55:15 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-3f36cb8e-88df-4d2f-84c4-b3f21c17e826 tempest-ProjectReaderTests-491830598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db1cae7b-8aac-4cd6-bcbf-a59f76c8cca4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:55:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1782726693',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c3b8093-405a-45f1-a9c7-ad0c9864bddf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91fed863712e46f2848d69224d11c16b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:55:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:55:16Z,use_quota=True,user_id='d3a28f8afda1496cab6a487c454024f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:55:15 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-3f36cb8e-88df-4d2f-84c4-b3f21c17e826 tempest-ProjectReaderTests-491830598 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (559c0e75-99d7-489e-8fd9-edf780be72de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:55:15 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-3f36cb8e-88df-4d2f-84c4-b3f21c17e826 tempest-ProjectReaderTests-491830598 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (559c0e75-99d7-489e-8fd9-edf780be72de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:55:15 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-3f36cb8e-88df-4d2f-84c4-b3f21c17e826 tempest-ProjectReaderTests-491830598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ae69bad-e8af-48f7-9338-2105ec314e66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:55:15 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-3f36cb8e-88df-4d2f-84c4-b3f21c17e826 tempest-ProjectReaderTests-491830598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ae69bad-e8af-48f7-9338-2105ec314e66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2c3b8093-405a-45f1-a9c7-ad0c9864bddf', 'volume_name': 'volume-2c3b8093-405a-45f1-a9c7-ad0c9864bddf', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:55:15 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-3f36cb8e-88df-4d2f-84c4-b3f21c17e826 tempest-ProjectReaderTests-491830598 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fe80e31-47d4-46a8-b04f-22bbad1aa438) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:55:15 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-3f36cb8e-88df-4d2f-84c4-b3f21c17e826 tempest-ProjectReaderTests-491830598 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fe80e31-47d4-46a8-b04f-22bbad1aa438) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:55:15 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-3f36cb8e-88df-4d2f-84c4-b3f21c17e826 tempest-ProjectReaderTests-491830598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1504107e-fcb5-403a-b307-aa613c91fb72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:55:15 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-3f36cb8e-88df-4d2f-84c4-b3f21c17e826 tempest-ProjectReaderTests-491830598 None] Volume 2c3b8093-405a-45f1-a9c7-ad0c9864bddf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2c3b8093-405a-45f1-a9c7-ad0c9864bddf', 'volume_size': 1} Sep 22 15:55:15 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-3f36cb8e-88df-4d2f-84c4-b3f21c17e826 tempest-ProjectReaderTests-491830598 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:55:15 devstack sudo[103914]: pam_unix(sudo:session): session closed for user root Sep 22 15:55:15 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-5378ae3a-aec7-4838-9b17-5994f7f76803 tempest-VolumeDependencyTests-28226350 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-32d46444-adbd-4dfd-9df9-93867f791b47" returned: 0 in 0.407s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:55:15 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-5378ae3a-aec7-4838-9b17-5994f7f76803 tempest-VolumeDependencyTests-28226350 None] will copy from snapshot at /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-32d46444-adbd-4dfd-9df9-93867f791b47 {{(pid=86212) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 22 15:55:15 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-5378ae3a-aec7-4838-9b17-5994f7f76803 tempest-VolumeDependencyTests-28226350 None] Creating direct copy from snapshot {{(pid=86212) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 22 15:55:15 devstack cinder-volume[86212]: DEBUG cinder.utils [None req-5378ae3a-aec7-4838-9b17-5994f7f76803 tempest-VolumeDependencyTests-28226350 None] Path /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-5864284b-5b8a-4b30-b9a2-469d8bddcd9b not found in is_blk_device check {{(pid=86212) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 22 15:55:15 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-5378ae3a-aec7-4838-9b17-5994f7f76803 tempest-VolumeDependencyTests-28226350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-32d46444-adbd-4dfd-9df9-93867f791b47 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-5864284b-5b8a-4b30-b9a2-469d8bddcd9b {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:55:15 devstack sudo[103919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-32d46444-adbd-4dfd-9df9-93867f791b47 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-5864284b-5b8a-4b30-b9a2-469d8bddcd9b Sep 22 15:55:15 devstack sudo[103919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:55:21 devstack sudo[103919]: pam_unix(sudo:session): session closed for user root Sep 22 15:55:21 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-5378ae3a-aec7-4838-9b17-5994f7f76803 tempest-VolumeDependencyTests-28226350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-32d46444-adbd-4dfd-9df9-93867f791b47 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-5864284b-5b8a-4b30-b9a2-469d8bddcd9b" returned: 0 in 6.184s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:55:21 devstack cinder-volume[86212]: DEBUG cinder.image.image_utils [None req-5378ae3a-aec7-4838-9b17-5994f7f76803 tempest-VolumeDependencyTests-28226350 None] Image conversion details: src /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-32d46444-adbd-4dfd-9df9-93867f791b47, size 1024.00 MB, duration 6.19 sec, destination /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-5864284b-5b8a-4b30-b9a2-469d8bddcd9b {{(pid=86212) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 22 15:55:21 devstack cinder-volume[86212]: INFO cinder.image.image_utils [None req-5378ae3a-aec7-4838-9b17-5994f7f76803 tempest-VolumeDependencyTests-28226350 None] Converted 1024.00 MB image at 165.55 MB/s Sep 22 15:55:21 devstack cinder-volume[86212]: WARNING cinder.volume.drivers.remotefs [None req-5378ae3a-aec7-4838-9b17-5994f7f76803 tempest-VolumeDependencyTests-28226350 None] /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-5864284b-5b8a-4b30-b9a2-469d8bddcd9b is being set with open permissions: ugo+rw Sep 22 15:55:21 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-5378ae3a-aec7-4838-9b17-5994f7f76803 tempest-VolumeDependencyTests-28226350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-5864284b-5b8a-4b30-b9a2-469d8bddcd9b {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:55:21 devstack sudo[104019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-5864284b-5b8a-4b30-b9a2-469d8bddcd9b Sep 22 15:55:21 devstack sudo[104019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:55:22 devstack sudo[104019]: pam_unix(sudo:session): session closed for user root Sep 22 15:55:22 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-5378ae3a-aec7-4838-9b17-5994f7f76803 tempest-VolumeDependencyTests-28226350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-5864284b-5b8a-4b30-b9a2-469d8bddcd9b" returned: 0 in 0.249s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:55:22 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-5378ae3a-aec7-4838-9b17-5994f7f76803 tempest-VolumeDependencyTests-28226350 None] Lock "cinder-quobyte-5864284b-5b8a-4b30-b9a2-469d8bddcd9b" released by "_copy_volume_from_snapshot" :: held 7.330s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:55:22 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-5378ae3a-aec7-4838-9b17-5994f7f76803 tempest-VolumeDependencyTests-28226350 None] Lock "cinder-quobyte-d8587a64-9220-4f70-8fcb-79d49d44e080-5864284b-5b8a-4b30-b9a2-469d8bddcd9b" released by "_create_volume_from_snapshot" :: held 7.398s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:55:22 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-5378ae3a-aec7-4838-9b17-5994f7f76803 tempest-VolumeDependencyTests-28226350 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.415s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:55:22 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-3f36cb8e-88df-4d2f-84c4-b3f21c17e826 tempest-ProjectReaderTests-491830598 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.581s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:55:22 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-3f36cb8e-88df-4d2f-84c4-b3f21c17e826 tempest-ProjectReaderTests-491830598 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:55:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1782726693',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c3b8093-405a-45f1-a9c7-ad0c9864bddf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91fed863712e46f2848d69224d11c16b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:55:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:55:16Z,use_quota=True,user_id='d3a28f8afda1496cab6a487c454024f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)}" {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 15:55:22 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-3f36cb8e-88df-4d2f-84c4-b3f21c17e826 tempest-ProjectReaderTests-491830598 None] Creating volume 2c3b8093-405a-45f1-a9c7-ad0c9864bddf {{(pid=86212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 15:55:22 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-3f36cb8e-88df-4d2f-84c4-b3f21c17e826 tempest-ProjectReaderTests-491830598 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:55:22 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-3f36cb8e-88df-4d2f-84c4-b3f21c17e826 tempest-ProjectReaderTests-491830598 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:55:22 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-3f36cb8e-88df-4d2f-84c4-b3f21c17e826 tempest-ProjectReaderTests-491830598 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:55:22 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-3f36cb8e-88df-4d2f-84c4-b3f21c17e826 tempest-ProjectReaderTests-491830598 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:55:22 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-3f36cb8e-88df-4d2f-84c4-b3f21c17e826 tempest-ProjectReaderTests-491830598 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:55:22 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-3f36cb8e-88df-4d2f-84c4-b3f21c17e826 tempest-ProjectReaderTests-491830598 None] Selected osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 as target Quobyte volume. {{(pid=86212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 15:55:22 devstack cinder-volume[86212]: INFO cinder.volume.drivers.remotefs [None req-3f36cb8e-88df-4d2f-84c4-b3f21c17e826 tempest-ProjectReaderTests-491830598 None] casted to osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 Sep 22 15:55:22 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-3f36cb8e-88df-4d2f-84c4-b3f21c17e826 tempest-ProjectReaderTests-491830598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2c3b8093-405a-45f1-a9c7-ad0c9864bddf 1073741824 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:55:22 devstack sudo[104022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2c3b8093-405a-45f1-a9c7-ad0c9864bddf 1073741824 Sep 22 15:55:22 devstack sudo[104022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:55:22 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-5378ae3a-aec7-4838-9b17-5994f7f76803 tempest-VolumeDependencyTests-28226350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97a4a425-2a92-43c9-b10a-dcb8890acd65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5864284b-5b8a-4b30-b9a2-469d8bddcd9b', 'volume_size': 1, 'snapshot_id': 'd8587a64-9220-4f70-8fcb-79d49d44e080'}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:55:22 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-5378ae3a-aec7-4838-9b17-5994f7f76803 tempest-VolumeDependencyTests-28226350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ed48feb-a9f4-4a21-b684-e20a6adfc6a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:55:22 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-5378ae3a-aec7-4838-9b17-5994f7f76803 tempest-VolumeDependencyTests-28226350 None] Volume volume-5864284b-5b8a-4b30-b9a2-469d8bddcd9b (5864284b-5b8a-4b30-b9a2-469d8bddcd9b): created successfully Sep 22 15:55:22 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-5378ae3a-aec7-4838-9b17-5994f7f76803 tempest-VolumeDependencyTests-28226350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ed48feb-a9f4-4a21-b684-e20a6adfc6a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:55:22 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-5378ae3a-aec7-4838-9b17-5994f7f76803 tempest-VolumeDependencyTests-28226350 None] Flow 'volume_create_manager' (f1efde0e-8c12-4620-9b7e-a78b7d737be6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:55:22 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-5378ae3a-aec7-4838-9b17-5994f7f76803 tempest-VolumeDependencyTests-28226350 None] Created volume successfully. Sep 22 15:55:22 devstack sudo[104022]: pam_unix(sudo:session): session closed for user root Sep 22 15:55:22 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-3f36cb8e-88df-4d2f-84c4-b3f21c17e826 tempest-ProjectReaderTests-491830598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2c3b8093-405a-45f1-a9c7-ad0c9864bddf 1073741824" returned: 0 in 0.413s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:55:22 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-3f36cb8e-88df-4d2f-84c4-b3f21c17e826 tempest-ProjectReaderTests-491830598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2c3b8093-405a-45f1-a9c7-ad0c9864bddf {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:55:22 devstack sudo[104028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2c3b8093-405a-45f1-a9c7-ad0c9864bddf Sep 22 15:55:22 devstack sudo[104028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:55:22 devstack sudo[104028]: pam_unix(sudo:session): session closed for user root Sep 22 15:55:22 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-3f36cb8e-88df-4d2f-84c4-b3f21c17e826 tempest-ProjectReaderTests-491830598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2c3b8093-405a-45f1-a9c7-ad0c9864bddf" returned: 0 in 0.249s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:55:22 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-3f36cb8e-88df-4d2f-84c4-b3f21c17e826 tempest-ProjectReaderTests-491830598 None] <== create_volume: return (705ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'} {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 15:55:22 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-3f36cb8e-88df-4d2f-84c4-b3f21c17e826 tempest-ProjectReaderTests-491830598 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.708s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:55:22 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-3f36cb8e-88df-4d2f-84c4-b3f21c17e826 tempest-ProjectReaderTests-491830598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1504107e-fcb5-403a-b307-aa613c91fb72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2c3b8093-405a-45f1-a9c7-ad0c9864bddf', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:55:22 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-3f36cb8e-88df-4d2f-84c4-b3f21c17e826 tempest-ProjectReaderTests-491830598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a3a4133-a04d-42e8-bd27-6a070e825253) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:55:22 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-3f36cb8e-88df-4d2f-84c4-b3f21c17e826 tempest-ProjectReaderTests-491830598 None] Volume volume-2c3b8093-405a-45f1-a9c7-ad0c9864bddf (2c3b8093-405a-45f1-a9c7-ad0c9864bddf): created successfully Sep 22 15:55:22 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-3f36cb8e-88df-4d2f-84c4-b3f21c17e826 tempest-ProjectReaderTests-491830598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a3a4133-a04d-42e8-bd27-6a070e825253) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:55:23 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-3f36cb8e-88df-4d2f-84c4-b3f21c17e826 tempest-ProjectReaderTests-491830598 None] Flow 'volume_create_manager' (563ade05-3dc5-4604-8858-d76591d6760b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:55:23 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-3f36cb8e-88df-4d2f-84c4-b3f21c17e826 tempest-ProjectReaderTests-491830598 None] Created volume successfully. Sep 22 15:55:23 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-dcf18c23-4dd2-4ae0-b4d2-b7f93b234143 tempest-ProjectReaderTests-491830598 None] Acquiring lock "cinder-2c3b8093-405a-45f1-a9c7-ad0c9864bddf-delete_volume" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:55:23 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-dcf18c23-4dd2-4ae0-b4d2-b7f93b234143 tempest-ProjectReaderTests-491830598 None] Lock "cinder-2c3b8093-405a-45f1-a9c7-ad0c9864bddf-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:55:23 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-dcf18c23-4dd2-4ae0-b4d2-b7f93b234143 tempest-ProjectReaderTests-491830598 None] Acquiring lock "cinder-quobyte-2c3b8093-405a-45f1-a9c7-ad0c9864bddf" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:55:23 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-dcf18c23-4dd2-4ae0-b4d2-b7f93b234143 tempest-ProjectReaderTests-491830598 None] Lock "cinder-quobyte-2c3b8093-405a-45f1-a9c7-ad0c9864bddf" acquired by "delete_volume" :: waited 0.017s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:55:23 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[f474a910-b274-4e63-9b47-bbb34270fb1d]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:55:23 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-dcf18c23-4dd2-4ae0-b4d2-b7f93b234143 tempest-ProjectReaderTests-491830598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2c3b8093-405a-45f1-a9c7-ad0c9864bddf {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:55:23 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-b63e9c55-6a2c-4a19-a583-0d055a9927a0 tempest-VolumeDependencyTests-28226350 None] Acquiring lock "cinder-d8587a64-9220-4f70-8fcb-79d49d44e080-delete_snapshot" by "delete_snapshot" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:55:23 devstack sudo[104031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2c3b8093-405a-45f1-a9c7-ad0c9864bddf Sep 22 15:55:23 devstack sudo[104031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:55:23 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-b63e9c55-6a2c-4a19-a583-0d055a9927a0 tempest-VolumeDependencyTests-28226350 None] Lock "cinder-d8587a64-9220-4f70-8fcb-79d49d44e080-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:55:23 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-b63e9c55-6a2c-4a19-a583-0d055a9927a0 tempest-VolumeDependencyTests-28226350 None] Acquiring lock "cinder-quobyte-32d46444-adbd-4dfd-9df9-93867f791b47" by "delete_snapshot" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:55:23 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-b63e9c55-6a2c-4a19-a583-0d055a9927a0 tempest-VolumeDependencyTests-28226350 None] Lock "cinder-quobyte-32d46444-adbd-4dfd-9df9-93867f791b47" acquired by "delete_snapshot" :: waited 0.013s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:55:23 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-b63e9c55-6a2c-4a19-a583-0d055a9927a0 tempest-VolumeDependencyTests-28226350 None] Acquiring lock "cinder-quobyte-d8587a64-9220-4f70-8fcb-79d49d44e080" by "_delete_snapshot" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:55:23 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-b63e9c55-6a2c-4a19-a583-0d055a9927a0 tempest-VolumeDependencyTests-28226350 None] Lock "cinder-quobyte-d8587a64-9220-4f70-8fcb-79d49d44e080" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:55:23 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-b63e9c55-6a2c-4a19-a583-0d055a9927a0 tempest-VolumeDependencyTests-28226350 None] Deleting offline snapshot d8587a64-9220-4f70-8fcb-79d49d44e080 of volume 32d46444-adbd-4dfd-9df9-93867f791b47 {{(pid=86212) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 22 15:55:23 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-b63e9c55-6a2c-4a19-a583-0d055a9927a0 tempest-VolumeDependencyTests-28226350 None] snapshot_file for this snap is: volume-32d46444-adbd-4dfd-9df9-93867f791b47.d8587a64-9220-4f70-8fcb-79d49d44e080 {{(pid=86212) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 22 15:55:23 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[20737085-b36b-41b4-9b72-e7673b5a4377]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:55:23 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-b63e9c55-6a2c-4a19-a583-0d055a9927a0 tempest-VolumeDependencyTests-28226350 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-32d46444-adbd-4dfd-9df9-93867f791b47.d8587a64-9220-4f70-8fcb-79d49d44e080 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:55:23 devstack sudo[104033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-32d46444-adbd-4dfd-9df9-93867f791b47.d8587a64-9220-4f70-8fcb-79d49d44e080 Sep 22 15:55:23 devstack sudo[104033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:55:23 devstack sudo[104031]: pam_unix(sudo:session): session closed for user root Sep 22 15:55:23 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-dcf18c23-4dd2-4ae0-b4d2-b7f93b234143 tempest-ProjectReaderTests-491830598 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2c3b8093-405a-45f1-a9c7-ad0c9864bddf" returned: 0 in 0.379s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:55:23 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-dcf18c23-4dd2-4ae0-b4d2-b7f93b234143 tempest-ProjectReaderTests-491830598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2c3b8093-405a-45f1-a9c7-ad0c9864bddf {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:55:23 devstack sudo[104038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2c3b8093-405a-45f1-a9c7-ad0c9864bddf Sep 22 15:55:23 devstack sudo[104038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:55:23 devstack sudo[104033]: pam_unix(sudo:session): session closed for user root Sep 22 15:55:23 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-b63e9c55-6a2c-4a19-a583-0d055a9927a0 tempest-VolumeDependencyTests-28226350 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-32d46444-adbd-4dfd-9df9-93867f791b47.d8587a64-9220-4f70-8fcb-79d49d44e080" returned: 0 in 0.373s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:55:23 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-b63e9c55-6a2c-4a19-a583-0d055a9927a0 tempest-VolumeDependencyTests-28226350 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-32d46444-adbd-4dfd-9df9-93867f791b47(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86212) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 22 15:55:23 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[c91307a0-1588-4926-b54a-9e5327b195ef]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:55:23 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-b63e9c55-6a2c-4a19-a583-0d055a9927a0 tempest-VolumeDependencyTests-28226350 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-32d46444-adbd-4dfd-9df9-93867f791b47 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:55:24 devstack sudo[104038]: pam_unix(sudo:session): session closed for user root Sep 22 15:55:24 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-dcf18c23-4dd2-4ae0-b4d2-b7f93b234143 tempest-ProjectReaderTests-491830598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2c3b8093-405a-45f1-a9c7-ad0c9864bddf" returned: 0 in 0.254s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:55:24 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-dcf18c23-4dd2-4ae0-b4d2-b7f93b234143 tempest-ProjectReaderTests-491830598 None] Lock "cinder-quobyte-2c3b8093-405a-45f1-a9c7-ad0c9864bddf" released by "delete_volume" :: held 0.680s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:55:24 devstack cinder-volume[86212]: DEBUG cinder.quota [None req-dcf18c23-4dd2-4ae0-b4d2-b7f93b234143 tempest-ProjectReaderTests-491830598 None] Created reservations ['a479091c-7759-4245-b530-be884df5f7a6', '87bff7b2-347a-459e-b87b-cef28aeac5fb', '8fcd58c8-fa5d-487c-af09-1bac4296fea7', '275fa5b6-c813-41fd-84b9-c6269bea7f8c'] {{(pid=86212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 15:55:24 devstack sudo[104044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-32d46444-adbd-4dfd-9df9-93867f791b47 Sep 22 15:55:24 devstack sudo[104044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:55:24 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-dcf18c23-4dd2-4ae0-b4d2-b7f93b234143 tempest-ProjectReaderTests-491830598 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:55:24 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-dcf18c23-4dd2-4ae0-b4d2-b7f93b234143 tempest-ProjectReaderTests-491830598 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:55:24 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-dcf18c23-4dd2-4ae0-b4d2-b7f93b234143 tempest-ProjectReaderTests-491830598 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:55:24 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-dcf18c23-4dd2-4ae0-b4d2-b7f93b234143 tempest-ProjectReaderTests-491830598 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:55:24 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-dcf18c23-4dd2-4ae0-b4d2-b7f93b234143 tempest-ProjectReaderTests-491830598 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:55:24 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-dcf18c23-4dd2-4ae0-b4d2-b7f93b234143 tempest-ProjectReaderTests-491830598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:55:24 devstack sudo[104046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc Sep 22 15:55:24 devstack sudo[104046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:55:24 devstack sudo[104046]: pam_unix(sudo:session): session closed for user root Sep 22 15:55:24 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-dcf18c23-4dd2-4ae0-b4d2-b7f93b234143 tempest-ProjectReaderTests-491830598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc" returned: 0 in 0.274s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:55:24 devstack cinder-volume[86212]: DEBUG cinder.manager [None req-dcf18c23-4dd2-4ae0-b4d2-b7f93b234143 tempest-ProjectReaderTests-491830598 None] Notifying Schedulers of capabilities ... {{(pid=86212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 15:55:24 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-dcf18c23-4dd2-4ae0-b4d2-b7f93b234143 tempest-ProjectReaderTests-491830598 None] Deleted volume successfully. Sep 22 15:55:24 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-dcf18c23-4dd2-4ae0-b4d2-b7f93b234143 tempest-ProjectReaderTests-491830598 None] Lock "cinder-2c3b8093-405a-45f1-a9c7-ad0c9864bddf-delete_volume" released by "delete_volume" :: held 1.165s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:55:24 devstack sudo[104044]: pam_unix(sudo:session): session closed for user root Sep 22 15:55:24 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-b63e9c55-6a2c-4a19-a583-0d055a9927a0 tempest-VolumeDependencyTests-28226350 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-32d46444-adbd-4dfd-9df9-93867f791b47" returned: 0 in 0.566s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:55:24 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-b63e9c55-6a2c-4a19-a583-0d055a9927a0 tempest-VolumeDependencyTests-28226350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-32d46444-adbd-4dfd-9df9-93867f791b47.d8587a64-9220-4f70-8fcb-79d49d44e080 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:55:24 devstack sudo[104052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-32d46444-adbd-4dfd-9df9-93867f791b47.d8587a64-9220-4f70-8fcb-79d49d44e080 Sep 22 15:55:24 devstack sudo[104052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:55:24 devstack sudo[104052]: pam_unix(sudo:session): session closed for user root Sep 22 15:55:24 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-b63e9c55-6a2c-4a19-a583-0d055a9927a0 tempest-VolumeDependencyTests-28226350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-32d46444-adbd-4dfd-9df9-93867f791b47.d8587a64-9220-4f70-8fcb-79d49d44e080" returned: 0 in 0.365s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:55:24 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-b63e9c55-6a2c-4a19-a583-0d055a9927a0 tempest-VolumeDependencyTests-28226350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-32d46444-adbd-4dfd-9df9-93867f791b47.d8587a64-9220-4f70-8fcb-79d49d44e080 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:55:24 devstack sudo[104059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-32d46444-adbd-4dfd-9df9-93867f791b47.d8587a64-9220-4f70-8fcb-79d49d44e080 Sep 22 15:55:24 devstack sudo[104059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:55:24 devstack cinder-volume[86212]: DEBUG cinder.volume.flows.manager.create_volume [None req-c378bd27-9043-4fa8-bf64-72ef337b71d4 tempest-ProjectReaderTests-491830598 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 15:55:25 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-c378bd27-9043-4fa8-bf64-72ef337b71d4 tempest-ProjectReaderTests-491830598 None] Flow 'volume_create_manager' (e66d0812-b08c-44e1-b46b-e02b8efea9de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:55:25 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-c378bd27-9043-4fa8-bf64-72ef337b71d4 tempest-ProjectReaderTests-491830598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb97f06d-0387-4c61-992f-f7825ce526f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:55:25 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-c378bd27-9043-4fa8-bf64-72ef337b71d4 tempest-ProjectReaderTests-491830598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb97f06d-0387-4c61-992f-f7825ce526f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:55:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-113800338',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53a9e0f2-bdde-4ce7-9f88-5c36c97c2590,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91fed863712e46f2848d69224d11c16b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:55:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:55:25Z,use_quota=True,user_id='d3a28f8afda1496cab6a487c454024f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:55:25 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-c378bd27-9043-4fa8-bf64-72ef337b71d4 tempest-ProjectReaderTests-491830598 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd3d8936-f3a2-4af9-8348-4a19d15d6294) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:55:25 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-c378bd27-9043-4fa8-bf64-72ef337b71d4 tempest-ProjectReaderTests-491830598 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd3d8936-f3a2-4af9-8348-4a19d15d6294) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:55:25 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-c378bd27-9043-4fa8-bf64-72ef337b71d4 tempest-ProjectReaderTests-491830598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b889075-e639-47e8-8225-f71a311c41ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:55:25 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-c378bd27-9043-4fa8-bf64-72ef337b71d4 tempest-ProjectReaderTests-491830598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b889075-e639-47e8-8225-f71a311c41ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '53a9e0f2-bdde-4ce7-9f88-5c36c97c2590', 'volume_name': 'volume-53a9e0f2-bdde-4ce7-9f88-5c36c97c2590', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:55:25 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-c378bd27-9043-4fa8-bf64-72ef337b71d4 tempest-ProjectReaderTests-491830598 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da970a57-1ea7-450e-afda-676701a6b192) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:55:25 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-c378bd27-9043-4fa8-bf64-72ef337b71d4 tempest-ProjectReaderTests-491830598 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da970a57-1ea7-450e-afda-676701a6b192) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:55:25 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-c378bd27-9043-4fa8-bf64-72ef337b71d4 tempest-ProjectReaderTests-491830598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cba697d1-2547-4a36-ac90-91d4fe06c480) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:55:25 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-c378bd27-9043-4fa8-bf64-72ef337b71d4 tempest-ProjectReaderTests-491830598 None] Volume 53a9e0f2-bdde-4ce7-9f88-5c36c97c2590: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-53a9e0f2-bdde-4ce7-9f88-5c36c97c2590', 'volume_size': 1} Sep 22 15:55:25 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-c378bd27-9043-4fa8-bf64-72ef337b71d4 tempest-ProjectReaderTests-491830598 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:55:25 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-c378bd27-9043-4fa8-bf64-72ef337b71d4 tempest-ProjectReaderTests-491830598 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:55:25 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-c378bd27-9043-4fa8-bf64-72ef337b71d4 tempest-ProjectReaderTests-491830598 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:55:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-113800338',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53a9e0f2-bdde-4ce7-9f88-5c36c97c2590,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91fed863712e46f2848d69224d11c16b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:55:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:55:25Z,use_quota=True,user_id='d3a28f8afda1496cab6a487c454024f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)}" {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 15:55:25 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-c378bd27-9043-4fa8-bf64-72ef337b71d4 tempest-ProjectReaderTests-491830598 None] Creating volume 53a9e0f2-bdde-4ce7-9f88-5c36c97c2590 {{(pid=86212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 15:55:25 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-c378bd27-9043-4fa8-bf64-72ef337b71d4 tempest-ProjectReaderTests-491830598 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:55:25 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-c378bd27-9043-4fa8-bf64-72ef337b71d4 tempest-ProjectReaderTests-491830598 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:55:25 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-c378bd27-9043-4fa8-bf64-72ef337b71d4 tempest-ProjectReaderTests-491830598 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:55:25 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-c378bd27-9043-4fa8-bf64-72ef337b71d4 tempest-ProjectReaderTests-491830598 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:55:25 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-c378bd27-9043-4fa8-bf64-72ef337b71d4 tempest-ProjectReaderTests-491830598 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:55:25 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-c378bd27-9043-4fa8-bf64-72ef337b71d4 tempest-ProjectReaderTests-491830598 None] Selected osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 as target Quobyte volume. {{(pid=86212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 15:55:25 devstack cinder-volume[86212]: INFO cinder.volume.drivers.remotefs [None req-c378bd27-9043-4fa8-bf64-72ef337b71d4 tempest-ProjectReaderTests-491830598 None] casted to osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 Sep 22 15:55:25 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-c378bd27-9043-4fa8-bf64-72ef337b71d4 tempest-ProjectReaderTests-491830598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-53a9e0f2-bdde-4ce7-9f88-5c36c97c2590 1073741824 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:55:25 devstack sudo[104061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-53a9e0f2-bdde-4ce7-9f88-5c36c97c2590 1073741824 Sep 22 15:55:25 devstack sudo[104061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:55:25 devstack sudo[104059]: pam_unix(sudo:session): session closed for user root Sep 22 15:55:25 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-b63e9c55-6a2c-4a19-a583-0d055a9927a0 tempest-VolumeDependencyTests-28226350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-32d46444-adbd-4dfd-9df9-93867f791b47.d8587a64-9220-4f70-8fcb-79d49d44e080" returned: 0 in 0.259s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:55:25 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-b63e9c55-6a2c-4a19-a583-0d055a9927a0 tempest-VolumeDependencyTests-28226350 None] Lock "cinder-quobyte-d8587a64-9220-4f70-8fcb-79d49d44e080" released by "_delete_snapshot" :: held 1.681s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:55:25 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-b63e9c55-6a2c-4a19-a583-0d055a9927a0 tempest-VolumeDependencyTests-28226350 None] Lock "cinder-quobyte-32d46444-adbd-4dfd-9df9-93867f791b47" released by "delete_snapshot" :: held 1.705s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:55:25 devstack cinder-volume[86212]: DEBUG cinder.quota [None req-b63e9c55-6a2c-4a19-a583-0d055a9927a0 tempest-VolumeDependencyTests-28226350 None] Created reservations ['35fc3887-83e2-422b-a68d-7773ea69d6dc', '51791ddc-22cd-429f-8298-b4c8653f5c03', 'f901c311-df16-4db6-a736-379ba8d42340', '43254bb2-689a-4b27-9a10-3409c7f94749'] {{(pid=86212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 15:55:25 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-b63e9c55-6a2c-4a19-a583-0d055a9927a0 tempest-VolumeDependencyTests-28226350 None] Delete snapshot completed successfully. Sep 22 15:55:25 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-b63e9c55-6a2c-4a19-a583-0d055a9927a0 tempest-VolumeDependencyTests-28226350 None] Lock "cinder-d8587a64-9220-4f70-8fcb-79d49d44e080-delete_snapshot" released by "delete_snapshot" :: held 1.843s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:55:25 devstack sudo[104061]: pam_unix(sudo:session): session closed for user root Sep 22 15:55:25 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-c378bd27-9043-4fa8-bf64-72ef337b71d4 tempest-ProjectReaderTests-491830598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-53a9e0f2-bdde-4ce7-9f88-5c36c97c2590 1073741824" returned: 0 in 0.443s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:55:25 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-c378bd27-9043-4fa8-bf64-72ef337b71d4 tempest-ProjectReaderTests-491830598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-53a9e0f2-bdde-4ce7-9f88-5c36c97c2590 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:55:25 devstack sudo[104067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-53a9e0f2-bdde-4ce7-9f88-5c36c97c2590 Sep 22 15:55:25 devstack sudo[104067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:55:25 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-eede573d-9791-4030-bdbd-6c1917d26526 tempest-VolumeDependencyTests-28226350 None] Acquiring lock "cinder-32d46444-adbd-4dfd-9df9-93867f791b47-delete_volume" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:55:25 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-eede573d-9791-4030-bdbd-6c1917d26526 tempest-VolumeDependencyTests-28226350 None] Lock "cinder-32d46444-adbd-4dfd-9df9-93867f791b47-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:55:25 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-eede573d-9791-4030-bdbd-6c1917d26526 tempest-VolumeDependencyTests-28226350 None] Acquiring lock "cinder-quobyte-32d46444-adbd-4dfd-9df9-93867f791b47" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:55:25 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-eede573d-9791-4030-bdbd-6c1917d26526 tempest-VolumeDependencyTests-28226350 None] Lock "cinder-quobyte-32d46444-adbd-4dfd-9df9-93867f791b47" acquired by "delete_volume" :: waited 0.020s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:55:25 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d5998d1-17d4-407b-9efa-89ca5e08f42a]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:55:25 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-eede573d-9791-4030-bdbd-6c1917d26526 tempest-VolumeDependencyTests-28226350 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-32d46444-adbd-4dfd-9df9-93867f791b47 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:55:25 devstack sudo[104067]: pam_unix(sudo:session): session closed for user root Sep 22 15:55:25 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-c378bd27-9043-4fa8-bf64-72ef337b71d4 tempest-ProjectReaderTests-491830598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-53a9e0f2-bdde-4ce7-9f88-5c36c97c2590" returned: 0 in 0.284s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:55:25 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-c378bd27-9043-4fa8-bf64-72ef337b71d4 tempest-ProjectReaderTests-491830598 None] <== create_volume: return (768ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'} {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 15:55:25 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-c378bd27-9043-4fa8-bf64-72ef337b71d4 tempest-ProjectReaderTests-491830598 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.773s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:55:25 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-c378bd27-9043-4fa8-bf64-72ef337b71d4 tempest-ProjectReaderTests-491830598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cba697d1-2547-4a36-ac90-91d4fe06c480) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-53a9e0f2-bdde-4ce7-9f88-5c36c97c2590', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:55:25 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-c378bd27-9043-4fa8-bf64-72ef337b71d4 tempest-ProjectReaderTests-491830598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4bb6ab44-7f0f-470a-b643-912627ebd164) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:55:25 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-c378bd27-9043-4fa8-bf64-72ef337b71d4 tempest-ProjectReaderTests-491830598 None] Volume volume-53a9e0f2-bdde-4ce7-9f88-5c36c97c2590 (53a9e0f2-bdde-4ce7-9f88-5c36c97c2590): created successfully Sep 22 15:55:25 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-c378bd27-9043-4fa8-bf64-72ef337b71d4 tempest-ProjectReaderTests-491830598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4bb6ab44-7f0f-470a-b643-912627ebd164) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:55:25 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-c378bd27-9043-4fa8-bf64-72ef337b71d4 tempest-ProjectReaderTests-491830598 None] Flow 'volume_create_manager' (e66d0812-b08c-44e1-b46b-e02b8efea9de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:55:25 devstack sudo[104070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-32d46444-adbd-4dfd-9df9-93867f791b47 Sep 22 15:55:25 devstack sudo[104070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:55:25 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-c378bd27-9043-4fa8-bf64-72ef337b71d4 tempest-ProjectReaderTests-491830598 None] Created volume successfully. Sep 22 15:55:26 devstack sudo[104070]: pam_unix(sudo:session): session closed for user root Sep 22 15:55:26 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-eede573d-9791-4030-bdbd-6c1917d26526 tempest-VolumeDependencyTests-28226350 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-32d46444-adbd-4dfd-9df9-93867f791b47" returned: 0 in 0.377s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:55:26 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-eede573d-9791-4030-bdbd-6c1917d26526 tempest-VolumeDependencyTests-28226350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-32d46444-adbd-4dfd-9df9-93867f791b47 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:55:26 devstack sudo[104076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-32d46444-adbd-4dfd-9df9-93867f791b47 Sep 22 15:55:26 devstack sudo[104076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:55:26 devstack sudo[104076]: pam_unix(sudo:session): session closed for user root Sep 22 15:55:26 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-eede573d-9791-4030-bdbd-6c1917d26526 tempest-VolumeDependencyTests-28226350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-32d46444-adbd-4dfd-9df9-93867f791b47" returned: 0 in 0.257s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:55:26 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-eede573d-9791-4030-bdbd-6c1917d26526 tempest-VolumeDependencyTests-28226350 None] Lock "cinder-quobyte-32d46444-adbd-4dfd-9df9-93867f791b47" released by "delete_volume" :: held 0.705s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:55:26 devstack cinder-volume[86212]: DEBUG cinder.quota [None req-eede573d-9791-4030-bdbd-6c1917d26526 tempest-VolumeDependencyTests-28226350 None] Created reservations ['9fdefe5f-649c-48f4-840a-8283f3d1e706', 'c4cf10cf-7097-4bf9-9c69-2d7714398762', 'c8f14a3b-91c7-4536-b042-60bc5418b1ee', 'c0b8dbf0-7dd5-401e-b881-e850e7916dea'] {{(pid=86212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 15:55:26 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-eede573d-9791-4030-bdbd-6c1917d26526 tempest-VolumeDependencyTests-28226350 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:55:26 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-eede573d-9791-4030-bdbd-6c1917d26526 tempest-VolumeDependencyTests-28226350 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:55:26 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-eede573d-9791-4030-bdbd-6c1917d26526 tempest-VolumeDependencyTests-28226350 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:55:26 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-eede573d-9791-4030-bdbd-6c1917d26526 tempest-VolumeDependencyTests-28226350 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:55:26 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-eede573d-9791-4030-bdbd-6c1917d26526 tempest-VolumeDependencyTests-28226350 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:55:26 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-eede573d-9791-4030-bdbd-6c1917d26526 tempest-VolumeDependencyTests-28226350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:55:26 devstack sudo[104079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc Sep 22 15:55:26 devstack sudo[104079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:55:26 devstack sudo[104079]: pam_unix(sudo:session): session closed for user root Sep 22 15:55:26 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-eede573d-9791-4030-bdbd-6c1917d26526 tempest-VolumeDependencyTests-28226350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc" returned: 0 in 0.274s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:55:26 devstack cinder-volume[86212]: DEBUG cinder.manager [None req-eede573d-9791-4030-bdbd-6c1917d26526 tempest-VolumeDependencyTests-28226350 None] Notifying Schedulers of capabilities ... {{(pid=86212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 15:55:26 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-eede573d-9791-4030-bdbd-6c1917d26526 tempest-VolumeDependencyTests-28226350 None] Deleted volume successfully. Sep 22 15:55:26 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-9e1c3759-f788-42d8-a200-e6590cd035f1 tempest-VolumeDependencyTests-28226350 None] Acquiring lock "cinder-5864284b-5b8a-4b30-b9a2-469d8bddcd9b-delete_volume" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:55:26 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-eede573d-9791-4030-bdbd-6c1917d26526 tempest-VolumeDependencyTests-28226350 None] Lock "cinder-32d46444-adbd-4dfd-9df9-93867f791b47-delete_volume" released by "delete_volume" :: held 1.204s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:55:26 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-9e1c3759-f788-42d8-a200-e6590cd035f1 tempest-VolumeDependencyTests-28226350 None] Lock "cinder-5864284b-5b8a-4b30-b9a2-469d8bddcd9b-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:55:26 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-9e1c3759-f788-42d8-a200-e6590cd035f1 tempest-VolumeDependencyTests-28226350 None] Acquiring lock "cinder-quobyte-5864284b-5b8a-4b30-b9a2-469d8bddcd9b" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:55:26 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-9e1c3759-f788-42d8-a200-e6590cd035f1 tempest-VolumeDependencyTests-28226350 None] Lock "cinder-quobyte-5864284b-5b8a-4b30-b9a2-469d8bddcd9b" acquired by "delete_volume" :: waited 0.017s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:55:27 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[39c1840b-a980-42fa-8ed8-af7e1c3d7f26]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:55:27 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-9e1c3759-f788-42d8-a200-e6590cd035f1 tempest-VolumeDependencyTests-28226350 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-5864284b-5b8a-4b30-b9a2-469d8bddcd9b {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:55:27 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-4a10154c-9950-44e8-8b69-4aff15427f4e tempest-ProjectReaderTests-491830598 None] Acquiring lock "cinder-53a9e0f2-bdde-4ce7-9f88-5c36c97c2590-delete_volume" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:55:27 devstack sudo[104082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-5864284b-5b8a-4b30-b9a2-469d8bddcd9b Sep 22 15:55:27 devstack sudo[104082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:55:27 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-4a10154c-9950-44e8-8b69-4aff15427f4e tempest-ProjectReaderTests-491830598 None] Lock "cinder-53a9e0f2-bdde-4ce7-9f88-5c36c97c2590-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:55:27 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-4a10154c-9950-44e8-8b69-4aff15427f4e tempest-ProjectReaderTests-491830598 None] Acquiring lock "cinder-quobyte-53a9e0f2-bdde-4ce7-9f88-5c36c97c2590" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:55:27 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-4a10154c-9950-44e8-8b69-4aff15427f4e tempest-ProjectReaderTests-491830598 None] Lock "cinder-quobyte-53a9e0f2-bdde-4ce7-9f88-5c36c97c2590" acquired by "delete_volume" :: waited 0.016s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:55:27 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1daa6eb-9462-412c-8030-7f2138833980]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:55:27 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-4a10154c-9950-44e8-8b69-4aff15427f4e tempest-ProjectReaderTests-491830598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-53a9e0f2-bdde-4ce7-9f88-5c36c97c2590 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:55:27 devstack sudo[104084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-53a9e0f2-bdde-4ce7-9f88-5c36c97c2590 Sep 22 15:55:27 devstack sudo[104084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:55:27 devstack sudo[104082]: pam_unix(sudo:session): session closed for user root Sep 22 15:55:27 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-9e1c3759-f788-42d8-a200-e6590cd035f1 tempest-VolumeDependencyTests-28226350 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-5864284b-5b8a-4b30-b9a2-469d8bddcd9b" returned: 0 in 0.390s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:55:27 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-9e1c3759-f788-42d8-a200-e6590cd035f1 tempest-VolumeDependencyTests-28226350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-5864284b-5b8a-4b30-b9a2-469d8bddcd9b {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:55:27 devstack sudo[104089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-5864284b-5b8a-4b30-b9a2-469d8bddcd9b Sep 22 15:55:27 devstack sudo[104089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:55:27 devstack sudo[104084]: pam_unix(sudo:session): session closed for user root Sep 22 15:55:27 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-4a10154c-9950-44e8-8b69-4aff15427f4e tempest-ProjectReaderTests-491830598 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-53a9e0f2-bdde-4ce7-9f88-5c36c97c2590" returned: 0 in 0.391s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:55:27 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-4a10154c-9950-44e8-8b69-4aff15427f4e tempest-ProjectReaderTests-491830598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-53a9e0f2-bdde-4ce7-9f88-5c36c97c2590 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:55:27 devstack sudo[104094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-53a9e0f2-bdde-4ce7-9f88-5c36c97c2590 Sep 22 15:55:27 devstack sudo[104094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:55:27 devstack sudo[104089]: pam_unix(sudo:session): session closed for user root Sep 22 15:55:27 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-9e1c3759-f788-42d8-a200-e6590cd035f1 tempest-VolumeDependencyTests-28226350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-5864284b-5b8a-4b30-b9a2-469d8bddcd9b" returned: 0 in 0.289s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:55:27 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-9e1c3759-f788-42d8-a200-e6590cd035f1 tempest-VolumeDependencyTests-28226350 None] Lock "cinder-quobyte-5864284b-5b8a-4b30-b9a2-469d8bddcd9b" released by "delete_volume" :: held 0.729s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:55:27 devstack cinder-volume[86212]: DEBUG cinder.quota [None req-9e1c3759-f788-42d8-a200-e6590cd035f1 tempest-VolumeDependencyTests-28226350 None] Created reservations ['0c8e662c-b452-4519-9d2a-ff011f34cf00', '36c58710-31dd-4a53-9ce0-5ccc27a049fb', '34eb5ff8-69e8-4b68-9ff1-b0e623fed6f8', '51404335-58e4-419f-aa5f-b047f239ceac'] {{(pid=86212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 15:55:27 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-9e1c3759-f788-42d8-a200-e6590cd035f1 tempest-VolumeDependencyTests-28226350 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:55:27 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-9e1c3759-f788-42d8-a200-e6590cd035f1 tempest-VolumeDependencyTests-28226350 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:55:27 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-9e1c3759-f788-42d8-a200-e6590cd035f1 tempest-VolumeDependencyTests-28226350 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:55:27 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-9e1c3759-f788-42d8-a200-e6590cd035f1 tempest-VolumeDependencyTests-28226350 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:55:27 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-9e1c3759-f788-42d8-a200-e6590cd035f1 tempest-VolumeDependencyTests-28226350 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:55:27 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-9e1c3759-f788-42d8-a200-e6590cd035f1 tempest-VolumeDependencyTests-28226350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:55:27 devstack sudo[104097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc Sep 22 15:55:27 devstack sudo[104097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:55:27 devstack sudo[104094]: pam_unix(sudo:session): session closed for user root Sep 22 15:55:27 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-4a10154c-9950-44e8-8b69-4aff15427f4e tempest-ProjectReaderTests-491830598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-53a9e0f2-bdde-4ce7-9f88-5c36c97c2590" returned: 0 in 0.318s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:55:27 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-4a10154c-9950-44e8-8b69-4aff15427f4e tempest-ProjectReaderTests-491830598 None] Lock "cinder-quobyte-53a9e0f2-bdde-4ce7-9f88-5c36c97c2590" released by "delete_volume" :: held 0.759s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:55:28 devstack cinder-volume[86212]: DEBUG cinder.quota [None req-4a10154c-9950-44e8-8b69-4aff15427f4e tempest-ProjectReaderTests-491830598 None] Created reservations ['c345d55d-91af-4044-a39f-d124628641a5', '08fbc4f1-5d42-4ace-b9fe-1ea5658c36c2', '02474b81-9e74-4697-bcf0-ca289f15e328', '2999928d-d227-4262-a0c7-da75567d9f57'] {{(pid=86212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 15:55:28 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-4a10154c-9950-44e8-8b69-4aff15427f4e tempest-ProjectReaderTests-491830598 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:55:28 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-4a10154c-9950-44e8-8b69-4aff15427f4e tempest-ProjectReaderTests-491830598 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:55:28 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-4a10154c-9950-44e8-8b69-4aff15427f4e tempest-ProjectReaderTests-491830598 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:55:28 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-4a10154c-9950-44e8-8b69-4aff15427f4e tempest-ProjectReaderTests-491830598 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:55:28 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-4a10154c-9950-44e8-8b69-4aff15427f4e tempest-ProjectReaderTests-491830598 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:55:28 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-4a10154c-9950-44e8-8b69-4aff15427f4e tempest-ProjectReaderTests-491830598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:55:28 devstack sudo[104102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc Sep 22 15:55:28 devstack sudo[104102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:55:28 devstack sudo[104097]: pam_unix(sudo:session): session closed for user root Sep 22 15:55:28 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-9e1c3759-f788-42d8-a200-e6590cd035f1 tempest-VolumeDependencyTests-28226350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc" returned: 0 in 0.302s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:55:28 devstack cinder-volume[86212]: DEBUG cinder.manager [None req-9e1c3759-f788-42d8-a200-e6590cd035f1 tempest-VolumeDependencyTests-28226350 None] Notifying Schedulers of capabilities ... {{(pid=86212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 15:55:28 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-9e1c3759-f788-42d8-a200-e6590cd035f1 tempest-VolumeDependencyTests-28226350 None] Deleted volume successfully. Sep 22 15:55:28 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-9e1c3759-f788-42d8-a200-e6590cd035f1 tempest-VolumeDependencyTests-28226350 None] Lock "cinder-5864284b-5b8a-4b30-b9a2-469d8bddcd9b-delete_volume" released by "delete_volume" :: held 1.272s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:55:28 devstack sudo[104102]: pam_unix(sudo:session): session closed for user root Sep 22 15:55:28 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-4a10154c-9950-44e8-8b69-4aff15427f4e tempest-ProjectReaderTests-491830598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc" returned: 0 in 0.303s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:55:28 devstack cinder-volume[86212]: DEBUG cinder.manager [None req-4a10154c-9950-44e8-8b69-4aff15427f4e tempest-ProjectReaderTests-491830598 None] Notifying Schedulers of capabilities ... {{(pid=86212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 15:55:28 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-4a10154c-9950-44e8-8b69-4aff15427f4e tempest-ProjectReaderTests-491830598 None] Deleted volume successfully. Sep 22 15:55:28 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-4a10154c-9950-44e8-8b69-4aff15427f4e tempest-ProjectReaderTests-491830598 None] Lock "cinder-53a9e0f2-bdde-4ce7-9f88-5c36c97c2590-delete_volume" released by "delete_volume" :: held 1.310s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:55:28 devstack cinder-volume[86212]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd99abcb-135b-47fe-8339-e449638d3ba5 tempest-ProjectReaderTests-491830598 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 15:55:28 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-cd99abcb-135b-47fe-8339-e449638d3ba5 tempest-ProjectReaderTests-491830598 None] Flow 'volume_create_manager' (38445702-0e32-4aaa-b20f-8685f42797b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:55:28 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-cd99abcb-135b-47fe-8339-e449638d3ba5 tempest-ProjectReaderTests-491830598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7797315b-e808-41e9-b10c-64b5e13efcf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:55:28 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-cd99abcb-135b-47fe-8339-e449638d3ba5 tempest-ProjectReaderTests-491830598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7797315b-e808-41e9-b10c-64b5e13efcf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:55:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1147177734',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2cbaf3ad-12e7-4ef1-b867-0e61f4c4f5b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91fed863712e46f2848d69224d11c16b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:55:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:55:29Z,use_quota=True,user_id='d3a28f8afda1496cab6a487c454024f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:55:28 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-cd99abcb-135b-47fe-8339-e449638d3ba5 tempest-ProjectReaderTests-491830598 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1cc4230-0667-42bc-a277-d2f461588610) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:55:28 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-cd99abcb-135b-47fe-8339-e449638d3ba5 tempest-ProjectReaderTests-491830598 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1cc4230-0667-42bc-a277-d2f461588610) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:55:28 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-cd99abcb-135b-47fe-8339-e449638d3ba5 tempest-ProjectReaderTests-491830598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd692928-93b0-4310-bc7d-f3151b93a05c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:55:28 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-cd99abcb-135b-47fe-8339-e449638d3ba5 tempest-ProjectReaderTests-491830598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd692928-93b0-4310-bc7d-f3151b93a05c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2cbaf3ad-12e7-4ef1-b867-0e61f4c4f5b5', 'volume_name': 'volume-2cbaf3ad-12e7-4ef1-b867-0e61f4c4f5b5', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:55:28 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-cd99abcb-135b-47fe-8339-e449638d3ba5 tempest-ProjectReaderTests-491830598 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1e428fb-c91a-494d-8022-1550ad2eaf8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:55:28 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-cd99abcb-135b-47fe-8339-e449638d3ba5 tempest-ProjectReaderTests-491830598 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1e428fb-c91a-494d-8022-1550ad2eaf8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:55:28 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-cd99abcb-135b-47fe-8339-e449638d3ba5 tempest-ProjectReaderTests-491830598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0f51c1b-df83-44f3-8a1c-5ff2e9393eec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:55:28 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-cd99abcb-135b-47fe-8339-e449638d3ba5 tempest-ProjectReaderTests-491830598 None] Volume 2cbaf3ad-12e7-4ef1-b867-0e61f4c4f5b5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2cbaf3ad-12e7-4ef1-b867-0e61f4c4f5b5', 'volume_size': 1} Sep 22 15:55:28 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-cd99abcb-135b-47fe-8339-e449638d3ba5 tempest-ProjectReaderTests-491830598 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:55:28 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-cd99abcb-135b-47fe-8339-e449638d3ba5 tempest-ProjectReaderTests-491830598 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:55:28 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-cd99abcb-135b-47fe-8339-e449638d3ba5 tempest-ProjectReaderTests-491830598 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:55:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1147177734',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2cbaf3ad-12e7-4ef1-b867-0e61f4c4f5b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91fed863712e46f2848d69224d11c16b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:55:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:55:29Z,use_quota=True,user_id='d3a28f8afda1496cab6a487c454024f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)}" {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 15:55:28 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-cd99abcb-135b-47fe-8339-e449638d3ba5 tempest-ProjectReaderTests-491830598 None] Creating volume 2cbaf3ad-12e7-4ef1-b867-0e61f4c4f5b5 {{(pid=86212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 15:55:28 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-cd99abcb-135b-47fe-8339-e449638d3ba5 tempest-ProjectReaderTests-491830598 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:55:28 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-cd99abcb-135b-47fe-8339-e449638d3ba5 tempest-ProjectReaderTests-491830598 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:55:28 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-cd99abcb-135b-47fe-8339-e449638d3ba5 tempest-ProjectReaderTests-491830598 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:55:28 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-cd99abcb-135b-47fe-8339-e449638d3ba5 tempest-ProjectReaderTests-491830598 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:55:28 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-cd99abcb-135b-47fe-8339-e449638d3ba5 tempest-ProjectReaderTests-491830598 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:55:28 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-cd99abcb-135b-47fe-8339-e449638d3ba5 tempest-ProjectReaderTests-491830598 None] Selected osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 as target Quobyte volume. {{(pid=86212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 15:55:28 devstack cinder-volume[86212]: INFO cinder.volume.drivers.remotefs [None req-cd99abcb-135b-47fe-8339-e449638d3ba5 tempest-ProjectReaderTests-491830598 None] casted to osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 Sep 22 15:55:28 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-cd99abcb-135b-47fe-8339-e449638d3ba5 tempest-ProjectReaderTests-491830598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2cbaf3ad-12e7-4ef1-b867-0e61f4c4f5b5 1073741824 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:55:28 devstack sudo[104105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2cbaf3ad-12e7-4ef1-b867-0e61f4c4f5b5 1073741824 Sep 22 15:55:28 devstack sudo[104105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:55:29 devstack sudo[104105]: pam_unix(sudo:session): session closed for user root Sep 22 15:55:29 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-cd99abcb-135b-47fe-8339-e449638d3ba5 tempest-ProjectReaderTests-491830598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2cbaf3ad-12e7-4ef1-b867-0e61f4c4f5b5 1073741824" returned: 0 in 0.503s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:55:29 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-cd99abcb-135b-47fe-8339-e449638d3ba5 tempest-ProjectReaderTests-491830598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2cbaf3ad-12e7-4ef1-b867-0e61f4c4f5b5 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:55:29 devstack sudo[104111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2cbaf3ad-12e7-4ef1-b867-0e61f4c4f5b5 Sep 22 15:55:29 devstack sudo[104111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:55:29 devstack sudo[104111]: pam_unix(sudo:session): session closed for user root Sep 22 15:55:29 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-cd99abcb-135b-47fe-8339-e449638d3ba5 tempest-ProjectReaderTests-491830598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2cbaf3ad-12e7-4ef1-b867-0e61f4c4f5b5" returned: 0 in 0.302s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:55:29 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-cd99abcb-135b-47fe-8339-e449638d3ba5 tempest-ProjectReaderTests-491830598 None] <== create_volume: return (851ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'} {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 15:55:29 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-cd99abcb-135b-47fe-8339-e449638d3ba5 tempest-ProjectReaderTests-491830598 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.853s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:55:29 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-cd99abcb-135b-47fe-8339-e449638d3ba5 tempest-ProjectReaderTests-491830598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0f51c1b-df83-44f3-8a1c-5ff2e9393eec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2cbaf3ad-12e7-4ef1-b867-0e61f4c4f5b5', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:55:29 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-cd99abcb-135b-47fe-8339-e449638d3ba5 tempest-ProjectReaderTests-491830598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (337101f7-ebcd-4257-8448-e866d36f3cdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:55:29 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-cd99abcb-135b-47fe-8339-e449638d3ba5 tempest-ProjectReaderTests-491830598 None] Volume volume-2cbaf3ad-12e7-4ef1-b867-0e61f4c4f5b5 (2cbaf3ad-12e7-4ef1-b867-0e61f4c4f5b5): created successfully Sep 22 15:55:29 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-cd99abcb-135b-47fe-8339-e449638d3ba5 tempest-ProjectReaderTests-491830598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (337101f7-ebcd-4257-8448-e866d36f3cdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:55:29 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-cd99abcb-135b-47fe-8339-e449638d3ba5 tempest-ProjectReaderTests-491830598 None] Flow 'volume_create_manager' (38445702-0e32-4aaa-b20f-8685f42797b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:55:29 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-cd99abcb-135b-47fe-8339-e449638d3ba5 tempest-ProjectReaderTests-491830598 None] Created volume successfully. Sep 22 15:55:31 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-168e571d-5100-483e-a11d-6f49669787d2 tempest-ProjectReaderTests-491830598 None] Acquiring lock "cinder-2cbaf3ad-12e7-4ef1-b867-0e61f4c4f5b5-delete_volume" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:55:31 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-168e571d-5100-483e-a11d-6f49669787d2 tempest-ProjectReaderTests-491830598 None] Lock "cinder-2cbaf3ad-12e7-4ef1-b867-0e61f4c4f5b5-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:55:31 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-168e571d-5100-483e-a11d-6f49669787d2 tempest-ProjectReaderTests-491830598 None] Acquiring lock "cinder-quobyte-2cbaf3ad-12e7-4ef1-b867-0e61f4c4f5b5" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:55:31 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-168e571d-5100-483e-a11d-6f49669787d2 tempest-ProjectReaderTests-491830598 None] Lock "cinder-quobyte-2cbaf3ad-12e7-4ef1-b867-0e61f4c4f5b5" acquired by "delete_volume" :: waited 0.016s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:55:31 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[628b3db2-326c-41a8-bb95-0d3adba6c27b]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:55:31 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-168e571d-5100-483e-a11d-6f49669787d2 tempest-ProjectReaderTests-491830598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2cbaf3ad-12e7-4ef1-b867-0e61f4c4f5b5 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:55:31 devstack sudo[104114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2cbaf3ad-12e7-4ef1-b867-0e61f4c4f5b5 Sep 22 15:55:31 devstack sudo[104114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:55:31 devstack sudo[104114]: pam_unix(sudo:session): session closed for user root Sep 22 15:55:31 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-168e571d-5100-483e-a11d-6f49669787d2 tempest-ProjectReaderTests-491830598 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2cbaf3ad-12e7-4ef1-b867-0e61f4c4f5b5" returned: 0 in 0.420s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:55:31 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-168e571d-5100-483e-a11d-6f49669787d2 tempest-ProjectReaderTests-491830598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2cbaf3ad-12e7-4ef1-b867-0e61f4c4f5b5 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:55:31 devstack sudo[104119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2cbaf3ad-12e7-4ef1-b867-0e61f4c4f5b5 Sep 22 15:55:31 devstack sudo[104119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:55:31 devstack sudo[104119]: pam_unix(sudo:session): session closed for user root Sep 22 15:55:31 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-168e571d-5100-483e-a11d-6f49669787d2 tempest-ProjectReaderTests-491830598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2cbaf3ad-12e7-4ef1-b867-0e61f4c4f5b5" returned: 0 in 0.272s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:55:31 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-168e571d-5100-483e-a11d-6f49669787d2 tempest-ProjectReaderTests-491830598 None] Lock "cinder-quobyte-2cbaf3ad-12e7-4ef1-b867-0e61f4c4f5b5" released by "delete_volume" :: held 0.754s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:55:31 devstack cinder-volume[86212]: DEBUG cinder.quota [None req-168e571d-5100-483e-a11d-6f49669787d2 tempest-ProjectReaderTests-491830598 None] Created reservations ['0c69ff5b-656a-4546-ada6-66a44574902f', '79a8a414-a422-4edc-abfb-982e700e646c', '14e22633-8c6d-433c-a1e0-d34f48992ee2', 'fc4e2e63-f426-48d0-9173-3a4a443384b5'] {{(pid=86212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 15:55:32 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-168e571d-5100-483e-a11d-6f49669787d2 tempest-ProjectReaderTests-491830598 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:55:32 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-168e571d-5100-483e-a11d-6f49669787d2 tempest-ProjectReaderTests-491830598 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:55:32 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-168e571d-5100-483e-a11d-6f49669787d2 tempest-ProjectReaderTests-491830598 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:55:32 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-168e571d-5100-483e-a11d-6f49669787d2 tempest-ProjectReaderTests-491830598 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:55:32 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-168e571d-5100-483e-a11d-6f49669787d2 tempest-ProjectReaderTests-491830598 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:55:32 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-168e571d-5100-483e-a11d-6f49669787d2 tempest-ProjectReaderTests-491830598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:55:32 devstack sudo[104122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc Sep 22 15:55:32 devstack sudo[104122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:55:32 devstack sudo[104122]: pam_unix(sudo:session): session closed for user root Sep 22 15:55:32 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-168e571d-5100-483e-a11d-6f49669787d2 tempest-ProjectReaderTests-491830598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc" returned: 0 in 0.271s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:55:32 devstack cinder-volume[86212]: DEBUG cinder.manager [None req-168e571d-5100-483e-a11d-6f49669787d2 tempest-ProjectReaderTests-491830598 None] Notifying Schedulers of capabilities ... {{(pid=86212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 15:55:32 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-168e571d-5100-483e-a11d-6f49669787d2 tempest-ProjectReaderTests-491830598 None] Deleted volume successfully. Sep 22 15:55:32 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-168e571d-5100-483e-a11d-6f49669787d2 tempest-ProjectReaderTests-491830598 None] Lock "cinder-2cbaf3ad-12e7-4ef1-b867-0e61f4c4f5b5-delete_volume" released by "delete_volume" :: held 1.303s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:55:32 devstack cinder-volume[86212]: DEBUG cinder.volume.flows.manager.create_volume [None req-0fe21786-6cdf-4012-8549-5ba265a07b28 tempest-ProjectReaderTests-281080527 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 15:55:32 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-0fe21786-6cdf-4012-8549-5ba265a07b28 tempest-ProjectReaderTests-281080527 None] Flow 'volume_create_manager' (46af994a-8de9-4dab-9724-1ca2038216e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:55:32 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-0fe21786-6cdf-4012-8549-5ba265a07b28 tempest-ProjectReaderTests-281080527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16079d2f-c263-4f64-8461-258147a8d87d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:55:32 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-0fe21786-6cdf-4012-8549-5ba265a07b28 tempest-ProjectReaderTests-281080527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16079d2f-c263-4f64-8461-258147a8d87d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:55:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-213994461',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9fa29eb7-c67b-416e-a714-9c7994ae62d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c03b4ef494e34edc98458b81912cd44f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:55:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:55:32Z,use_quota=True,user_id='90c6c6f1e133408aaa1a919b7817fbea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:55:32 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-0fe21786-6cdf-4012-8549-5ba265a07b28 tempest-ProjectReaderTests-281080527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79d07c26-4e93-4b57-b75c-fcdc12d727d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:55:32 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-0fe21786-6cdf-4012-8549-5ba265a07b28 tempest-ProjectReaderTests-281080527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79d07c26-4e93-4b57-b75c-fcdc12d727d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:55:32 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-0fe21786-6cdf-4012-8549-5ba265a07b28 tempest-ProjectReaderTests-281080527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (977f950f-31f0-426e-b3f4-15dfa93f8fac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:55:32 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-0fe21786-6cdf-4012-8549-5ba265a07b28 tempest-ProjectReaderTests-281080527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (977f950f-31f0-426e-b3f4-15dfa93f8fac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9fa29eb7-c67b-416e-a714-9c7994ae62d8', 'volume_name': 'volume-9fa29eb7-c67b-416e-a714-9c7994ae62d8', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:55:32 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-0fe21786-6cdf-4012-8549-5ba265a07b28 tempest-ProjectReaderTests-281080527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85c4ff3b-dc0f-4222-82d6-b76edcb51c0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:55:32 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-0fe21786-6cdf-4012-8549-5ba265a07b28 tempest-ProjectReaderTests-281080527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85c4ff3b-dc0f-4222-82d6-b76edcb51c0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:55:32 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-0fe21786-6cdf-4012-8549-5ba265a07b28 tempest-ProjectReaderTests-281080527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e90073b-016b-4a2d-b815-2ed310aa3a72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:55:32 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-0fe21786-6cdf-4012-8549-5ba265a07b28 tempest-ProjectReaderTests-281080527 None] Volume 9fa29eb7-c67b-416e-a714-9c7994ae62d8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9fa29eb7-c67b-416e-a714-9c7994ae62d8', 'volume_size': 1} Sep 22 15:55:32 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-0fe21786-6cdf-4012-8549-5ba265a07b28 tempest-ProjectReaderTests-281080527 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:55:32 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-0fe21786-6cdf-4012-8549-5ba265a07b28 tempest-ProjectReaderTests-281080527 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:55:32 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-0fe21786-6cdf-4012-8549-5ba265a07b28 tempest-ProjectReaderTests-281080527 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:55:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-213994461',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9fa29eb7-c67b-416e-a714-9c7994ae62d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c03b4ef494e34edc98458b81912cd44f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:55:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:55:32Z,use_quota=True,user_id='90c6c6f1e133408aaa1a919b7817fbea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)}" {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 15:55:32 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-0fe21786-6cdf-4012-8549-5ba265a07b28 tempest-ProjectReaderTests-281080527 None] Creating volume 9fa29eb7-c67b-416e-a714-9c7994ae62d8 {{(pid=86212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 15:55:32 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-0fe21786-6cdf-4012-8549-5ba265a07b28 tempest-ProjectReaderTests-281080527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:55:32 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-0fe21786-6cdf-4012-8549-5ba265a07b28 tempest-ProjectReaderTests-281080527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:55:32 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-0fe21786-6cdf-4012-8549-5ba265a07b28 tempest-ProjectReaderTests-281080527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:55:32 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-0fe21786-6cdf-4012-8549-5ba265a07b28 tempest-ProjectReaderTests-281080527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:55:32 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-0fe21786-6cdf-4012-8549-5ba265a07b28 tempest-ProjectReaderTests-281080527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:55:32 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-0fe21786-6cdf-4012-8549-5ba265a07b28 tempest-ProjectReaderTests-281080527 None] Selected osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 as target Quobyte volume. {{(pid=86212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 15:55:32 devstack cinder-volume[86212]: INFO cinder.volume.drivers.remotefs [None req-0fe21786-6cdf-4012-8549-5ba265a07b28 tempest-ProjectReaderTests-281080527 None] casted to osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 Sep 22 15:55:32 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-0fe21786-6cdf-4012-8549-5ba265a07b28 tempest-ProjectReaderTests-281080527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-9fa29eb7-c67b-416e-a714-9c7994ae62d8 1073741824 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:55:32 devstack sudo[104125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-9fa29eb7-c67b-416e-a714-9c7994ae62d8 1073741824 Sep 22 15:55:32 devstack sudo[104125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:55:32 devstack cinder-volume[86212]: DEBUG cinder.volume.flows.manager.create_volume [None req-12dacb92-34e7-4082-9897-f307b89b3a06 tempest-ProjectReaderTests-491830598 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 15:55:32 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-12dacb92-34e7-4082-9897-f307b89b3a06 tempest-ProjectReaderTests-491830598 None] Flow 'volume_create_manager' (0d7db9db-eeab-4a23-9585-7c614a2a7214) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:55:32 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-12dacb92-34e7-4082-9897-f307b89b3a06 tempest-ProjectReaderTests-491830598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6476d009-32a2-4b8c-86e1-7a384ac85158) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:55:32 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-12dacb92-34e7-4082-9897-f307b89b3a06 tempest-ProjectReaderTests-491830598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6476d009-32a2-4b8c-86e1-7a384ac85158) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:55:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1852583504',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6aa09f7f-0cb5-4900-b767-f9d734057786,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91fed863712e46f2848d69224d11c16b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:55:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:55:33Z,use_quota=True,user_id='d3a28f8afda1496cab6a487c454024f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:55:32 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-12dacb92-34e7-4082-9897-f307b89b3a06 tempest-ProjectReaderTests-491830598 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0fb445c-aace-4108-9414-cf32bfef363f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:55:32 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-12dacb92-34e7-4082-9897-f307b89b3a06 tempest-ProjectReaderTests-491830598 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0fb445c-aace-4108-9414-cf32bfef363f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:55:32 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-12dacb92-34e7-4082-9897-f307b89b3a06 tempest-ProjectReaderTests-491830598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fdf29df1-fa65-4fa5-bcbb-190da81df630) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:55:32 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-12dacb92-34e7-4082-9897-f307b89b3a06 tempest-ProjectReaderTests-491830598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fdf29df1-fa65-4fa5-bcbb-190da81df630) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6aa09f7f-0cb5-4900-b767-f9d734057786', 'volume_name': 'volume-6aa09f7f-0cb5-4900-b767-f9d734057786', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:55:32 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-12dacb92-34e7-4082-9897-f307b89b3a06 tempest-ProjectReaderTests-491830598 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29b734e1-696b-46d3-b93c-2ee40ca82ad1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:55:32 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-12dacb92-34e7-4082-9897-f307b89b3a06 tempest-ProjectReaderTests-491830598 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29b734e1-696b-46d3-b93c-2ee40ca82ad1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:55:32 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-12dacb92-34e7-4082-9897-f307b89b3a06 tempest-ProjectReaderTests-491830598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd44a0eb-cc72-4258-b025-7607f32966ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:55:32 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-12dacb92-34e7-4082-9897-f307b89b3a06 tempest-ProjectReaderTests-491830598 None] Volume 6aa09f7f-0cb5-4900-b767-f9d734057786: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6aa09f7f-0cb5-4900-b767-f9d734057786', 'volume_size': 1} Sep 22 15:55:32 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-12dacb92-34e7-4082-9897-f307b89b3a06 tempest-ProjectReaderTests-491830598 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:55:32 devstack sudo[104125]: pam_unix(sudo:session): session closed for user root Sep 22 15:55:32 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-0fe21786-6cdf-4012-8549-5ba265a07b28 tempest-ProjectReaderTests-281080527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-9fa29eb7-c67b-416e-a714-9c7994ae62d8 1073741824" returned: 0 in 0.476s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:55:32 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-0fe21786-6cdf-4012-8549-5ba265a07b28 tempest-ProjectReaderTests-281080527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-9fa29eb7-c67b-416e-a714-9c7994ae62d8 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:55:32 devstack sudo[104130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-9fa29eb7-c67b-416e-a714-9c7994ae62d8 Sep 22 15:55:32 devstack sudo[104130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:55:33 devstack sudo[104130]: pam_unix(sudo:session): session closed for user root Sep 22 15:55:33 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-0fe21786-6cdf-4012-8549-5ba265a07b28 tempest-ProjectReaderTests-281080527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-9fa29eb7-c67b-416e-a714-9c7994ae62d8" returned: 0 in 0.243s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:55:33 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-0fe21786-6cdf-4012-8549-5ba265a07b28 tempest-ProjectReaderTests-281080527 None] <== create_volume: return (760ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'} {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 15:55:33 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-0fe21786-6cdf-4012-8549-5ba265a07b28 tempest-ProjectReaderTests-281080527 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.764s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:55:33 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-12dacb92-34e7-4082-9897-f307b89b3a06 tempest-ProjectReaderTests-491830598 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.401s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:55:33 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-12dacb92-34e7-4082-9897-f307b89b3a06 tempest-ProjectReaderTests-491830598 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:55:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1852583504',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6aa09f7f-0cb5-4900-b767-f9d734057786,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91fed863712e46f2848d69224d11c16b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:55:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:55:33Z,use_quota=True,user_id='d3a28f8afda1496cab6a487c454024f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)}" {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 15:55:33 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-12dacb92-34e7-4082-9897-f307b89b3a06 tempest-ProjectReaderTests-491830598 None] Creating volume 6aa09f7f-0cb5-4900-b767-f9d734057786 {{(pid=86212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 15:55:33 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-12dacb92-34e7-4082-9897-f307b89b3a06 tempest-ProjectReaderTests-491830598 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:55:33 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-12dacb92-34e7-4082-9897-f307b89b3a06 tempest-ProjectReaderTests-491830598 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:55:33 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-12dacb92-34e7-4082-9897-f307b89b3a06 tempest-ProjectReaderTests-491830598 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:55:33 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-12dacb92-34e7-4082-9897-f307b89b3a06 tempest-ProjectReaderTests-491830598 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:55:33 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-12dacb92-34e7-4082-9897-f307b89b3a06 tempest-ProjectReaderTests-491830598 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:55:33 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-12dacb92-34e7-4082-9897-f307b89b3a06 tempest-ProjectReaderTests-491830598 None] Selected osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 as target Quobyte volume. {{(pid=86212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 15:55:33 devstack cinder-volume[86212]: INFO cinder.volume.drivers.remotefs [None req-12dacb92-34e7-4082-9897-f307b89b3a06 tempest-ProjectReaderTests-491830598 None] casted to osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 Sep 22 15:55:33 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-12dacb92-34e7-4082-9897-f307b89b3a06 tempest-ProjectReaderTests-491830598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-6aa09f7f-0cb5-4900-b767-f9d734057786 1073741824 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:55:33 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-0fe21786-6cdf-4012-8549-5ba265a07b28 tempest-ProjectReaderTests-281080527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e90073b-016b-4a2d-b815-2ed310aa3a72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9fa29eb7-c67b-416e-a714-9c7994ae62d8', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:55:33 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-0fe21786-6cdf-4012-8549-5ba265a07b28 tempest-ProjectReaderTests-281080527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae0b9a06-4065-46f2-b81a-d5e5a44d9933) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:55:33 devstack sudo[104133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-6aa09f7f-0cb5-4900-b767-f9d734057786 1073741824 Sep 22 15:55:33 devstack sudo[104133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:55:33 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-0fe21786-6cdf-4012-8549-5ba265a07b28 tempest-ProjectReaderTests-281080527 None] Volume volume-9fa29eb7-c67b-416e-a714-9c7994ae62d8 (9fa29eb7-c67b-416e-a714-9c7994ae62d8): created successfully Sep 22 15:55:33 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-0fe21786-6cdf-4012-8549-5ba265a07b28 tempest-ProjectReaderTests-281080527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae0b9a06-4065-46f2-b81a-d5e5a44d9933) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:55:33 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-0fe21786-6cdf-4012-8549-5ba265a07b28 tempest-ProjectReaderTests-281080527 None] Flow 'volume_create_manager' (46af994a-8de9-4dab-9724-1ca2038216e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:55:33 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-0fe21786-6cdf-4012-8549-5ba265a07b28 tempest-ProjectReaderTests-281080527 None] Created volume successfully. Sep 22 15:55:33 devstack sudo[104133]: pam_unix(sudo:session): session closed for user root Sep 22 15:55:33 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-12dacb92-34e7-4082-9897-f307b89b3a06 tempest-ProjectReaderTests-491830598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-6aa09f7f-0cb5-4900-b767-f9d734057786 1073741824" returned: 0 in 0.448s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:55:33 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-12dacb92-34e7-4082-9897-f307b89b3a06 tempest-ProjectReaderTests-491830598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-6aa09f7f-0cb5-4900-b767-f9d734057786 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:55:33 devstack sudo[104138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-6aa09f7f-0cb5-4900-b767-f9d734057786 Sep 22 15:55:33 devstack sudo[104138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:55:33 devstack sudo[104138]: pam_unix(sudo:session): session closed for user root Sep 22 15:55:33 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-12dacb92-34e7-4082-9897-f307b89b3a06 tempest-ProjectReaderTests-491830598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-6aa09f7f-0cb5-4900-b767-f9d734057786" returned: 0 in 0.254s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:55:33 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-12dacb92-34e7-4082-9897-f307b89b3a06 tempest-ProjectReaderTests-491830598 None] <== create_volume: return (743ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'} {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 15:55:33 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-12dacb92-34e7-4082-9897-f307b89b3a06 tempest-ProjectReaderTests-491830598 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.746s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:55:33 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-12dacb92-34e7-4082-9897-f307b89b3a06 tempest-ProjectReaderTests-491830598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd44a0eb-cc72-4258-b025-7607f32966ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6aa09f7f-0cb5-4900-b767-f9d734057786', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:55:33 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-12dacb92-34e7-4082-9897-f307b89b3a06 tempest-ProjectReaderTests-491830598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aeecc3dd-99d9-45f6-9862-f5f20fcb20f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:55:33 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-12dacb92-34e7-4082-9897-f307b89b3a06 tempest-ProjectReaderTests-491830598 None] Volume volume-6aa09f7f-0cb5-4900-b767-f9d734057786 (6aa09f7f-0cb5-4900-b767-f9d734057786): created successfully Sep 22 15:55:33 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-12dacb92-34e7-4082-9897-f307b89b3a06 tempest-ProjectReaderTests-491830598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aeecc3dd-99d9-45f6-9862-f5f20fcb20f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:55:34 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-12dacb92-34e7-4082-9897-f307b89b3a06 tempest-ProjectReaderTests-491830598 None] Flow 'volume_create_manager' (0d7db9db-eeab-4a23-9585-7c614a2a7214) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:55:34 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-12dacb92-34e7-4082-9897-f307b89b3a06 tempest-ProjectReaderTests-491830598 None] Created volume successfully. Sep 22 15:55:34 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-f340bcb6-ca4b-4fd8-bf13-77372898e776 tempest-ProjectReaderTests-281080527 None] Acquiring lock "cinder-9fa29eb7-c67b-416e-a714-9c7994ae62d8-delete_volume" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:55:34 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-f340bcb6-ca4b-4fd8-bf13-77372898e776 tempest-ProjectReaderTests-281080527 None] Lock "cinder-9fa29eb7-c67b-416e-a714-9c7994ae62d8-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:55:34 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-f340bcb6-ca4b-4fd8-bf13-77372898e776 tempest-ProjectReaderTests-281080527 None] Acquiring lock "cinder-quobyte-9fa29eb7-c67b-416e-a714-9c7994ae62d8" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:55:34 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-f340bcb6-ca4b-4fd8-bf13-77372898e776 tempest-ProjectReaderTests-281080527 None] Lock "cinder-quobyte-9fa29eb7-c67b-416e-a714-9c7994ae62d8" acquired by "delete_volume" :: waited 0.015s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:55:34 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4f0fd27-9c66-4c07-8ffb-e458a71261ce]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:55:34 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-f340bcb6-ca4b-4fd8-bf13-77372898e776 tempest-ProjectReaderTests-281080527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-9fa29eb7-c67b-416e-a714-9c7994ae62d8 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:55:34 devstack sudo[104141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-9fa29eb7-c67b-416e-a714-9c7994ae62d8 Sep 22 15:55:34 devstack sudo[104141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:55:34 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-2b2de501-5554-42fa-a2bb-b151d190e75d tempest-ProjectReaderTests-491830598 None] Acquiring lock "cinder-6aa09f7f-0cb5-4900-b767-f9d734057786-delete_volume" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:55:34 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-2b2de501-5554-42fa-a2bb-b151d190e75d tempest-ProjectReaderTests-491830598 None] Lock "cinder-6aa09f7f-0cb5-4900-b767-f9d734057786-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:55:34 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-2b2de501-5554-42fa-a2bb-b151d190e75d tempest-ProjectReaderTests-491830598 None] Acquiring lock "cinder-quobyte-6aa09f7f-0cb5-4900-b767-f9d734057786" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:55:34 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-2b2de501-5554-42fa-a2bb-b151d190e75d tempest-ProjectReaderTests-491830598 None] Lock "cinder-quobyte-6aa09f7f-0cb5-4900-b767-f9d734057786" acquired by "delete_volume" :: waited 0.018s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:55:34 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[1245f8e7-d93f-470b-8deb-9a1ebc869faa]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:55:34 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-2b2de501-5554-42fa-a2bb-b151d190e75d tempest-ProjectReaderTests-491830598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-6aa09f7f-0cb5-4900-b767-f9d734057786 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:55:35 devstack sudo[104141]: pam_unix(sudo:session): session closed for user root Sep 22 15:55:35 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-f340bcb6-ca4b-4fd8-bf13-77372898e776 tempest-ProjectReaderTests-281080527 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-9fa29eb7-c67b-416e-a714-9c7994ae62d8" returned: 0 in 0.413s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:55:35 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-f340bcb6-ca4b-4fd8-bf13-77372898e776 tempest-ProjectReaderTests-281080527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-9fa29eb7-c67b-416e-a714-9c7994ae62d8 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:55:35 devstack sudo[104144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-6aa09f7f-0cb5-4900-b767-f9d734057786 Sep 22 15:55:35 devstack sudo[104144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:55:35 devstack sudo[104147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-9fa29eb7-c67b-416e-a714-9c7994ae62d8 Sep 22 15:55:35 devstack sudo[104147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:55:35 devstack sudo[104147]: pam_unix(sudo:session): session closed for user root Sep 22 15:55:35 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-f340bcb6-ca4b-4fd8-bf13-77372898e776 tempest-ProjectReaderTests-281080527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-9fa29eb7-c67b-416e-a714-9c7994ae62d8" returned: 0 in 0.246s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:55:35 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-f340bcb6-ca4b-4fd8-bf13-77372898e776 tempest-ProjectReaderTests-281080527 None] Lock "cinder-quobyte-9fa29eb7-c67b-416e-a714-9c7994ae62d8" released by "delete_volume" :: held 0.709s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:55:35 devstack sudo[104144]: pam_unix(sudo:session): session closed for user root Sep 22 15:55:35 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-2b2de501-5554-42fa-a2bb-b151d190e75d tempest-ProjectReaderTests-491830598 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-6aa09f7f-0cb5-4900-b767-f9d734057786" returned: 0 in 0.374s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:55:35 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-2b2de501-5554-42fa-a2bb-b151d190e75d tempest-ProjectReaderTests-491830598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-6aa09f7f-0cb5-4900-b767-f9d734057786 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:55:35 devstack sudo[104155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-6aa09f7f-0cb5-4900-b767-f9d734057786 Sep 22 15:55:35 devstack sudo[104155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:55:35 devstack cinder-volume[86212]: DEBUG cinder.quota [None req-f340bcb6-ca4b-4fd8-bf13-77372898e776 tempest-ProjectReaderTests-281080527 None] Created reservations ['9267ccf1-6926-4ffc-834b-8715162ee230', '4c0e3125-6014-4ece-bd28-57988c376c50', '41c491b8-9a14-400e-9e6f-3e6326b33440', 'cfbf343c-bde0-4028-8487-903926ed26f4'] {{(pid=86212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 15:55:35 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-f340bcb6-ca4b-4fd8-bf13-77372898e776 tempest-ProjectReaderTests-281080527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:55:35 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-f340bcb6-ca4b-4fd8-bf13-77372898e776 tempest-ProjectReaderTests-281080527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:55:35 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-f340bcb6-ca4b-4fd8-bf13-77372898e776 tempest-ProjectReaderTests-281080527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:55:35 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-f340bcb6-ca4b-4fd8-bf13-77372898e776 tempest-ProjectReaderTests-281080527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:55:35 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-f340bcb6-ca4b-4fd8-bf13-77372898e776 tempest-ProjectReaderTests-281080527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:55:35 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-f340bcb6-ca4b-4fd8-bf13-77372898e776 tempest-ProjectReaderTests-281080527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:55:35 devstack sudo[104157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc Sep 22 15:55:35 devstack sudo[104157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:55:35 devstack sudo[104155]: pam_unix(sudo:session): session closed for user root Sep 22 15:55:35 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-2b2de501-5554-42fa-a2bb-b151d190e75d tempest-ProjectReaderTests-491830598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-6aa09f7f-0cb5-4900-b767-f9d734057786" returned: 0 in 0.252s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:55:35 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-2b2de501-5554-42fa-a2bb-b151d190e75d tempest-ProjectReaderTests-491830598 None] Lock "cinder-quobyte-6aa09f7f-0cb5-4900-b767-f9d734057786" released by "delete_volume" :: held 0.685s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:55:35 devstack cinder-volume[86212]: DEBUG cinder.quota [None req-2b2de501-5554-42fa-a2bb-b151d190e75d tempest-ProjectReaderTests-491830598 None] Created reservations ['edb31c8c-1ae4-42c2-bdc6-e67166b53c9d', '22a6c368-6ae0-489a-be7e-2bd265b7de4a', 'd9d2d1e3-6281-44c6-ae0d-2a072782a034', '5b8a7783-291d-419c-95ff-5d66c6560ed1'] {{(pid=86212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 15:55:35 devstack sudo[104157]: pam_unix(sudo:session): session closed for user root Sep 22 15:55:35 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-f340bcb6-ca4b-4fd8-bf13-77372898e776 tempest-ProjectReaderTests-281080527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc" returned: 0 in 0.275s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:55:35 devstack cinder-volume[86212]: DEBUG cinder.manager [None req-f340bcb6-ca4b-4fd8-bf13-77372898e776 tempest-ProjectReaderTests-281080527 None] Notifying Schedulers of capabilities ... {{(pid=86212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 15:55:35 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-f340bcb6-ca4b-4fd8-bf13-77372898e776 tempest-ProjectReaderTests-281080527 None] Deleted volume successfully. Sep 22 15:55:35 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-f340bcb6-ca4b-4fd8-bf13-77372898e776 tempest-ProjectReaderTests-281080527 None] Lock "cinder-9fa29eb7-c67b-416e-a714-9c7994ae62d8-delete_volume" released by "delete_volume" :: held 1.248s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:55:35 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-2b2de501-5554-42fa-a2bb-b151d190e75d tempest-ProjectReaderTests-491830598 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:55:35 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-2b2de501-5554-42fa-a2bb-b151d190e75d tempest-ProjectReaderTests-491830598 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:55:35 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-2b2de501-5554-42fa-a2bb-b151d190e75d tempest-ProjectReaderTests-491830598 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:55:35 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-2b2de501-5554-42fa-a2bb-b151d190e75d tempest-ProjectReaderTests-491830598 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:55:35 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-2b2de501-5554-42fa-a2bb-b151d190e75d tempest-ProjectReaderTests-491830598 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:55:35 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-2b2de501-5554-42fa-a2bb-b151d190e75d tempest-ProjectReaderTests-491830598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:55:35 devstack sudo[104161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc Sep 22 15:55:35 devstack sudo[104161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:55:36 devstack sudo[104161]: pam_unix(sudo:session): session closed for user root Sep 22 15:55:36 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-2b2de501-5554-42fa-a2bb-b151d190e75d tempest-ProjectReaderTests-491830598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc" returned: 0 in 0.305s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:55:36 devstack cinder-volume[86212]: DEBUG cinder.manager [None req-2b2de501-5554-42fa-a2bb-b151d190e75d tempest-ProjectReaderTests-491830598 None] Notifying Schedulers of capabilities ... {{(pid=86212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 15:55:36 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-2b2de501-5554-42fa-a2bb-b151d190e75d tempest-ProjectReaderTests-491830598 None] Deleted volume successfully. Sep 22 15:55:36 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-2b2de501-5554-42fa-a2bb-b151d190e75d tempest-ProjectReaderTests-491830598 None] Lock "cinder-6aa09f7f-0cb5-4900-b767-f9d734057786-delete_volume" released by "delete_volume" :: held 1.313s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:55:36 devstack cinder-volume[86212]: DEBUG cinder.volume.flows.manager.create_volume [None req-422746fd-abaa-4acf-867e-a6a8df7ed868 tempest-ProjectReaderTests-281080527 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 15:55:36 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-422746fd-abaa-4acf-867e-a6a8df7ed868 tempest-ProjectReaderTests-281080527 None] Flow 'volume_create_manager' (d11c1416-e69a-43bd-b1ae-2eecabc1b4d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:55:36 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-422746fd-abaa-4acf-867e-a6a8df7ed868 tempest-ProjectReaderTests-281080527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87f99d7f-22a4-4d5b-8f14-566c361d3446) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:55:36 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-422746fd-abaa-4acf-867e-a6a8df7ed868 tempest-ProjectReaderTests-281080527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87f99d7f-22a4-4d5b-8f14-566c361d3446) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:55:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1086436774',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9929312-6457-4f67-b0c0-52a0aeb020a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c03b4ef494e34edc98458b81912cd44f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:55:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:55:36Z,use_quota=True,user_id='90c6c6f1e133408aaa1a919b7817fbea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:55:36 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-422746fd-abaa-4acf-867e-a6a8df7ed868 tempest-ProjectReaderTests-281080527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9eb1f9a9-1f22-4be5-8dc6-673cf61c8561) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:55:36 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-422746fd-abaa-4acf-867e-a6a8df7ed868 tempest-ProjectReaderTests-281080527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9eb1f9a9-1f22-4be5-8dc6-673cf61c8561) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:55:36 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-422746fd-abaa-4acf-867e-a6a8df7ed868 tempest-ProjectReaderTests-281080527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eea82663-8e13-4760-9547-e2bd1e6c162c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:55:36 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-422746fd-abaa-4acf-867e-a6a8df7ed868 tempest-ProjectReaderTests-281080527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eea82663-8e13-4760-9547-e2bd1e6c162c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e9929312-6457-4f67-b0c0-52a0aeb020a1', 'volume_name': 'volume-e9929312-6457-4f67-b0c0-52a0aeb020a1', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:55:36 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-422746fd-abaa-4acf-867e-a6a8df7ed868 tempest-ProjectReaderTests-281080527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9e5fd2e-9111-4285-b163-28dfde699570) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:55:36 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-422746fd-abaa-4acf-867e-a6a8df7ed868 tempest-ProjectReaderTests-281080527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9e5fd2e-9111-4285-b163-28dfde699570) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:55:36 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-422746fd-abaa-4acf-867e-a6a8df7ed868 tempest-ProjectReaderTests-281080527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd3223f5-699a-4bbd-8167-e077d056cdfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:55:36 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-422746fd-abaa-4acf-867e-a6a8df7ed868 tempest-ProjectReaderTests-281080527 None] Volume e9929312-6457-4f67-b0c0-52a0aeb020a1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e9929312-6457-4f67-b0c0-52a0aeb020a1', 'volume_size': 1} Sep 22 15:55:36 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-422746fd-abaa-4acf-867e-a6a8df7ed868 tempest-ProjectReaderTests-281080527 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:55:36 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-422746fd-abaa-4acf-867e-a6a8df7ed868 tempest-ProjectReaderTests-281080527 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:55:36 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-422746fd-abaa-4acf-867e-a6a8df7ed868 tempest-ProjectReaderTests-281080527 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:55:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1086436774',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9929312-6457-4f67-b0c0-52a0aeb020a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c03b4ef494e34edc98458b81912cd44f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:55:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:55:36Z,use_quota=True,user_id='90c6c6f1e133408aaa1a919b7817fbea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)}" {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 15:55:36 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-422746fd-abaa-4acf-867e-a6a8df7ed868 tempest-ProjectReaderTests-281080527 None] Creating volume e9929312-6457-4f67-b0c0-52a0aeb020a1 {{(pid=86212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 15:55:36 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-422746fd-abaa-4acf-867e-a6a8df7ed868 tempest-ProjectReaderTests-281080527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:55:36 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-422746fd-abaa-4acf-867e-a6a8df7ed868 tempest-ProjectReaderTests-281080527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:55:36 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-422746fd-abaa-4acf-867e-a6a8df7ed868 tempest-ProjectReaderTests-281080527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:55:36 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-422746fd-abaa-4acf-867e-a6a8df7ed868 tempest-ProjectReaderTests-281080527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:55:36 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-422746fd-abaa-4acf-867e-a6a8df7ed868 tempest-ProjectReaderTests-281080527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:55:36 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-422746fd-abaa-4acf-867e-a6a8df7ed868 tempest-ProjectReaderTests-281080527 None] Selected osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 as target Quobyte volume. {{(pid=86212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 15:55:36 devstack cinder-volume[86212]: INFO cinder.volume.drivers.remotefs [None req-422746fd-abaa-4acf-867e-a6a8df7ed868 tempest-ProjectReaderTests-281080527 None] casted to osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 Sep 22 15:55:36 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-422746fd-abaa-4acf-867e-a6a8df7ed868 tempest-ProjectReaderTests-281080527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-e9929312-6457-4f67-b0c0-52a0aeb020a1 1073741824 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:55:36 devstack sudo[104164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-e9929312-6457-4f67-b0c0-52a0aeb020a1 1073741824 Sep 22 15:55:36 devstack sudo[104164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:55:36 devstack sudo[104164]: pam_unix(sudo:session): session closed for user root Sep 22 15:55:36 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-422746fd-abaa-4acf-867e-a6a8df7ed868 tempest-ProjectReaderTests-281080527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-e9929312-6457-4f67-b0c0-52a0aeb020a1 1073741824" returned: 0 in 0.465s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:55:36 devstack cinder-volume[86212]: DEBUG dbcounter [-] [86212] Writing DB stats cinder:UPDATE=220,cinder:SELECT=154,cinder:INSERT=61,cinder:DELETE=19 {{(pid=86212) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 22 15:55:36 devstack cinder-volume[86212]: DEBUG dbcounter [-] [86212] Writing DB stats cinder:SELECT=161,cinder:INSERT=53,cinder:UPDATE=234,cinder:DELETE=21 {{(pid=86212) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 22 15:55:36 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-422746fd-abaa-4acf-867e-a6a8df7ed868 tempest-ProjectReaderTests-281080527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-e9929312-6457-4f67-b0c0-52a0aeb020a1 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:55:36 devstack sudo[104169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-e9929312-6457-4f67-b0c0-52a0aeb020a1 Sep 22 15:55:36 devstack sudo[104169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:55:37 devstack sudo[104169]: pam_unix(sudo:session): session closed for user root Sep 22 15:55:37 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-422746fd-abaa-4acf-867e-a6a8df7ed868 tempest-ProjectReaderTests-281080527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-e9929312-6457-4f67-b0c0-52a0aeb020a1" returned: 0 in 0.302s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:55:37 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-422746fd-abaa-4acf-867e-a6a8df7ed868 tempest-ProjectReaderTests-281080527 None] <== create_volume: return (826ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'} {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 15:55:37 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-422746fd-abaa-4acf-867e-a6a8df7ed868 tempest-ProjectReaderTests-281080527 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.829s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:55:37 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-422746fd-abaa-4acf-867e-a6a8df7ed868 tempest-ProjectReaderTests-281080527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd3223f5-699a-4bbd-8167-e077d056cdfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e9929312-6457-4f67-b0c0-52a0aeb020a1', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:55:37 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-422746fd-abaa-4acf-867e-a6a8df7ed868 tempest-ProjectReaderTests-281080527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1dbf755d-4616-4a11-812c-f9d0acd90e18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:55:37 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-422746fd-abaa-4acf-867e-a6a8df7ed868 tempest-ProjectReaderTests-281080527 None] Volume volume-e9929312-6457-4f67-b0c0-52a0aeb020a1 (e9929312-6457-4f67-b0c0-52a0aeb020a1): created successfully Sep 22 15:55:37 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-422746fd-abaa-4acf-867e-a6a8df7ed868 tempest-ProjectReaderTests-281080527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1dbf755d-4616-4a11-812c-f9d0acd90e18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:55:37 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-422746fd-abaa-4acf-867e-a6a8df7ed868 tempest-ProjectReaderTests-281080527 None] Flow 'volume_create_manager' (d11c1416-e69a-43bd-b1ae-2eecabc1b4d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:55:37 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-422746fd-abaa-4acf-867e-a6a8df7ed868 tempest-ProjectReaderTests-281080527 None] Created volume successfully. Sep 22 15:55:38 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-23bbb749-9770-494d-adda-0c0f6473519e tempest-ProjectReaderTests-281080527 None] Acquiring lock "cinder-e9929312-6457-4f67-b0c0-52a0aeb020a1-delete_volume" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:55:38 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-23bbb749-9770-494d-adda-0c0f6473519e tempest-ProjectReaderTests-281080527 None] Lock "cinder-e9929312-6457-4f67-b0c0-52a0aeb020a1-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:55:38 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-23bbb749-9770-494d-adda-0c0f6473519e tempest-ProjectReaderTests-281080527 None] Acquiring lock "cinder-quobyte-e9929312-6457-4f67-b0c0-52a0aeb020a1" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:55:38 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-23bbb749-9770-494d-adda-0c0f6473519e tempest-ProjectReaderTests-281080527 None] Lock "cinder-quobyte-e9929312-6457-4f67-b0c0-52a0aeb020a1" acquired by "delete_volume" :: waited 0.017s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:55:38 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[999f9546-20bd-4be7-8561-78d9c7ba3181]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:55:38 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-23bbb749-9770-494d-adda-0c0f6473519e tempest-ProjectReaderTests-281080527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-e9929312-6457-4f67-b0c0-52a0aeb020a1 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:55:38 devstack cinder-volume[86212]: DEBUG oslo_service.periodic_task [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86212) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 22 15:55:38 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:55:38 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:55:38 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:55:38 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:55:38 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:55:38 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:55:38 devstack sudo[104174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc Sep 22 15:55:38 devstack sudo[104174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:55:38 devstack sudo[104173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-e9929312-6457-4f67-b0c0-52a0aeb020a1 Sep 22 15:55:38 devstack sudo[104173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:55:38 devstack sudo[104174]: pam_unix(sudo:session): session closed for user root Sep 22 15:55:38 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc" returned: 0 in 0.294s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:55:38 devstack cinder-volume[86212]: DEBUG cinder.manager [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] Notifying Schedulers of capabilities ... {{(pid=86212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 15:55:38 devstack cinder-volume[86212]: DEBUG oslo_service.periodic_task [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] Running periodic task VolumeManager._thread_info {{(pid=86212) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 22 15:55:38 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] thread count: 29 {{(pid=86212) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 22 15:55:38 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] thread info: [<_MainThread(MainThread, started 136163191222400)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86212) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 22 15:55:38 devstack sudo[104173]: pam_unix(sudo:session): session closed for user root Sep 22 15:55:38 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-23bbb749-9770-494d-adda-0c0f6473519e tempest-ProjectReaderTests-281080527 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-e9929312-6457-4f67-b0c0-52a0aeb020a1" returned: 0 in 0.399s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:55:38 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-23bbb749-9770-494d-adda-0c0f6473519e tempest-ProjectReaderTests-281080527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-e9929312-6457-4f67-b0c0-52a0aeb020a1 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:55:38 devstack sudo[104181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-e9929312-6457-4f67-b0c0-52a0aeb020a1 Sep 22 15:55:38 devstack sudo[104181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:55:39 devstack sudo[104181]: pam_unix(sudo:session): session closed for user root Sep 22 15:55:39 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-23bbb749-9770-494d-adda-0c0f6473519e tempest-ProjectReaderTests-281080527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-e9929312-6457-4f67-b0c0-52a0aeb020a1" returned: 0 in 0.250s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:55:39 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-23bbb749-9770-494d-adda-0c0f6473519e tempest-ProjectReaderTests-281080527 None] Lock "cinder-quobyte-e9929312-6457-4f67-b0c0-52a0aeb020a1" released by "delete_volume" :: held 0.695s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:55:39 devstack cinder-volume[86212]: DEBUG cinder.quota [None req-23bbb749-9770-494d-adda-0c0f6473519e tempest-ProjectReaderTests-281080527 None] Created reservations ['52a14134-ac83-4b8c-bc0d-3f0d03ca2acd', '3a38445b-6b1e-43e5-b041-43069b4830c0', 'c86f75a1-bada-4420-833c-fac15a1e83b9', 'f7be79fd-c5b3-4d03-bfb1-0219b79ca8c2'] {{(pid=86212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 15:55:39 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-23bbb749-9770-494d-adda-0c0f6473519e tempest-ProjectReaderTests-281080527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:55:39 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-23bbb749-9770-494d-adda-0c0f6473519e tempest-ProjectReaderTests-281080527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:55:39 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-23bbb749-9770-494d-adda-0c0f6473519e tempest-ProjectReaderTests-281080527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:55:39 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-23bbb749-9770-494d-adda-0c0f6473519e tempest-ProjectReaderTests-281080527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:55:39 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-23bbb749-9770-494d-adda-0c0f6473519e tempest-ProjectReaderTests-281080527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:55:39 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-23bbb749-9770-494d-adda-0c0f6473519e tempest-ProjectReaderTests-281080527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:55:39 devstack sudo[104184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc Sep 22 15:55:39 devstack sudo[104184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:55:39 devstack sudo[104184]: pam_unix(sudo:session): session closed for user root Sep 22 15:55:39 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-23bbb749-9770-494d-adda-0c0f6473519e tempest-ProjectReaderTests-281080527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc" returned: 0 in 0.259s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:55:39 devstack cinder-volume[86212]: DEBUG cinder.manager [None req-23bbb749-9770-494d-adda-0c0f6473519e tempest-ProjectReaderTests-281080527 None] Notifying Schedulers of capabilities ... {{(pid=86212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 15:55:39 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-23bbb749-9770-494d-adda-0c0f6473519e tempest-ProjectReaderTests-281080527 None] Deleted volume successfully. Sep 22 15:55:39 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-23bbb749-9770-494d-adda-0c0f6473519e tempest-ProjectReaderTests-281080527 None] Lock "cinder-e9929312-6457-4f67-b0c0-52a0aeb020a1-delete_volume" released by "delete_volume" :: held 1.168s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:55:49 devstack cinder-volume[86212]: DEBUG dbcounter [-] [86212] Writing DB stats cinder:UPDATE=9,cinder:DELETE=1,cinder:SELECT=5,cinder:INSERT=1 {{(pid=86212) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 22 15:55:49 devstack cinder-volume[86212]: DEBUG dbcounter [-] [86212] Writing DB stats cinder:SELECT=6,cinder:INSERT=4,cinder:UPDATE=11,cinder:DELETE=1 {{(pid=86212) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 22 15:55:52 devstack cinder-volume[86212]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d7f6375-562d-4074-8e72-c56c445b557d tempest-CinderUnicodeTest-1397280805 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 15:55:52 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-6d7f6375-562d-4074-8e72-c56c445b557d tempest-CinderUnicodeTest-1397280805 None] Flow 'volume_create_manager' (67c6b5e4-8f26-40a7-bb42-6be4a5ed252e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:55:52 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-6d7f6375-562d-4074-8e72-c56c445b557d tempest-CinderUnicodeTest-1397280805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b439020-e5e6-4687-8ee4-a926d06df450) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:55:52 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-6d7f6375-562d-4074-8e72-c56c445b557d tempest-CinderUnicodeTest-1397280805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b439020-e5e6-4687-8ee4-a926d06df450) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:55:52Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51c954bf-cc7e-4299-9fd7-465f2a8f2a4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2372b54c48c47e7bb84e51abae8aad4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:55:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:55:52Z,use_quota=True,user_id='26067de675b645d4aa6ce54eb992260d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:55:52 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-6d7f6375-562d-4074-8e72-c56c445b557d tempest-CinderUnicodeTest-1397280805 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df54a83e-6249-4a90-b6f7-6a8cdefd0b0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:55:52 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-6d7f6375-562d-4074-8e72-c56c445b557d tempest-CinderUnicodeTest-1397280805 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df54a83e-6249-4a90-b6f7-6a8cdefd0b0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:55:52 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-6d7f6375-562d-4074-8e72-c56c445b557d tempest-CinderUnicodeTest-1397280805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35c06cb5-4654-49de-b7b5-7ac01eaea77d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:55:52 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-6d7f6375-562d-4074-8e72-c56c445b557d tempest-CinderUnicodeTest-1397280805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35c06cb5-4654-49de-b7b5-7ac01eaea77d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '51c954bf-cc7e-4299-9fd7-465f2a8f2a4e', 'volume_name': 'volume-51c954bf-cc7e-4299-9fd7-465f2a8f2a4e', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:55:52 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-6d7f6375-562d-4074-8e72-c56c445b557d tempest-CinderUnicodeTest-1397280805 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32365eb3-5575-4ffd-bc5e-95e1bb08db98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:55:52 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-6d7f6375-562d-4074-8e72-c56c445b557d tempest-CinderUnicodeTest-1397280805 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32365eb3-5575-4ffd-bc5e-95e1bb08db98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:55:52 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-6d7f6375-562d-4074-8e72-c56c445b557d tempest-CinderUnicodeTest-1397280805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9b81ed0-17e4-46aa-afc0-1f213abec37c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:55:52 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-6d7f6375-562d-4074-8e72-c56c445b557d tempest-CinderUnicodeTest-1397280805 None] Volume 51c954bf-cc7e-4299-9fd7-465f2a8f2a4e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-51c954bf-cc7e-4299-9fd7-465f2a8f2a4e', 'volume_size': 1} Sep 22 15:55:52 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-6d7f6375-562d-4074-8e72-c56c445b557d tempest-CinderUnicodeTest-1397280805 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:55:52 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-6d7f6375-562d-4074-8e72-c56c445b557d tempest-CinderUnicodeTest-1397280805 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:55:52 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-6d7f6375-562d-4074-8e72-c56c445b557d tempest-CinderUnicodeTest-1397280805 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:55:52Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51c954bf-cc7e-4299-9fd7-465f2a8f2a4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2372b54c48c47e7bb84e51abae8aad4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:55:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:55:52Z,use_quota=True,user_id='26067de675b645d4aa6ce54eb992260d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)}" {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 15:55:52 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-6d7f6375-562d-4074-8e72-c56c445b557d tempest-CinderUnicodeTest-1397280805 None] Creating volume 51c954bf-cc7e-4299-9fd7-465f2a8f2a4e {{(pid=86212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 15:55:52 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-6d7f6375-562d-4074-8e72-c56c445b557d tempest-CinderUnicodeTest-1397280805 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:55:52 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-6d7f6375-562d-4074-8e72-c56c445b557d tempest-CinderUnicodeTest-1397280805 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:55:52 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-6d7f6375-562d-4074-8e72-c56c445b557d tempest-CinderUnicodeTest-1397280805 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:55:52 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-6d7f6375-562d-4074-8e72-c56c445b557d tempest-CinderUnicodeTest-1397280805 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:55:52 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-6d7f6375-562d-4074-8e72-c56c445b557d tempest-CinderUnicodeTest-1397280805 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:55:52 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-6d7f6375-562d-4074-8e72-c56c445b557d tempest-CinderUnicodeTest-1397280805 None] Selected osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 as target Quobyte volume. {{(pid=86212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 15:55:52 devstack cinder-volume[86212]: INFO cinder.volume.drivers.remotefs [None req-6d7f6375-562d-4074-8e72-c56c445b557d tempest-CinderUnicodeTest-1397280805 None] casted to osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 Sep 22 15:55:52 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-6d7f6375-562d-4074-8e72-c56c445b557d tempest-CinderUnicodeTest-1397280805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-51c954bf-cc7e-4299-9fd7-465f2a8f2a4e 1073741824 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:55:52 devstack sudo[104267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-51c954bf-cc7e-4299-9fd7-465f2a8f2a4e 1073741824 Sep 22 15:55:52 devstack sudo[104267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:55:52 devstack cinder-volume[86212]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd265261-1e52-4553-a502-e930ebf02903 tempest-CreateVolumesFromSnapshotTest-1406547820 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 15:55:52 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-cd265261-1e52-4553-a502-e930ebf02903 tempest-CreateVolumesFromSnapshotTest-1406547820 None] Flow 'volume_create_manager' (7d09f2e4-b960-494b-931f-0dda334ed52f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:55:52 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-cd265261-1e52-4553-a502-e930ebf02903 tempest-CreateVolumesFromSnapshotTest-1406547820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d7f53da-465e-4490-9817-8b2261320528) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:55:52 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-cd265261-1e52-4553-a502-e930ebf02903 tempest-CreateVolumesFromSnapshotTest-1406547820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d7f53da-465e-4490-9817-8b2261320528) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:55:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-356606306',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce918ec7-3c0c-4f95-8f74-5e76be25bd61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='117f5def5f6948089fe793e13bded5d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:55:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:55:52Z,use_quota=True,user_id='f351156bd1214328bced88784864ce1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:55:52 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-cd265261-1e52-4553-a502-e930ebf02903 tempest-CreateVolumesFromSnapshotTest-1406547820 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2154dbc4-b190-4027-88ab-6b4c39d142a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:55:52 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-cd265261-1e52-4553-a502-e930ebf02903 tempest-CreateVolumesFromSnapshotTest-1406547820 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2154dbc4-b190-4027-88ab-6b4c39d142a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:55:52 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-cd265261-1e52-4553-a502-e930ebf02903 tempest-CreateVolumesFromSnapshotTest-1406547820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a0d68fa-09d2-4c5a-bb23-f433e3be9a7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:55:52 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-cd265261-1e52-4553-a502-e930ebf02903 tempest-CreateVolumesFromSnapshotTest-1406547820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a0d68fa-09d2-4c5a-bb23-f433e3be9a7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ce918ec7-3c0c-4f95-8f74-5e76be25bd61', 'volume_name': 'volume-ce918ec7-3c0c-4f95-8f74-5e76be25bd61', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:55:52 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-cd265261-1e52-4553-a502-e930ebf02903 tempest-CreateVolumesFromSnapshotTest-1406547820 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e75fed3-6398-4fd6-bf92-89d1174132db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:55:52 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-cd265261-1e52-4553-a502-e930ebf02903 tempest-CreateVolumesFromSnapshotTest-1406547820 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e75fed3-6398-4fd6-bf92-89d1174132db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:55:52 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-cd265261-1e52-4553-a502-e930ebf02903 tempest-CreateVolumesFromSnapshotTest-1406547820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5748055c-d587-41a1-9b99-7f2d4ee4f128) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:55:52 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-cd265261-1e52-4553-a502-e930ebf02903 tempest-CreateVolumesFromSnapshotTest-1406547820 None] Volume ce918ec7-3c0c-4f95-8f74-5e76be25bd61: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ce918ec7-3c0c-4f95-8f74-5e76be25bd61', 'volume_size': 1} Sep 22 15:55:52 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-cd265261-1e52-4553-a502-e930ebf02903 tempest-CreateVolumesFromSnapshotTest-1406547820 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:55:53 devstack sudo[104267]: pam_unix(sudo:session): session closed for user root Sep 22 15:55:53 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-6d7f6375-562d-4074-8e72-c56c445b557d tempest-CinderUnicodeTest-1397280805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-51c954bf-cc7e-4299-9fd7-465f2a8f2a4e 1073741824" returned: 0 in 0.581s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:55:53 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-6d7f6375-562d-4074-8e72-c56c445b557d tempest-CinderUnicodeTest-1397280805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-51c954bf-cc7e-4299-9fd7-465f2a8f2a4e {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:55:53 devstack cinder-volume[86212]: DEBUG cinder.volume.flows.manager.create_volume [None req-70cba915-1fe6-4a99-9758-5b352eb9f75d tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 15:55:53 devstack sudo[104273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-51c954bf-cc7e-4299-9fd7-465f2a8f2a4e Sep 22 15:55:53 devstack sudo[104273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:55:53 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-70cba915-1fe6-4a99-9758-5b352eb9f75d tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Flow 'volume_create_manager' (04c3d8cb-d05a-4d27-8ca3-b09552e9131d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:55:53 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-70cba915-1fe6-4a99-9758-5b352eb9f75d tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2eb6c1dd-cc79-4563-9b19-921f2f8065fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:55:53 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-70cba915-1fe6-4a99-9758-5b352eb9f75d tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2eb6c1dd-cc79-4563-9b19-921f2f8065fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:55:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2031664743',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c822fb8b-519c-4544-9bb9-3a87d72149bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='081c795581ff40e5950211bd6415b04a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:55:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:55:53Z,use_quota=True,user_id='2aef7a4996294ed0936519470fa6d8e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:55:53 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-70cba915-1fe6-4a99-9758-5b352eb9f75d tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0ef501e-8536-4967-9222-1d8976577691) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:55:53 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-70cba915-1fe6-4a99-9758-5b352eb9f75d tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0ef501e-8536-4967-9222-1d8976577691) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:55:53 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-70cba915-1fe6-4a99-9758-5b352eb9f75d tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (869a0d5e-5108-4c60-8fc5-8e3b04cdaa3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:55:53 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-70cba915-1fe6-4a99-9758-5b352eb9f75d tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (869a0d5e-5108-4c60-8fc5-8e3b04cdaa3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c822fb8b-519c-4544-9bb9-3a87d72149bd', 'volume_name': 'volume-c822fb8b-519c-4544-9bb9-3a87d72149bd', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:55:53 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-70cba915-1fe6-4a99-9758-5b352eb9f75d tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3dafc21d-b99c-4fd8-aa2f-4086949dc57c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:55:53 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-70cba915-1fe6-4a99-9758-5b352eb9f75d tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3dafc21d-b99c-4fd8-aa2f-4086949dc57c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:55:53 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-70cba915-1fe6-4a99-9758-5b352eb9f75d tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a1fb05c-7075-4897-920f-ee6256ce2061) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:55:53 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-70cba915-1fe6-4a99-9758-5b352eb9f75d tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Volume c822fb8b-519c-4544-9bb9-3a87d72149bd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c822fb8b-519c-4544-9bb9-3a87d72149bd', 'volume_size': 1} Sep 22 15:55:53 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-70cba915-1fe6-4a99-9758-5b352eb9f75d tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:55:53 devstack sudo[104273]: pam_unix(sudo:session): session closed for user root Sep 22 15:55:53 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-6d7f6375-562d-4074-8e72-c56c445b557d tempest-CinderUnicodeTest-1397280805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-51c954bf-cc7e-4299-9fd7-465f2a8f2a4e" returned: 0 in 0.266s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:55:53 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-6d7f6375-562d-4074-8e72-c56c445b557d tempest-CinderUnicodeTest-1397280805 None] <== create_volume: return (915ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'} {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 15:55:53 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-6d7f6375-562d-4074-8e72-c56c445b557d tempest-CinderUnicodeTest-1397280805 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.917s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:55:53 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-cd265261-1e52-4553-a502-e930ebf02903 tempest-CreateVolumesFromSnapshotTest-1406547820 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.652s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:55:53 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-cd265261-1e52-4553-a502-e930ebf02903 tempest-CreateVolumesFromSnapshotTest-1406547820 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:55:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-356606306',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce918ec7-3c0c-4f95-8f74-5e76be25bd61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='117f5def5f6948089fe793e13bded5d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:55:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:55:52Z,use_quota=True,user_id='f351156bd1214328bced88784864ce1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)}" {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 15:55:53 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-cd265261-1e52-4553-a502-e930ebf02903 tempest-CreateVolumesFromSnapshotTest-1406547820 None] Creating volume ce918ec7-3c0c-4f95-8f74-5e76be25bd61 {{(pid=86212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 15:55:53 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-cd265261-1e52-4553-a502-e930ebf02903 tempest-CreateVolumesFromSnapshotTest-1406547820 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:55:53 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-cd265261-1e52-4553-a502-e930ebf02903 tempest-CreateVolumesFromSnapshotTest-1406547820 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:55:53 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-cd265261-1e52-4553-a502-e930ebf02903 tempest-CreateVolumesFromSnapshotTest-1406547820 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:55:53 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-cd265261-1e52-4553-a502-e930ebf02903 tempest-CreateVolumesFromSnapshotTest-1406547820 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:55:53 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-cd265261-1e52-4553-a502-e930ebf02903 tempest-CreateVolumesFromSnapshotTest-1406547820 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:55:53 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-cd265261-1e52-4553-a502-e930ebf02903 tempest-CreateVolumesFromSnapshotTest-1406547820 None] Selected osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 as target Quobyte volume. {{(pid=86212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 15:55:53 devstack cinder-volume[86212]: INFO cinder.volume.drivers.remotefs [None req-cd265261-1e52-4553-a502-e930ebf02903 tempest-CreateVolumesFromSnapshotTest-1406547820 None] casted to osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 Sep 22 15:55:53 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-cd265261-1e52-4553-a502-e930ebf02903 tempest-CreateVolumesFromSnapshotTest-1406547820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-ce918ec7-3c0c-4f95-8f74-5e76be25bd61 1073741824 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:55:53 devstack sudo[104276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-ce918ec7-3c0c-4f95-8f74-5e76be25bd61 1073741824 Sep 22 15:55:53 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-6d7f6375-562d-4074-8e72-c56c445b557d tempest-CinderUnicodeTest-1397280805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9b81ed0-17e4-46aa-afc0-1f213abec37c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-51c954bf-cc7e-4299-9fd7-465f2a8f2a4e', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:55:53 devstack sudo[104276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:55:53 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-6d7f6375-562d-4074-8e72-c56c445b557d tempest-CinderUnicodeTest-1397280805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8d06978-6cc7-427a-97af-89729c1a8690) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:55:53 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-6d7f6375-562d-4074-8e72-c56c445b557d tempest-CinderUnicodeTest-1397280805 None] Volume volume-51c954bf-cc7e-4299-9fd7-465f2a8f2a4e (51c954bf-cc7e-4299-9fd7-465f2a8f2a4e): created successfully Sep 22 15:55:53 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-6d7f6375-562d-4074-8e72-c56c445b557d tempest-CinderUnicodeTest-1397280805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8d06978-6cc7-427a-97af-89729c1a8690) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:55:53 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-6d7f6375-562d-4074-8e72-c56c445b557d tempest-CinderUnicodeTest-1397280805 None] Flow 'volume_create_manager' (67c6b5e4-8f26-40a7-bb42-6be4a5ed252e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:55:53 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-6d7f6375-562d-4074-8e72-c56c445b557d tempest-CinderUnicodeTest-1397280805 None] Created volume successfully. Sep 22 15:55:53 devstack sudo[104276]: pam_unix(sudo:session): session closed for user root Sep 22 15:55:53 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-cd265261-1e52-4553-a502-e930ebf02903 tempest-CreateVolumesFromSnapshotTest-1406547820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-ce918ec7-3c0c-4f95-8f74-5e76be25bd61 1073741824" returned: 0 in 0.502s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:55:53 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-cd265261-1e52-4553-a502-e930ebf02903 tempest-CreateVolumesFromSnapshotTest-1406547820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-ce918ec7-3c0c-4f95-8f74-5e76be25bd61 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:55:53 devstack sudo[104282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-ce918ec7-3c0c-4f95-8f74-5e76be25bd61 Sep 22 15:55:53 devstack sudo[104282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:55:54 devstack sudo[104282]: pam_unix(sudo:session): session closed for user root Sep 22 15:55:54 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-cd265261-1e52-4553-a502-e930ebf02903 tempest-CreateVolumesFromSnapshotTest-1406547820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-ce918ec7-3c0c-4f95-8f74-5e76be25bd61" returned: 0 in 0.270s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:55:54 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-cd265261-1e52-4553-a502-e930ebf02903 tempest-CreateVolumesFromSnapshotTest-1406547820 None] <== create_volume: return (812ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'} {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 15:55:54 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-cd265261-1e52-4553-a502-e930ebf02903 tempest-CreateVolumesFromSnapshotTest-1406547820 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.814s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:55:54 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-70cba915-1fe6-4a99-9758-5b352eb9f75d tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.986s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:55:54 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-70cba915-1fe6-4a99-9758-5b352eb9f75d tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:55:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2031664743',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c822fb8b-519c-4544-9bb9-3a87d72149bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='081c795581ff40e5950211bd6415b04a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:55:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:55:53Z,use_quota=True,user_id='2aef7a4996294ed0936519470fa6d8e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)}" {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 15:55:54 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-70cba915-1fe6-4a99-9758-5b352eb9f75d tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Creating volume c822fb8b-519c-4544-9bb9-3a87d72149bd {{(pid=86212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 15:55:54 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-70cba915-1fe6-4a99-9758-5b352eb9f75d tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:55:54 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-70cba915-1fe6-4a99-9758-5b352eb9f75d tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:55:54 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-70cba915-1fe6-4a99-9758-5b352eb9f75d tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:55:54 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-70cba915-1fe6-4a99-9758-5b352eb9f75d tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:55:54 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-70cba915-1fe6-4a99-9758-5b352eb9f75d tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:55:54 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-70cba915-1fe6-4a99-9758-5b352eb9f75d tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Selected osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 as target Quobyte volume. {{(pid=86212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 15:55:54 devstack cinder-volume[86212]: INFO cinder.volume.drivers.remotefs [None req-70cba915-1fe6-4a99-9758-5b352eb9f75d tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] casted to osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 Sep 22 15:55:54 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-70cba915-1fe6-4a99-9758-5b352eb9f75d tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-c822fb8b-519c-4544-9bb9-3a87d72149bd 1073741824 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:55:54 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-cd265261-1e52-4553-a502-e930ebf02903 tempest-CreateVolumesFromSnapshotTest-1406547820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5748055c-d587-41a1-9b99-7f2d4ee4f128) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce918ec7-3c0c-4f95-8f74-5e76be25bd61', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:55:54 devstack sudo[104285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-c822fb8b-519c-4544-9bb9-3a87d72149bd 1073741824 Sep 22 15:55:54 devstack sudo[104285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:55:54 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-cd265261-1e52-4553-a502-e930ebf02903 tempest-CreateVolumesFromSnapshotTest-1406547820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef209af5-a31d-4bdc-acb6-4c7bd82f6c60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:55:54 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-cd265261-1e52-4553-a502-e930ebf02903 tempest-CreateVolumesFromSnapshotTest-1406547820 None] Volume volume-ce918ec7-3c0c-4f95-8f74-5e76be25bd61 (ce918ec7-3c0c-4f95-8f74-5e76be25bd61): created successfully Sep 22 15:55:54 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-cd265261-1e52-4553-a502-e930ebf02903 tempest-CreateVolumesFromSnapshotTest-1406547820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef209af5-a31d-4bdc-acb6-4c7bd82f6c60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:55:54 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-cd265261-1e52-4553-a502-e930ebf02903 tempest-CreateVolumesFromSnapshotTest-1406547820 None] Flow 'volume_create_manager' (7d09f2e4-b960-494b-931f-0dda334ed52f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:55:54 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-cd265261-1e52-4553-a502-e930ebf02903 tempest-CreateVolumesFromSnapshotTest-1406547820 None] Created volume successfully. Sep 22 15:55:54 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-78318891-6065-4260-b85c-8fdf31c5abef tempest-CreateVolumesFromSnapshotTest-1406547820 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:55:54 devstack sudo[104285]: pam_unix(sudo:session): session closed for user root Sep 22 15:55:54 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-70cba915-1fe6-4a99-9758-5b352eb9f75d tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-c822fb8b-519c-4544-9bb9-3a87d72149bd 1073741824" returned: 0 in 0.638s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:55:54 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-70cba915-1fe6-4a99-9758-5b352eb9f75d tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-c822fb8b-519c-4544-9bb9-3a87d72149bd {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:55:54 devstack sudo[104291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-c822fb8b-519c-4544-9bb9-3a87d72149bd Sep 22 15:55:54 devstack sudo[104291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:55:55 devstack cinder-volume[86212]: DEBUG cinder.volume.flows.manager.create_volume [None req-bfa6e749-50cd-4178-a0bb-d08894ae2830 tempest-CinderUnicodeTest-1397280805 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 15:55:55 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-bfa6e749-50cd-4178-a0bb-d08894ae2830 tempest-CinderUnicodeTest-1397280805 None] Flow 'volume_create_manager' (ec47d443-311a-458a-a504-a05049702151) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:55:55 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-bfa6e749-50cd-4178-a0bb-d08894ae2830 tempest-CinderUnicodeTest-1397280805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acadf093-7d74-4d4e-be53-8b14838e2bde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:55:55 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-bfa6e749-50cd-4178-a0bb-d08894ae2830 tempest-CinderUnicodeTest-1397280805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acadf093-7d74-4d4e-be53-8b14838e2bde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:55:55Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-124668323',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=accee605-2de3-4951-8c31-f7c00c4c3b75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2372b54c48c47e7bb84e51abae8aad4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:55:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:55:55Z,use_quota=True,user_id='26067de675b645d4aa6ce54eb992260d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:55:55 devstack sudo[104291]: pam_unix(sudo:session): session closed for user root Sep 22 15:55:55 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-bfa6e749-50cd-4178-a0bb-d08894ae2830 tempest-CinderUnicodeTest-1397280805 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (700e842d-9580-432c-b80a-51099faa6123) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:55:55 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-bfa6e749-50cd-4178-a0bb-d08894ae2830 tempest-CinderUnicodeTest-1397280805 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (700e842d-9580-432c-b80a-51099faa6123) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:55:55 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-bfa6e749-50cd-4178-a0bb-d08894ae2830 tempest-CinderUnicodeTest-1397280805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f408cf1-66ed-4dae-8a75-ab553bcf7fb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:55:55 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-bfa6e749-50cd-4178-a0bb-d08894ae2830 tempest-CinderUnicodeTest-1397280805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f408cf1-66ed-4dae-8a75-ab553bcf7fb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'accee605-2de3-4951-8c31-f7c00c4c3b75', 'volume_name': 'volume-accee605-2de3-4951-8c31-f7c00c4c3b75', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:55:55 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-bfa6e749-50cd-4178-a0bb-d08894ae2830 tempest-CinderUnicodeTest-1397280805 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23933a7e-f5c2-46d4-b3f7-a7e5881722cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:55:55 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-bfa6e749-50cd-4178-a0bb-d08894ae2830 tempest-CinderUnicodeTest-1397280805 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23933a7e-f5c2-46d4-b3f7-a7e5881722cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:55:55 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-bfa6e749-50cd-4178-a0bb-d08894ae2830 tempest-CinderUnicodeTest-1397280805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4dfa0ca-6dfd-400e-85e9-fffd4f309d54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:55:55 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-bfa6e749-50cd-4178-a0bb-d08894ae2830 tempest-CinderUnicodeTest-1397280805 None] Volume accee605-2de3-4951-8c31-f7c00c4c3b75: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-accee605-2de3-4951-8c31-f7c00c4c3b75', 'volume_size': 1} Sep 22 15:55:55 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-bfa6e749-50cd-4178-a0bb-d08894ae2830 tempest-CinderUnicodeTest-1397280805 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:55:55 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-70cba915-1fe6-4a99-9758-5b352eb9f75d tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-c822fb8b-519c-4544-9bb9-3a87d72149bd" returned: 0 in 0.397s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:55:55 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-70cba915-1fe6-4a99-9758-5b352eb9f75d tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] <== create_volume: return (1083ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'} {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 15:55:55 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-70cba915-1fe6-4a99-9758-5b352eb9f75d tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.087s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:55:55 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-78318891-6065-4260-b85c-8fdf31c5abef tempest-CreateVolumesFromSnapshotTest-1406547820 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.452s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:55:55 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-70cba915-1fe6-4a99-9758-5b352eb9f75d tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a1fb05c-7075-4897-920f-ee6256ce2061) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c822fb8b-519c-4544-9bb9-3a87d72149bd', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:55:55 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-70cba915-1fe6-4a99-9758-5b352eb9f75d tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee449f59-b52a-4149-b473-c1a29731c57b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:55:55 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-78318891-6065-4260-b85c-8fdf31c5abef tempest-CreateVolumesFromSnapshotTest-1406547820 None] Creating offline snapshot 7bb1e354-c41f-4002-89a6-14b158f4331a of volume ce918ec7-3c0c-4f95-8f74-5e76be25bd61 {{(pid=86212) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 22 15:55:55 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-70cba915-1fe6-4a99-9758-5b352eb9f75d tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Volume volume-c822fb8b-519c-4544-9bb9-3a87d72149bd (c822fb8b-519c-4544-9bb9-3a87d72149bd): created successfully Sep 22 15:55:55 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-70cba915-1fe6-4a99-9758-5b352eb9f75d tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee449f59-b52a-4149-b473-c1a29731c57b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:55:55 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-70cba915-1fe6-4a99-9758-5b352eb9f75d tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Flow 'volume_create_manager' (04c3d8cb-d05a-4d27-8ca3-b09552e9131d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:55:55 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[27ff27b8-fdc4-4bd7-b109-f4be3a1c07f0]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:55:55 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-78318891-6065-4260-b85c-8fdf31c5abef tempest-CreateVolumesFromSnapshotTest-1406547820 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-ce918ec7-3c0c-4f95-8f74-5e76be25bd61 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:55:55 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-70cba915-1fe6-4a99-9758-5b352eb9f75d tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Created volume successfully. Sep 22 15:55:55 devstack sudo[104294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-ce918ec7-3c0c-4f95-8f74-5e76be25bd61 Sep 22 15:55:55 devstack sudo[104294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:55:55 devstack sudo[104294]: pam_unix(sudo:session): session closed for user root Sep 22 15:55:55 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-78318891-6065-4260-b85c-8fdf31c5abef tempest-CreateVolumesFromSnapshotTest-1406547820 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-ce918ec7-3c0c-4f95-8f74-5e76be25bd61" returned: 0 in 0.408s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:55:55 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-78318891-6065-4260-b85c-8fdf31c5abef tempest-CreateVolumesFromSnapshotTest-1406547820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-ce918ec7-3c0c-4f95-8f74-5e76be25bd61,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-ce918ec7-3c0c-4f95-8f74-5e76be25bd61.7bb1e354-c41f-4002-89a6-14b158f4331a 1G {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:55:55 devstack sudo[104299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-ce918ec7-3c0c-4f95-8f74-5e76be25bd61,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-ce918ec7-3c0c-4f95-8f74-5e76be25bd61.7bb1e354-c41f-4002-89a6-14b158f4331a 1G Sep 22 15:55:55 devstack sudo[104299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:55:56 devstack sudo[104299]: pam_unix(sudo:session): session closed for user root Sep 22 15:55:56 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-78318891-6065-4260-b85c-8fdf31c5abef tempest-CreateVolumesFromSnapshotTest-1406547820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-ce918ec7-3c0c-4f95-8f74-5e76be25bd61,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-ce918ec7-3c0c-4f95-8f74-5e76be25bd61.7bb1e354-c41f-4002-89a6-14b158f4331a 1G" returned: 0 in 0.498s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:55:56 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-78318891-6065-4260-b85c-8fdf31c5abef tempest-CreateVolumesFromSnapshotTest-1406547820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ce918ec7-3c0c-4f95-8f74-5e76be25bd61 -F qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-ce918ec7-3c0c-4f95-8f74-5e76be25bd61.7bb1e354-c41f-4002-89a6-14b158f4331a {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:55:56 devstack sudo[104305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ce918ec7-3c0c-4f95-8f74-5e76be25bd61 -F qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-ce918ec7-3c0c-4f95-8f74-5e76be25bd61.7bb1e354-c41f-4002-89a6-14b158f4331a Sep 22 15:55:56 devstack sudo[104305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:55:56 devstack sudo[104305]: pam_unix(sudo:session): session closed for user root Sep 22 15:55:56 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-78318891-6065-4260-b85c-8fdf31c5abef tempest-CreateVolumesFromSnapshotTest-1406547820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ce918ec7-3c0c-4f95-8f74-5e76be25bd61 -F qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-ce918ec7-3c0c-4f95-8f74-5e76be25bd61.7bb1e354-c41f-4002-89a6-14b158f4331a" returned: 0 in 0.389s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:55:56 devstack cinder-volume[86212]: WARNING cinder.volume.drivers.remotefs [None req-78318891-6065-4260-b85c-8fdf31c5abef tempest-CreateVolumesFromSnapshotTest-1406547820 None] /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-ce918ec7-3c0c-4f95-8f74-5e76be25bd61.7bb1e354-c41f-4002-89a6-14b158f4331a is being set with open permissions: ugo+rw Sep 22 15:55:56 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-78318891-6065-4260-b85c-8fdf31c5abef tempest-CreateVolumesFromSnapshotTest-1406547820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-ce918ec7-3c0c-4f95-8f74-5e76be25bd61.7bb1e354-c41f-4002-89a6-14b158f4331a {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:55:56 devstack sudo[104311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-ce918ec7-3c0c-4f95-8f74-5e76be25bd61.7bb1e354-c41f-4002-89a6-14b158f4331a Sep 22 15:55:56 devstack sudo[104311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:55:56 devstack sudo[104311]: pam_unix(sudo:session): session closed for user root Sep 22 15:55:56 devstack cinder-volume[86212]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ca7d89f-8d3f-40ae-9296-141cab9001ae tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 15:55:56 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-0ca7d89f-8d3f-40ae-9296-141cab9001ae tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Flow 'volume_create_manager' (8ba35dc1-e2bd-4ef3-aaa7-6d07c5c90a70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:55:57 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-0ca7d89f-8d3f-40ae-9296-141cab9001ae tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4264fab8-7999-43d0-95cc-9aae83bdd076) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:55:57 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-78318891-6065-4260-b85c-8fdf31c5abef tempest-CreateVolumesFromSnapshotTest-1406547820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-ce918ec7-3c0c-4f95-8f74-5e76be25bd61.7bb1e354-c41f-4002-89a6-14b158f4331a" returned: 0 in 0.382s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:55:57 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-0ca7d89f-8d3f-40ae-9296-141cab9001ae tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4264fab8-7999-43d0-95cc-9aae83bdd076) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:55:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-677478720',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c9d9341-b7fd-4a69-bda3-9b08a7741234,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='081c795581ff40e5950211bd6415b04a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:55:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:55:57Z,use_quota=True,user_id='2aef7a4996294ed0936519470fa6d8e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:55:57 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-0ca7d89f-8d3f-40ae-9296-141cab9001ae tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd269d7a-64ef-4cb2-a010-2d01fd7bccaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:55:57 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-0ca7d89f-8d3f-40ae-9296-141cab9001ae tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd269d7a-64ef-4cb2-a010-2d01fd7bccaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:55:57 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-0ca7d89f-8d3f-40ae-9296-141cab9001ae tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (440de009-8f16-41a8-bc3e-ca47f2b1e82b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:55:57 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-0ca7d89f-8d3f-40ae-9296-141cab9001ae tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (440de009-8f16-41a8-bc3e-ca47f2b1e82b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4c9d9341-b7fd-4a69-bda3-9b08a7741234', 'volume_name': 'volume-4c9d9341-b7fd-4a69-bda3-9b08a7741234', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:55:57 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-0ca7d89f-8d3f-40ae-9296-141cab9001ae tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b561495-74d7-4ff1-bf12-b37b0ea0bace) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:55:57 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-0ca7d89f-8d3f-40ae-9296-141cab9001ae tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b561495-74d7-4ff1-bf12-b37b0ea0bace) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:55:57 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-0ca7d89f-8d3f-40ae-9296-141cab9001ae tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (957b43b1-0c77-40e5-bfbe-250778d59b81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:55:57 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-0ca7d89f-8d3f-40ae-9296-141cab9001ae tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Volume 4c9d9341-b7fd-4a69-bda3-9b08a7741234: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4c9d9341-b7fd-4a69-bda3-9b08a7741234', 'volume_size': 1} Sep 22 15:55:57 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-0ca7d89f-8d3f-40ae-9296-141cab9001ae tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:55:57 devstack cinder-volume[86212]: DEBUG cinder.volume.flows.manager.create_volume [None req-381afe4b-24b3-4c2d-902b-6c0dd67e5a8a tempest-VolumeAndVolumeTypeFromImageTest-1497179036 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 15:55:57 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-381afe4b-24b3-4c2d-902b-6c0dd67e5a8a tempest-VolumeAndVolumeTypeFromImageTest-1497179036 None] Flow 'volume_create_manager' (087485aa-6d51-4fae-b13e-859479c4f140) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:55:57 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-381afe4b-24b3-4c2d-902b-6c0dd67e5a8a tempest-VolumeAndVolumeTypeFromImageTest-1497179036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d493f547-6fbc-48e1-aaa2-9f6d88ac09cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:55:57 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-381afe4b-24b3-4c2d-902b-6c0dd67e5a8a tempest-VolumeAndVolumeTypeFromImageTest-1497179036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d493f547-6fbc-48e1-aaa2-9f6d88ac09cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:55:56Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31e65922-ec7e-4c0b-9cab-3a1e40bd084b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69fa55b4f15248f692c5b0fb8338dc68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:55:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:55:57Z,use_quota=True,user_id='03d15f3a929c4af2b73ca552b0488fa4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(708118da-3cfb-4cee-b506-528db8f5a937),volume_type_id=708118da-3cfb-4cee-b506-528db8f5a937)' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:55:57 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-381afe4b-24b3-4c2d-902b-6c0dd67e5a8a tempest-VolumeAndVolumeTypeFromImageTest-1497179036 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fd250fe-1724-473e-9f17-f5b470c8b858) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:55:57 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-381afe4b-24b3-4c2d-902b-6c0dd67e5a8a tempest-VolumeAndVolumeTypeFromImageTest-1497179036 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fd250fe-1724-473e-9f17-f5b470c8b858) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:55:57 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-381afe4b-24b3-4c2d-902b-6c0dd67e5a8a tempest-VolumeAndVolumeTypeFromImageTest-1497179036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b41e5dc1-c7e5-4d2a-a85e-8555797cfe19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:55:57 devstack cinder-volume[86212]: DEBUG cinder.image.glance [None req-381afe4b-24b3-4c2d-902b-6c0dd67e5a8a tempest-VolumeAndVolumeTypeFromImageTest-1497179036 None] Creating Keystone auth plugin from conf {{(pid=86212) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 22 15:55:57 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-78318891-6065-4260-b85c-8fdf31c5abef tempest-CreateVolumesFromSnapshotTest-1406547820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-ce918ec7-3c0c-4f95-8f74-5e76be25bd61.info {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:55:57 devstack sudo[104314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-ce918ec7-3c0c-4f95-8f74-5e76be25bd61.info Sep 22 15:55:57 devstack sudo[104314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:55:57 devstack cinder-volume[86212]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9aef281-769d-4e40-b313-9b0ddbf56d15 tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 15:55:57 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-c9aef281-769d-4e40-b313-9b0ddbf56d15 tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Flow 'volume_create_manager' (e3258eb7-a792-4907-958f-fce354f5402f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:55:57 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-c9aef281-769d-4e40-b313-9b0ddbf56d15 tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a1bc387-2f67-47a6-86b4-18375f8a7d6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:55:57 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-c9aef281-769d-4e40-b313-9b0ddbf56d15 tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a1bc387-2f67-47a6-86b4-18375f8a7d6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:55:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1871256465',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f3b5234-b299-41e4-b304-73a8438da7d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='081c795581ff40e5950211bd6415b04a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:55:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:55:57Z,use_quota=True,user_id='2aef7a4996294ed0936519470fa6d8e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:55:57 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-c9aef281-769d-4e40-b313-9b0ddbf56d15 tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f98fb99-4a67-47f2-afb4-ff8f1be6554f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:55:57 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-c9aef281-769d-4e40-b313-9b0ddbf56d15 tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f98fb99-4a67-47f2-afb4-ff8f1be6554f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:55:57 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-c9aef281-769d-4e40-b313-9b0ddbf56d15 tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f73c82e-b494-489e-be73-d4d876500939) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:55:57 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-c9aef281-769d-4e40-b313-9b0ddbf56d15 tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f73c82e-b494-489e-be73-d4d876500939) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f3b5234-b299-41e4-b304-73a8438da7d2', 'volume_name': 'volume-2f3b5234-b299-41e4-b304-73a8438da7d2', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:55:57 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-c9aef281-769d-4e40-b313-9b0ddbf56d15 tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a76b43c6-2739-4465-9422-748349523926) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:55:57 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-c9aef281-769d-4e40-b313-9b0ddbf56d15 tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a76b43c6-2739-4465-9422-748349523926) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:55:57 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-c9aef281-769d-4e40-b313-9b0ddbf56d15 tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e06ea4d7-e12f-476c-8d75-c2e967725d6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:55:57 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-c9aef281-769d-4e40-b313-9b0ddbf56d15 tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Volume 2f3b5234-b299-41e4-b304-73a8438da7d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f3b5234-b299-41e4-b304-73a8438da7d2', 'volume_size': 1} Sep 22 15:55:57 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-c9aef281-769d-4e40-b313-9b0ddbf56d15 tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:55:57 devstack sudo[104314]: pam_unix(sudo:session): session closed for user root Sep 22 15:55:57 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-78318891-6065-4260-b85c-8fdf31c5abef tempest-CreateVolumesFromSnapshotTest-1406547820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-ce918ec7-3c0c-4f95-8f74-5e76be25bd61.info" returned: 0 in 0.299s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:55:57 devstack cinder-volume[86212]: WARNING cinder.volume.drivers.remotefs [None req-78318891-6065-4260-b85c-8fdf31c5abef tempest-CreateVolumesFromSnapshotTest-1406547820 None] /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-ce918ec7-3c0c-4f95-8f74-5e76be25bd61.info is being set with open permissions: ugo+rw Sep 22 15:55:57 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-78318891-6065-4260-b85c-8fdf31c5abef tempest-CreateVolumesFromSnapshotTest-1406547820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-ce918ec7-3c0c-4f95-8f74-5e76be25bd61.info {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:55:57 devstack sudo[104317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-ce918ec7-3c0c-4f95-8f74-5e76be25bd61.info Sep 22 15:55:57 devstack sudo[104317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:55:57 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-381afe4b-24b3-4c2d-902b-6c0dd67e5a8a tempest-VolumeAndVolumeTypeFromImageTest-1497179036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b41e5dc1-c7e5-4d2a-a85e-8555797cfe19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '31e65922-ec7e-4c0b-9cab-3a1e40bd084b', 'volume_name': 'volume-31e65922-ec7e-4c0b-9cab-3a1e40bd084b', 'volume_size': 1, 'image_id': '45204c59-273c-4bf1-ac4c-99a20c887aa8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/45204c59-273c-4bf1-ac4c-99a20c887aa8', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'bca72b425eb26b6898289841a182add2', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '69fa55b4f15248f692c5b0fb8338dc68', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'e86b393dcb8e04f06a35ebcf29bc3f9c9e58509501dd9226e0af298665c00d47f7a52317b55fe57cb5b981882788c5dca87c64aeb4e408d0efad10ed4c9c6f35', 'id': '45204c59-273c-4bf1-ac4c-99a20c887aa8', 'created_at': datetime.datetime(2026, 9, 22, 13, 55, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 13, 55, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/45204c59-273c-4bf1-ac4c-99a20c887aa8/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:55:57 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-381afe4b-24b3-4c2d-902b-6c0dd67e5a8a tempest-VolumeAndVolumeTypeFromImageTest-1497179036 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0f46685-3760-4094-b118-5768341211f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:55:57 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-381afe4b-24b3-4c2d-902b-6c0dd67e5a8a tempest-VolumeAndVolumeTypeFromImageTest-1497179036 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0f46685-3760-4094-b118-5768341211f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:55:57 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-381afe4b-24b3-4c2d-902b-6c0dd67e5a8a tempest-VolumeAndVolumeTypeFromImageTest-1497179036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32a88aa8-8747-4bd1-801b-1f4972bb7ee5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:55:57 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-381afe4b-24b3-4c2d-902b-6c0dd67e5a8a tempest-VolumeAndVolumeTypeFromImageTest-1497179036 None] Volume 31e65922-ec7e-4c0b-9cab-3a1e40bd084b: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-31e65922-ec7e-4c0b-9cab-3a1e40bd084b', 'volume_size': 1, 'image_id': '45204c59-273c-4bf1-ac4c-99a20c887aa8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/45204c59-273c-4bf1-ac4c-99a20c887aa8', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'bca72b425eb26b6898289841a182add2', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '69fa55b4f15248f692c5b0fb8338dc68', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'e86b393dcb8e04f06a35ebcf29bc3f9c9e58509501dd9226e0af298665c00d47f7a52317b55fe57cb5b981882788c5dca87c64aeb4e408d0efad10ed4c9c6f35', 'id': '45204c59-273c-4bf1-ac4c-99a20c887aa8', 'created_at': datetime.datetime(2026, 9, 22, 13, 55, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 13, 55, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/45204c59-273c-4bf1-ac4c-99a20c887aa8/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 22 15:55:57 devstack cinder-volume[86212]: DEBUG cinder.volume.flows.manager.create_volume [None req-381afe4b-24b3-4c2d-902b-6c0dd67e5a8a tempest-VolumeAndVolumeTypeFromImageTest-1497179036 None] Trying to clone 31e65922-ec7e-4c0b-9cab-3a1e40bd084b from image 45204c59-273c-4bf1-ac4c-99a20c887aa8 at location (None, [{'url': 'file:///opt/stack/data/glance/images/45204c59-273c-4bf1-ac4c-99a20c887aa8', 'metadata': {}}]). {{(pid=86212) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 22 15:55:57 devstack cinder-volume[86212]: DEBUG cinder.volume.flows.manager.create_volume [None req-4159bfac-70e8-4675-a66b-7a1b698bb43f tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 15:55:57 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-4159bfac-70e8-4675-a66b-7a1b698bb43f tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Flow 'volume_create_manager' (9a12b539-480a-4527-b63a-701333f92930) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:55:57 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-4159bfac-70e8-4675-a66b-7a1b698bb43f tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1806a157-d6bc-4d0b-9d8a-8aac75af19d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:55:57 devstack cinder-volume[86212]: DEBUG cinder.image.image_utils [None req-381afe4b-24b3-4c2d-902b-6c0dd67e5a8a tempest-VolumeAndVolumeTypeFromImageTest-1497179036 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_45204c59-273c-4bf1-ac4c-99a20c887aa8_f9mczlpddevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86212) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 22 15:55:57 devstack cinder-volume[86212]: INFO cinder.image.image_utils [None req-381afe4b-24b3-4c2d-902b-6c0dd67e5a8a tempest-VolumeAndVolumeTypeFromImageTest-1497179036 None] Image download 0.00 MB at 0.00 MB/s Sep 22 15:55:57 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-4159bfac-70e8-4675-a66b-7a1b698bb43f tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1806a157-d6bc-4d0b-9d8a-8aac75af19d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:55:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1279654516',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9386d4f-ad27-40af-b7eb-493dd23002dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='081c795581ff40e5950211bd6415b04a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:55:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:55:58Z,use_quota=True,user_id='2aef7a4996294ed0936519470fa6d8e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:55:57 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-4159bfac-70e8-4675-a66b-7a1b698bb43f tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68f04210-02fb-4415-9355-c932357a3f12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:55:57 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-4159bfac-70e8-4675-a66b-7a1b698bb43f tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68f04210-02fb-4415-9355-c932357a3f12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:55:57 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-4159bfac-70e8-4675-a66b-7a1b698bb43f tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0283e89-328a-4b8d-b413-9f3985985900) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:55:57 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-4159bfac-70e8-4675-a66b-7a1b698bb43f tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0283e89-328a-4b8d-b413-9f3985985900) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c9386d4f-ad27-40af-b7eb-493dd23002dd', 'volume_name': 'volume-c9386d4f-ad27-40af-b7eb-493dd23002dd', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:55:57 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-4159bfac-70e8-4675-a66b-7a1b698bb43f tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7527f631-acfa-493a-8cc1-1467f5b2e4b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:55:57 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-4159bfac-70e8-4675-a66b-7a1b698bb43f tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7527f631-acfa-493a-8cc1-1467f5b2e4b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:55:57 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-4159bfac-70e8-4675-a66b-7a1b698bb43f tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a089edb5-a682-414f-bb68-8ca6446873d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:55:57 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-4159bfac-70e8-4675-a66b-7a1b698bb43f tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Volume c9386d4f-ad27-40af-b7eb-493dd23002dd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c9386d4f-ad27-40af-b7eb-493dd23002dd', 'volume_size': 1} Sep 22 15:55:57 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-4159bfac-70e8-4675-a66b-7a1b698bb43f tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:55:57 devstack sudo[104317]: pam_unix(sudo:session): session closed for user root Sep 22 15:55:57 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-78318891-6065-4260-b85c-8fdf31c5abef tempest-CreateVolumesFromSnapshotTest-1406547820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-ce918ec7-3c0c-4f95-8f74-5e76be25bd61.info" returned: 0 in 0.369s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:55:57 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-78318891-6065-4260-b85c-8fdf31c5abef tempest-CreateVolumesFromSnapshotTest-1406547820 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.605s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:55:57 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-bfa6e749-50cd-4178-a0bb-d08894ae2830 tempest-CinderUnicodeTest-1397280805 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.622s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:55:57 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-bfa6e749-50cd-4178-a0bb-d08894ae2830 tempest-CinderUnicodeTest-1397280805 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:55:55Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-124668323',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=accee605-2de3-4951-8c31-f7c00c4c3b75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2372b54c48c47e7bb84e51abae8aad4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:55:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:55:55Z,use_quota=True,user_id='26067de675b645d4aa6ce54eb992260d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)}" {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 15:55:57 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-bfa6e749-50cd-4178-a0bb-d08894ae2830 tempest-CinderUnicodeTest-1397280805 None] Creating volume accee605-2de3-4951-8c31-f7c00c4c3b75 {{(pid=86212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 15:55:57 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-bfa6e749-50cd-4178-a0bb-d08894ae2830 tempest-CinderUnicodeTest-1397280805 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:55:57 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-bfa6e749-50cd-4178-a0bb-d08894ae2830 tempest-CinderUnicodeTest-1397280805 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:55:57 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-bfa6e749-50cd-4178-a0bb-d08894ae2830 tempest-CinderUnicodeTest-1397280805 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:55:57 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-bfa6e749-50cd-4178-a0bb-d08894ae2830 tempest-CinderUnicodeTest-1397280805 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:55:57 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-bfa6e749-50cd-4178-a0bb-d08894ae2830 tempest-CinderUnicodeTest-1397280805 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:55:57 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-bfa6e749-50cd-4178-a0bb-d08894ae2830 tempest-CinderUnicodeTest-1397280805 None] Selected osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 as target Quobyte volume. {{(pid=86212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 15:55:57 devstack cinder-volume[86212]: INFO cinder.volume.drivers.remotefs [None req-bfa6e749-50cd-4178-a0bb-d08894ae2830 tempest-CinderUnicodeTest-1397280805 None] casted to osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 Sep 22 15:55:57 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-bfa6e749-50cd-4178-a0bb-d08894ae2830 tempest-CinderUnicodeTest-1397280805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-accee605-2de3-4951-8c31-f7c00c4c3b75 1073741824 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:55:57 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[3aef24da-f153-4783-8209-b7066690226e]: (4, 'raw') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:55:57 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-381afe4b-24b3-4c2d-902b-6c0dd67e5a8a tempest-VolumeAndVolumeTypeFromImageTest-1497179036 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_45204c59-273c-4bf1-ac4c-99a20c887aa8_f9mczlpddevstack@QuobyteHD {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:55:57 devstack sudo[104321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-accee605-2de3-4951-8c31-f7c00c4c3b75 1073741824 Sep 22 15:55:57 devstack sudo[104321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:55:57 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-78318891-6065-4260-b85c-8fdf31c5abef tempest-CreateVolumesFromSnapshotTest-1406547820 None] Create snapshot completed successfully Sep 22 15:55:58 devstack sudo[104322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_45204c59-273c-4bf1-ac4c-99a20c887aa8_f9mczlpddevstack@QuobyteHD Sep 22 15:55:58 devstack sudo[104322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:55:58 devstack cinder-volume[86212]: DEBUG cinder.volume.flows.manager.create_volume [None req-753edabf-5f03-4508-bbba-2adc743c2e50 tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 15:55:58 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-753edabf-5f03-4508-bbba-2adc743c2e50 tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Flow 'volume_create_manager' (b9a987fe-227c-4f00-96f4-0e5ba046eae9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:55:58 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-753edabf-5f03-4508-bbba-2adc743c2e50 tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cceaa4b7-40ed-4abe-ad7d-7e5c193927a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:55:58 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-753edabf-5f03-4508-bbba-2adc743c2e50 tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cceaa4b7-40ed-4abe-ad7d-7e5c193927a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:55:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1427584675',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41f4ec7e-b999-45fe-b57e-2e14f2038d40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='081c795581ff40e5950211bd6415b04a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:55:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:55:58Z,use_quota=True,user_id='2aef7a4996294ed0936519470fa6d8e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:55:58 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-753edabf-5f03-4508-bbba-2adc743c2e50 tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22828865-20ae-43b0-85ef-7c53f02b6a7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:55:58 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-753edabf-5f03-4508-bbba-2adc743c2e50 tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22828865-20ae-43b0-85ef-7c53f02b6a7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:55:58 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-753edabf-5f03-4508-bbba-2adc743c2e50 tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bf8d8f8-133a-4bf7-85b1-a454807a5155) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:55:58 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-753edabf-5f03-4508-bbba-2adc743c2e50 tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bf8d8f8-133a-4bf7-85b1-a454807a5155) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '41f4ec7e-b999-45fe-b57e-2e14f2038d40', 'volume_name': 'volume-41f4ec7e-b999-45fe-b57e-2e14f2038d40', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:55:58 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-753edabf-5f03-4508-bbba-2adc743c2e50 tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1020795c-c733-44ee-901d-e96058f2f60f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:55:58 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-753edabf-5f03-4508-bbba-2adc743c2e50 tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1020795c-c733-44ee-901d-e96058f2f60f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:55:58 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-753edabf-5f03-4508-bbba-2adc743c2e50 tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3060f4a-2e2f-49f9-9a9d-7fa8dd7aafb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:55:58 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-753edabf-5f03-4508-bbba-2adc743c2e50 tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Volume 41f4ec7e-b999-45fe-b57e-2e14f2038d40: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-41f4ec7e-b999-45fe-b57e-2e14f2038d40', 'volume_size': 1} Sep 22 15:55:58 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-753edabf-5f03-4508-bbba-2adc743c2e50 tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:55:58 devstack sudo[104322]: pam_unix(sudo:session): session closed for user root Sep 22 15:55:58 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-381afe4b-24b3-4c2d-902b-6c0dd67e5a8a tempest-VolumeAndVolumeTypeFromImageTest-1497179036 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_45204c59-273c-4bf1-ac4c-99a20c887aa8_f9mczlpddevstack@QuobyteHD" returned: 0 in 0.419s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:55:58 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-381afe4b-24b3-4c2d-902b-6c0dd67e5a8a tempest-VolumeAndVolumeTypeFromImageTest-1497179036 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_45204c59-273c-4bf1-ac4c-99a20c887aa8_f9mczlpddevstack@QuobyteHD {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:55:58 devstack sudo[104332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_45204c59-273c-4bf1-ac4c-99a20c887aa8_f9mczlpddevstack@QuobyteHD Sep 22 15:55:58 devstack sudo[104332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:55:58 devstack sudo[104321]: pam_unix(sudo:session): session closed for user root Sep 22 15:55:58 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-bfa6e749-50cd-4178-a0bb-d08894ae2830 tempest-CinderUnicodeTest-1397280805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-accee605-2de3-4951-8c31-f7c00c4c3b75 1073741824" returned: 0 in 0.587s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:55:58 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-bfa6e749-50cd-4178-a0bb-d08894ae2830 tempest-CinderUnicodeTest-1397280805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-accee605-2de3-4951-8c31-f7c00c4c3b75 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:55:58 devstack sudo[104334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-accee605-2de3-4951-8c31-f7c00c4c3b75 Sep 22 15:55:58 devstack sudo[104334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:55:58 devstack cinder-volume[86212]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce08ed02-f68a-408f-98aa-bc777735f0ad tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 15:55:58 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-ce08ed02-f68a-408f-98aa-bc777735f0ad tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Flow 'volume_create_manager' (d2d892e3-4003-495f-b0ac-cd839f39e5c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:55:58 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-ce08ed02-f68a-408f-98aa-bc777735f0ad tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83c6baf5-6d23-4127-8b53-4c1aa3060f06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:55:58 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-ce08ed02-f68a-408f-98aa-bc777735f0ad tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83c6baf5-6d23-4127-8b53-4c1aa3060f06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:55:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1953459365',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8726b0fd-2553-4b92-88d6-4e89759e1bd0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='081c795581ff40e5950211bd6415b04a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:55:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:55:59Z,use_quota=True,user_id='2aef7a4996294ed0936519470fa6d8e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:55:58 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-ce08ed02-f68a-408f-98aa-bc777735f0ad tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (edff5703-971e-4847-b71a-8b7ebcf6445a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:55:58 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-ce08ed02-f68a-408f-98aa-bc777735f0ad tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (edff5703-971e-4847-b71a-8b7ebcf6445a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:55:58 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-ce08ed02-f68a-408f-98aa-bc777735f0ad tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09a83939-8a1d-4b65-aaa1-327dffdbac2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:55:58 devstack sudo[104332]: pam_unix(sudo:session): session closed for user root Sep 22 15:55:58 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-ce08ed02-f68a-408f-98aa-bc777735f0ad tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09a83939-8a1d-4b65-aaa1-327dffdbac2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8726b0fd-2553-4b92-88d6-4e89759e1bd0', 'volume_name': 'volume-8726b0fd-2553-4b92-88d6-4e89759e1bd0', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:55:58 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-ce08ed02-f68a-408f-98aa-bc777735f0ad tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ca0a6e3-82ae-44fb-a3ec-18217e2bb9c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:55:58 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-ce08ed02-f68a-408f-98aa-bc777735f0ad tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ca0a6e3-82ae-44fb-a3ec-18217e2bb9c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:55:58 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-ce08ed02-f68a-408f-98aa-bc777735f0ad tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58132ef5-e144-4d94-8c1a-efaf048ea467) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:55:58 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-ce08ed02-f68a-408f-98aa-bc777735f0ad tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Volume 8726b0fd-2553-4b92-88d6-4e89759e1bd0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8726b0fd-2553-4b92-88d6-4e89759e1bd0', 'volume_size': 1} Sep 22 15:55:58 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-ce08ed02-f68a-408f-98aa-bc777735f0ad tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:55:58 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-381afe4b-24b3-4c2d-902b-6c0dd67e5a8a tempest-VolumeAndVolumeTypeFromImageTest-1497179036 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_45204c59-273c-4bf1-ac4c-99a20c887aa8_f9mczlpddevstack@QuobyteHD" returned: 1 in 0.416s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:55:58 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-381afe4b-24b3-4c2d-902b-6c0dd67e5a8a tempest-VolumeAndVolumeTypeFromImageTest-1497179036 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_45204c59-273c-4bf1-ac4c-99a20c887aa8_f9mczlpddevstack@QuobyteHD' failed. Not Retrying. {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 22 15:55:58 devstack cinder-volume[86212]: DEBUG cinder.image.image_utils [None req-381afe4b-24b3-4c2d-902b-6c0dd67e5a8a tempest-VolumeAndVolumeTypeFromImageTest-1497179036 None] Temporary image 45204c59-273c-4bf1-ac4c-99a20c887aa8 is fetched for user 03d15f3a929c4af2b73ca552b0488fa4. {{(pid=86212) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 22 15:55:58 devstack sudo[104334]: pam_unix(sudo:session): session closed for user root Sep 22 15:55:58 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-bfa6e749-50cd-4178-a0bb-d08894ae2830 tempest-CinderUnicodeTest-1397280805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-accee605-2de3-4951-8c31-f7c00c4c3b75" returned: 0 in 0.260s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:55:58 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-bfa6e749-50cd-4178-a0bb-d08894ae2830 tempest-CinderUnicodeTest-1397280805 None] <== create_volume: return (895ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'} {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 15:55:58 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-bfa6e749-50cd-4178-a0bb-d08894ae2830 tempest-CinderUnicodeTest-1397280805 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.899s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:55:58 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-0ca7d89f-8d3f-40ae-9296-141cab9001ae tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.713s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:55:58 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-0ca7d89f-8d3f-40ae-9296-141cab9001ae tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:55:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-677478720',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c9d9341-b7fd-4a69-bda3-9b08a7741234,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='081c795581ff40e5950211bd6415b04a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:55:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:55:57Z,use_quota=True,user_id='2aef7a4996294ed0936519470fa6d8e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)}" {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 15:55:58 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-0ca7d89f-8d3f-40ae-9296-141cab9001ae tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Creating volume 4c9d9341-b7fd-4a69-bda3-9b08a7741234 {{(pid=86212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 15:55:58 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-0ca7d89f-8d3f-40ae-9296-141cab9001ae tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:55:58 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-0ca7d89f-8d3f-40ae-9296-141cab9001ae tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:55:58 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-0ca7d89f-8d3f-40ae-9296-141cab9001ae tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:55:58 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-0ca7d89f-8d3f-40ae-9296-141cab9001ae tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:55:58 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-0ca7d89f-8d3f-40ae-9296-141cab9001ae tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:55:58 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-0ca7d89f-8d3f-40ae-9296-141cab9001ae tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Selected osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 as target Quobyte volume. {{(pid=86212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 15:55:58 devstack cinder-volume[86212]: INFO cinder.volume.drivers.remotefs [None req-0ca7d89f-8d3f-40ae-9296-141cab9001ae tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] casted to osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 Sep 22 15:55:58 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-0ca7d89f-8d3f-40ae-9296-141cab9001ae tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-4c9d9341-b7fd-4a69-bda3-9b08a7741234 1073741824 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:55:58 devstack sudo[104340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-4c9d9341-b7fd-4a69-bda3-9b08a7741234 1073741824 Sep 22 15:55:58 devstack sudo[104340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:55:58 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-bfa6e749-50cd-4178-a0bb-d08894ae2830 tempest-CinderUnicodeTest-1397280805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4dfa0ca-6dfd-400e-85e9-fffd4f309d54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-accee605-2de3-4951-8c31-f7c00c4c3b75', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:55:58 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-bfa6e749-50cd-4178-a0bb-d08894ae2830 tempest-CinderUnicodeTest-1397280805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96ab255d-4def-436c-bd54-b66bbe05a5fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:55:58 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-bfa6e749-50cd-4178-a0bb-d08894ae2830 tempest-CinderUnicodeTest-1397280805 None] Volume volume-accee605-2de3-4951-8c31-f7c00c4c3b75 (accee605-2de3-4951-8c31-f7c00c4c3b75): created successfully Sep 22 15:55:58 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-bfa6e749-50cd-4178-a0bb-d08894ae2830 tempest-CinderUnicodeTest-1397280805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96ab255d-4def-436c-bd54-b66bbe05a5fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:55:58 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-bfa6e749-50cd-4178-a0bb-d08894ae2830 tempest-CinderUnicodeTest-1397280805 None] Flow 'volume_create_manager' (ec47d443-311a-458a-a504-a05049702151) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:55:58 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[acd1e3b5-8327-4ba8-860b-91872aad6007]: (4, 'raw') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:55:58 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-381afe4b-24b3-4c2d-902b-6c0dd67e5a8a tempest-VolumeAndVolumeTypeFromImageTest-1497179036 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_45204c59-273c-4bf1-ac4c-99a20c887aa8_f9mczlpddevstack@QuobyteHD {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:55:58 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-bfa6e749-50cd-4178-a0bb-d08894ae2830 tempest-CinderUnicodeTest-1397280805 None] Created volume successfully. Sep 22 15:55:59 devstack sudo[104342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_45204c59-273c-4bf1-ac4c-99a20c887aa8_f9mczlpddevstack@QuobyteHD Sep 22 15:55:59 devstack sudo[104342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:55:59 devstack sudo[104342]: pam_unix(sudo:session): session closed for user root Sep 22 15:55:59 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-381afe4b-24b3-4c2d-902b-6c0dd67e5a8a tempest-VolumeAndVolumeTypeFromImageTest-1497179036 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_45204c59-273c-4bf1-ac4c-99a20c887aa8_f9mczlpddevstack@QuobyteHD" returned: 0 in 0.366s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:55:59 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-381afe4b-24b3-4c2d-902b-6c0dd67e5a8a tempest-VolumeAndVolumeTypeFromImageTest-1497179036 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_45204c59-273c-4bf1-ac4c-99a20c887aa8_f9mczlpddevstack@QuobyteHD {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:55:59 devstack sudo[104340]: pam_unix(sudo:session): session closed for user root Sep 22 15:55:59 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-0ca7d89f-8d3f-40ae-9296-141cab9001ae tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-4c9d9341-b7fd-4a69-bda3-9b08a7741234 1073741824" returned: 0 in 0.473s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:55:59 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-0ca7d89f-8d3f-40ae-9296-141cab9001ae tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-4c9d9341-b7fd-4a69-bda3-9b08a7741234 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:55:59 devstack sudo[104350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-4c9d9341-b7fd-4a69-bda3-9b08a7741234 Sep 22 15:55:59 devstack sudo[104350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:55:59 devstack sudo[104349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_45204c59-273c-4bf1-ac4c-99a20c887aa8_f9mczlpddevstack@QuobyteHD Sep 22 15:55:59 devstack sudo[104349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:55:59 devstack cinder-volume[86212]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f76bde3-92aa-458d-8291-b739b21c5feb tempest-CreateVolumesFromSnapshotTest-1406547820 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 15:55:59 devstack sudo[104350]: pam_unix(sudo:session): session closed for user root Sep 22 15:55:59 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-2f76bde3-92aa-458d-8291-b739b21c5feb tempest-CreateVolumesFromSnapshotTest-1406547820 None] Flow 'volume_create_manager' (334e032f-b119-4510-aa8d-be4e3c821347) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:55:59 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-2f76bde3-92aa-458d-8291-b739b21c5feb tempest-CreateVolumesFromSnapshotTest-1406547820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (434aefe6-6c0a-4176-b904-a531a00122b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:55:59 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-0ca7d89f-8d3f-40ae-9296-141cab9001ae tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-4c9d9341-b7fd-4a69-bda3-9b08a7741234" returned: 0 in 0.381s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:55:59 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-0ca7d89f-8d3f-40ae-9296-141cab9001ae tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] <== create_volume: return (901ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'} {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 15:55:59 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-0ca7d89f-8d3f-40ae-9296-141cab9001ae tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.905s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:55:59 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-c9aef281-769d-4e40-b313-9b0ddbf56d15 tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.350s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:55:59 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-c9aef281-769d-4e40-b313-9b0ddbf56d15 tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:55:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1871256465',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f3b5234-b299-41e4-b304-73a8438da7d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='081c795581ff40e5950211bd6415b04a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:55:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:55:57Z,use_quota=True,user_id='2aef7a4996294ed0936519470fa6d8e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)}" {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 15:55:59 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-c9aef281-769d-4e40-b313-9b0ddbf56d15 tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Creating volume 2f3b5234-b299-41e4-b304-73a8438da7d2 {{(pid=86212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 15:55:59 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-c9aef281-769d-4e40-b313-9b0ddbf56d15 tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:55:59 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-c9aef281-769d-4e40-b313-9b0ddbf56d15 tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:55:59 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-c9aef281-769d-4e40-b313-9b0ddbf56d15 tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:55:59 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-c9aef281-769d-4e40-b313-9b0ddbf56d15 tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:55:59 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-c9aef281-769d-4e40-b313-9b0ddbf56d15 tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:55:59 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-c9aef281-769d-4e40-b313-9b0ddbf56d15 tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Selected osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 as target Quobyte volume. {{(pid=86212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 15:55:59 devstack cinder-volume[86212]: INFO cinder.volume.drivers.remotefs [None req-c9aef281-769d-4e40-b313-9b0ddbf56d15 tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] casted to osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 Sep 22 15:55:59 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-c9aef281-769d-4e40-b313-9b0ddbf56d15 tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2f3b5234-b299-41e4-b304-73a8438da7d2 1073741824 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:55:59 devstack sudo[104349]: pam_unix(sudo:session): session closed for user root Sep 22 15:55:59 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-2f76bde3-92aa-458d-8291-b739b21c5feb tempest-CreateVolumesFromSnapshotTest-1406547820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (434aefe6-6c0a-4176-b904-a531a00122b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:55:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-912185287',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3820c96-9deb-4ae6-9b3f-483f6264971e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='117f5def5f6948089fe793e13bded5d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:56:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:56:00Z,use_quota=True,user_id='f351156bd1214328bced88784864ce1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:55:59 devstack sudo[104357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2f3b5234-b299-41e4-b304-73a8438da7d2 1073741824 Sep 22 15:55:59 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-2f76bde3-92aa-458d-8291-b739b21c5feb tempest-CreateVolumesFromSnapshotTest-1406547820 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (486ce062-3ae8-4413-af19-3717de441ad9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:55:59 devstack sudo[104357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:55:59 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-2f76bde3-92aa-458d-8291-b739b21c5feb tempest-CreateVolumesFromSnapshotTest-1406547820 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (486ce062-3ae8-4413-af19-3717de441ad9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:55:59 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-2f76bde3-92aa-458d-8291-b739b21c5feb tempest-CreateVolumesFromSnapshotTest-1406547820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (985bf652-8ed0-4389-923f-8952bd8d3000) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:55:59 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-2f76bde3-92aa-458d-8291-b739b21c5feb tempest-CreateVolumesFromSnapshotTest-1406547820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (985bf652-8ed0-4389-923f-8952bd8d3000) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd3820c96-9deb-4ae6-9b3f-483f6264971e', 'volume_name': 'volume-d3820c96-9deb-4ae6-9b3f-483f6264971e', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:55:59 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-2f76bde3-92aa-458d-8291-b739b21c5feb tempest-CreateVolumesFromSnapshotTest-1406547820 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (997961a7-eba7-4623-896e-8d1cf038940e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:55:59 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-2f76bde3-92aa-458d-8291-b739b21c5feb tempest-CreateVolumesFromSnapshotTest-1406547820 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (997961a7-eba7-4623-896e-8d1cf038940e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:55:59 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-2f76bde3-92aa-458d-8291-b739b21c5feb tempest-CreateVolumesFromSnapshotTest-1406547820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (647d0f18-9732-4262-893b-725b188c2752) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:55:59 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-2f76bde3-92aa-458d-8291-b739b21c5feb tempest-CreateVolumesFromSnapshotTest-1406547820 None] Volume d3820c96-9deb-4ae6-9b3f-483f6264971e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d3820c96-9deb-4ae6-9b3f-483f6264971e', 'volume_size': 1} Sep 22 15:55:59 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-2f76bde3-92aa-458d-8291-b739b21c5feb tempest-CreateVolumesFromSnapshotTest-1406547820 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:55:59 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-381afe4b-24b3-4c2d-902b-6c0dd67e5a8a tempest-VolumeAndVolumeTypeFromImageTest-1497179036 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_45204c59-273c-4bf1-ac4c-99a20c887aa8_f9mczlpddevstack@QuobyteHD" returned: 1 in 0.559s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:55:59 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-381afe4b-24b3-4c2d-902b-6c0dd67e5a8a tempest-VolumeAndVolumeTypeFromImageTest-1497179036 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_45204c59-273c-4bf1-ac4c-99a20c887aa8_f9mczlpddevstack@QuobyteHD' failed. Not Retrying. {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 22 15:55:59 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-381afe4b-24b3-4c2d-902b-6c0dd67e5a8a tempest-VolumeAndVolumeTypeFromImageTest-1497179036 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:55:59 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-0ca7d89f-8d3f-40ae-9296-141cab9001ae tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (957b43b1-0c77-40e5-bfbe-250778d59b81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c9d9341-b7fd-4a69-bda3-9b08a7741234', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:55:59 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-0ca7d89f-8d3f-40ae-9296-141cab9001ae tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9cad10f3-7fc7-4a4f-8548-82f9a035f570) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:55:59 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-0ca7d89f-8d3f-40ae-9296-141cab9001ae tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Volume volume-4c9d9341-b7fd-4a69-bda3-9b08a7741234 (4c9d9341-b7fd-4a69-bda3-9b08a7741234): created successfully Sep 22 15:55:59 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-0ca7d89f-8d3f-40ae-9296-141cab9001ae tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9cad10f3-7fc7-4a4f-8548-82f9a035f570) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:55:59 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-0ca7d89f-8d3f-40ae-9296-141cab9001ae tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Flow 'volume_create_manager' (8ba35dc1-e2bd-4ef3-aaa7-6d07c5c90a70) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:55:59 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-0ca7d89f-8d3f-40ae-9296-141cab9001ae tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Created volume successfully. Sep 22 15:55:59 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-8cb35e3f-70b5-4f12-b1be-f0517aa63ca2 tempest-CinderUnicodeTest-1397280805 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:56:00 devstack cinder-volume[86212]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3817280-7723-419f-bdde-f0a585a615d9 tempest-CreateVolumesFromSnapshotTest-1406547820 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 15:56:00 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-e3817280-7723-419f-bdde-f0a585a615d9 tempest-CreateVolumesFromSnapshotTest-1406547820 None] Flow 'volume_create_manager' (2120ae7d-c343-49ad-866b-dce8c4b8868a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:56:00 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-e3817280-7723-419f-bdde-f0a585a615d9 tempest-CreateVolumesFromSnapshotTest-1406547820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ab76b52-caeb-4c7c-87be-f9c8e6f2b0ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:56:00 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-e3817280-7723-419f-bdde-f0a585a615d9 tempest-CreateVolumesFromSnapshotTest-1406547820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ab76b52-caeb-4c7c-87be-f9c8e6f2b0ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:56:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-835090313',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a70bc76d-af4c-4af6-ab46-3400d84760a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='117f5def5f6948089fe793e13bded5d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:56:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:56:00Z,use_quota=True,user_id='f351156bd1214328bced88784864ce1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:56:00 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-e3817280-7723-419f-bdde-f0a585a615d9 tempest-CreateVolumesFromSnapshotTest-1406547820 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (065812af-d191-4bef-80df-4c99dcf8d83a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:56:00 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-e3817280-7723-419f-bdde-f0a585a615d9 tempest-CreateVolumesFromSnapshotTest-1406547820 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (065812af-d191-4bef-80df-4c99dcf8d83a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:56:00 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-e3817280-7723-419f-bdde-f0a585a615d9 tempest-CreateVolumesFromSnapshotTest-1406547820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1fb01152-71da-491b-860b-7831924ce1ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:56:00 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-e3817280-7723-419f-bdde-f0a585a615d9 tempest-CreateVolumesFromSnapshotTest-1406547820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1fb01152-71da-491b-860b-7831924ce1ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a70bc76d-af4c-4af6-ab46-3400d84760a7', 'volume_name': 'volume-a70bc76d-af4c-4af6-ab46-3400d84760a7', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:56:00 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-e3817280-7723-419f-bdde-f0a585a615d9 tempest-CreateVolumesFromSnapshotTest-1406547820 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50dded97-49db-40a6-b481-248262e444e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:56:00 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-e3817280-7723-419f-bdde-f0a585a615d9 tempest-CreateVolumesFromSnapshotTest-1406547820 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50dded97-49db-40a6-b481-248262e444e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:56:00 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-e3817280-7723-419f-bdde-f0a585a615d9 tempest-CreateVolumesFromSnapshotTest-1406547820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bb151c5-d240-4f6e-9d3a-242b36db4365) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:56:00 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-e3817280-7723-419f-bdde-f0a585a615d9 tempest-CreateVolumesFromSnapshotTest-1406547820 None] Volume a70bc76d-af4c-4af6-ab46-3400d84760a7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a70bc76d-af4c-4af6-ab46-3400d84760a7', 'volume_size': 1} Sep 22 15:56:00 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-e3817280-7723-419f-bdde-f0a585a615d9 tempest-CreateVolumesFromSnapshotTest-1406547820 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:56:00 devstack sudo[104357]: pam_unix(sudo:session): session closed for user root Sep 22 15:56:00 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-c9aef281-769d-4e40-b313-9b0ddbf56d15 tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2f3b5234-b299-41e4-b304-73a8438da7d2 1073741824" returned: 0 in 0.556s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:56:00 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-c9aef281-769d-4e40-b313-9b0ddbf56d15 tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2f3b5234-b299-41e4-b304-73a8438da7d2 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:56:00 devstack sudo[104363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2f3b5234-b299-41e4-b304-73a8438da7d2 Sep 22 15:56:00 devstack sudo[104363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:56:00 devstack sudo[104363]: pam_unix(sudo:session): session closed for user root Sep 22 15:56:00 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-c9aef281-769d-4e40-b313-9b0ddbf56d15 tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2f3b5234-b299-41e4-b304-73a8438da7d2" returned: 0 in 0.261s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:56:00 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-c9aef281-769d-4e40-b313-9b0ddbf56d15 tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] <== create_volume: return (873ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'} {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 15:56:00 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-c9aef281-769d-4e40-b313-9b0ddbf56d15 tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.876s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:56:00 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-4159bfac-70e8-4675-a66b-7a1b698bb43f tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.740s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:56:00 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-4159bfac-70e8-4675-a66b-7a1b698bb43f tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:55:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1279654516',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9386d4f-ad27-40af-b7eb-493dd23002dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='081c795581ff40e5950211bd6415b04a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:55:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:55:58Z,use_quota=True,user_id='2aef7a4996294ed0936519470fa6d8e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)}" {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 15:56:00 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-4159bfac-70e8-4675-a66b-7a1b698bb43f tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Creating volume c9386d4f-ad27-40af-b7eb-493dd23002dd {{(pid=86212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 15:56:00 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-4159bfac-70e8-4675-a66b-7a1b698bb43f tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:56:00 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-4159bfac-70e8-4675-a66b-7a1b698bb43f tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:56:00 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-4159bfac-70e8-4675-a66b-7a1b698bb43f tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:56:00 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-4159bfac-70e8-4675-a66b-7a1b698bb43f tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:56:00 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-4159bfac-70e8-4675-a66b-7a1b698bb43f tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:56:00 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-4159bfac-70e8-4675-a66b-7a1b698bb43f tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Selected osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 as target Quobyte volume. {{(pid=86212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 15:56:00 devstack cinder-volume[86212]: INFO cinder.volume.drivers.remotefs [None req-4159bfac-70e8-4675-a66b-7a1b698bb43f tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] casted to osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 Sep 22 15:56:00 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-4159bfac-70e8-4675-a66b-7a1b698bb43f tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-c9386d4f-ad27-40af-b7eb-493dd23002dd 1073741824 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:56:00 devstack sudo[104366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-c9386d4f-ad27-40af-b7eb-493dd23002dd 1073741824 Sep 22 15:56:00 devstack sudo[104366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:56:00 devstack cinder-volume[86212]: DEBUG cinder.volume.flows.manager.create_volume [None req-8bd3baf5-1d75-4bee-add6-636485f80de2 tempest-CreateVolumesFromSnapshotTest-1406547820 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 15:56:00 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-8bd3baf5-1d75-4bee-add6-636485f80de2 tempest-CreateVolumesFromSnapshotTest-1406547820 None] Flow 'volume_create_manager' (ba64a728-4318-442d-bb6e-d6de31388475) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:56:00 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-8bd3baf5-1d75-4bee-add6-636485f80de2 tempest-CreateVolumesFromSnapshotTest-1406547820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11552bee-efaf-4537-9ab2-f0ad69c6520f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:56:00 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-c9aef281-769d-4e40-b313-9b0ddbf56d15 tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e06ea4d7-e12f-476c-8d75-c2e967725d6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f3b5234-b299-41e4-b304-73a8438da7d2', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:56:00 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-c9aef281-769d-4e40-b313-9b0ddbf56d15 tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31e60ba8-9551-47bb-8dad-6cc46b3954c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:56:00 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-8bd3baf5-1d75-4bee-add6-636485f80de2 tempest-CreateVolumesFromSnapshotTest-1406547820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11552bee-efaf-4537-9ab2-f0ad69c6520f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:56:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-948980856',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dce703ca-cd1c-4ea3-8d0c-55ecb93228aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='117f5def5f6948089fe793e13bded5d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:56:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:56:01Z,use_quota=True,user_id='f351156bd1214328bced88784864ce1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:56:00 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-8bd3baf5-1d75-4bee-add6-636485f80de2 tempest-CreateVolumesFromSnapshotTest-1406547820 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2810b22f-345e-4ef5-803e-ffe9a6238c12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:56:00 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-8bd3baf5-1d75-4bee-add6-636485f80de2 tempest-CreateVolumesFromSnapshotTest-1406547820 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2810b22f-345e-4ef5-803e-ffe9a6238c12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:56:00 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-8bd3baf5-1d75-4bee-add6-636485f80de2 tempest-CreateVolumesFromSnapshotTest-1406547820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d9d6185-3651-4da7-a6ea-1d483e4c3a34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:56:00 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-8bd3baf5-1d75-4bee-add6-636485f80de2 tempest-CreateVolumesFromSnapshotTest-1406547820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d9d6185-3651-4da7-a6ea-1d483e4c3a34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dce703ca-cd1c-4ea3-8d0c-55ecb93228aa', 'volume_name': 'volume-dce703ca-cd1c-4ea3-8d0c-55ecb93228aa', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:56:00 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-8bd3baf5-1d75-4bee-add6-636485f80de2 tempest-CreateVolumesFromSnapshotTest-1406547820 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7aa68d82-f519-4061-982e-d7f11bc1e3ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:56:00 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-8bd3baf5-1d75-4bee-add6-636485f80de2 tempest-CreateVolumesFromSnapshotTest-1406547820 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7aa68d82-f519-4061-982e-d7f11bc1e3ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:56:00 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-8bd3baf5-1d75-4bee-add6-636485f80de2 tempest-CreateVolumesFromSnapshotTest-1406547820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ae08ffc-6775-4e4c-930f-be34306fcdee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:56:00 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-8bd3baf5-1d75-4bee-add6-636485f80de2 tempest-CreateVolumesFromSnapshotTest-1406547820 None] Volume dce703ca-cd1c-4ea3-8d0c-55ecb93228aa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dce703ca-cd1c-4ea3-8d0c-55ecb93228aa', 'volume_size': 1} Sep 22 15:56:00 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-8bd3baf5-1d75-4bee-add6-636485f80de2 tempest-CreateVolumesFromSnapshotTest-1406547820 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:56:00 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-c9aef281-769d-4e40-b313-9b0ddbf56d15 tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Volume volume-2f3b5234-b299-41e4-b304-73a8438da7d2 (2f3b5234-b299-41e4-b304-73a8438da7d2): created successfully Sep 22 15:56:00 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-c9aef281-769d-4e40-b313-9b0ddbf56d15 tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31e60ba8-9551-47bb-8dad-6cc46b3954c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:56:00 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-c9aef281-769d-4e40-b313-9b0ddbf56d15 tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Flow 'volume_create_manager' (e3258eb7-a792-4907-958f-fce354f5402f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:56:00 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-c9aef281-769d-4e40-b313-9b0ddbf56d15 tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Created volume successfully. Sep 22 15:56:01 devstack cinder-volume[86212]: DEBUG cinder.volume.flows.manager.create_volume [None req-a726964f-835f-4544-8d1f-cc36e40d98c4 tempest-CreateVolumesFromSnapshotTest-1406547820 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 15:56:01 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-a726964f-835f-4544-8d1f-cc36e40d98c4 tempest-CreateVolumesFromSnapshotTest-1406547820 None] Flow 'volume_create_manager' (a0506adf-e18e-42a3-8bad-ee9d62224a79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:56:01 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-a726964f-835f-4544-8d1f-cc36e40d98c4 tempest-CreateVolumesFromSnapshotTest-1406547820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b96f8510-8975-4dad-8f61-e3f04377d157) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:56:01 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-a726964f-835f-4544-8d1f-cc36e40d98c4 tempest-CreateVolumesFromSnapshotTest-1406547820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b96f8510-8975-4dad-8f61-e3f04377d157) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:56:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2125937660',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=863420f6-f9cf-4ddf-9437-eca8acaf0807,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='117f5def5f6948089fe793e13bded5d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:56:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:56:01Z,use_quota=True,user_id='f351156bd1214328bced88784864ce1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:56:01 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-a726964f-835f-4544-8d1f-cc36e40d98c4 tempest-CreateVolumesFromSnapshotTest-1406547820 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94b79066-7b73-4de7-a605-66af58ec24e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:56:01 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-a726964f-835f-4544-8d1f-cc36e40d98c4 tempest-CreateVolumesFromSnapshotTest-1406547820 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94b79066-7b73-4de7-a605-66af58ec24e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:56:01 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-a726964f-835f-4544-8d1f-cc36e40d98c4 tempest-CreateVolumesFromSnapshotTest-1406547820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87d89d51-0fe7-4181-8d0b-feecb39a9a51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:56:01 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-a726964f-835f-4544-8d1f-cc36e40d98c4 tempest-CreateVolumesFromSnapshotTest-1406547820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87d89d51-0fe7-4181-8d0b-feecb39a9a51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '863420f6-f9cf-4ddf-9437-eca8acaf0807', 'volume_name': 'volume-863420f6-f9cf-4ddf-9437-eca8acaf0807', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:56:01 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-a726964f-835f-4544-8d1f-cc36e40d98c4 tempest-CreateVolumesFromSnapshotTest-1406547820 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4c53541-a30f-47a8-8f4d-cdbb9cdc51f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:56:01 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-a726964f-835f-4544-8d1f-cc36e40d98c4 tempest-CreateVolumesFromSnapshotTest-1406547820 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4c53541-a30f-47a8-8f4d-cdbb9cdc51f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:56:01 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-a726964f-835f-4544-8d1f-cc36e40d98c4 tempest-CreateVolumesFromSnapshotTest-1406547820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4e54db0-cbe0-4c95-b0cc-4d0b11bac076) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:56:01 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-a726964f-835f-4544-8d1f-cc36e40d98c4 tempest-CreateVolumesFromSnapshotTest-1406547820 None] Volume 863420f6-f9cf-4ddf-9437-eca8acaf0807: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-863420f6-f9cf-4ddf-9437-eca8acaf0807', 'volume_size': 1} Sep 22 15:56:01 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-a726964f-835f-4544-8d1f-cc36e40d98c4 tempest-CreateVolumesFromSnapshotTest-1406547820 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:56:01 devstack sudo[104366]: pam_unix(sudo:session): session closed for user root Sep 22 15:56:01 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-4159bfac-70e8-4675-a66b-7a1b698bb43f tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-c9386d4f-ad27-40af-b7eb-493dd23002dd 1073741824" returned: 0 in 0.629s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:56:01 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-4159bfac-70e8-4675-a66b-7a1b698bb43f tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-c9386d4f-ad27-40af-b7eb-493dd23002dd {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:56:01 devstack sudo[104372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-c9386d4f-ad27-40af-b7eb-493dd23002dd Sep 22 15:56:01 devstack sudo[104372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:56:01 devstack cinder-volume[86212]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d4ec35c-4daf-4299-b148-e714a942636e tempest-CreateVolumesFromSnapshotTest-1406547820 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 15:56:01 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-1d4ec35c-4daf-4299-b148-e714a942636e tempest-CreateVolumesFromSnapshotTest-1406547820 None] Flow 'volume_create_manager' (a03ad0e6-d518-4e27-8d4a-39758529c3ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:56:01 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-1d4ec35c-4daf-4299-b148-e714a942636e tempest-CreateVolumesFromSnapshotTest-1406547820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b426e61-f8a0-4be4-9283-7429857e1e2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:56:01 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-1d4ec35c-4daf-4299-b148-e714a942636e tempest-CreateVolumesFromSnapshotTest-1406547820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b426e61-f8a0-4be4-9283-7429857e1e2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:56:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-997867924',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26fda26b-443f-45da-9b16-58d3865f4d35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='117f5def5f6948089fe793e13bded5d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:56:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:56:01Z,use_quota=True,user_id='f351156bd1214328bced88784864ce1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:56:01 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-1d4ec35c-4daf-4299-b148-e714a942636e tempest-CreateVolumesFromSnapshotTest-1406547820 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87237ea3-e6ce-445d-b523-1bf5397fb4ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:56:01 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-1d4ec35c-4daf-4299-b148-e714a942636e tempest-CreateVolumesFromSnapshotTest-1406547820 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87237ea3-e6ce-445d-b523-1bf5397fb4ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:56:01 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-1d4ec35c-4daf-4299-b148-e714a942636e tempest-CreateVolumesFromSnapshotTest-1406547820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89dd89d2-864d-406b-b29e-70f2273dc927) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:56:01 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-1d4ec35c-4daf-4299-b148-e714a942636e tempest-CreateVolumesFromSnapshotTest-1406547820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89dd89d2-864d-406b-b29e-70f2273dc927) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '26fda26b-443f-45da-9b16-58d3865f4d35', 'volume_name': 'volume-26fda26b-443f-45da-9b16-58d3865f4d35', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:56:01 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-1d4ec35c-4daf-4299-b148-e714a942636e tempest-CreateVolumesFromSnapshotTest-1406547820 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf499b80-bd9c-47a7-90cc-524c03153030) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:56:01 devstack sudo[104372]: pam_unix(sudo:session): session closed for user root Sep 22 15:56:01 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-1d4ec35c-4daf-4299-b148-e714a942636e tempest-CreateVolumesFromSnapshotTest-1406547820 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf499b80-bd9c-47a7-90cc-524c03153030) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:56:01 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-1d4ec35c-4daf-4299-b148-e714a942636e tempest-CreateVolumesFromSnapshotTest-1406547820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (786fb3a5-2660-47b9-95be-f17a2e039dcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:56:01 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-1d4ec35c-4daf-4299-b148-e714a942636e tempest-CreateVolumesFromSnapshotTest-1406547820 None] Volume 26fda26b-443f-45da-9b16-58d3865f4d35: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-26fda26b-443f-45da-9b16-58d3865f4d35', 'volume_size': 1} Sep 22 15:56:01 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-1d4ec35c-4daf-4299-b148-e714a942636e tempest-CreateVolumesFromSnapshotTest-1406547820 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:56:01 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-4159bfac-70e8-4675-a66b-7a1b698bb43f tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-c9386d4f-ad27-40af-b7eb-493dd23002dd" returned: 0 in 0.284s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:56:01 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-4159bfac-70e8-4675-a66b-7a1b698bb43f tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] <== create_volume: return (968ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'} {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 15:56:01 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-4159bfac-70e8-4675-a66b-7a1b698bb43f tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.972s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:56:01 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-753edabf-5f03-4508-bbba-2adc743c2e50 tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.244s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:56:01 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-753edabf-5f03-4508-bbba-2adc743c2e50 tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:55:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1427584675',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41f4ec7e-b999-45fe-b57e-2e14f2038d40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='081c795581ff40e5950211bd6415b04a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:55:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:55:58Z,use_quota=True,user_id='2aef7a4996294ed0936519470fa6d8e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)}" {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 15:56:01 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-753edabf-5f03-4508-bbba-2adc743c2e50 tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Creating volume 41f4ec7e-b999-45fe-b57e-2e14f2038d40 {{(pid=86212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 15:56:01 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-753edabf-5f03-4508-bbba-2adc743c2e50 tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:56:01 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-753edabf-5f03-4508-bbba-2adc743c2e50 tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:56:01 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-753edabf-5f03-4508-bbba-2adc743c2e50 tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:56:01 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-753edabf-5f03-4508-bbba-2adc743c2e50 tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:56:01 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-753edabf-5f03-4508-bbba-2adc743c2e50 tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:56:01 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-753edabf-5f03-4508-bbba-2adc743c2e50 tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Selected osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 as target Quobyte volume. {{(pid=86212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 15:56:01 devstack cinder-volume[86212]: INFO cinder.volume.drivers.remotefs [None req-753edabf-5f03-4508-bbba-2adc743c2e50 tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] casted to osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 Sep 22 15:56:01 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-753edabf-5f03-4508-bbba-2adc743c2e50 tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-41f4ec7e-b999-45fe-b57e-2e14f2038d40 1073741824 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:56:01 devstack sudo[104375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-41f4ec7e-b999-45fe-b57e-2e14f2038d40 1073741824 Sep 22 15:56:01 devstack sudo[104375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:56:01 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-4159bfac-70e8-4675-a66b-7a1b698bb43f tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a089edb5-a682-414f-bb68-8ca6446873d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c9386d4f-ad27-40af-b7eb-493dd23002dd', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:56:01 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-4159bfac-70e8-4675-a66b-7a1b698bb43f tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95071d21-f40e-4409-a90d-8cbc14fa2605) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:56:01 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-4159bfac-70e8-4675-a66b-7a1b698bb43f tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Volume volume-c9386d4f-ad27-40af-b7eb-493dd23002dd (c9386d4f-ad27-40af-b7eb-493dd23002dd): created successfully Sep 22 15:56:01 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-4159bfac-70e8-4675-a66b-7a1b698bb43f tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95071d21-f40e-4409-a90d-8cbc14fa2605) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:56:01 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-4159bfac-70e8-4675-a66b-7a1b698bb43f tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Flow 'volume_create_manager' (9a12b539-480a-4527-b63a-701333f92930) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:56:01 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-4159bfac-70e8-4675-a66b-7a1b698bb43f tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Created volume successfully. Sep 22 15:56:02 devstack sudo[104375]: pam_unix(sudo:session): session closed for user root Sep 22 15:56:02 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-753edabf-5f03-4508-bbba-2adc743c2e50 tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-41f4ec7e-b999-45fe-b57e-2e14f2038d40 1073741824" returned: 0 in 0.492s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:56:02 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-753edabf-5f03-4508-bbba-2adc743c2e50 tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-41f4ec7e-b999-45fe-b57e-2e14f2038d40 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:56:02 devstack sudo[104381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-41f4ec7e-b999-45fe-b57e-2e14f2038d40 Sep 22 15:56:02 devstack sudo[104381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:56:02 devstack sudo[104381]: pam_unix(sudo:session): session closed for user root Sep 22 15:56:02 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-753edabf-5f03-4508-bbba-2adc743c2e50 tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-41f4ec7e-b999-45fe-b57e-2e14f2038d40" returned: 0 in 0.298s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:56:02 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-753edabf-5f03-4508-bbba-2adc743c2e50 tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] <== create_volume: return (865ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'} {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 15:56:02 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-753edabf-5f03-4508-bbba-2adc743c2e50 tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.867s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:56:02 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-ce08ed02-f68a-408f-98aa-bc777735f0ad tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.667s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:56:02 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-ce08ed02-f68a-408f-98aa-bc777735f0ad tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:55:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1953459365',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8726b0fd-2553-4b92-88d6-4e89759e1bd0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='081c795581ff40e5950211bd6415b04a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:55:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:55:59Z,use_quota=True,user_id='2aef7a4996294ed0936519470fa6d8e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)}" {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 15:56:02 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-ce08ed02-f68a-408f-98aa-bc777735f0ad tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Creating volume 8726b0fd-2553-4b92-88d6-4e89759e1bd0 {{(pid=86212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 15:56:02 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-ce08ed02-f68a-408f-98aa-bc777735f0ad tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:56:02 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-ce08ed02-f68a-408f-98aa-bc777735f0ad tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:56:02 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-ce08ed02-f68a-408f-98aa-bc777735f0ad tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:56:02 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-ce08ed02-f68a-408f-98aa-bc777735f0ad tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:56:02 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-ce08ed02-f68a-408f-98aa-bc777735f0ad tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:56:02 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-ce08ed02-f68a-408f-98aa-bc777735f0ad tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Selected osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 as target Quobyte volume. {{(pid=86212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 15:56:02 devstack cinder-volume[86212]: INFO cinder.volume.drivers.remotefs [None req-ce08ed02-f68a-408f-98aa-bc777735f0ad tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] casted to osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 Sep 22 15:56:02 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-ce08ed02-f68a-408f-98aa-bc777735f0ad tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8726b0fd-2553-4b92-88d6-4e89759e1bd0 1073741824 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:56:02 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-753edabf-5f03-4508-bbba-2adc743c2e50 tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3060f4a-2e2f-49f9-9a9d-7fa8dd7aafb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41f4ec7e-b999-45fe-b57e-2e14f2038d40', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:56:02 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-753edabf-5f03-4508-bbba-2adc743c2e50 tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f7d89dc-453e-401f-b515-379ac5467807) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:56:02 devstack sudo[104384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8726b0fd-2553-4b92-88d6-4e89759e1bd0 1073741824 Sep 22 15:56:02 devstack sudo[104384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:56:02 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-753edabf-5f03-4508-bbba-2adc743c2e50 tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Volume volume-41f4ec7e-b999-45fe-b57e-2e14f2038d40 (41f4ec7e-b999-45fe-b57e-2e14f2038d40): created successfully Sep 22 15:56:02 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-753edabf-5f03-4508-bbba-2adc743c2e50 tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f7d89dc-453e-401f-b515-379ac5467807) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:56:02 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-753edabf-5f03-4508-bbba-2adc743c2e50 tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Flow 'volume_create_manager' (b9a987fe-227c-4f00-96f4-0e5ba046eae9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:56:02 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-753edabf-5f03-4508-bbba-2adc743c2e50 tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Created volume successfully. Sep 22 15:56:02 devstack sudo[104384]: pam_unix(sudo:session): session closed for user root Sep 22 15:56:02 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-ce08ed02-f68a-408f-98aa-bc777735f0ad tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8726b0fd-2553-4b92-88d6-4e89759e1bd0 1073741824" returned: 0 in 0.456s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:56:02 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-ce08ed02-f68a-408f-98aa-bc777735f0ad tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8726b0fd-2553-4b92-88d6-4e89759e1bd0 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:56:02 devstack sudo[104389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8726b0fd-2553-4b92-88d6-4e89759e1bd0 Sep 22 15:56:02 devstack sudo[104389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:56:03 devstack sudo[104389]: pam_unix(sudo:session): session closed for user root Sep 22 15:56:03 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-ce08ed02-f68a-408f-98aa-bc777735f0ad tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8726b0fd-2553-4b92-88d6-4e89759e1bd0" returned: 0 in 0.257s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:56:03 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-ce08ed02-f68a-408f-98aa-bc777735f0ad tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] <== create_volume: return (758ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'} {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 15:56:03 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-ce08ed02-f68a-408f-98aa-bc777735f0ad tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.762s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:56:03 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-2f76bde3-92aa-458d-8291-b739b21c5feb tempest-CreateVolumesFromSnapshotTest-1406547820 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.383s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:56:03 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-2f76bde3-92aa-458d-8291-b739b21c5feb tempest-CreateVolumesFromSnapshotTest-1406547820 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:55:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-912185287',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3820c96-9deb-4ae6-9b3f-483f6264971e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='117f5def5f6948089fe793e13bded5d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:56:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:56:00Z,use_quota=True,user_id='f351156bd1214328bced88784864ce1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)}" {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 15:56:03 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-2f76bde3-92aa-458d-8291-b739b21c5feb tempest-CreateVolumesFromSnapshotTest-1406547820 None] Creating volume d3820c96-9deb-4ae6-9b3f-483f6264971e {{(pid=86212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 15:56:03 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-2f76bde3-92aa-458d-8291-b739b21c5feb tempest-CreateVolumesFromSnapshotTest-1406547820 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:56:03 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-2f76bde3-92aa-458d-8291-b739b21c5feb tempest-CreateVolumesFromSnapshotTest-1406547820 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:56:03 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-2f76bde3-92aa-458d-8291-b739b21c5feb tempest-CreateVolumesFromSnapshotTest-1406547820 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:56:03 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-2f76bde3-92aa-458d-8291-b739b21c5feb tempest-CreateVolumesFromSnapshotTest-1406547820 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:56:03 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-2f76bde3-92aa-458d-8291-b739b21c5feb tempest-CreateVolumesFromSnapshotTest-1406547820 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:56:03 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-2f76bde3-92aa-458d-8291-b739b21c5feb tempest-CreateVolumesFromSnapshotTest-1406547820 None] Selected osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 as target Quobyte volume. {{(pid=86212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 15:56:03 devstack cinder-volume[86212]: INFO cinder.volume.drivers.remotefs [None req-2f76bde3-92aa-458d-8291-b739b21c5feb tempest-CreateVolumesFromSnapshotTest-1406547820 None] casted to osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 Sep 22 15:56:03 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-2f76bde3-92aa-458d-8291-b739b21c5feb tempest-CreateVolumesFromSnapshotTest-1406547820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-d3820c96-9deb-4ae6-9b3f-483f6264971e 1073741824 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:56:03 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-ce08ed02-f68a-408f-98aa-bc777735f0ad tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58132ef5-e144-4d94-8c1a-efaf048ea467) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8726b0fd-2553-4b92-88d6-4e89759e1bd0', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:56:03 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-ce08ed02-f68a-408f-98aa-bc777735f0ad tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1d87df8-7eff-4222-916e-e4366a5b6653) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:56:03 devstack sudo[104392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-d3820c96-9deb-4ae6-9b3f-483f6264971e 1073741824 Sep 22 15:56:03 devstack sudo[104392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:56:03 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-ce08ed02-f68a-408f-98aa-bc777735f0ad tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Volume volume-8726b0fd-2553-4b92-88d6-4e89759e1bd0 (8726b0fd-2553-4b92-88d6-4e89759e1bd0): created successfully Sep 22 15:56:03 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-ce08ed02-f68a-408f-98aa-bc777735f0ad tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1d87df8-7eff-4222-916e-e4366a5b6653) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:56:03 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-ce08ed02-f68a-408f-98aa-bc777735f0ad tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Flow 'volume_create_manager' (d2d892e3-4003-495f-b0ac-cd839f39e5c1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:56:03 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-ce08ed02-f68a-408f-98aa-bc777735f0ad tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Created volume successfully. Sep 22 15:56:03 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-5a5a4fb5-c33b-4d09-b0ee-b5fbce1d7081 tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Acquiring lock "cinder-8726b0fd-2553-4b92-88d6-4e89759e1bd0-delete_volume" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:56:03 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-5a5a4fb5-c33b-4d09-b0ee-b5fbce1d7081 tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Lock "cinder-8726b0fd-2553-4b92-88d6-4e89759e1bd0-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:56:03 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-5a5a4fb5-c33b-4d09-b0ee-b5fbce1d7081 tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Acquiring lock "cinder-quobyte-8726b0fd-2553-4b92-88d6-4e89759e1bd0" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:56:03 devstack sudo[104392]: pam_unix(sudo:session): session closed for user root Sep 22 15:56:03 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-2f76bde3-92aa-458d-8291-b739b21c5feb tempest-CreateVolumesFromSnapshotTest-1406547820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-d3820c96-9deb-4ae6-9b3f-483f6264971e 1073741824" returned: 0 in 0.549s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:56:03 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-5a5a4fb5-c33b-4d09-b0ee-b5fbce1d7081 tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Lock "cinder-quobyte-8726b0fd-2553-4b92-88d6-4e89759e1bd0" acquired by "delete_volume" :: waited 0.018s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:56:03 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[8589dc69-4e9a-4986-b884-67c4d265a84a]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:56:03 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-5a5a4fb5-c33b-4d09-b0ee-b5fbce1d7081 tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8726b0fd-2553-4b92-88d6-4e89759e1bd0 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:56:03 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-2f76bde3-92aa-458d-8291-b739b21c5feb tempest-CreateVolumesFromSnapshotTest-1406547820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-d3820c96-9deb-4ae6-9b3f-483f6264971e {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:56:03 devstack sudo[104399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-d3820c96-9deb-4ae6-9b3f-483f6264971e Sep 22 15:56:03 devstack sudo[104399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:56:03 devstack sudo[104398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8726b0fd-2553-4b92-88d6-4e89759e1bd0 Sep 22 15:56:03 devstack sudo[104398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:56:04 devstack sudo[104399]: pam_unix(sudo:session): session closed for user root Sep 22 15:56:04 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-2f76bde3-92aa-458d-8291-b739b21c5feb tempest-CreateVolumesFromSnapshotTest-1406547820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-d3820c96-9deb-4ae6-9b3f-483f6264971e" returned: 0 in 0.247s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:56:04 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-2f76bde3-92aa-458d-8291-b739b21c5feb tempest-CreateVolumesFromSnapshotTest-1406547820 None] <== create_volume: return (865ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'} {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 15:56:04 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-2f76bde3-92aa-458d-8291-b739b21c5feb tempest-CreateVolumesFromSnapshotTest-1406547820 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.868s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:56:04 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-381afe4b-24b3-4c2d-902b-6c0dd67e5a8a tempest-VolumeAndVolumeTypeFromImageTest-1497179036 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.252s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:56:04 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-381afe4b-24b3-4c2d-902b-6c0dd67e5a8a tempest-VolumeAndVolumeTypeFromImageTest-1497179036 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:55:56Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31e65922-ec7e-4c0b-9cab-3a1e40bd084b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69fa55b4f15248f692c5b0fb8338dc68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:55:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:55:57Z,use_quota=True,user_id='03d15f3a929c4af2b73ca552b0488fa4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(708118da-3cfb-4cee-b506-528db8f5a937),volume_type_id=708118da-3cfb-4cee-b506-528db8f5a937)}" {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 15:56:04 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-381afe4b-24b3-4c2d-902b-6c0dd67e5a8a tempest-VolumeAndVolumeTypeFromImageTest-1497179036 None] Creating volume 31e65922-ec7e-4c0b-9cab-3a1e40bd084b {{(pid=86212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 15:56:04 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-381afe4b-24b3-4c2d-902b-6c0dd67e5a8a tempest-VolumeAndVolumeTypeFromImageTest-1497179036 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:56:04 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-381afe4b-24b3-4c2d-902b-6c0dd67e5a8a tempest-VolumeAndVolumeTypeFromImageTest-1497179036 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:56:04 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-381afe4b-24b3-4c2d-902b-6c0dd67e5a8a tempest-VolumeAndVolumeTypeFromImageTest-1497179036 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:56:04 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-381afe4b-24b3-4c2d-902b-6c0dd67e5a8a tempest-VolumeAndVolumeTypeFromImageTest-1497179036 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:56:04 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-381afe4b-24b3-4c2d-902b-6c0dd67e5a8a tempest-VolumeAndVolumeTypeFromImageTest-1497179036 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:56:04 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-381afe4b-24b3-4c2d-902b-6c0dd67e5a8a tempest-VolumeAndVolumeTypeFromImageTest-1497179036 None] Selected osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 as target Quobyte volume. {{(pid=86212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 15:56:04 devstack cinder-volume[86212]: INFO cinder.volume.drivers.remotefs [None req-381afe4b-24b3-4c2d-902b-6c0dd67e5a8a tempest-VolumeAndVolumeTypeFromImageTest-1497179036 None] casted to osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 Sep 22 15:56:04 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-381afe4b-24b3-4c2d-902b-6c0dd67e5a8a tempest-VolumeAndVolumeTypeFromImageTest-1497179036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-31e65922-ec7e-4c0b-9cab-3a1e40bd084b 1073741824 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:56:04 devstack sudo[104403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-31e65922-ec7e-4c0b-9cab-3a1e40bd084b 1073741824 Sep 22 15:56:04 devstack sudo[104403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:56:04 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-2f76bde3-92aa-458d-8291-b739b21c5feb tempest-CreateVolumesFromSnapshotTest-1406547820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (647d0f18-9732-4262-893b-725b188c2752) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d3820c96-9deb-4ae6-9b3f-483f6264971e', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:56:04 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-2f76bde3-92aa-458d-8291-b739b21c5feb tempest-CreateVolumesFromSnapshotTest-1406547820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aece73ed-8176-4921-b5d8-d6244d951139) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:56:04 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-2f76bde3-92aa-458d-8291-b739b21c5feb tempest-CreateVolumesFromSnapshotTest-1406547820 None] Volume volume-d3820c96-9deb-4ae6-9b3f-483f6264971e (d3820c96-9deb-4ae6-9b3f-483f6264971e): created successfully Sep 22 15:56:04 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-2f76bde3-92aa-458d-8291-b739b21c5feb tempest-CreateVolumesFromSnapshotTest-1406547820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aece73ed-8176-4921-b5d8-d6244d951139) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:56:04 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-2f76bde3-92aa-458d-8291-b739b21c5feb tempest-CreateVolumesFromSnapshotTest-1406547820 None] Flow 'volume_create_manager' (334e032f-b119-4510-aa8d-be4e3c821347) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:56:04 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-2f76bde3-92aa-458d-8291-b739b21c5feb tempest-CreateVolumesFromSnapshotTest-1406547820 None] Created volume successfully. Sep 22 15:56:04 devstack sudo[104398]: pam_unix(sudo:session): session closed for user root Sep 22 15:56:04 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-5a5a4fb5-c33b-4d09-b0ee-b5fbce1d7081 tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8726b0fd-2553-4b92-88d6-4e89759e1bd0" returned: 0 in 0.420s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:56:04 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-5a5a4fb5-c33b-4d09-b0ee-b5fbce1d7081 tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8726b0fd-2553-4b92-88d6-4e89759e1bd0 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:56:04 devstack sudo[104408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8726b0fd-2553-4b92-88d6-4e89759e1bd0 Sep 22 15:56:04 devstack sudo[104408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:56:04 devstack sudo[104408]: pam_unix(sudo:session): session closed for user root Sep 22 15:56:04 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-5a5a4fb5-c33b-4d09-b0ee-b5fbce1d7081 tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8726b0fd-2553-4b92-88d6-4e89759e1bd0" returned: 0 in 0.279s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:56:04 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-5a5a4fb5-c33b-4d09-b0ee-b5fbce1d7081 tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Lock "cinder-quobyte-8726b0fd-2553-4b92-88d6-4e89759e1bd0" released by "delete_volume" :: held 0.749s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:56:04 devstack sudo[104403]: pam_unix(sudo:session): session closed for user root Sep 22 15:56:04 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-381afe4b-24b3-4c2d-902b-6c0dd67e5a8a tempest-VolumeAndVolumeTypeFromImageTest-1497179036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-31e65922-ec7e-4c0b-9cab-3a1e40bd084b 1073741824" returned: 0 in 0.455s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:56:04 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-381afe4b-24b3-4c2d-902b-6c0dd67e5a8a tempest-VolumeAndVolumeTypeFromImageTest-1497179036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-31e65922-ec7e-4c0b-9cab-3a1e40bd084b {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:56:04 devstack cinder-volume[86212]: DEBUG cinder.quota [None req-5a5a4fb5-c33b-4d09-b0ee-b5fbce1d7081 tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Created reservations ['22f3916f-e84c-4428-a2a8-636c54dbcf23', '3e476238-e471-4672-a3d1-590f686c7b68', 'c7b3e983-537b-4234-a914-ae68ba6c4d86', '13c1b5cd-8d93-4ffd-83a5-79fa4899fe74'] {{(pid=86212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 15:56:04 devstack sudo[104415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-31e65922-ec7e-4c0b-9cab-3a1e40bd084b Sep 22 15:56:04 devstack sudo[104415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:56:04 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-5a5a4fb5-c33b-4d09-b0ee-b5fbce1d7081 tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:56:04 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-5a5a4fb5-c33b-4d09-b0ee-b5fbce1d7081 tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:56:04 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-5a5a4fb5-c33b-4d09-b0ee-b5fbce1d7081 tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:56:04 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-5a5a4fb5-c33b-4d09-b0ee-b5fbce1d7081 tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:56:04 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-5a5a4fb5-c33b-4d09-b0ee-b5fbce1d7081 tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:56:04 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-5a5a4fb5-c33b-4d09-b0ee-b5fbce1d7081 tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:56:04 devstack sudo[104417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc Sep 22 15:56:04 devstack sudo[104417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:56:04 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-ce667785-43bb-4126-8a6a-50b0b1c53bd5 tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Acquiring lock "cinder-41f4ec7e-b999-45fe-b57e-2e14f2038d40-delete_volume" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:56:04 devstack sudo[104415]: pam_unix(sudo:session): session closed for user root Sep 22 15:56:04 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-ce667785-43bb-4126-8a6a-50b0b1c53bd5 tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Lock "cinder-41f4ec7e-b999-45fe-b57e-2e14f2038d40-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:56:04 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-381afe4b-24b3-4c2d-902b-6c0dd67e5a8a tempest-VolumeAndVolumeTypeFromImageTest-1497179036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-31e65922-ec7e-4c0b-9cab-3a1e40bd084b" returned: 0 in 0.292s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:56:04 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-381afe4b-24b3-4c2d-902b-6c0dd67e5a8a tempest-VolumeAndVolumeTypeFromImageTest-1497179036 None] <== create_volume: return (809ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'} {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 15:56:04 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-381afe4b-24b3-4c2d-902b-6c0dd67e5a8a tempest-VolumeAndVolumeTypeFromImageTest-1497179036 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.814s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:56:04 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-8cb35e3f-70b5-4f12-b1be-f0517aa63ca2 tempest-CinderUnicodeTest-1397280805 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.969s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:56:04 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-8cb35e3f-70b5-4f12-b1be-f0517aa63ca2 tempest-CinderUnicodeTest-1397280805 None] Creating offline snapshot c9232961-4829-41df-8e68-12dd902fce25 of volume accee605-2de3-4951-8c31-f7c00c4c3b75 {{(pid=86212) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 22 15:56:04 devstack cinder-volume[86212]: DEBUG cinder.volume.volume_utils [None req-381afe4b-24b3-4c2d-902b-6c0dd67e5a8a tempest-VolumeAndVolumeTypeFromImageTest-1497179036 None] Attempting download of 45204c59-273c-4bf1-ac4c-99a20c887aa8 ((None, [{'url': 'file:///opt/stack/data/glance/images/45204c59-273c-4bf1-ac4c-99a20c887aa8', 'metadata': {}}])) to volume 31e65922-ec7e-4c0b-9cab-3a1e40bd084b. {{(pid=86212) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 22 15:56:04 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[25e9ec32-373f-49b7-9998-30e867a84e17]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:56:04 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-8cb35e3f-70b5-4f12-b1be-f0517aa63ca2 tempest-CinderUnicodeTest-1397280805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-accee605-2de3-4951-8c31-f7c00c4c3b75 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:56:04 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-ce667785-43bb-4126-8a6a-50b0b1c53bd5 tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Acquiring lock "cinder-quobyte-41f4ec7e-b999-45fe-b57e-2e14f2038d40" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:56:04 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-ce667785-43bb-4126-8a6a-50b0b1c53bd5 tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Lock "cinder-quobyte-41f4ec7e-b999-45fe-b57e-2e14f2038d40" acquired by "delete_volume" :: waited 0.032s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:56:05 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[9689afff-7099-48de-a73d-5d5bdb4b6d17]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:56:05 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-ce667785-43bb-4126-8a6a-50b0b1c53bd5 tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-41f4ec7e-b999-45fe-b57e-2e14f2038d40 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:56:05 devstack sudo[104417]: pam_unix(sudo:session): session closed for user root Sep 22 15:56:05 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-5a5a4fb5-c33b-4d09-b0ee-b5fbce1d7081 tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc" returned: 0 in 0.369s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:56:05 devstack cinder-volume[86212]: DEBUG cinder.manager [None req-5a5a4fb5-c33b-4d09-b0ee-b5fbce1d7081 tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Notifying Schedulers of capabilities ... {{(pid=86212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 15:56:05 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-5a5a4fb5-c33b-4d09-b0ee-b5fbce1d7081 tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Deleted volume successfully. Sep 22 15:56:05 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce25c29a-df54-4b32-9199-a1a42f1e03ad]: (4, 'raw') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:56:05 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-381afe4b-24b3-4c2d-902b-6c0dd67e5a8a tempest-VolumeAndVolumeTypeFromImageTest-1497179036 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_45204c59-273c-4bf1-ac4c-99a20c887aa8_t83cxfaw {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:56:05 devstack sudo[104420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-accee605-2de3-4951-8c31-f7c00c4c3b75 Sep 22 15:56:05 devstack sudo[104420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:56:05 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-5a5a4fb5-c33b-4d09-b0ee-b5fbce1d7081 tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Lock "cinder-8726b0fd-2553-4b92-88d6-4e89759e1bd0-delete_volume" released by "delete_volume" :: held 1.418s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:56:05 devstack sudo[104422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-41f4ec7e-b999-45fe-b57e-2e14f2038d40 Sep 22 15:56:05 devstack sudo[104422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:56:05 devstack sudo[104424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_45204c59-273c-4bf1-ac4c-99a20c887aa8_t83cxfaw Sep 22 15:56:05 devstack sudo[104424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:56:05 devstack sudo[104420]: pam_unix(sudo:session): session closed for user root Sep 22 15:56:05 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-8cb35e3f-70b5-4f12-b1be-f0517aa63ca2 tempest-CinderUnicodeTest-1397280805 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-accee605-2de3-4951-8c31-f7c00c4c3b75" returned: 0 in 0.423s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:56:05 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-8cb35e3f-70b5-4f12-b1be-f0517aa63ca2 tempest-CinderUnicodeTest-1397280805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-accee605-2de3-4951-8c31-f7c00c4c3b75,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-accee605-2de3-4951-8c31-f7c00c4c3b75.c9232961-4829-41df-8e68-12dd902fce25 1G {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:56:05 devstack sudo[104430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-accee605-2de3-4951-8c31-f7c00c4c3b75,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-accee605-2de3-4951-8c31-f7c00c4c3b75.c9232961-4829-41df-8e68-12dd902fce25 1G Sep 22 15:56:05 devstack sudo[104430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:56:05 devstack sudo[104424]: pam_unix(sudo:session): session closed for user root Sep 22 15:56:05 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-381afe4b-24b3-4c2d-902b-6c0dd67e5a8a tempest-VolumeAndVolumeTypeFromImageTest-1497179036 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_45204c59-273c-4bf1-ac4c-99a20c887aa8_t83cxfaw" returned: 0 in 0.365s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:56:05 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-381afe4b-24b3-4c2d-902b-6c0dd67e5a8a tempest-VolumeAndVolumeTypeFromImageTest-1497179036 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_45204c59-273c-4bf1-ac4c-99a20c887aa8_t83cxfaw {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:56:05 devstack sudo[104422]: pam_unix(sudo:session): session closed for user root Sep 22 15:56:05 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-ce667785-43bb-4126-8a6a-50b0b1c53bd5 tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-41f4ec7e-b999-45fe-b57e-2e14f2038d40" returned: 0 in 0.449s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:56:05 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-ce667785-43bb-4126-8a6a-50b0b1c53bd5 tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-41f4ec7e-b999-45fe-b57e-2e14f2038d40 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:56:05 devstack sudo[104439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-41f4ec7e-b999-45fe-b57e-2e14f2038d40 Sep 22 15:56:05 devstack sudo[104439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:56:05 devstack sudo[104438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_45204c59-273c-4bf1-ac4c-99a20c887aa8_t83cxfaw Sep 22 15:56:05 devstack sudo[104438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:56:05 devstack sudo[104439]: pam_unix(sudo:session): session closed for user root Sep 22 15:56:05 devstack sudo[104438]: pam_unix(sudo:session): session closed for user root Sep 22 15:56:05 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-ce667785-43bb-4126-8a6a-50b0b1c53bd5 tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-41f4ec7e-b999-45fe-b57e-2e14f2038d40" returned: 0 in 0.317s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:56:05 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-381afe4b-24b3-4c2d-902b-6c0dd67e5a8a tempest-VolumeAndVolumeTypeFromImageTest-1497179036 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_45204c59-273c-4bf1-ac4c-99a20c887aa8_t83cxfaw" returned: 1 in 0.365s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:56:05 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-381afe4b-24b3-4c2d-902b-6c0dd67e5a8a tempest-VolumeAndVolumeTypeFromImageTest-1497179036 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_45204c59-273c-4bf1-ac4c-99a20c887aa8_t83cxfaw' failed. Not Retrying. {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 22 15:56:05 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-ce667785-43bb-4126-8a6a-50b0b1c53bd5 tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Lock "cinder-quobyte-41f4ec7e-b999-45fe-b57e-2e14f2038d40" released by "delete_volume" :: held 0.833s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:56:05 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[5078088d-ce8c-40c2-9f1e-82af6df9789b]: (4, 'raw') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:56:05 devstack sudo[104430]: pam_unix(sudo:session): session closed for user root Sep 22 15:56:05 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-381afe4b-24b3-4c2d-902b-6c0dd67e5a8a tempest-VolumeAndVolumeTypeFromImageTest-1497179036 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_45204c59-273c-4bf1-ac4c-99a20c887aa8_f9mczlpddevstack@QuobyteHD {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:56:05 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-8cb35e3f-70b5-4f12-b1be-f0517aa63ca2 tempest-CinderUnicodeTest-1397280805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-accee605-2de3-4951-8c31-f7c00c4c3b75,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-accee605-2de3-4951-8c31-f7c00c4c3b75.c9232961-4829-41df-8e68-12dd902fce25 1G" returned: 0 in 0.475s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:56:05 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-8cb35e3f-70b5-4f12-b1be-f0517aa63ca2 tempest-CinderUnicodeTest-1397280805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-accee605-2de3-4951-8c31-f7c00c4c3b75 -F qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-accee605-2de3-4951-8c31-f7c00c4c3b75.c9232961-4829-41df-8e68-12dd902fce25 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:56:05 devstack sudo[104450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-accee605-2de3-4951-8c31-f7c00c4c3b75 -F qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-accee605-2de3-4951-8c31-f7c00c4c3b75.c9232961-4829-41df-8e68-12dd902fce25 Sep 22 15:56:05 devstack sudo[104450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:56:05 devstack cinder-volume[86212]: DEBUG cinder.quota [None req-ce667785-43bb-4126-8a6a-50b0b1c53bd5 tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Created reservations ['80ce8185-8533-47a5-bf19-6c95a0bef411', 'd41ed5f1-ebdc-4352-9108-c5290612e9e5', '50de22aa-6a7e-47c7-9c65-1519d45c6335', '26cb9edc-bd15-49dc-bb8b-19f0b256ef74'] {{(pid=86212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 15:56:05 devstack sudo[104449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_45204c59-273c-4bf1-ac4c-99a20c887aa8_f9mczlpddevstack@QuobyteHD Sep 22 15:56:05 devstack sudo[104449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:56:05 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-ce667785-43bb-4126-8a6a-50b0b1c53bd5 tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:56:05 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-ce667785-43bb-4126-8a6a-50b0b1c53bd5 tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:56:05 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-ce667785-43bb-4126-8a6a-50b0b1c53bd5 tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:56:05 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-ce667785-43bb-4126-8a6a-50b0b1c53bd5 tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:56:05 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-ce667785-43bb-4126-8a6a-50b0b1c53bd5 tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:56:05 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-ce667785-43bb-4126-8a6a-50b0b1c53bd5 tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:56:06 devstack sudo[104453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc Sep 22 15:56:06 devstack sudo[104453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:56:06 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-6f3e183c-711a-438c-9374-d5310c457cd3 tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Acquiring lock "cinder-c9386d4f-ad27-40af-b7eb-493dd23002dd-delete_volume" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:56:06 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-6f3e183c-711a-438c-9374-d5310c457cd3 tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Lock "cinder-c9386d4f-ad27-40af-b7eb-493dd23002dd-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:56:06 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-6f3e183c-711a-438c-9374-d5310c457cd3 tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Acquiring lock "cinder-quobyte-c9386d4f-ad27-40af-b7eb-493dd23002dd" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:56:06 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-6f3e183c-711a-438c-9374-d5310c457cd3 tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Lock "cinder-quobyte-c9386d4f-ad27-40af-b7eb-493dd23002dd" acquired by "delete_volume" :: waited 0.020s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:56:06 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[45725f64-a452-4086-91fe-36da11d65eb6]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:56:06 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-6f3e183c-711a-438c-9374-d5310c457cd3 tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-c9386d4f-ad27-40af-b7eb-493dd23002dd {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:56:06 devstack sudo[104450]: pam_unix(sudo:session): session closed for user root Sep 22 15:56:06 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-8cb35e3f-70b5-4f12-b1be-f0517aa63ca2 tempest-CinderUnicodeTest-1397280805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-accee605-2de3-4951-8c31-f7c00c4c3b75 -F qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-accee605-2de3-4951-8c31-f7c00c4c3b75.c9232961-4829-41df-8e68-12dd902fce25" returned: 0 in 0.390s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:56:06 devstack cinder-volume[86212]: WARNING cinder.volume.drivers.remotefs [None req-8cb35e3f-70b5-4f12-b1be-f0517aa63ca2 tempest-CinderUnicodeTest-1397280805 None] /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-accee605-2de3-4951-8c31-f7c00c4c3b75.c9232961-4829-41df-8e68-12dd902fce25 is being set with open permissions: ugo+rw Sep 22 15:56:06 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-8cb35e3f-70b5-4f12-b1be-f0517aa63ca2 tempest-CinderUnicodeTest-1397280805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-accee605-2de3-4951-8c31-f7c00c4c3b75.c9232961-4829-41df-8e68-12dd902fce25 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:56:06 devstack sudo[104449]: pam_unix(sudo:session): session closed for user root Sep 22 15:56:06 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-381afe4b-24b3-4c2d-902b-6c0dd67e5a8a tempest-VolumeAndVolumeTypeFromImageTest-1497179036 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_45204c59-273c-4bf1-ac4c-99a20c887aa8_f9mczlpddevstack@QuobyteHD" returned: 0 in 0.434s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:56:06 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-381afe4b-24b3-4c2d-902b-6c0dd67e5a8a tempest-VolumeAndVolumeTypeFromImageTest-1497179036 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_45204c59-273c-4bf1-ac4c-99a20c887aa8_f9mczlpddevstack@QuobyteHD {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:56:06 devstack sudo[104461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-accee605-2de3-4951-8c31-f7c00c4c3b75.c9232961-4829-41df-8e68-12dd902fce25 Sep 22 15:56:06 devstack sudo[104461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:56:06 devstack sudo[104458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-c9386d4f-ad27-40af-b7eb-493dd23002dd Sep 22 15:56:06 devstack sudo[104458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:56:06 devstack sudo[104453]: pam_unix(sudo:session): session closed for user root Sep 22 15:56:06 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-ce667785-43bb-4126-8a6a-50b0b1c53bd5 tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc" returned: 0 in 0.348s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:56:06 devstack cinder-volume[86212]: DEBUG cinder.manager [None req-ce667785-43bb-4126-8a6a-50b0b1c53bd5 tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Notifying Schedulers of capabilities ... {{(pid=86212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 15:56:06 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-ce667785-43bb-4126-8a6a-50b0b1c53bd5 tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Deleted volume successfully. Sep 22 15:56:06 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-ce667785-43bb-4126-8a6a-50b0b1c53bd5 tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Lock "cinder-41f4ec7e-b999-45fe-b57e-2e14f2038d40-delete_volume" released by "delete_volume" :: held 1.511s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:56:06 devstack sudo[104463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_45204c59-273c-4bf1-ac4c-99a20c887aa8_f9mczlpddevstack@QuobyteHD Sep 22 15:56:06 devstack sudo[104463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:56:06 devstack sudo[104461]: pam_unix(sudo:session): session closed for user root Sep 22 15:56:06 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-8cb35e3f-70b5-4f12-b1be-f0517aa63ca2 tempest-CinderUnicodeTest-1397280805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-accee605-2de3-4951-8c31-f7c00c4c3b75.c9232961-4829-41df-8e68-12dd902fce25" returned: 0 in 0.263s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:56:06 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-8cb35e3f-70b5-4f12-b1be-f0517aa63ca2 tempest-CinderUnicodeTest-1397280805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-accee605-2de3-4951-8c31-f7c00c4c3b75.info {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:56:06 devstack sudo[104468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-accee605-2de3-4951-8c31-f7c00c4c3b75.info Sep 22 15:56:06 devstack sudo[104468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:56:06 devstack sudo[104463]: pam_unix(sudo:session): session closed for user root Sep 22 15:56:06 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-381afe4b-24b3-4c2d-902b-6c0dd67e5a8a tempest-VolumeAndVolumeTypeFromImageTest-1497179036 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_45204c59-273c-4bf1-ac4c-99a20c887aa8_f9mczlpddevstack@QuobyteHD" returned: 1 in 0.361s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:56:06 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-381afe4b-24b3-4c2d-902b-6c0dd67e5a8a tempest-VolumeAndVolumeTypeFromImageTest-1497179036 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_45204c59-273c-4bf1-ac4c-99a20c887aa8_f9mczlpddevstack@QuobyteHD' failed. Not Retrying. {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 22 15:56:06 devstack cinder-volume[86212]: DEBUG cinder.image.image_utils [None req-381afe4b-24b3-4c2d-902b-6c0dd67e5a8a tempest-VolumeAndVolumeTypeFromImageTest-1497179036 None] 45204c59-273c-4bf1-ac4c-99a20c887aa8 was raw, converting to qcow2 {{(pid=86212) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 22 15:56:06 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-381afe4b-24b3-4c2d-902b-6c0dd67e5a8a tempest-VolumeAndVolumeTypeFromImageTest-1497179036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_45204c59-273c-4bf1-ac4c-99a20c887aa8_f9mczlpddevstack@QuobyteHD /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-31e65922-ec7e-4c0b-9cab-3a1e40bd084b {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:56:06 devstack sudo[104458]: pam_unix(sudo:session): session closed for user root Sep 22 15:56:06 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-6f3e183c-711a-438c-9374-d5310c457cd3 tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-c9386d4f-ad27-40af-b7eb-493dd23002dd" returned: 0 in 0.453s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:56:06 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-6f3e183c-711a-438c-9374-d5310c457cd3 tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-c9386d4f-ad27-40af-b7eb-493dd23002dd {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:56:06 devstack sudo[104476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_45204c59-273c-4bf1-ac4c-99a20c887aa8_f9mczlpddevstack@QuobyteHD /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-31e65922-ec7e-4c0b-9cab-3a1e40bd084b Sep 22 15:56:06 devstack sudo[104476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:56:06 devstack sudo[104477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-c9386d4f-ad27-40af-b7eb-493dd23002dd Sep 22 15:56:06 devstack sudo[104477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:56:06 devstack sudo[104468]: pam_unix(sudo:session): session closed for user root Sep 22 15:56:06 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-8cb35e3f-70b5-4f12-b1be-f0517aa63ca2 tempest-CinderUnicodeTest-1397280805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-accee605-2de3-4951-8c31-f7c00c4c3b75.info" returned: 0 in 0.291s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:56:06 devstack cinder-volume[86212]: WARNING cinder.volume.drivers.remotefs [None req-8cb35e3f-70b5-4f12-b1be-f0517aa63ca2 tempest-CinderUnicodeTest-1397280805 None] /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-accee605-2de3-4951-8c31-f7c00c4c3b75.info is being set with open permissions: ugo+rw Sep 22 15:56:06 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-8cb35e3f-70b5-4f12-b1be-f0517aa63ca2 tempest-CinderUnicodeTest-1397280805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-accee605-2de3-4951-8c31-f7c00c4c3b75.info {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:56:06 devstack sudo[104481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-accee605-2de3-4951-8c31-f7c00c4c3b75.info Sep 22 15:56:06 devstack sudo[104481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:56:06 devstack sudo[104477]: pam_unix(sudo:session): session closed for user root Sep 22 15:56:06 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-6f3e183c-711a-438c-9374-d5310c457cd3 tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-c9386d4f-ad27-40af-b7eb-493dd23002dd" returned: 0 in 0.289s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:56:06 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-6f3e183c-711a-438c-9374-d5310c457cd3 tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Lock "cinder-quobyte-c9386d4f-ad27-40af-b7eb-493dd23002dd" released by "delete_volume" :: held 0.792s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:56:07 devstack cinder-volume[86212]: DEBUG cinder.quota [None req-6f3e183c-711a-438c-9374-d5310c457cd3 tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Created reservations ['8a14972a-6a91-43da-ad0b-32d21973a187', 'd3880922-6b6f-4413-949c-5265720e54bc', 'e51366b1-a125-4237-861a-782ead006821', '41369168-f45d-4305-9371-7b09627e5302'] {{(pid=86212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 15:56:07 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-6f3e183c-711a-438c-9374-d5310c457cd3 tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:56:07 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-6f3e183c-711a-438c-9374-d5310c457cd3 tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:56:07 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-6f3e183c-711a-438c-9374-d5310c457cd3 tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:56:07 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-6f3e183c-711a-438c-9374-d5310c457cd3 tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:56:07 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-6f3e183c-711a-438c-9374-d5310c457cd3 tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:56:07 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-6f3e183c-711a-438c-9374-d5310c457cd3 tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:56:07 devstack sudo[104481]: pam_unix(sudo:session): session closed for user root Sep 22 15:56:07 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-8cb35e3f-70b5-4f12-b1be-f0517aa63ca2 tempest-CinderUnicodeTest-1397280805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-accee605-2de3-4951-8c31-f7c00c4c3b75.info" returned: 0 in 0.279s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:56:07 devstack sudo[104488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc Sep 22 15:56:07 devstack sudo[104488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:56:07 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-8cb35e3f-70b5-4f12-b1be-f0517aa63ca2 tempest-CinderUnicodeTest-1397280805 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.242s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:56:07 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-e3817280-7723-419f-bdde-f0a585a615d9 tempest-CreateVolumesFromSnapshotTest-1406547820 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.867s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:56:07 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-e3817280-7723-419f-bdde-f0a585a615d9 tempest-CreateVolumesFromSnapshotTest-1406547820 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:56:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-835090313',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a70bc76d-af4c-4af6-ab46-3400d84760a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='117f5def5f6948089fe793e13bded5d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:56:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:56:00Z,use_quota=True,user_id='f351156bd1214328bced88784864ce1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)}" {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 15:56:07 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-e3817280-7723-419f-bdde-f0a585a615d9 tempest-CreateVolumesFromSnapshotTest-1406547820 None] Creating volume a70bc76d-af4c-4af6-ab46-3400d84760a7 {{(pid=86212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 15:56:07 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-e3817280-7723-419f-bdde-f0a585a615d9 tempest-CreateVolumesFromSnapshotTest-1406547820 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:56:07 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-e3817280-7723-419f-bdde-f0a585a615d9 tempest-CreateVolumesFromSnapshotTest-1406547820 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:56:07 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-e3817280-7723-419f-bdde-f0a585a615d9 tempest-CreateVolumesFromSnapshotTest-1406547820 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:56:07 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-e3817280-7723-419f-bdde-f0a585a615d9 tempest-CreateVolumesFromSnapshotTest-1406547820 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:56:07 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-e3817280-7723-419f-bdde-f0a585a615d9 tempest-CreateVolumesFromSnapshotTest-1406547820 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:56:07 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-e3817280-7723-419f-bdde-f0a585a615d9 tempest-CreateVolumesFromSnapshotTest-1406547820 None] Selected osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 as target Quobyte volume. {{(pid=86212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 15:56:07 devstack cinder-volume[86212]: INFO cinder.volume.drivers.remotefs [None req-e3817280-7723-419f-bdde-f0a585a615d9 tempest-CreateVolumesFromSnapshotTest-1406547820 None] casted to osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 Sep 22 15:56:07 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-e3817280-7723-419f-bdde-f0a585a615d9 tempest-CreateVolumesFromSnapshotTest-1406547820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a70bc76d-af4c-4af6-ab46-3400d84760a7 1073741824 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:56:07 devstack sudo[104476]: pam_unix(sudo:session): session closed for user root Sep 22 15:56:07 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-381afe4b-24b3-4c2d-902b-6c0dd67e5a8a tempest-VolumeAndVolumeTypeFromImageTest-1497179036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_45204c59-273c-4bf1-ac4c-99a20c887aa8_f9mczlpddevstack@QuobyteHD /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-31e65922-ec7e-4c0b-9cab-3a1e40bd084b" returned: 0 in 0.524s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:56:07 devstack cinder-volume[86212]: DEBUG cinder.image.image_utils [None req-381afe4b-24b3-4c2d-902b-6c0dd67e5a8a tempest-VolumeAndVolumeTypeFromImageTest-1497179036 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_45204c59-273c-4bf1-ac4c-99a20c887aa8_f9mczlpddevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-31e65922-ec7e-4c0b-9cab-3a1e40bd084b {{(pid=86212) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 22 15:56:07 devstack cinder-volume[86212]: INFO cinder.image.image_utils [None req-381afe4b-24b3-4c2d-902b-6c0dd67e5a8a tempest-VolumeAndVolumeTypeFromImageTest-1497179036 None] Converted 0.00 MB image at 0.00 MB/s Sep 22 15:56:07 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-381afe4b-24b3-4c2d-902b-6c0dd67e5a8a tempest-VolumeAndVolumeTypeFromImageTest-1497179036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-31e65922-ec7e-4c0b-9cab-3a1e40bd084b 1G {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:56:07 devstack sudo[104490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a70bc76d-af4c-4af6-ab46-3400d84760a7 1073741824 Sep 22 15:56:07 devstack sudo[104490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:56:07 devstack sudo[104492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-31e65922-ec7e-4c0b-9cab-3a1e40bd084b 1G Sep 22 15:56:07 devstack sudo[104492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:56:07 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-8cb35e3f-70b5-4f12-b1be-f0517aa63ca2 tempest-CinderUnicodeTest-1397280805 None] Create snapshot completed successfully Sep 22 15:56:07 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-35a4043a-c729-474a-9359-bdbba9738b90 tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Acquiring lock "cinder-2f3b5234-b299-41e4-b304-73a8438da7d2-delete_volume" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:56:07 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-35a4043a-c729-474a-9359-bdbba9738b90 tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Lock "cinder-2f3b5234-b299-41e4-b304-73a8438da7d2-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:56:07 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-35a4043a-c729-474a-9359-bdbba9738b90 tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Acquiring lock "cinder-quobyte-2f3b5234-b299-41e4-b304-73a8438da7d2" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:56:07 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-35a4043a-c729-474a-9359-bdbba9738b90 tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Lock "cinder-quobyte-2f3b5234-b299-41e4-b304-73a8438da7d2" acquired by "delete_volume" :: waited 0.044s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:56:07 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-7c344764-cf4e-4880-aaec-6e8bf8b74000 tempest-CinderUnicodeTest-1397280805 None] Acquiring lock "cinder-c9232961-4829-41df-8e68-12dd902fce25-delete_snapshot" by "delete_snapshot" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:56:07 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[82e4b033-e032-49ab-954d-f73ff5033ded]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:56:07 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-35a4043a-c729-474a-9359-bdbba9738b90 tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2f3b5234-b299-41e4-b304-73a8438da7d2 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:56:07 devstack sudo[104488]: pam_unix(sudo:session): session closed for user root Sep 22 15:56:07 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-6f3e183c-711a-438c-9374-d5310c457cd3 tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc" returned: 0 in 0.462s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:56:07 devstack cinder-volume[86212]: DEBUG cinder.manager [None req-6f3e183c-711a-438c-9374-d5310c457cd3 tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Notifying Schedulers of capabilities ... {{(pid=86212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 15:56:07 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-6f3e183c-711a-438c-9374-d5310c457cd3 tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Deleted volume successfully. Sep 22 15:56:07 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-7c344764-cf4e-4880-aaec-6e8bf8b74000 tempest-CinderUnicodeTest-1397280805 None] Lock "cinder-c9232961-4829-41df-8e68-12dd902fce25-delete_snapshot" acquired by "delete_snapshot" :: waited 0.090s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:56:07 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-7c344764-cf4e-4880-aaec-6e8bf8b74000 tempest-CinderUnicodeTest-1397280805 None] Acquiring lock "cinder-quobyte-accee605-2de3-4951-8c31-f7c00c4c3b75" by "delete_snapshot" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:56:07 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-6f3e183c-711a-438c-9374-d5310c457cd3 tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Lock "cinder-c9386d4f-ad27-40af-b7eb-493dd23002dd-delete_volume" released by "delete_volume" :: held 1.542s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:56:07 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-7c344764-cf4e-4880-aaec-6e8bf8b74000 tempest-CinderUnicodeTest-1397280805 None] Lock "cinder-quobyte-accee605-2de3-4951-8c31-f7c00c4c3b75" acquired by "delete_snapshot" :: waited 0.034s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:56:07 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-7c344764-cf4e-4880-aaec-6e8bf8b74000 tempest-CinderUnicodeTest-1397280805 None] Acquiring lock "cinder-quobyte-c9232961-4829-41df-8e68-12dd902fce25" by "_delete_snapshot" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:56:07 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-7c344764-cf4e-4880-aaec-6e8bf8b74000 tempest-CinderUnicodeTest-1397280805 None] Lock "cinder-quobyte-c9232961-4829-41df-8e68-12dd902fce25" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:56:07 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-7c344764-cf4e-4880-aaec-6e8bf8b74000 tempest-CinderUnicodeTest-1397280805 None] Deleting offline snapshot c9232961-4829-41df-8e68-12dd902fce25 of volume accee605-2de3-4951-8c31-f7c00c4c3b75 {{(pid=86212) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 22 15:56:07 devstack sudo[104501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2f3b5234-b299-41e4-b304-73a8438da7d2 Sep 22 15:56:07 devstack sudo[104501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:56:07 devstack sudo[104492]: pam_unix(sudo:session): session closed for user root Sep 22 15:56:07 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-7c344764-cf4e-4880-aaec-6e8bf8b74000 tempest-CinderUnicodeTest-1397280805 None] snapshot_file for this snap is: volume-accee605-2de3-4951-8c31-f7c00c4c3b75.c9232961-4829-41df-8e68-12dd902fce25 {{(pid=86212) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 22 15:56:07 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-381afe4b-24b3-4c2d-902b-6c0dd67e5a8a tempest-VolumeAndVolumeTypeFromImageTest-1497179036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-31e65922-ec7e-4c0b-9cab-3a1e40bd084b 1G" returned: 0 in 0.523s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:56:07 devstack cinder-volume[86212]: DEBUG cinder.volume.volume_utils [None req-381afe4b-24b3-4c2d-902b-6c0dd67e5a8a tempest-VolumeAndVolumeTypeFromImageTest-1497179036 None] Downloaded image 45204c59-273c-4bf1-ac4c-99a20c887aa8 ((None, [{'url': 'file:///opt/stack/data/glance/images/45204c59-273c-4bf1-ac4c-99a20c887aa8', 'metadata': {}}])) to volume 31e65922-ec7e-4c0b-9cab-3a1e40bd084b successfully. {{(pid=86212) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 22 15:56:07 devstack cinder-volume[86212]: DEBUG cinder.image.image_utils [None req-381afe4b-24b3-4c2d-902b-6c0dd67e5a8a tempest-VolumeAndVolumeTypeFromImageTest-1497179036 None] Temporary image 45204c59-273c-4bf1-ac4c-99a20c887aa8 for user 03d15f3a929c4af2b73ca552b0488fa4 is deleted. {{(pid=86212) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 22 15:56:07 devstack cinder-volume[86212]: DEBUG cinder.volume.volume_utils [None req-381afe4b-24b3-4c2d-902b-6c0dd67e5a8a tempest-VolumeAndVolumeTypeFromImageTest-1497179036 None] Marking volume 31e65922-ec7e-4c0b-9cab-3a1e40bd084b as bootable. {{(pid=86212) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 22 15:56:07 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[607aa2b8-373b-4976-8721-2d7dba8abd50]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:56:07 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-7c344764-cf4e-4880-aaec-6e8bf8b74000 tempest-CinderUnicodeTest-1397280805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-accee605-2de3-4951-8c31-f7c00c4c3b75.c9232961-4829-41df-8e68-12dd902fce25 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:56:07 devstack cinder-volume[86212]: DEBUG cinder.volume.flows.manager.create_volume [None req-381afe4b-24b3-4c2d-902b-6c0dd67e5a8a tempest-VolumeAndVolumeTypeFromImageTest-1497179036 None] Copying metadata from image 45204c59-273c-4bf1-ac4c-99a20c887aa8 to 31e65922-ec7e-4c0b-9cab-3a1e40bd084b. {{(pid=86212) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 22 15:56:07 devstack cinder-volume[86212]: DEBUG cinder.volume.flows.manager.create_volume [None req-381afe4b-24b3-4c2d-902b-6c0dd67e5a8a tempest-VolumeAndVolumeTypeFromImageTest-1497179036 None] Creating volume glance metadata for volume 31e65922-ec7e-4c0b-9cab-3a1e40bd084b backed by image 45204c59-273c-4bf1-ac4c-99a20c887aa8 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '45204c59-273c-4bf1-ac4c-99a20c887aa8', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'bca72b425eb26b6898289841a182add2', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86212) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 22 15:56:07 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-381afe4b-24b3-4c2d-902b-6c0dd67e5a8a tempest-VolumeAndVolumeTypeFromImageTest-1497179036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32a88aa8-8747-4bd1-801b-1f4972bb7ee5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-31e65922-ec7e-4c0b-9cab-3a1e40bd084b', 'volume_size': 1, 'image_id': '45204c59-273c-4bf1-ac4c-99a20c887aa8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/45204c59-273c-4bf1-ac4c-99a20c887aa8', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'bca72b425eb26b6898289841a182add2', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '69fa55b4f15248f692c5b0fb8338dc68', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'e86b393dcb8e04f06a35ebcf29bc3f9c9e58509501dd9226e0af298665c00d47f7a52317b55fe57cb5b981882788c5dca87c64aeb4e408d0efad10ed4c9c6f35', 'id': '45204c59-273c-4bf1-ac4c-99a20c887aa8', 'created_at': datetime.datetime(2026, 9, 22, 13, 55, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 13, 55, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/45204c59-273c-4bf1-ac4c-99a20c887aa8/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:56:07 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-381afe4b-24b3-4c2d-902b-6c0dd67e5a8a tempest-VolumeAndVolumeTypeFromImageTest-1497179036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f6d29ff-c7f8-424f-a7e5-d0b283653146) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:56:07 devstack sudo[104503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-accee605-2de3-4951-8c31-f7c00c4c3b75.c9232961-4829-41df-8e68-12dd902fce25 Sep 22 15:56:07 devstack sudo[104503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:56:07 devstack sudo[104490]: pam_unix(sudo:session): session closed for user root Sep 22 15:56:07 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-e3817280-7723-419f-bdde-f0a585a615d9 tempest-CreateVolumesFromSnapshotTest-1406547820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a70bc76d-af4c-4af6-ab46-3400d84760a7 1073741824" returned: 0 in 0.746s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:56:07 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-381afe4b-24b3-4c2d-902b-6c0dd67e5a8a tempest-VolumeAndVolumeTypeFromImageTest-1497179036 None] Volume volume-31e65922-ec7e-4c0b-9cab-3a1e40bd084b (31e65922-ec7e-4c0b-9cab-3a1e40bd084b): created successfully Sep 22 15:56:07 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-381afe4b-24b3-4c2d-902b-6c0dd67e5a8a tempest-VolumeAndVolumeTypeFromImageTest-1497179036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f6d29ff-c7f8-424f-a7e5-d0b283653146) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:56:07 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-381afe4b-24b3-4c2d-902b-6c0dd67e5a8a tempest-VolumeAndVolumeTypeFromImageTest-1497179036 None] Flow 'volume_create_manager' (087485aa-6d51-4fae-b13e-859479c4f140) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:56:07 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-381afe4b-24b3-4c2d-902b-6c0dd67e5a8a tempest-VolumeAndVolumeTypeFromImageTest-1497179036 None] Created volume successfully. Sep 22 15:56:07 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-e3817280-7723-419f-bdde-f0a585a615d9 tempest-CreateVolumesFromSnapshotTest-1406547820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a70bc76d-af4c-4af6-ab46-3400d84760a7 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:56:07 devstack sudo[104510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a70bc76d-af4c-4af6-ab46-3400d84760a7 Sep 22 15:56:07 devstack sudo[104510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:56:08 devstack sudo[104501]: pam_unix(sudo:session): session closed for user root Sep 22 15:56:08 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-35a4043a-c729-474a-9359-bdbba9738b90 tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2f3b5234-b299-41e4-b304-73a8438da7d2" returned: 0 in 0.513s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:56:08 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-35a4043a-c729-474a-9359-bdbba9738b90 tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2f3b5234-b299-41e4-b304-73a8438da7d2 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:56:08 devstack sudo[104512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2f3b5234-b299-41e4-b304-73a8438da7d2 Sep 22 15:56:08 devstack sudo[104512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:56:08 devstack sudo[104503]: pam_unix(sudo:session): session closed for user root Sep 22 15:56:08 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-7c344764-cf4e-4880-aaec-6e8bf8b74000 tempest-CinderUnicodeTest-1397280805 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-accee605-2de3-4951-8c31-f7c00c4c3b75.c9232961-4829-41df-8e68-12dd902fce25" returned: 0 in 0.468s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:56:08 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-7c344764-cf4e-4880-aaec-6e8bf8b74000 tempest-CinderUnicodeTest-1397280805 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-accee605-2de3-4951-8c31-f7c00c4c3b75(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86212) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 22 15:56:08 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[0697a0cc-0217-4934-8216-d3518fec8285]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:56:08 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-7c344764-cf4e-4880-aaec-6e8bf8b74000 tempest-CinderUnicodeTest-1397280805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-accee605-2de3-4951-8c31-f7c00c4c3b75 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:56:08 devstack sudo[104510]: pam_unix(sudo:session): session closed for user root Sep 22 15:56:08 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-e3817280-7723-419f-bdde-f0a585a615d9 tempest-CreateVolumesFromSnapshotTest-1406547820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a70bc76d-af4c-4af6-ab46-3400d84760a7" returned: 0 in 0.295s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:56:08 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-e3817280-7723-419f-bdde-f0a585a615d9 tempest-CreateVolumesFromSnapshotTest-1406547820 None] <== create_volume: return (1119ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'} {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 15:56:08 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-e3817280-7723-419f-bdde-f0a585a615d9 tempest-CreateVolumesFromSnapshotTest-1406547820 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.123s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:56:08 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-8bd3baf5-1d75-4bee-add6-636485f80de2 tempest-CreateVolumesFromSnapshotTest-1406547820 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.534s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:56:08 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-8bd3baf5-1d75-4bee-add6-636485f80de2 tempest-CreateVolumesFromSnapshotTest-1406547820 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:56:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-948980856',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dce703ca-cd1c-4ea3-8d0c-55ecb93228aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='117f5def5f6948089fe793e13bded5d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:56:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:56:01Z,use_quota=True,user_id='f351156bd1214328bced88784864ce1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)}" {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 15:56:08 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-8bd3baf5-1d75-4bee-add6-636485f80de2 tempest-CreateVolumesFromSnapshotTest-1406547820 None] Creating volume dce703ca-cd1c-4ea3-8d0c-55ecb93228aa {{(pid=86212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 15:56:08 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-8bd3baf5-1d75-4bee-add6-636485f80de2 tempest-CreateVolumesFromSnapshotTest-1406547820 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:56:08 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-8bd3baf5-1d75-4bee-add6-636485f80de2 tempest-CreateVolumesFromSnapshotTest-1406547820 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:56:08 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-8bd3baf5-1d75-4bee-add6-636485f80de2 tempest-CreateVolumesFromSnapshotTest-1406547820 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:56:08 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-8bd3baf5-1d75-4bee-add6-636485f80de2 tempest-CreateVolumesFromSnapshotTest-1406547820 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:56:08 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-8bd3baf5-1d75-4bee-add6-636485f80de2 tempest-CreateVolumesFromSnapshotTest-1406547820 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:56:08 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-8bd3baf5-1d75-4bee-add6-636485f80de2 tempest-CreateVolumesFromSnapshotTest-1406547820 None] Selected osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 as target Quobyte volume. {{(pid=86212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 15:56:08 devstack cinder-volume[86212]: INFO cinder.volume.drivers.remotefs [None req-8bd3baf5-1d75-4bee-add6-636485f80de2 tempest-CreateVolumesFromSnapshotTest-1406547820 None] casted to osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 Sep 22 15:56:08 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-8bd3baf5-1d75-4bee-add6-636485f80de2 tempest-CreateVolumesFromSnapshotTest-1406547820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-dce703ca-cd1c-4ea3-8d0c-55ecb93228aa 1073741824 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:56:08 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-e3817280-7723-419f-bdde-f0a585a615d9 tempest-CreateVolumesFromSnapshotTest-1406547820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bb151c5-d240-4f6e-9d3a-242b36db4365) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a70bc76d-af4c-4af6-ab46-3400d84760a7', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:56:08 devstack sudo[104520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-dce703ca-cd1c-4ea3-8d0c-55ecb93228aa 1073741824 Sep 22 15:56:08 devstack sudo[104520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:56:08 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-e3817280-7723-419f-bdde-f0a585a615d9 tempest-CreateVolumesFromSnapshotTest-1406547820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9af48b8a-b74c-4aa0-9624-7400ef73fb74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:56:08 devstack sudo[104512]: pam_unix(sudo:session): session closed for user root Sep 22 15:56:08 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-35a4043a-c729-474a-9359-bdbba9738b90 tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2f3b5234-b299-41e4-b304-73a8438da7d2" returned: 0 in 0.295s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:56:08 devstack sudo[104518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-accee605-2de3-4951-8c31-f7c00c4c3b75 Sep 22 15:56:08 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-e3817280-7723-419f-bdde-f0a585a615d9 tempest-CreateVolumesFromSnapshotTest-1406547820 None] Volume volume-a70bc76d-af4c-4af6-ab46-3400d84760a7 (a70bc76d-af4c-4af6-ab46-3400d84760a7): created successfully Sep 22 15:56:08 devstack sudo[104518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:56:08 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-e3817280-7723-419f-bdde-f0a585a615d9 tempest-CreateVolumesFromSnapshotTest-1406547820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9af48b8a-b74c-4aa0-9624-7400ef73fb74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:56:08 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-e3817280-7723-419f-bdde-f0a585a615d9 tempest-CreateVolumesFromSnapshotTest-1406547820 None] Flow 'volume_create_manager' (2120ae7d-c343-49ad-866b-dce8c4b8868a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:56:08 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-35a4043a-c729-474a-9359-bdbba9738b90 tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Lock "cinder-quobyte-2f3b5234-b299-41e4-b304-73a8438da7d2" released by "delete_volume" :: held 0.907s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:56:08 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-e3817280-7723-419f-bdde-f0a585a615d9 tempest-CreateVolumesFromSnapshotTest-1406547820 None] Created volume successfully. Sep 22 15:56:08 devstack cinder-volume[86212]: DEBUG cinder.quota [None req-35a4043a-c729-474a-9359-bdbba9738b90 tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Created reservations ['040b1892-0c94-471b-ac08-89c0aef33a5b', 'f4254edb-0448-4390-b306-07788bc01d4c', '5f75f199-99c3-491a-8bcd-3259c6a03a08', 'c2bc6b83-8669-418b-8a7f-c26f4d78a16a'] {{(pid=86212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 15:56:08 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-35a4043a-c729-474a-9359-bdbba9738b90 tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:56:08 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-35a4043a-c729-474a-9359-bdbba9738b90 tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:56:08 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-35a4043a-c729-474a-9359-bdbba9738b90 tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:56:08 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-35a4043a-c729-474a-9359-bdbba9738b90 tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:56:08 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-35a4043a-c729-474a-9359-bdbba9738b90 tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:56:08 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-35a4043a-c729-474a-9359-bdbba9738b90 tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:56:08 devstack sudo[104523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc Sep 22 15:56:08 devstack sudo[104523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:56:08 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-cd6c714c-6b46-4c42-8201-c1ea2e1b045f tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Acquiring lock "cinder-4c9d9341-b7fd-4a69-bda3-9b08a7741234-delete_volume" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:56:08 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-cd6c714c-6b46-4c42-8201-c1ea2e1b045f tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Lock "cinder-4c9d9341-b7fd-4a69-bda3-9b08a7741234-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:56:08 devstack sudo[104518]: pam_unix(sudo:session): session closed for user root Sep 22 15:56:08 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-7c344764-cf4e-4880-aaec-6e8bf8b74000 tempest-CinderUnicodeTest-1397280805 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-accee605-2de3-4951-8c31-f7c00c4c3b75" returned: 0 in 0.517s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:56:08 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-7c344764-cf4e-4880-aaec-6e8bf8b74000 tempest-CinderUnicodeTest-1397280805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-accee605-2de3-4951-8c31-f7c00c4c3b75.c9232961-4829-41df-8e68-12dd902fce25 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:56:08 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-cd6c714c-6b46-4c42-8201-c1ea2e1b045f tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Acquiring lock "cinder-quobyte-4c9d9341-b7fd-4a69-bda3-9b08a7741234" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:56:08 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-cd6c714c-6b46-4c42-8201-c1ea2e1b045f tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Lock "cinder-quobyte-4c9d9341-b7fd-4a69-bda3-9b08a7741234" acquired by "delete_volume" :: waited 0.027s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:56:08 devstack sudo[104532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-accee605-2de3-4951-8c31-f7c00c4c3b75.c9232961-4829-41df-8e68-12dd902fce25 Sep 22 15:56:08 devstack sudo[104532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:56:08 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-a13b2811-524f-4605-8f61-cb13b56ecb91 tempest-VolumeAndVolumeTypeFromImageTest-1497179036 None] Acquiring lock "cinder-31e65922-ec7e-4c0b-9cab-3a1e40bd084b-delete_volume" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:56:08 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce3ff4bc-7725-462f-91ac-495f74bab17b]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:56:08 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-cd6c714c-6b46-4c42-8201-c1ea2e1b045f tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-4c9d9341-b7fd-4a69-bda3-9b08a7741234 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:56:08 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-a13b2811-524f-4605-8f61-cb13b56ecb91 tempest-VolumeAndVolumeTypeFromImageTest-1497179036 None] Lock "cinder-31e65922-ec7e-4c0b-9cab-3a1e40bd084b-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:56:08 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-a13b2811-524f-4605-8f61-cb13b56ecb91 tempest-VolumeAndVolumeTypeFromImageTest-1497179036 None] Acquiring lock "cinder-quobyte-31e65922-ec7e-4c0b-9cab-3a1e40bd084b" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:56:08 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-a13b2811-524f-4605-8f61-cb13b56ecb91 tempest-VolumeAndVolumeTypeFromImageTest-1497179036 None] Lock "cinder-quobyte-31e65922-ec7e-4c0b-9cab-3a1e40bd084b" acquired by "delete_volume" :: waited 0.018s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:56:08 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[2751e98d-c8ea-4821-a1f8-3f7cc8867531]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:56:08 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-a13b2811-524f-4605-8f61-cb13b56ecb91 tempest-VolumeAndVolumeTypeFromImageTest-1497179036 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-31e65922-ec7e-4c0b-9cab-3a1e40bd084b {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:56:08 devstack sudo[104520]: pam_unix(sudo:session): session closed for user root Sep 22 15:56:08 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-8bd3baf5-1d75-4bee-add6-636485f80de2 tempest-CreateVolumesFromSnapshotTest-1406547820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-dce703ca-cd1c-4ea3-8d0c-55ecb93228aa 1073741824" returned: 0 in 0.717s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:56:09 devstack sudo[104534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-4c9d9341-b7fd-4a69-bda3-9b08a7741234 Sep 22 15:56:09 devstack sudo[104534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:56:09 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-8bd3baf5-1d75-4bee-add6-636485f80de2 tempest-CreateVolumesFromSnapshotTest-1406547820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-dce703ca-cd1c-4ea3-8d0c-55ecb93228aa {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:56:09 devstack sudo[104523]: pam_unix(sudo:session): session closed for user root Sep 22 15:56:09 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-35a4043a-c729-474a-9359-bdbba9738b90 tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc" returned: 0 in 0.576s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:56:09 devstack cinder-volume[86212]: DEBUG cinder.manager [None req-35a4043a-c729-474a-9359-bdbba9738b90 tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Notifying Schedulers of capabilities ... {{(pid=86212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 15:56:09 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-35a4043a-c729-474a-9359-bdbba9738b90 tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Deleted volume successfully. Sep 22 15:56:09 devstack sudo[104541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-dce703ca-cd1c-4ea3-8d0c-55ecb93228aa Sep 22 15:56:09 devstack sudo[104541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:56:09 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-35a4043a-c729-474a-9359-bdbba9738b90 tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Lock "cinder-2f3b5234-b299-41e4-b304-73a8438da7d2-delete_volume" released by "delete_volume" :: held 1.812s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:56:09 devstack sudo[104537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-31e65922-ec7e-4c0b-9cab-3a1e40bd084b Sep 22 15:56:09 devstack sudo[104537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:56:09 devstack sudo[104532]: pam_unix(sudo:session): session closed for user root Sep 22 15:56:09 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-7c344764-cf4e-4880-aaec-6e8bf8b74000 tempest-CinderUnicodeTest-1397280805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-accee605-2de3-4951-8c31-f7c00c4c3b75.c9232961-4829-41df-8e68-12dd902fce25" returned: 0 in 0.520s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:56:09 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-7c344764-cf4e-4880-aaec-6e8bf8b74000 tempest-CinderUnicodeTest-1397280805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-accee605-2de3-4951-8c31-f7c00c4c3b75.c9232961-4829-41df-8e68-12dd902fce25 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:56:09 devstack sudo[104547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-accee605-2de3-4951-8c31-f7c00c4c3b75.c9232961-4829-41df-8e68-12dd902fce25 Sep 22 15:56:09 devstack sudo[104547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:56:09 devstack sudo[104534]: pam_unix(sudo:session): session closed for user root Sep 22 15:56:09 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-cd6c714c-6b46-4c42-8201-c1ea2e1b045f tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-4c9d9341-b7fd-4a69-bda3-9b08a7741234" returned: 0 in 0.514s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:56:09 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-cd6c714c-6b46-4c42-8201-c1ea2e1b045f tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-4c9d9341-b7fd-4a69-bda3-9b08a7741234 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:56:09 devstack sudo[104550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-4c9d9341-b7fd-4a69-bda3-9b08a7741234 Sep 22 15:56:09 devstack sudo[104550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:56:09 devstack sudo[104541]: pam_unix(sudo:session): session closed for user root Sep 22 15:56:09 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-8bd3baf5-1d75-4bee-add6-636485f80de2 tempest-CreateVolumesFromSnapshotTest-1406547820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-dce703ca-cd1c-4ea3-8d0c-55ecb93228aa" returned: 0 in 0.370s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:56:09 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-8bd3baf5-1d75-4bee-add6-636485f80de2 tempest-CreateVolumesFromSnapshotTest-1406547820 None] <== create_volume: return (1182ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'} {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 15:56:09 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-8bd3baf5-1d75-4bee-add6-636485f80de2 tempest-CreateVolumesFromSnapshotTest-1406547820 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.184s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:56:09 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-a726964f-835f-4544-8d1f-cc36e40d98c4 tempest-CreateVolumesFromSnapshotTest-1406547820 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.240s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:56:09 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-a726964f-835f-4544-8d1f-cc36e40d98c4 tempest-CreateVolumesFromSnapshotTest-1406547820 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:56:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2125937660',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=863420f6-f9cf-4ddf-9437-eca8acaf0807,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='117f5def5f6948089fe793e13bded5d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:56:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:56:01Z,use_quota=True,user_id='f351156bd1214328bced88784864ce1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)}" {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 15:56:09 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-a726964f-835f-4544-8d1f-cc36e40d98c4 tempest-CreateVolumesFromSnapshotTest-1406547820 None] Creating volume 863420f6-f9cf-4ddf-9437-eca8acaf0807 {{(pid=86212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 15:56:09 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-a726964f-835f-4544-8d1f-cc36e40d98c4 tempest-CreateVolumesFromSnapshotTest-1406547820 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:56:09 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-a726964f-835f-4544-8d1f-cc36e40d98c4 tempest-CreateVolumesFromSnapshotTest-1406547820 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:56:09 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-a726964f-835f-4544-8d1f-cc36e40d98c4 tempest-CreateVolumesFromSnapshotTest-1406547820 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:56:09 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-a726964f-835f-4544-8d1f-cc36e40d98c4 tempest-CreateVolumesFromSnapshotTest-1406547820 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:56:09 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-a726964f-835f-4544-8d1f-cc36e40d98c4 tempest-CreateVolumesFromSnapshotTest-1406547820 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:56:09 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-a726964f-835f-4544-8d1f-cc36e40d98c4 tempest-CreateVolumesFromSnapshotTest-1406547820 None] Selected osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 as target Quobyte volume. {{(pid=86212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 15:56:09 devstack cinder-volume[86212]: INFO cinder.volume.drivers.remotefs [None req-a726964f-835f-4544-8d1f-cc36e40d98c4 tempest-CreateVolumesFromSnapshotTest-1406547820 None] casted to osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 Sep 22 15:56:09 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-a726964f-835f-4544-8d1f-cc36e40d98c4 tempest-CreateVolumesFromSnapshotTest-1406547820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-863420f6-f9cf-4ddf-9437-eca8acaf0807 1073741824 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:56:09 devstack sudo[104537]: pam_unix(sudo:session): session closed for user root Sep 22 15:56:09 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-8bd3baf5-1d75-4bee-add6-636485f80de2 tempest-CreateVolumesFromSnapshotTest-1406547820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ae08ffc-6775-4e4c-930f-be34306fcdee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dce703ca-cd1c-4ea3-8d0c-55ecb93228aa', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:56:09 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-8bd3baf5-1d75-4bee-add6-636485f80de2 tempest-CreateVolumesFromSnapshotTest-1406547820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf031f64-5e3d-4306-bb7c-89c9dc8ff94e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:56:09 devstack sudo[104556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-863420f6-f9cf-4ddf-9437-eca8acaf0807 1073741824 Sep 22 15:56:09 devstack sudo[104556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:56:09 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-a13b2811-524f-4605-8f61-cb13b56ecb91 tempest-VolumeAndVolumeTypeFromImageTest-1497179036 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-31e65922-ec7e-4c0b-9cab-3a1e40bd084b" returned: 0 in 0.540s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:56:09 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-a13b2811-524f-4605-8f61-cb13b56ecb91 tempest-VolumeAndVolumeTypeFromImageTest-1497179036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-31e65922-ec7e-4c0b-9cab-3a1e40bd084b {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:56:09 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-8bd3baf5-1d75-4bee-add6-636485f80de2 tempest-CreateVolumesFromSnapshotTest-1406547820 None] Volume volume-dce703ca-cd1c-4ea3-8d0c-55ecb93228aa (dce703ca-cd1c-4ea3-8d0c-55ecb93228aa): created successfully Sep 22 15:56:09 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-8bd3baf5-1d75-4bee-add6-636485f80de2 tempest-CreateVolumesFromSnapshotTest-1406547820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf031f64-5e3d-4306-bb7c-89c9dc8ff94e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:56:09 devstack sudo[104559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-31e65922-ec7e-4c0b-9cab-3a1e40bd084b Sep 22 15:56:09 devstack sudo[104559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:56:09 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-8bd3baf5-1d75-4bee-add6-636485f80de2 tempest-CreateVolumesFromSnapshotTest-1406547820 None] Flow 'volume_create_manager' (ba64a728-4318-442d-bb6e-d6de31388475) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:56:09 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-8bd3baf5-1d75-4bee-add6-636485f80de2 tempest-CreateVolumesFromSnapshotTest-1406547820 None] Created volume successfully. Sep 22 15:56:09 devstack sudo[104547]: pam_unix(sudo:session): session closed for user root Sep 22 15:56:09 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-7c344764-cf4e-4880-aaec-6e8bf8b74000 tempest-CinderUnicodeTest-1397280805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-accee605-2de3-4951-8c31-f7c00c4c3b75.c9232961-4829-41df-8e68-12dd902fce25" returned: 0 in 0.333s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:56:09 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-7c344764-cf4e-4880-aaec-6e8bf8b74000 tempest-CinderUnicodeTest-1397280805 None] Lock "cinder-quobyte-c9232961-4829-41df-8e68-12dd902fce25" released by "_delete_snapshot" :: held 1.979s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:56:09 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-7c344764-cf4e-4880-aaec-6e8bf8b74000 tempest-CinderUnicodeTest-1397280805 None] Lock "cinder-quobyte-accee605-2de3-4951-8c31-f7c00c4c3b75" released by "delete_snapshot" :: held 2.011s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:56:09 devstack sudo[104550]: pam_unix(sudo:session): session closed for user root Sep 22 15:56:09 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-cd6c714c-6b46-4c42-8201-c1ea2e1b045f tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-4c9d9341-b7fd-4a69-bda3-9b08a7741234" returned: 0 in 0.344s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:56:09 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-cd6c714c-6b46-4c42-8201-c1ea2e1b045f tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Lock "cinder-quobyte-4c9d9341-b7fd-4a69-bda3-9b08a7741234" released by "delete_volume" :: held 0.927s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:56:09 devstack cinder-volume[86212]: DEBUG cinder.quota [None req-7c344764-cf4e-4880-aaec-6e8bf8b74000 tempest-CinderUnicodeTest-1397280805 None] Created reservations ['b9deb932-17f4-4f2f-9a2d-50915bb4bcfa', '93295f31-9800-4211-8a3a-f0bb61945521', 'f287b3c4-2fc6-4f83-a8f8-9b9cd3ca4eca', 'c3b878f5-4b14-4aa8-9c06-02ef6fdff24d'] {{(pid=86212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 15:56:09 devstack cinder-volume[86212]: DEBUG cinder.quota [None req-cd6c714c-6b46-4c42-8201-c1ea2e1b045f tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Created reservations ['40ad648f-78d4-4a24-987f-24fb1512a58e', '4ce70d3f-b3f4-4b0c-bf63-049e568c2974', '14a0ec21-59a5-4083-ac0f-3d8b47ad786d', 'a47b185f-c329-4610-8243-899b828859f3'] {{(pid=86212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 15:56:09 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-7c344764-cf4e-4880-aaec-6e8bf8b74000 tempest-CinderUnicodeTest-1397280805 None] Delete snapshot completed successfully. Sep 22 15:56:09 devstack sudo[104559]: pam_unix(sudo:session): session closed for user root Sep 22 15:56:09 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-a13b2811-524f-4605-8f61-cb13b56ecb91 tempest-VolumeAndVolumeTypeFromImageTest-1497179036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-31e65922-ec7e-4c0b-9cab-3a1e40bd084b" returned: 0 in 0.348s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:56:09 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-7c344764-cf4e-4880-aaec-6e8bf8b74000 tempest-CinderUnicodeTest-1397280805 None] Lock "cinder-c9232961-4829-41df-8e68-12dd902fce25-delete_snapshot" released by "delete_snapshot" :: held 2.267s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:56:09 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-a13b2811-524f-4605-8f61-cb13b56ecb91 tempest-VolumeAndVolumeTypeFromImageTest-1497179036 None] Lock "cinder-quobyte-31e65922-ec7e-4c0b-9cab-3a1e40bd084b" released by "delete_volume" :: held 0.969s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:56:09 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-cd6c714c-6b46-4c42-8201-c1ea2e1b045f tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:56:09 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-cd6c714c-6b46-4c42-8201-c1ea2e1b045f tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:56:09 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-cd6c714c-6b46-4c42-8201-c1ea2e1b045f tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:56:09 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-cd6c714c-6b46-4c42-8201-c1ea2e1b045f tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:56:09 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-cd6c714c-6b46-4c42-8201-c1ea2e1b045f tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:56:09 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-cd6c714c-6b46-4c42-8201-c1ea2e1b045f tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:56:09 devstack sudo[104567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc Sep 22 15:56:09 devstack sudo[104567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:56:09 devstack cinder-volume[86212]: DEBUG cinder.quota [None req-a13b2811-524f-4605-8f61-cb13b56ecb91 tempest-VolumeAndVolumeTypeFromImageTest-1497179036 None] Created reservations ['49f959a6-be11-4a29-a111-481e8f5f8e97', '31481ff2-a839-4f26-95ac-ace4d0f7f3ac', 'ace000b1-a9d2-4eaf-9eed-30ab7f544eb2', 'a78fa1ef-64e6-4418-9b0a-ebf83694139b'] {{(pid=86212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 15:56:10 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-a13b2811-524f-4605-8f61-cb13b56ecb91 tempest-VolumeAndVolumeTypeFromImageTest-1497179036 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:56:10 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-a13b2811-524f-4605-8f61-cb13b56ecb91 tempest-VolumeAndVolumeTypeFromImageTest-1497179036 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:56:10 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-a13b2811-524f-4605-8f61-cb13b56ecb91 tempest-VolumeAndVolumeTypeFromImageTest-1497179036 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:56:10 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-a13b2811-524f-4605-8f61-cb13b56ecb91 tempest-VolumeAndVolumeTypeFromImageTest-1497179036 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:56:10 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-a13b2811-524f-4605-8f61-cb13b56ecb91 tempest-VolumeAndVolumeTypeFromImageTest-1497179036 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:56:10 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-a13b2811-524f-4605-8f61-cb13b56ecb91 tempest-VolumeAndVolumeTypeFromImageTest-1497179036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:56:10 devstack sudo[104556]: pam_unix(sudo:session): session closed for user root Sep 22 15:56:10 devstack sudo[104569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc Sep 22 15:56:10 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-a726964f-835f-4544-8d1f-cc36e40d98c4 tempest-CreateVolumesFromSnapshotTest-1406547820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-863420f6-f9cf-4ddf-9437-eca8acaf0807 1073741824" returned: 0 in 0.625s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:56:10 devstack sudo[104569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:56:10 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-a726964f-835f-4544-8d1f-cc36e40d98c4 tempest-CreateVolumesFromSnapshotTest-1406547820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-863420f6-f9cf-4ddf-9437-eca8acaf0807 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:56:10 devstack sudo[104571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-863420f6-f9cf-4ddf-9437-eca8acaf0807 Sep 22 15:56:10 devstack sudo[104571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:56:10 devstack sudo[104567]: pam_unix(sudo:session): session closed for user root Sep 22 15:56:10 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-cd6c714c-6b46-4c42-8201-c1ea2e1b045f tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc" returned: 0 in 0.323s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:56:10 devstack cinder-volume[86212]: DEBUG cinder.manager [None req-cd6c714c-6b46-4c42-8201-c1ea2e1b045f tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Notifying Schedulers of capabilities ... {{(pid=86212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 15:56:10 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-cd6c714c-6b46-4c42-8201-c1ea2e1b045f tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Deleted volume successfully. Sep 22 15:56:10 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-cd6c714c-6b46-4c42-8201-c1ea2e1b045f tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Lock "cinder-4c9d9341-b7fd-4a69-bda3-9b08a7741234-delete_volume" released by "delete_volume" :: held 1.632s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:56:10 devstack sudo[104569]: pam_unix(sudo:session): session closed for user root Sep 22 15:56:10 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-a13b2811-524f-4605-8f61-cb13b56ecb91 tempest-VolumeAndVolumeTypeFromImageTest-1497179036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc" returned: 0 in 0.277s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:56:10 devstack cinder-volume[86212]: DEBUG cinder.manager [None req-a13b2811-524f-4605-8f61-cb13b56ecb91 tempest-VolumeAndVolumeTypeFromImageTest-1497179036 None] Notifying Schedulers of capabilities ... {{(pid=86212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 15:56:10 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-a13b2811-524f-4605-8f61-cb13b56ecb91 tempest-VolumeAndVolumeTypeFromImageTest-1497179036 None] Deleted volume successfully. Sep 22 15:56:10 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-a13b2811-524f-4605-8f61-cb13b56ecb91 tempest-VolumeAndVolumeTypeFromImageTest-1497179036 None] Lock "cinder-31e65922-ec7e-4c0b-9cab-3a1e40bd084b-delete_volume" released by "delete_volume" :: held 1.522s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:56:10 devstack sudo[104571]: pam_unix(sudo:session): session closed for user root Sep 22 15:56:10 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-a726964f-835f-4544-8d1f-cc36e40d98c4 tempest-CreateVolumesFromSnapshotTest-1406547820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-863420f6-f9cf-4ddf-9437-eca8acaf0807" returned: 0 in 0.299s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:56:10 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-a726964f-835f-4544-8d1f-cc36e40d98c4 tempest-CreateVolumesFromSnapshotTest-1406547820 None] <== create_volume: return (967ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'} {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 15:56:10 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-a726964f-835f-4544-8d1f-cc36e40d98c4 tempest-CreateVolumesFromSnapshotTest-1406547820 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.970s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:56:10 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-1d4ec35c-4daf-4299-b148-e714a942636e tempest-CreateVolumesFromSnapshotTest-1406547820 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.876s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:56:10 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-1d4ec35c-4daf-4299-b148-e714a942636e tempest-CreateVolumesFromSnapshotTest-1406547820 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:56:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-997867924',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26fda26b-443f-45da-9b16-58d3865f4d35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='117f5def5f6948089fe793e13bded5d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:56:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:56:01Z,use_quota=True,user_id='f351156bd1214328bced88784864ce1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)}" {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 15:56:10 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-1d4ec35c-4daf-4299-b148-e714a942636e tempest-CreateVolumesFromSnapshotTest-1406547820 None] Creating volume 26fda26b-443f-45da-9b16-58d3865f4d35 {{(pid=86212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 15:56:10 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-1d4ec35c-4daf-4299-b148-e714a942636e tempest-CreateVolumesFromSnapshotTest-1406547820 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:56:10 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-1d4ec35c-4daf-4299-b148-e714a942636e tempest-CreateVolumesFromSnapshotTest-1406547820 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:56:10 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-1d4ec35c-4daf-4299-b148-e714a942636e tempest-CreateVolumesFromSnapshotTest-1406547820 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:56:10 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-1d4ec35c-4daf-4299-b148-e714a942636e tempest-CreateVolumesFromSnapshotTest-1406547820 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:56:10 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-1d4ec35c-4daf-4299-b148-e714a942636e tempest-CreateVolumesFromSnapshotTest-1406547820 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:56:10 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-1d4ec35c-4daf-4299-b148-e714a942636e tempest-CreateVolumesFromSnapshotTest-1406547820 None] Selected osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 as target Quobyte volume. {{(pid=86212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 15:56:10 devstack cinder-volume[86212]: INFO cinder.volume.drivers.remotefs [None req-1d4ec35c-4daf-4299-b148-e714a942636e tempest-CreateVolumesFromSnapshotTest-1406547820 None] casted to osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 Sep 22 15:56:10 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-1d4ec35c-4daf-4299-b148-e714a942636e tempest-CreateVolumesFromSnapshotTest-1406547820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-26fda26b-443f-45da-9b16-58d3865f4d35 1073741824 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:56:10 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-a726964f-835f-4544-8d1f-cc36e40d98c4 tempest-CreateVolumesFromSnapshotTest-1406547820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4e54db0-cbe0-4c95-b0cc-4d0b11bac076) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-863420f6-f9cf-4ddf-9437-eca8acaf0807', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:56:10 devstack sudo[104576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-26fda26b-443f-45da-9b16-58d3865f4d35 1073741824 Sep 22 15:56:10 devstack sudo[104576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:56:10 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-a726964f-835f-4544-8d1f-cc36e40d98c4 tempest-CreateVolumesFromSnapshotTest-1406547820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74ad614e-8d9a-41b6-9742-20c232ec50f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:56:10 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-a726964f-835f-4544-8d1f-cc36e40d98c4 tempest-CreateVolumesFromSnapshotTest-1406547820 None] Volume volume-863420f6-f9cf-4ddf-9437-eca8acaf0807 (863420f6-f9cf-4ddf-9437-eca8acaf0807): created successfully Sep 22 15:56:10 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-a726964f-835f-4544-8d1f-cc36e40d98c4 tempest-CreateVolumesFromSnapshotTest-1406547820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74ad614e-8d9a-41b6-9742-20c232ec50f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:56:10 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-a726964f-835f-4544-8d1f-cc36e40d98c4 tempest-CreateVolumesFromSnapshotTest-1406547820 None] Flow 'volume_create_manager' (a0506adf-e18e-42a3-8bad-ee9d62224a79) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:56:10 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-a726964f-835f-4544-8d1f-cc36e40d98c4 tempest-CreateVolumesFromSnapshotTest-1406547820 None] Created volume successfully. Sep 22 15:56:10 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-2e212287-fdc8-43a9-b3d4-80b81c5123d5 tempest-CinderUnicodeTest-1397280805 None] Acquiring lock "cinder-accee605-2de3-4951-8c31-f7c00c4c3b75-delete_volume" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:56:10 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-2e212287-fdc8-43a9-b3d4-80b81c5123d5 tempest-CinderUnicodeTest-1397280805 None] Lock "cinder-accee605-2de3-4951-8c31-f7c00c4c3b75-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:56:10 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-2e212287-fdc8-43a9-b3d4-80b81c5123d5 tempest-CinderUnicodeTest-1397280805 None] Acquiring lock "cinder-quobyte-accee605-2de3-4951-8c31-f7c00c4c3b75" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:56:10 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-2e212287-fdc8-43a9-b3d4-80b81c5123d5 tempest-CinderUnicodeTest-1397280805 None] Lock "cinder-quobyte-accee605-2de3-4951-8c31-f7c00c4c3b75" acquired by "delete_volume" :: waited 0.023s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:56:10 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[8853fb8a-11be-4d40-9743-8f7891833034]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:56:10 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-2e212287-fdc8-43a9-b3d4-80b81c5123d5 tempest-CinderUnicodeTest-1397280805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-accee605-2de3-4951-8c31-f7c00c4c3b75 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:56:10 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-81e08913-5126-4085-b9d5-af17d3f1e6e9 tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Acquiring lock "cinder-c822fb8b-519c-4544-9bb9-3a87d72149bd-delete_volume" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:56:10 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-81e08913-5126-4085-b9d5-af17d3f1e6e9 tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Lock "cinder-c822fb8b-519c-4544-9bb9-3a87d72149bd-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:56:11 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-81e08913-5126-4085-b9d5-af17d3f1e6e9 tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Acquiring lock "cinder-quobyte-c822fb8b-519c-4544-9bb9-3a87d72149bd" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:56:11 devstack sudo[104576]: pam_unix(sudo:session): session closed for user root Sep 22 15:56:11 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-81e08913-5126-4085-b9d5-af17d3f1e6e9 tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Lock "cinder-quobyte-c822fb8b-519c-4544-9bb9-3a87d72149bd" acquired by "delete_volume" :: waited 0.024s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:56:11 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-1d4ec35c-4daf-4299-b148-e714a942636e tempest-CreateVolumesFromSnapshotTest-1406547820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-26fda26b-443f-45da-9b16-58d3865f4d35 1073741824" returned: 0 in 0.641s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:56:11 devstack sudo[104582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-accee605-2de3-4951-8c31-f7c00c4c3b75 Sep 22 15:56:11 devstack sudo[104582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:56:11 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[db16a8b3-91a8-4ac8-9fb5-adaba71f6ffc]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:56:11 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-81e08913-5126-4085-b9d5-af17d3f1e6e9 tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-c822fb8b-519c-4544-9bb9-3a87d72149bd {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:56:11 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-1d4ec35c-4daf-4299-b148-e714a942636e tempest-CreateVolumesFromSnapshotTest-1406547820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-26fda26b-443f-45da-9b16-58d3865f4d35 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:56:11 devstack sudo[104585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-26fda26b-443f-45da-9b16-58d3865f4d35 Sep 22 15:56:11 devstack sudo[104585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:56:11 devstack sudo[104584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-c822fb8b-519c-4544-9bb9-3a87d72149bd Sep 22 15:56:11 devstack sudo[104584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:56:11 devstack sudo[104582]: pam_unix(sudo:session): session closed for user root Sep 22 15:56:11 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-2e212287-fdc8-43a9-b3d4-80b81c5123d5 tempest-CinderUnicodeTest-1397280805 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-accee605-2de3-4951-8c31-f7c00c4c3b75" returned: 0 in 0.522s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:56:11 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-2e212287-fdc8-43a9-b3d4-80b81c5123d5 tempest-CinderUnicodeTest-1397280805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-accee605-2de3-4951-8c31-f7c00c4c3b75 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:56:11 devstack sudo[104592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-accee605-2de3-4951-8c31-f7c00c4c3b75 Sep 22 15:56:11 devstack sudo[104592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:56:11 devstack sudo[104585]: pam_unix(sudo:session): session closed for user root Sep 22 15:56:11 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-1d4ec35c-4daf-4299-b148-e714a942636e tempest-CreateVolumesFromSnapshotTest-1406547820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-26fda26b-443f-45da-9b16-58d3865f4d35" returned: 0 in 0.374s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:56:11 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-1d4ec35c-4daf-4299-b148-e714a942636e tempest-CreateVolumesFromSnapshotTest-1406547820 None] <== create_volume: return (1079ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'} {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 15:56:11 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-1d4ec35c-4daf-4299-b148-e714a942636e tempest-CreateVolumesFromSnapshotTest-1406547820 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.083s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:56:11 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-1d4ec35c-4daf-4299-b148-e714a942636e tempest-CreateVolumesFromSnapshotTest-1406547820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (786fb3a5-2660-47b9-95be-f17a2e039dcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-26fda26b-443f-45da-9b16-58d3865f4d35', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:56:11 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-1d4ec35c-4daf-4299-b148-e714a942636e tempest-CreateVolumesFromSnapshotTest-1406547820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85c68664-74eb-419d-b719-e270c5afda2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:56:11 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-1d4ec35c-4daf-4299-b148-e714a942636e tempest-CreateVolumesFromSnapshotTest-1406547820 None] Volume volume-26fda26b-443f-45da-9b16-58d3865f4d35 (26fda26b-443f-45da-9b16-58d3865f4d35): created successfully Sep 22 15:56:11 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-1d4ec35c-4daf-4299-b148-e714a942636e tempest-CreateVolumesFromSnapshotTest-1406547820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85c68664-74eb-419d-b719-e270c5afda2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:56:11 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-1d4ec35c-4daf-4299-b148-e714a942636e tempest-CreateVolumesFromSnapshotTest-1406547820 None] Flow 'volume_create_manager' (a03ad0e6-d518-4e27-8d4a-39758529c3ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:56:11 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-1d4ec35c-4daf-4299-b148-e714a942636e tempest-CreateVolumesFromSnapshotTest-1406547820 None] Created volume successfully. Sep 22 15:56:11 devstack sudo[104584]: pam_unix(sudo:session): session closed for user root Sep 22 15:56:11 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-81e08913-5126-4085-b9d5-af17d3f1e6e9 tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-c822fb8b-519c-4544-9bb9-3a87d72149bd" returned: 0 in 0.517s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:56:11 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-81e08913-5126-4085-b9d5-af17d3f1e6e9 tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-c822fb8b-519c-4544-9bb9-3a87d72149bd {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:56:11 devstack sudo[104598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-c822fb8b-519c-4544-9bb9-3a87d72149bd Sep 22 15:56:11 devstack sudo[104598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:56:11 devstack sudo[104592]: pam_unix(sudo:session): session closed for user root Sep 22 15:56:11 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-2e212287-fdc8-43a9-b3d4-80b81c5123d5 tempest-CinderUnicodeTest-1397280805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-accee605-2de3-4951-8c31-f7c00c4c3b75" returned: 0 in 0.279s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:56:11 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-2e212287-fdc8-43a9-b3d4-80b81c5123d5 tempest-CinderUnicodeTest-1397280805 None] Lock "cinder-quobyte-accee605-2de3-4951-8c31-f7c00c4c3b75" released by "delete_volume" :: held 0.891s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:56:11 devstack cinder-volume[86212]: DEBUG cinder.quota [None req-2e212287-fdc8-43a9-b3d4-80b81c5123d5 tempest-CinderUnicodeTest-1397280805 None] Created reservations ['3c6a32ad-9f4f-4ce3-b296-6d75d5a783a0', '364eea57-0309-44ad-a932-c2878c589e34', 'c4a578c1-8c4f-4266-b587-d8532b015aa5', '9bb10225-31ae-4582-aa8d-66502649ef45'] {{(pid=86212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 15:56:11 devstack sudo[104598]: pam_unix(sudo:session): session closed for user root Sep 22 15:56:11 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-81e08913-5126-4085-b9d5-af17d3f1e6e9 tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-c822fb8b-519c-4544-9bb9-3a87d72149bd" returned: 0 in 0.297s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:56:11 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-2e212287-fdc8-43a9-b3d4-80b81c5123d5 tempest-CinderUnicodeTest-1397280805 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:56:11 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-2e212287-fdc8-43a9-b3d4-80b81c5123d5 tempest-CinderUnicodeTest-1397280805 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:56:11 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-2e212287-fdc8-43a9-b3d4-80b81c5123d5 tempest-CinderUnicodeTest-1397280805 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:56:11 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-2e212287-fdc8-43a9-b3d4-80b81c5123d5 tempest-CinderUnicodeTest-1397280805 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:56:11 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-2e212287-fdc8-43a9-b3d4-80b81c5123d5 tempest-CinderUnicodeTest-1397280805 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:56:11 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-2e212287-fdc8-43a9-b3d4-80b81c5123d5 tempest-CinderUnicodeTest-1397280805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:56:11 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-81e08913-5126-4085-b9d5-af17d3f1e6e9 tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Lock "cinder-quobyte-c822fb8b-519c-4544-9bb9-3a87d72149bd" released by "delete_volume" :: held 0.890s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:56:11 devstack sudo[104602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc Sep 22 15:56:11 devstack sudo[104602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:56:11 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-e8a1e560-2410-4458-a64c-28c0915d1ae1 tempest-CinderUnicodeTest-1397280805 None] Acquiring lock "cinder-51c954bf-cc7e-4299-9fd7-465f2a8f2a4e-delete_volume" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:56:12 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-e8a1e560-2410-4458-a64c-28c0915d1ae1 tempest-CinderUnicodeTest-1397280805 None] Lock "cinder-51c954bf-cc7e-4299-9fd7-465f2a8f2a4e-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:56:12 devstack cinder-volume[86212]: DEBUG cinder.quota [None req-81e08913-5126-4085-b9d5-af17d3f1e6e9 tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Created reservations ['dd0a36c9-0cbc-47f3-a938-70a67bfb7b57', '2f5844d5-460c-4eb8-9a33-b112f0efe333', '0799f3fe-da37-4eae-afe8-f522ee7bb5b7', 'e0790dbc-163c-436e-b4c7-64efe373d7c8'] {{(pid=86212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 15:56:12 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-e8a1e560-2410-4458-a64c-28c0915d1ae1 tempest-CinderUnicodeTest-1397280805 None] Acquiring lock "cinder-quobyte-51c954bf-cc7e-4299-9fd7-465f2a8f2a4e" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:56:12 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-e8a1e560-2410-4458-a64c-28c0915d1ae1 tempest-CinderUnicodeTest-1397280805 None] Lock "cinder-quobyte-51c954bf-cc7e-4299-9fd7-465f2a8f2a4e" acquired by "delete_volume" :: waited 0.043s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:56:12 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[51cc412b-ba7a-4269-a9fb-06697a1f4288]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:56:12 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-e8a1e560-2410-4458-a64c-28c0915d1ae1 tempest-CinderUnicodeTest-1397280805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-51c954bf-cc7e-4299-9fd7-465f2a8f2a4e {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:56:12 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-81e08913-5126-4085-b9d5-af17d3f1e6e9 tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:56:12 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-81e08913-5126-4085-b9d5-af17d3f1e6e9 tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:56:12 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-81e08913-5126-4085-b9d5-af17d3f1e6e9 tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:56:12 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-81e08913-5126-4085-b9d5-af17d3f1e6e9 tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:56:12 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-81e08913-5126-4085-b9d5-af17d3f1e6e9 tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:56:12 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-81e08913-5126-4085-b9d5-af17d3f1e6e9 tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:56:12 devstack sudo[104602]: pam_unix(sudo:session): session closed for user root Sep 22 15:56:12 devstack sudo[104606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc Sep 22 15:56:12 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-2e212287-fdc8-43a9-b3d4-80b81c5123d5 tempest-CinderUnicodeTest-1397280805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc" returned: 0 in 0.365s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:56:12 devstack sudo[104606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:56:12 devstack cinder-volume[86212]: DEBUG cinder.manager [None req-2e212287-fdc8-43a9-b3d4-80b81c5123d5 tempest-CinderUnicodeTest-1397280805 None] Notifying Schedulers of capabilities ... {{(pid=86212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 15:56:12 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-2e212287-fdc8-43a9-b3d4-80b81c5123d5 tempest-CinderUnicodeTest-1397280805 None] Deleted volume successfully. Sep 22 15:56:12 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-2e212287-fdc8-43a9-b3d4-80b81c5123d5 tempest-CinderUnicodeTest-1397280805 None] Lock "cinder-accee605-2de3-4951-8c31-f7c00c4c3b75-delete_volume" released by "delete_volume" :: held 1.535s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:56:12 devstack sudo[104604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-51c954bf-cc7e-4299-9fd7-465f2a8f2a4e Sep 22 15:56:12 devstack sudo[104604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:56:12 devstack sudo[104606]: pam_unix(sudo:session): session closed for user root Sep 22 15:56:12 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-81e08913-5126-4085-b9d5-af17d3f1e6e9 tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc" returned: 0 in 0.293s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:56:12 devstack cinder-volume[86212]: DEBUG cinder.manager [None req-81e08913-5126-4085-b9d5-af17d3f1e6e9 tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Notifying Schedulers of capabilities ... {{(pid=86212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 15:56:12 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-81e08913-5126-4085-b9d5-af17d3f1e6e9 tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Deleted volume successfully. Sep 22 15:56:12 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-81e08913-5126-4085-b9d5-af17d3f1e6e9 tempest-CreateVolumesFromSourceVolumeTest-1970530582 None] Lock "cinder-c822fb8b-519c-4544-9bb9-3a87d72149bd-delete_volume" released by "delete_volume" :: held 1.622s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:56:12 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-ec6fc2a1-acd1-47c5-96f4-c30532c2321b tempest-CreateVolumesFromSnapshotTest-1406547820 None] Acquiring lock "cinder-26fda26b-443f-45da-9b16-58d3865f4d35-delete_volume" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:56:12 devstack sudo[104604]: pam_unix(sudo:session): session closed for user root Sep 22 15:56:12 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-ec6fc2a1-acd1-47c5-96f4-c30532c2321b tempest-CreateVolumesFromSnapshotTest-1406547820 None] Lock "cinder-26fda26b-443f-45da-9b16-58d3865f4d35-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:56:12 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-e8a1e560-2410-4458-a64c-28c0915d1ae1 tempest-CinderUnicodeTest-1397280805 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-51c954bf-cc7e-4299-9fd7-465f2a8f2a4e" returned: 0 in 0.469s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:56:12 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-e8a1e560-2410-4458-a64c-28c0915d1ae1 tempest-CinderUnicodeTest-1397280805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-51c954bf-cc7e-4299-9fd7-465f2a8f2a4e {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:56:12 devstack sudo[104613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-51c954bf-cc7e-4299-9fd7-465f2a8f2a4e Sep 22 15:56:12 devstack sudo[104613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:56:12 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-ec6fc2a1-acd1-47c5-96f4-c30532c2321b tempest-CreateVolumesFromSnapshotTest-1406547820 None] Acquiring lock "cinder-quobyte-26fda26b-443f-45da-9b16-58d3865f4d35" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:56:12 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-ec6fc2a1-acd1-47c5-96f4-c30532c2321b tempest-CreateVolumesFromSnapshotTest-1406547820 None] Lock "cinder-quobyte-26fda26b-443f-45da-9b16-58d3865f4d35" acquired by "delete_volume" :: waited 0.025s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:56:12 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a22fe52-f1b1-422f-af72-0ca26bc5d9b6]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:56:12 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-ec6fc2a1-acd1-47c5-96f4-c30532c2321b tempest-CreateVolumesFromSnapshotTest-1406547820 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-26fda26b-443f-45da-9b16-58d3865f4d35 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:56:12 devstack sudo[104615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-26fda26b-443f-45da-9b16-58d3865f4d35 Sep 22 15:56:12 devstack sudo[104615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:56:13 devstack sudo[104613]: pam_unix(sudo:session): session closed for user root Sep 22 15:56:13 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-e8a1e560-2410-4458-a64c-28c0915d1ae1 tempest-CinderUnicodeTest-1397280805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-51c954bf-cc7e-4299-9fd7-465f2a8f2a4e" returned: 0 in 0.353s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:56:13 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-e8a1e560-2410-4458-a64c-28c0915d1ae1 tempest-CinderUnicodeTest-1397280805 None] Lock "cinder-quobyte-51c954bf-cc7e-4299-9fd7-465f2a8f2a4e" released by "delete_volume" :: held 0.882s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:56:13 devstack cinder-volume[86212]: DEBUG cinder.quota [None req-e8a1e560-2410-4458-a64c-28c0915d1ae1 tempest-CinderUnicodeTest-1397280805 None] Created reservations ['a484e988-98de-4871-957d-af73c91bda24', 'ab1f2396-0d52-4dff-bc08-ae17d3fb2e44', 'cc4c9b01-e213-4543-81de-c72a6fccc48a', 'aa3835b9-0f60-496d-80ce-e40acf6e2e9b'] {{(pid=86212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 15:56:13 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-e8a1e560-2410-4458-a64c-28c0915d1ae1 tempest-CinderUnicodeTest-1397280805 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:56:13 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-e8a1e560-2410-4458-a64c-28c0915d1ae1 tempest-CinderUnicodeTest-1397280805 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:56:13 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-e8a1e560-2410-4458-a64c-28c0915d1ae1 tempest-CinderUnicodeTest-1397280805 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:56:13 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-e8a1e560-2410-4458-a64c-28c0915d1ae1 tempest-CinderUnicodeTest-1397280805 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:56:13 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-e8a1e560-2410-4458-a64c-28c0915d1ae1 tempest-CinderUnicodeTest-1397280805 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:56:13 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-e8a1e560-2410-4458-a64c-28c0915d1ae1 tempest-CinderUnicodeTest-1397280805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:56:13 devstack sudo[104621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc Sep 22 15:56:13 devstack sudo[104621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:56:13 devstack sudo[104615]: pam_unix(sudo:session): session closed for user root Sep 22 15:56:13 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-ec6fc2a1-acd1-47c5-96f4-c30532c2321b tempest-CreateVolumesFromSnapshotTest-1406547820 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-26fda26b-443f-45da-9b16-58d3865f4d35" returned: 0 in 0.533s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:56:13 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-ec6fc2a1-acd1-47c5-96f4-c30532c2321b tempest-CreateVolumesFromSnapshotTest-1406547820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-26fda26b-443f-45da-9b16-58d3865f4d35 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:56:13 devstack sudo[104623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-26fda26b-443f-45da-9b16-58d3865f4d35 Sep 22 15:56:13 devstack sudo[104623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:56:13 devstack sudo[104621]: pam_unix(sudo:session): session closed for user root Sep 22 15:56:13 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-e8a1e560-2410-4458-a64c-28c0915d1ae1 tempest-CinderUnicodeTest-1397280805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc" returned: 0 in 0.339s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:56:13 devstack cinder-volume[86212]: DEBUG cinder.manager [None req-e8a1e560-2410-4458-a64c-28c0915d1ae1 tempest-CinderUnicodeTest-1397280805 None] Notifying Schedulers of capabilities ... {{(pid=86212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 15:56:13 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-e8a1e560-2410-4458-a64c-28c0915d1ae1 tempest-CinderUnicodeTest-1397280805 None] Deleted volume successfully. Sep 22 15:56:13 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-e8a1e560-2410-4458-a64c-28c0915d1ae1 tempest-CinderUnicodeTest-1397280805 None] Lock "cinder-51c954bf-cc7e-4299-9fd7-465f2a8f2a4e-delete_volume" released by "delete_volume" :: held 1.614s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:56:13 devstack sudo[104623]: pam_unix(sudo:session): session closed for user root Sep 22 15:56:13 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-ec6fc2a1-acd1-47c5-96f4-c30532c2321b tempest-CreateVolumesFromSnapshotTest-1406547820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-26fda26b-443f-45da-9b16-58d3865f4d35" returned: 0 in 0.437s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:56:13 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-ec6fc2a1-acd1-47c5-96f4-c30532c2321b tempest-CreateVolumesFromSnapshotTest-1406547820 None] Lock "cinder-quobyte-26fda26b-443f-45da-9b16-58d3865f4d35" released by "delete_volume" :: held 1.056s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:56:13 devstack cinder-volume[86212]: DEBUG cinder.quota [None req-ec6fc2a1-acd1-47c5-96f4-c30532c2321b tempest-CreateVolumesFromSnapshotTest-1406547820 None] Created reservations ['ab089385-31cc-42c1-a5ac-993ae4c3a3af', 'bee450d7-42b0-4b74-b41e-a044509a0146', '98dd2562-2ba3-4cec-8f8c-328646e8c642', 'babafbc6-3b39-4ace-b3ee-83763d323d83'] {{(pid=86212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 15:56:13 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-ec6fc2a1-acd1-47c5-96f4-c30532c2321b tempest-CreateVolumesFromSnapshotTest-1406547820 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:56:13 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-ec6fc2a1-acd1-47c5-96f4-c30532c2321b tempest-CreateVolumesFromSnapshotTest-1406547820 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:56:13 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-ec6fc2a1-acd1-47c5-96f4-c30532c2321b tempest-CreateVolumesFromSnapshotTest-1406547820 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:56:13 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-ec6fc2a1-acd1-47c5-96f4-c30532c2321b tempest-CreateVolumesFromSnapshotTest-1406547820 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:56:13 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-ec6fc2a1-acd1-47c5-96f4-c30532c2321b tempest-CreateVolumesFromSnapshotTest-1406547820 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:56:13 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-ec6fc2a1-acd1-47c5-96f4-c30532c2321b tempest-CreateVolumesFromSnapshotTest-1406547820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:56:14 devstack sudo[104628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc Sep 22 15:56:14 devstack sudo[104628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:56:14 devstack sudo[104628]: pam_unix(sudo:session): session closed for user root Sep 22 15:56:14 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-ec6fc2a1-acd1-47c5-96f4-c30532c2321b tempest-CreateVolumesFromSnapshotTest-1406547820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc" returned: 0 in 0.339s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:56:14 devstack cinder-volume[86212]: DEBUG cinder.manager [None req-ec6fc2a1-acd1-47c5-96f4-c30532c2321b tempest-CreateVolumesFromSnapshotTest-1406547820 None] Notifying Schedulers of capabilities ... {{(pid=86212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 15:56:14 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-ec6fc2a1-acd1-47c5-96f4-c30532c2321b tempest-CreateVolumesFromSnapshotTest-1406547820 None] Deleted volume successfully. Sep 22 15:56:14 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-ec6fc2a1-acd1-47c5-96f4-c30532c2321b tempest-CreateVolumesFromSnapshotTest-1406547820 None] Lock "cinder-26fda26b-443f-45da-9b16-58d3865f4d35-delete_volume" released by "delete_volume" :: held 1.696s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:56:14 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-b10f144d-5bc2-4081-9406-5eb35d70cee4 tempest-CreateVolumesFromSnapshotTest-1406547820 None] Acquiring lock "cinder-863420f6-f9cf-4ddf-9437-eca8acaf0807-delete_volume" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:56:14 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-b10f144d-5bc2-4081-9406-5eb35d70cee4 tempest-CreateVolumesFromSnapshotTest-1406547820 None] Lock "cinder-863420f6-f9cf-4ddf-9437-eca8acaf0807-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:56:15 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-b10f144d-5bc2-4081-9406-5eb35d70cee4 tempest-CreateVolumesFromSnapshotTest-1406547820 None] Acquiring lock "cinder-quobyte-863420f6-f9cf-4ddf-9437-eca8acaf0807" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:56:15 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-b10f144d-5bc2-4081-9406-5eb35d70cee4 tempest-CreateVolumesFromSnapshotTest-1406547820 None] Lock "cinder-quobyte-863420f6-f9cf-4ddf-9437-eca8acaf0807" acquired by "delete_volume" :: waited 0.021s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:56:15 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb7102f7-dd72-4d3f-af51-e37c7008fcf3]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:56:15 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-b10f144d-5bc2-4081-9406-5eb35d70cee4 tempest-CreateVolumesFromSnapshotTest-1406547820 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-863420f6-f9cf-4ddf-9437-eca8acaf0807 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:56:15 devstack sudo[104631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-863420f6-f9cf-4ddf-9437-eca8acaf0807 Sep 22 15:56:15 devstack sudo[104631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:56:15 devstack sudo[104631]: pam_unix(sudo:session): session closed for user root Sep 22 15:56:15 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-b10f144d-5bc2-4081-9406-5eb35d70cee4 tempest-CreateVolumesFromSnapshotTest-1406547820 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-863420f6-f9cf-4ddf-9437-eca8acaf0807" returned: 0 in 0.553s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:56:15 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-b10f144d-5bc2-4081-9406-5eb35d70cee4 tempest-CreateVolumesFromSnapshotTest-1406547820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-863420f6-f9cf-4ddf-9437-eca8acaf0807 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:56:15 devstack sudo[104636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-863420f6-f9cf-4ddf-9437-eca8acaf0807 Sep 22 15:56:15 devstack sudo[104636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:56:16 devstack sudo[104636]: pam_unix(sudo:session): session closed for user root Sep 22 15:56:16 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-b10f144d-5bc2-4081-9406-5eb35d70cee4 tempest-CreateVolumesFromSnapshotTest-1406547820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-863420f6-f9cf-4ddf-9437-eca8acaf0807" returned: 0 in 0.350s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:56:16 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-b10f144d-5bc2-4081-9406-5eb35d70cee4 tempest-CreateVolumesFromSnapshotTest-1406547820 None] Lock "cinder-quobyte-863420f6-f9cf-4ddf-9437-eca8acaf0807" released by "delete_volume" :: held 0.990s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:56:16 devstack cinder-volume[86212]: DEBUG cinder.quota [None req-b10f144d-5bc2-4081-9406-5eb35d70cee4 tempest-CreateVolumesFromSnapshotTest-1406547820 None] Created reservations ['e5a369b4-9b6e-4ad8-b85d-ae50181f9402', '746b122f-3c28-4ba7-9cfa-2c1133ccb394', '51d17645-f77a-476e-89c1-8a61199874d8', 'cd9aa8c0-8ace-40e8-a166-d1f31f7ad01c'] {{(pid=86212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 15:56:16 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-b10f144d-5bc2-4081-9406-5eb35d70cee4 tempest-CreateVolumesFromSnapshotTest-1406547820 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:56:16 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-b10f144d-5bc2-4081-9406-5eb35d70cee4 tempest-CreateVolumesFromSnapshotTest-1406547820 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:56:16 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-b10f144d-5bc2-4081-9406-5eb35d70cee4 tempest-CreateVolumesFromSnapshotTest-1406547820 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:56:16 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-b10f144d-5bc2-4081-9406-5eb35d70cee4 tempest-CreateVolumesFromSnapshotTest-1406547820 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:56:16 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-b10f144d-5bc2-4081-9406-5eb35d70cee4 tempest-CreateVolumesFromSnapshotTest-1406547820 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:56:16 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-b10f144d-5bc2-4081-9406-5eb35d70cee4 tempest-CreateVolumesFromSnapshotTest-1406547820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:56:16 devstack sudo[104639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc Sep 22 15:56:16 devstack sudo[104639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:56:16 devstack sudo[104639]: pam_unix(sudo:session): session closed for user root Sep 22 15:56:16 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-b10f144d-5bc2-4081-9406-5eb35d70cee4 tempest-CreateVolumesFromSnapshotTest-1406547820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc" returned: 0 in 0.286s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:56:16 devstack cinder-volume[86212]: DEBUG cinder.manager [None req-b10f144d-5bc2-4081-9406-5eb35d70cee4 tempest-CreateVolumesFromSnapshotTest-1406547820 None] Notifying Schedulers of capabilities ... {{(pid=86212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 15:56:16 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-b10f144d-5bc2-4081-9406-5eb35d70cee4 tempest-CreateVolumesFromSnapshotTest-1406547820 None] Deleted volume successfully. Sep 22 15:56:16 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-b10f144d-5bc2-4081-9406-5eb35d70cee4 tempest-CreateVolumesFromSnapshotTest-1406547820 None] Lock "cinder-863420f6-f9cf-4ddf-9437-eca8acaf0807-delete_volume" released by "delete_volume" :: held 1.610s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:56:17 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-3f7bf3d4-7741-414d-a17b-daf0363dac4f tempest-CreateVolumesFromSnapshotTest-1406547820 None] Acquiring lock "cinder-dce703ca-cd1c-4ea3-8d0c-55ecb93228aa-delete_volume" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:56:17 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-3f7bf3d4-7741-414d-a17b-daf0363dac4f tempest-CreateVolumesFromSnapshotTest-1406547820 None] Lock "cinder-dce703ca-cd1c-4ea3-8d0c-55ecb93228aa-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:56:17 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-3f7bf3d4-7741-414d-a17b-daf0363dac4f tempest-CreateVolumesFromSnapshotTest-1406547820 None] Acquiring lock "cinder-quobyte-dce703ca-cd1c-4ea3-8d0c-55ecb93228aa" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:56:17 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-3f7bf3d4-7741-414d-a17b-daf0363dac4f tempest-CreateVolumesFromSnapshotTest-1406547820 None] Lock "cinder-quobyte-dce703ca-cd1c-4ea3-8d0c-55ecb93228aa" acquired by "delete_volume" :: waited 0.032s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:56:17 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[303e0153-ba32-46c5-ad15-0c01045127e7]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:56:17 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-3f7bf3d4-7741-414d-a17b-daf0363dac4f tempest-CreateVolumesFromSnapshotTest-1406547820 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-dce703ca-cd1c-4ea3-8d0c-55ecb93228aa {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:56:17 devstack cinder-volume[86212]: DEBUG cinder.volume.flows.manager.create_volume [None req-65be17f7-6f51-40d6-9586-57a129e24bc8 tempest-CreateVolumesFromImageTest-1870167345 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 15:56:17 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-65be17f7-6f51-40d6-9586-57a129e24bc8 tempest-CreateVolumesFromImageTest-1870167345 None] Flow 'volume_create_manager' (63812df4-960a-4f49-a2ed-fc495ccbe5ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:56:17 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-65be17f7-6f51-40d6-9586-57a129e24bc8 tempest-CreateVolumesFromImageTest-1870167345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (768b0c0d-0441-4fc2-aba6-e9b30ef34a93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:56:17 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-65be17f7-6f51-40d6-9586-57a129e24bc8 tempest-CreateVolumesFromImageTest-1870167345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (768b0c0d-0441-4fc2-aba6-e9b30ef34a93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:56:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-115173377',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36266a84-667b-4570-9f56-71b87687fb6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7288268a2184b768aae50c9ad97e2a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:56:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:56:18Z,use_quota=True,user_id='1a37851380ab4e2797e898d6d532f712',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:56:17 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-65be17f7-6f51-40d6-9586-57a129e24bc8 tempest-CreateVolumesFromImageTest-1870167345 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2322a30b-c371-458e-9eeb-6f5c8f9e294e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:56:17 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-65be17f7-6f51-40d6-9586-57a129e24bc8 tempest-CreateVolumesFromImageTest-1870167345 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2322a30b-c371-458e-9eeb-6f5c8f9e294e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:56:17 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-65be17f7-6f51-40d6-9586-57a129e24bc8 tempest-CreateVolumesFromImageTest-1870167345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bee4dc38-3e18-478b-92c8-9adcf1a3aaf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:56:17 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-65be17f7-6f51-40d6-9586-57a129e24bc8 tempest-CreateVolumesFromImageTest-1870167345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bee4dc38-3e18-478b-92c8-9adcf1a3aaf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '36266a84-667b-4570-9f56-71b87687fb6e', 'volume_name': 'volume-36266a84-667b-4570-9f56-71b87687fb6e', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:56:17 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-65be17f7-6f51-40d6-9586-57a129e24bc8 tempest-CreateVolumesFromImageTest-1870167345 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44cd1134-4c14-4ee3-a8ef-5aa584e43e81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:56:17 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-65be17f7-6f51-40d6-9586-57a129e24bc8 tempest-CreateVolumesFromImageTest-1870167345 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44cd1134-4c14-4ee3-a8ef-5aa584e43e81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:56:17 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-65be17f7-6f51-40d6-9586-57a129e24bc8 tempest-CreateVolumesFromImageTest-1870167345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28072b30-d083-4bc9-a81b-8cdb846a5c30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:56:17 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-65be17f7-6f51-40d6-9586-57a129e24bc8 tempest-CreateVolumesFromImageTest-1870167345 None] Volume 36266a84-667b-4570-9f56-71b87687fb6e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-36266a84-667b-4570-9f56-71b87687fb6e', 'volume_size': 1} Sep 22 15:56:17 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-65be17f7-6f51-40d6-9586-57a129e24bc8 tempest-CreateVolumesFromImageTest-1870167345 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:56:17 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-65be17f7-6f51-40d6-9586-57a129e24bc8 tempest-CreateVolumesFromImageTest-1870167345 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:56:17 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-65be17f7-6f51-40d6-9586-57a129e24bc8 tempest-CreateVolumesFromImageTest-1870167345 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:56:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-115173377',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36266a84-667b-4570-9f56-71b87687fb6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7288268a2184b768aae50c9ad97e2a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:56:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:56:18Z,use_quota=True,user_id='1a37851380ab4e2797e898d6d532f712',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)}" {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 15:56:17 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-65be17f7-6f51-40d6-9586-57a129e24bc8 tempest-CreateVolumesFromImageTest-1870167345 None] Creating volume 36266a84-667b-4570-9f56-71b87687fb6e {{(pid=86212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 15:56:17 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-65be17f7-6f51-40d6-9586-57a129e24bc8 tempest-CreateVolumesFromImageTest-1870167345 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:56:17 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-65be17f7-6f51-40d6-9586-57a129e24bc8 tempest-CreateVolumesFromImageTest-1870167345 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:56:17 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-65be17f7-6f51-40d6-9586-57a129e24bc8 tempest-CreateVolumesFromImageTest-1870167345 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:56:17 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-65be17f7-6f51-40d6-9586-57a129e24bc8 tempest-CreateVolumesFromImageTest-1870167345 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:56:17 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-65be17f7-6f51-40d6-9586-57a129e24bc8 tempest-CreateVolumesFromImageTest-1870167345 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:56:17 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-65be17f7-6f51-40d6-9586-57a129e24bc8 tempest-CreateVolumesFromImageTest-1870167345 None] Selected osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 as target Quobyte volume. {{(pid=86212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 15:56:17 devstack cinder-volume[86212]: INFO cinder.volume.drivers.remotefs [None req-65be17f7-6f51-40d6-9586-57a129e24bc8 tempest-CreateVolumesFromImageTest-1870167345 None] casted to osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 Sep 22 15:56:17 devstack sudo[104642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-dce703ca-cd1c-4ea3-8d0c-55ecb93228aa Sep 22 15:56:17 devstack sudo[104642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:56:17 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-65be17f7-6f51-40d6-9586-57a129e24bc8 tempest-CreateVolumesFromImageTest-1870167345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-36266a84-667b-4570-9f56-71b87687fb6e 1073741824 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:56:17 devstack sudo[104644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-36266a84-667b-4570-9f56-71b87687fb6e 1073741824 Sep 22 15:56:17 devstack sudo[104644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:56:18 devstack sudo[104642]: pam_unix(sudo:session): session closed for user root Sep 22 15:56:18 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-3f7bf3d4-7741-414d-a17b-daf0363dac4f tempest-CreateVolumesFromSnapshotTest-1406547820 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-dce703ca-cd1c-4ea3-8d0c-55ecb93228aa" returned: 0 in 0.602s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:56:18 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-3f7bf3d4-7741-414d-a17b-daf0363dac4f tempest-CreateVolumesFromSnapshotTest-1406547820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-dce703ca-cd1c-4ea3-8d0c-55ecb93228aa {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:56:18 devstack sudo[104654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-dce703ca-cd1c-4ea3-8d0c-55ecb93228aa Sep 22 15:56:18 devstack sudo[104654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:56:18 devstack sudo[104644]: pam_unix(sudo:session): session closed for user root Sep 22 15:56:18 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-65be17f7-6f51-40d6-9586-57a129e24bc8 tempest-CreateVolumesFromImageTest-1870167345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-36266a84-667b-4570-9f56-71b87687fb6e 1073741824" returned: 0 in 0.604s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:56:18 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-65be17f7-6f51-40d6-9586-57a129e24bc8 tempest-CreateVolumesFromImageTest-1870167345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-36266a84-667b-4570-9f56-71b87687fb6e {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:56:18 devstack sudo[104656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-36266a84-667b-4570-9f56-71b87687fb6e Sep 22 15:56:18 devstack sudo[104656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:56:18 devstack sudo[104654]: pam_unix(sudo:session): session closed for user root Sep 22 15:56:18 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-3f7bf3d4-7741-414d-a17b-daf0363dac4f tempest-CreateVolumesFromSnapshotTest-1406547820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-dce703ca-cd1c-4ea3-8d0c-55ecb93228aa" returned: 0 in 0.391s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:56:18 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-3f7bf3d4-7741-414d-a17b-daf0363dac4f tempest-CreateVolumesFromSnapshotTest-1406547820 None] Lock "cinder-quobyte-dce703ca-cd1c-4ea3-8d0c-55ecb93228aa" released by "delete_volume" :: held 1.084s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:56:18 devstack sudo[104656]: pam_unix(sudo:session): session closed for user root Sep 22 15:56:18 devstack cinder-volume[86212]: DEBUG cinder.quota [None req-3f7bf3d4-7741-414d-a17b-daf0363dac4f tempest-CreateVolumesFromSnapshotTest-1406547820 None] Created reservations ['6467f3f6-7fa7-4f99-8766-862922b48ff4', 'a66084cc-4e8a-4190-9767-4d9fe3e60ff4', '2e5c137d-bebe-44fa-ad89-be7465cfeccb', '12a3cc93-a590-4275-bacc-df8ed1671cff'] {{(pid=86212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 15:56:18 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-65be17f7-6f51-40d6-9586-57a129e24bc8 tempest-CreateVolumesFromImageTest-1870167345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-36266a84-667b-4570-9f56-71b87687fb6e" returned: 0 in 0.386s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:56:18 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-65be17f7-6f51-40d6-9586-57a129e24bc8 tempest-CreateVolumesFromImageTest-1870167345 None] <== create_volume: return (1064ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'} {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 15:56:18 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-65be17f7-6f51-40d6-9586-57a129e24bc8 tempest-CreateVolumesFromImageTest-1870167345 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.067s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:56:18 devstack cinder-volume[86212]: DEBUG cinder.volume.flows.manager.create_volume [None req-48359f70-326e-41b3-95cb-b13a0b37334e tempest-CreateVolumesFromImageTest-1870167345 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 15:56:18 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-48359f70-326e-41b3-95cb-b13a0b37334e tempest-CreateVolumesFromImageTest-1870167345 None] Flow 'volume_create_manager' (107afa1e-3003-4a11-ba9c-0d80313c4e3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:56:18 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-48359f70-326e-41b3-95cb-b13a0b37334e tempest-CreateVolumesFromImageTest-1870167345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1ebe929-ec2a-4e5a-9c9d-7767f7e437e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:56:18 devstack cinder-volume[86212]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b5fd5af-8275-4685-b9de-19f9005b0a15 tempest-VolumeDependencyTests-1291485210 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 15:56:18 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-8b5fd5af-8275-4685-b9de-19f9005b0a15 tempest-VolumeDependencyTests-1291485210 None] Flow 'volume_create_manager' (e118960b-6488-448f-99d3-85c285372975) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:56:18 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-8b5fd5af-8275-4685-b9de-19f9005b0a15 tempest-VolumeDependencyTests-1291485210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee573fc3-a1f8-4830-bd39-42573fce3e4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:56:19 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-48359f70-326e-41b3-95cb-b13a0b37334e tempest-CreateVolumesFromImageTest-1870167345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1ebe929-ec2a-4e5a-9c9d-7767f7e437e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:56:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-324968409',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfe8d334-20c1-4d43-902f-8e70a325ace2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7288268a2184b768aae50c9ad97e2a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:56:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:56:19Z,use_quota=True,user_id='1a37851380ab4e2797e898d6d532f712',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:56:19 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-48359f70-326e-41b3-95cb-b13a0b37334e tempest-CreateVolumesFromImageTest-1870167345 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba68e339-de2b-4008-a527-33819037a5a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:56:19 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-48359f70-326e-41b3-95cb-b13a0b37334e tempest-CreateVolumesFromImageTest-1870167345 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba68e339-de2b-4008-a527-33819037a5a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:56:19 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-48359f70-326e-41b3-95cb-b13a0b37334e tempest-CreateVolumesFromImageTest-1870167345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73a1f55a-97f9-4f3e-9012-485725b6f806) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:56:19 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-48359f70-326e-41b3-95cb-b13a0b37334e tempest-CreateVolumesFromImageTest-1870167345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73a1f55a-97f9-4f3e-9012-485725b6f806) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dfe8d334-20c1-4d43-902f-8e70a325ace2', 'volume_name': 'volume-dfe8d334-20c1-4d43-902f-8e70a325ace2', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:56:19 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-48359f70-326e-41b3-95cb-b13a0b37334e tempest-CreateVolumesFromImageTest-1870167345 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0b65747-2e91-427f-9095-fa4430bbf657) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:56:19 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-48359f70-326e-41b3-95cb-b13a0b37334e tempest-CreateVolumesFromImageTest-1870167345 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0b65747-2e91-427f-9095-fa4430bbf657) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:56:19 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-48359f70-326e-41b3-95cb-b13a0b37334e tempest-CreateVolumesFromImageTest-1870167345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b39bec4-4b68-4fe6-a5a3-9a1bd24266b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:56:19 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-48359f70-326e-41b3-95cb-b13a0b37334e tempest-CreateVolumesFromImageTest-1870167345 None] Volume dfe8d334-20c1-4d43-902f-8e70a325ace2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dfe8d334-20c1-4d43-902f-8e70a325ace2', 'volume_size': 1} Sep 22 15:56:19 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-48359f70-326e-41b3-95cb-b13a0b37334e tempest-CreateVolumesFromImageTest-1870167345 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:56:19 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-48359f70-326e-41b3-95cb-b13a0b37334e tempest-CreateVolumesFromImageTest-1870167345 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:56:19 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-48359f70-326e-41b3-95cb-b13a0b37334e tempest-CreateVolumesFromImageTest-1870167345 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:56:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-324968409',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfe8d334-20c1-4d43-902f-8e70a325ace2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7288268a2184b768aae50c9ad97e2a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:56:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:56:19Z,use_quota=True,user_id='1a37851380ab4e2797e898d6d532f712',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)}" {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 15:56:19 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-48359f70-326e-41b3-95cb-b13a0b37334e tempest-CreateVolumesFromImageTest-1870167345 None] Creating volume dfe8d334-20c1-4d43-902f-8e70a325ace2 {{(pid=86212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 15:56:19 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-48359f70-326e-41b3-95cb-b13a0b37334e tempest-CreateVolumesFromImageTest-1870167345 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:56:19 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-48359f70-326e-41b3-95cb-b13a0b37334e tempest-CreateVolumesFromImageTest-1870167345 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:56:19 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-48359f70-326e-41b3-95cb-b13a0b37334e tempest-CreateVolumesFromImageTest-1870167345 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:56:19 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-48359f70-326e-41b3-95cb-b13a0b37334e tempest-CreateVolumesFromImageTest-1870167345 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:56:19 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-48359f70-326e-41b3-95cb-b13a0b37334e tempest-CreateVolumesFromImageTest-1870167345 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:56:19 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-48359f70-326e-41b3-95cb-b13a0b37334e tempest-CreateVolumesFromImageTest-1870167345 None] Selected osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 as target Quobyte volume. {{(pid=86212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 15:56:19 devstack cinder-volume[86212]: INFO cinder.volume.drivers.remotefs [None req-48359f70-326e-41b3-95cb-b13a0b37334e tempest-CreateVolumesFromImageTest-1870167345 None] casted to osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 Sep 22 15:56:19 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-48359f70-326e-41b3-95cb-b13a0b37334e tempest-CreateVolumesFromImageTest-1870167345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-dfe8d334-20c1-4d43-902f-8e70a325ace2 1073741824 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:56:19 devstack sudo[104661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-dfe8d334-20c1-4d43-902f-8e70a325ace2 1073741824 Sep 22 15:56:19 devstack sudo[104661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:56:19 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-8b5fd5af-8275-4685-b9de-19f9005b0a15 tempest-VolumeDependencyTests-1291485210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee573fc3-a1f8-4830-bd39-42573fce3e4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:56:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1965713460',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62b589a2-5362-4f3a-8d41-abc51acd6885,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7845e0469934739a12ee152120026e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:56:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:56:19Z,use_quota=True,user_id='e396d372c7a14b02a1aa84f0d6cd4376',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:56:19 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-8b5fd5af-8275-4685-b9de-19f9005b0a15 tempest-VolumeDependencyTests-1291485210 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e5bc03d-f63d-4abe-bf65-66ec5ba4971c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:56:19 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-8b5fd5af-8275-4685-b9de-19f9005b0a15 tempest-VolumeDependencyTests-1291485210 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e5bc03d-f63d-4abe-bf65-66ec5ba4971c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:56:19 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-8b5fd5af-8275-4685-b9de-19f9005b0a15 tempest-VolumeDependencyTests-1291485210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (000c85d1-927e-4de1-8a4a-6645fdb3ef03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:56:19 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-8b5fd5af-8275-4685-b9de-19f9005b0a15 tempest-VolumeDependencyTests-1291485210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (000c85d1-927e-4de1-8a4a-6645fdb3ef03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '62b589a2-5362-4f3a-8d41-abc51acd6885', 'volume_name': 'volume-62b589a2-5362-4f3a-8d41-abc51acd6885', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:56:19 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-8b5fd5af-8275-4685-b9de-19f9005b0a15 tempest-VolumeDependencyTests-1291485210 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff7b44f1-77d9-4ca9-a65f-65ce908b3079) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:56:19 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-8b5fd5af-8275-4685-b9de-19f9005b0a15 tempest-VolumeDependencyTests-1291485210 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff7b44f1-77d9-4ca9-a65f-65ce908b3079) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:56:19 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-8b5fd5af-8275-4685-b9de-19f9005b0a15 tempest-VolumeDependencyTests-1291485210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (678c08dc-f7da-48f5-8166-e32c8f2bfe20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:56:19 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-8b5fd5af-8275-4685-b9de-19f9005b0a15 tempest-VolumeDependencyTests-1291485210 None] Volume 62b589a2-5362-4f3a-8d41-abc51acd6885: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-62b589a2-5362-4f3a-8d41-abc51acd6885', 'volume_size': 1} Sep 22 15:56:19 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-8b5fd5af-8275-4685-b9de-19f9005b0a15 tempest-VolumeDependencyTests-1291485210 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:56:19 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-65be17f7-6f51-40d6-9586-57a129e24bc8 tempest-CreateVolumesFromImageTest-1870167345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28072b30-d083-4bc9-a81b-8cdb846a5c30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36266a84-667b-4570-9f56-71b87687fb6e', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:56:19 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-65be17f7-6f51-40d6-9586-57a129e24bc8 tempest-CreateVolumesFromImageTest-1870167345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2cd143b9-79ec-4774-8f96-400228e6a5c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:56:19 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-65be17f7-6f51-40d6-9586-57a129e24bc8 tempest-CreateVolumesFromImageTest-1870167345 None] Volume volume-36266a84-667b-4570-9f56-71b87687fb6e (36266a84-667b-4570-9f56-71b87687fb6e): created successfully Sep 22 15:56:19 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-65be17f7-6f51-40d6-9586-57a129e24bc8 tempest-CreateVolumesFromImageTest-1870167345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2cd143b9-79ec-4774-8f96-400228e6a5c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:56:19 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-65be17f7-6f51-40d6-9586-57a129e24bc8 tempest-CreateVolumesFromImageTest-1870167345 None] Flow 'volume_create_manager' (63812df4-960a-4f49-a2ed-fc495ccbe5ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:56:19 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-a96e878d-345b-4f35-85ba-657c891f72de tempest-CreateVolumesFromSnapshotTest-1406547820 None] Acquiring lock "cinder-a70bc76d-af4c-4af6-ab46-3400d84760a7-delete_volume" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:56:19 devstack cinder-volume[86212]: DEBUG cinder.volume.flows.manager.create_volume [None req-038d4ed2-eff4-492f-803f-7677f06ae78f tempest-CreateVolumesFromImageTest-1870167345 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 15:56:19 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-038d4ed2-eff4-492f-803f-7677f06ae78f tempest-CreateVolumesFromImageTest-1870167345 None] Flow 'volume_create_manager' (05da25eb-f6e4-42f9-a323-0ee7674533ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:56:19 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-038d4ed2-eff4-492f-803f-7677f06ae78f tempest-CreateVolumesFromImageTest-1870167345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05f97102-72db-4f6d-b002-33672cffba98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:56:19 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-65be17f7-6f51-40d6-9586-57a129e24bc8 tempest-CreateVolumesFromImageTest-1870167345 None] Created volume successfully. Sep 22 15:56:19 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-a96e878d-345b-4f35-85ba-657c891f72de tempest-CreateVolumesFromSnapshotTest-1406547820 None] Lock "cinder-a70bc76d-af4c-4af6-ab46-3400d84760a7-delete_volume" acquired by "delete_volume" :: waited 0.113s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:56:19 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-038d4ed2-eff4-492f-803f-7677f06ae78f tempest-CreateVolumesFromImageTest-1870167345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05f97102-72db-4f6d-b002-33672cffba98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:56:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-141303090',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49b91e70-8aae-462d-936d-f2c9fbf72dfb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7288268a2184b768aae50c9ad97e2a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:56:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:56:19Z,use_quota=True,user_id='1a37851380ab4e2797e898d6d532f712',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:56:19 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-038d4ed2-eff4-492f-803f-7677f06ae78f tempest-CreateVolumesFromImageTest-1870167345 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (988fd16f-e419-449c-bf7d-eb98dc45589c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:56:19 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-038d4ed2-eff4-492f-803f-7677f06ae78f tempest-CreateVolumesFromImageTest-1870167345 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (988fd16f-e419-449c-bf7d-eb98dc45589c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:56:19 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-038d4ed2-eff4-492f-803f-7677f06ae78f tempest-CreateVolumesFromImageTest-1870167345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a56de367-e3b4-452f-aeb7-a0100f54bf00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:56:19 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-038d4ed2-eff4-492f-803f-7677f06ae78f tempest-CreateVolumesFromImageTest-1870167345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a56de367-e3b4-452f-aeb7-a0100f54bf00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '49b91e70-8aae-462d-936d-f2c9fbf72dfb', 'volume_name': 'volume-49b91e70-8aae-462d-936d-f2c9fbf72dfb', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:56:19 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-038d4ed2-eff4-492f-803f-7677f06ae78f tempest-CreateVolumesFromImageTest-1870167345 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba4a2f7f-1f1f-40e7-ace7-877e7c567f0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:56:19 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-038d4ed2-eff4-492f-803f-7677f06ae78f tempest-CreateVolumesFromImageTest-1870167345 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba4a2f7f-1f1f-40e7-ace7-877e7c567f0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:56:19 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-038d4ed2-eff4-492f-803f-7677f06ae78f tempest-CreateVolumesFromImageTest-1870167345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d932f505-eacb-49e7-8a09-66432f16b6dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:56:19 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-038d4ed2-eff4-492f-803f-7677f06ae78f tempest-CreateVolumesFromImageTest-1870167345 None] Volume 49b91e70-8aae-462d-936d-f2c9fbf72dfb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-49b91e70-8aae-462d-936d-f2c9fbf72dfb', 'volume_size': 1} Sep 22 15:56:19 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-038d4ed2-eff4-492f-803f-7677f06ae78f tempest-CreateVolumesFromImageTest-1870167345 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:56:19 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-3f7bf3d4-7741-414d-a17b-daf0363dac4f tempest-CreateVolumesFromSnapshotTest-1406547820 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:56:19 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-3f7bf3d4-7741-414d-a17b-daf0363dac4f tempest-CreateVolumesFromSnapshotTest-1406547820 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:56:19 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-3f7bf3d4-7741-414d-a17b-daf0363dac4f tempest-CreateVolumesFromSnapshotTest-1406547820 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:56:19 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-3f7bf3d4-7741-414d-a17b-daf0363dac4f tempest-CreateVolumesFromSnapshotTest-1406547820 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:56:19 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-3f7bf3d4-7741-414d-a17b-daf0363dac4f tempest-CreateVolumesFromSnapshotTest-1406547820 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:56:19 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-3f7bf3d4-7741-414d-a17b-daf0363dac4f tempest-CreateVolumesFromSnapshotTest-1406547820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:56:19 devstack sudo[104666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc Sep 22 15:56:19 devstack sudo[104666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:56:19 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-a96e878d-345b-4f35-85ba-657c891f72de tempest-CreateVolumesFromSnapshotTest-1406547820 None] Acquiring lock "cinder-quobyte-a70bc76d-af4c-4af6-ab46-3400d84760a7" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:56:19 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-a96e878d-345b-4f35-85ba-657c891f72de tempest-CreateVolumesFromSnapshotTest-1406547820 None] Lock "cinder-quobyte-a70bc76d-af4c-4af6-ab46-3400d84760a7" acquired by "delete_volume" :: waited 0.023s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:56:19 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[57450726-4ed6-425d-a148-3e5ff632f39a]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:56:19 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-a96e878d-345b-4f35-85ba-657c891f72de tempest-CreateVolumesFromSnapshotTest-1406547820 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a70bc76d-af4c-4af6-ab46-3400d84760a7 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:56:19 devstack cinder-volume[86212]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5a681c8-cbdf-442b-825b-5c17e3826112 tempest-CreateVolumesFromImageTest-1870167345 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 15:56:19 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-c5a681c8-cbdf-442b-825b-5c17e3826112 tempest-CreateVolumesFromImageTest-1870167345 None] Flow 'volume_create_manager' (86719cdf-af40-463d-bc9f-86fd0d3ed74e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:56:19 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-c5a681c8-cbdf-442b-825b-5c17e3826112 tempest-CreateVolumesFromImageTest-1870167345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (784e91ad-45ae-4b61-b480-f77fea209930) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:56:19 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-c5a681c8-cbdf-442b-825b-5c17e3826112 tempest-CreateVolumesFromImageTest-1870167345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (784e91ad-45ae-4b61-b480-f77fea209930) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:56:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1695493413',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b072eb0a-c9cd-4159-aaae-061b3421b8a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7288268a2184b768aae50c9ad97e2a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:56:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:56:20Z,use_quota=True,user_id='1a37851380ab4e2797e898d6d532f712',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:56:19 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-c5a681c8-cbdf-442b-825b-5c17e3826112 tempest-CreateVolumesFromImageTest-1870167345 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94956175-5502-4544-8134-f28d6a121ae8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:56:19 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-c5a681c8-cbdf-442b-825b-5c17e3826112 tempest-CreateVolumesFromImageTest-1870167345 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94956175-5502-4544-8134-f28d6a121ae8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:56:19 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-c5a681c8-cbdf-442b-825b-5c17e3826112 tempest-CreateVolumesFromImageTest-1870167345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afe5d979-ead0-4684-b61c-e8ad09b75004) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:56:19 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-c5a681c8-cbdf-442b-825b-5c17e3826112 tempest-CreateVolumesFromImageTest-1870167345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afe5d979-ead0-4684-b61c-e8ad09b75004) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b072eb0a-c9cd-4159-aaae-061b3421b8a3', 'volume_name': 'volume-b072eb0a-c9cd-4159-aaae-061b3421b8a3', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:56:19 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-c5a681c8-cbdf-442b-825b-5c17e3826112 tempest-CreateVolumesFromImageTest-1870167345 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3019d90a-95d6-44e5-bb33-b1a14cdbd2f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:56:19 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-c5a681c8-cbdf-442b-825b-5c17e3826112 tempest-CreateVolumesFromImageTest-1870167345 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3019d90a-95d6-44e5-bb33-b1a14cdbd2f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:56:19 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-c5a681c8-cbdf-442b-825b-5c17e3826112 tempest-CreateVolumesFromImageTest-1870167345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cad6da50-79a2-4cbb-863e-899d1db06e92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:56:19 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-c5a681c8-cbdf-442b-825b-5c17e3826112 tempest-CreateVolumesFromImageTest-1870167345 None] Volume b072eb0a-c9cd-4159-aaae-061b3421b8a3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b072eb0a-c9cd-4159-aaae-061b3421b8a3', 'volume_size': 1} Sep 22 15:56:19 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-c5a681c8-cbdf-442b-825b-5c17e3826112 tempest-CreateVolumesFromImageTest-1870167345 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:56:19 devstack sudo[104661]: pam_unix(sudo:session): session closed for user root Sep 22 15:56:19 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-48359f70-326e-41b3-95cb-b13a0b37334e tempest-CreateVolumesFromImageTest-1870167345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-dfe8d334-20c1-4d43-902f-8e70a325ace2 1073741824" returned: 0 in 0.717s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:56:19 devstack sudo[104669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a70bc76d-af4c-4af6-ab46-3400d84760a7 Sep 22 15:56:19 devstack sudo[104669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:56:19 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-48359f70-326e-41b3-95cb-b13a0b37334e tempest-CreateVolumesFromImageTest-1870167345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-dfe8d334-20c1-4d43-902f-8e70a325ace2 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:56:20 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-3f7bf3d4-7741-414d-a17b-daf0363dac4f tempest-CreateVolumesFromSnapshotTest-1406547820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc" returned: 0 in 0.457s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:56:20 devstack cinder-volume[86212]: DEBUG cinder.manager [None req-3f7bf3d4-7741-414d-a17b-daf0363dac4f tempest-CreateVolumesFromSnapshotTest-1406547820 None] Notifying Schedulers of capabilities ... {{(pid=86212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 15:56:20 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-3f7bf3d4-7741-414d-a17b-daf0363dac4f tempest-CreateVolumesFromSnapshotTest-1406547820 None] Deleted volume successfully. Sep 22 15:56:20 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-3f7bf3d4-7741-414d-a17b-daf0363dac4f tempest-CreateVolumesFromSnapshotTest-1406547820 None] Lock "cinder-dce703ca-cd1c-4ea3-8d0c-55ecb93228aa-delete_volume" released by "delete_volume" :: held 2.547s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:56:19 devstack sudo[104671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-dfe8d334-20c1-4d43-902f-8e70a325ace2 Sep 22 15:56:19 devstack sudo[104671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:56:19 devstack sudo[104666]: pam_unix(sudo:session): session closed for user root Sep 22 15:56:20 devstack cinder-volume[86212]: DEBUG cinder.volume.flows.manager.create_volume [None req-4041f2bd-91a2-46d4-8dbd-0fc6ab8423c5 tempest-CreateVolumesFromImageTest-1870167345 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 15:56:20 devstack sudo[104669]: pam_unix(sudo:session): session closed for user root Sep 22 15:56:20 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-4041f2bd-91a2-46d4-8dbd-0fc6ab8423c5 tempest-CreateVolumesFromImageTest-1870167345 None] Flow 'volume_create_manager' (b308fb67-d537-498c-976f-8ba551174df1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:56:20 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-4041f2bd-91a2-46d4-8dbd-0fc6ab8423c5 tempest-CreateVolumesFromImageTest-1870167345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6db5311-ec00-4327-be55-6771ccb6169e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:56:20 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-a96e878d-345b-4f35-85ba-657c891f72de tempest-CreateVolumesFromSnapshotTest-1406547820 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a70bc76d-af4c-4af6-ab46-3400d84760a7" returned: 0 in 0.628s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:56:20 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-a96e878d-345b-4f35-85ba-657c891f72de tempest-CreateVolumesFromSnapshotTest-1406547820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a70bc76d-af4c-4af6-ab46-3400d84760a7 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:56:20 devstack sudo[104680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a70bc76d-af4c-4af6-ab46-3400d84760a7 Sep 22 15:56:20 devstack sudo[104680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:56:20 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-4041f2bd-91a2-46d4-8dbd-0fc6ab8423c5 tempest-CreateVolumesFromImageTest-1870167345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6db5311-ec00-4327-be55-6771ccb6169e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:56:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1918489224',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b570bbc-7321-4893-bdfe-181bb9e00bc2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7288268a2184b768aae50c9ad97e2a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:56:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:56:20Z,use_quota=True,user_id='1a37851380ab4e2797e898d6d532f712',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:56:20 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-4041f2bd-91a2-46d4-8dbd-0fc6ab8423c5 tempest-CreateVolumesFromImageTest-1870167345 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e2ebe8b-7a93-49cd-8beb-252c85b8c564) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:56:20 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-4041f2bd-91a2-46d4-8dbd-0fc6ab8423c5 tempest-CreateVolumesFromImageTest-1870167345 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e2ebe8b-7a93-49cd-8beb-252c85b8c564) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:56:20 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-4041f2bd-91a2-46d4-8dbd-0fc6ab8423c5 tempest-CreateVolumesFromImageTest-1870167345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e770e66e-0ea1-466d-9163-6caf5d49a963) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:56:20 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-4041f2bd-91a2-46d4-8dbd-0fc6ab8423c5 tempest-CreateVolumesFromImageTest-1870167345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e770e66e-0ea1-466d-9163-6caf5d49a963) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2b570bbc-7321-4893-bdfe-181bb9e00bc2', 'volume_name': 'volume-2b570bbc-7321-4893-bdfe-181bb9e00bc2', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:56:20 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-4041f2bd-91a2-46d4-8dbd-0fc6ab8423c5 tempest-CreateVolumesFromImageTest-1870167345 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00f093bf-1206-4d2c-8a20-52ce17f123e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:56:20 devstack sudo[104671]: pam_unix(sudo:session): session closed for user root Sep 22 15:56:20 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-4041f2bd-91a2-46d4-8dbd-0fc6ab8423c5 tempest-CreateVolumesFromImageTest-1870167345 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00f093bf-1206-4d2c-8a20-52ce17f123e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:56:20 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-4041f2bd-91a2-46d4-8dbd-0fc6ab8423c5 tempest-CreateVolumesFromImageTest-1870167345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82a3e6bc-c6bf-4d16-8e7f-72e4652df0e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:56:20 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-4041f2bd-91a2-46d4-8dbd-0fc6ab8423c5 tempest-CreateVolumesFromImageTest-1870167345 None] Volume 2b570bbc-7321-4893-bdfe-181bb9e00bc2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2b570bbc-7321-4893-bdfe-181bb9e00bc2', 'volume_size': 1} Sep 22 15:56:20 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-4041f2bd-91a2-46d4-8dbd-0fc6ab8423c5 tempest-CreateVolumesFromImageTest-1870167345 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:56:20 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-48359f70-326e-41b3-95cb-b13a0b37334e tempest-CreateVolumesFromImageTest-1870167345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-dfe8d334-20c1-4d43-902f-8e70a325ace2" returned: 0 in 0.525s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:56:20 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-48359f70-326e-41b3-95cb-b13a0b37334e tempest-CreateVolumesFromImageTest-1870167345 None] <== create_volume: return (1292ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'} {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 15:56:20 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-48359f70-326e-41b3-95cb-b13a0b37334e tempest-CreateVolumesFromImageTest-1870167345 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.297s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:56:20 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-8b5fd5af-8275-4685-b9de-19f9005b0a15 tempest-VolumeDependencyTests-1291485210 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.178s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:56:20 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-8b5fd5af-8275-4685-b9de-19f9005b0a15 tempest-VolumeDependencyTests-1291485210 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:56:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1965713460',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62b589a2-5362-4f3a-8d41-abc51acd6885,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7845e0469934739a12ee152120026e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:56:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:56:19Z,use_quota=True,user_id='e396d372c7a14b02a1aa84f0d6cd4376',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)}" {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 15:56:20 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-8b5fd5af-8275-4685-b9de-19f9005b0a15 tempest-VolumeDependencyTests-1291485210 None] Creating volume 62b589a2-5362-4f3a-8d41-abc51acd6885 {{(pid=86212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 15:56:20 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-8b5fd5af-8275-4685-b9de-19f9005b0a15 tempest-VolumeDependencyTests-1291485210 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:56:20 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-8b5fd5af-8275-4685-b9de-19f9005b0a15 tempest-VolumeDependencyTests-1291485210 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:56:20 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-8b5fd5af-8275-4685-b9de-19f9005b0a15 tempest-VolumeDependencyTests-1291485210 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:56:20 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-8b5fd5af-8275-4685-b9de-19f9005b0a15 tempest-VolumeDependencyTests-1291485210 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:56:20 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-8b5fd5af-8275-4685-b9de-19f9005b0a15 tempest-VolumeDependencyTests-1291485210 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:56:20 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-8b5fd5af-8275-4685-b9de-19f9005b0a15 tempest-VolumeDependencyTests-1291485210 None] Selected osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 as target Quobyte volume. {{(pid=86212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 15:56:20 devstack cinder-volume[86212]: INFO cinder.volume.drivers.remotefs [None req-8b5fd5af-8275-4685-b9de-19f9005b0a15 tempest-VolumeDependencyTests-1291485210 None] casted to osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 Sep 22 15:56:20 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-8b5fd5af-8275-4685-b9de-19f9005b0a15 tempest-VolumeDependencyTests-1291485210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-62b589a2-5362-4f3a-8d41-abc51acd6885 1073741824 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:56:20 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-48359f70-326e-41b3-95cb-b13a0b37334e tempest-CreateVolumesFromImageTest-1870167345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b39bec4-4b68-4fe6-a5a3-9a1bd24266b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dfe8d334-20c1-4d43-902f-8e70a325ace2', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:56:20 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-48359f70-326e-41b3-95cb-b13a0b37334e tempest-CreateVolumesFromImageTest-1870167345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae9f8117-a3e3-49cc-8b17-416d8d27823c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:56:20 devstack sudo[104683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-62b589a2-5362-4f3a-8d41-abc51acd6885 1073741824 Sep 22 15:56:20 devstack sudo[104683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:56:20 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-48359f70-326e-41b3-95cb-b13a0b37334e tempest-CreateVolumesFromImageTest-1870167345 None] Volume volume-dfe8d334-20c1-4d43-902f-8e70a325ace2 (dfe8d334-20c1-4d43-902f-8e70a325ace2): created successfully Sep 22 15:56:20 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-48359f70-326e-41b3-95cb-b13a0b37334e tempest-CreateVolumesFromImageTest-1870167345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae9f8117-a3e3-49cc-8b17-416d8d27823c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:56:20 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-48359f70-326e-41b3-95cb-b13a0b37334e tempest-CreateVolumesFromImageTest-1870167345 None] Flow 'volume_create_manager' (107afa1e-3003-4a11-ba9c-0d80313c4e3f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:56:20 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-48359f70-326e-41b3-95cb-b13a0b37334e tempest-CreateVolumesFromImageTest-1870167345 None] Created volume successfully. Sep 22 15:56:20 devstack sudo[104680]: pam_unix(sudo:session): session closed for user root Sep 22 15:56:20 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-a96e878d-345b-4f35-85ba-657c891f72de tempest-CreateVolumesFromSnapshotTest-1406547820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a70bc76d-af4c-4af6-ab46-3400d84760a7" returned: 0 in 0.366s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:56:20 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-a96e878d-345b-4f35-85ba-657c891f72de tempest-CreateVolumesFromSnapshotTest-1406547820 None] Lock "cinder-quobyte-a70bc76d-af4c-4af6-ab46-3400d84760a7" released by "delete_volume" :: held 1.062s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:56:20 devstack cinder-volume[86212]: DEBUG cinder.quota [None req-a96e878d-345b-4f35-85ba-657c891f72de tempest-CreateVolumesFromSnapshotTest-1406547820 None] Created reservations ['0b41407c-ef75-43d5-9264-cf549a31033f', 'd9974bc1-5762-4a96-80f9-61a8d7a05643', '05a9eab1-86b8-463f-8ba3-11a9c5c9204b', 'c3ee17d2-48c3-45cf-97ff-3a2537241f0b'] {{(pid=86212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 15:56:20 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-a96e878d-345b-4f35-85ba-657c891f72de tempest-CreateVolumesFromSnapshotTest-1406547820 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:56:20 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-a96e878d-345b-4f35-85ba-657c891f72de tempest-CreateVolumesFromSnapshotTest-1406547820 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:56:20 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-a96e878d-345b-4f35-85ba-657c891f72de tempest-CreateVolumesFromSnapshotTest-1406547820 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:56:20 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-a96e878d-345b-4f35-85ba-657c891f72de tempest-CreateVolumesFromSnapshotTest-1406547820 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:56:20 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-a96e878d-345b-4f35-85ba-657c891f72de tempest-CreateVolumesFromSnapshotTest-1406547820 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:56:20 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-a96e878d-345b-4f35-85ba-657c891f72de tempest-CreateVolumesFromSnapshotTest-1406547820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:56:20 devstack sudo[104689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc Sep 22 15:56:20 devstack sudo[104689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:56:21 devstack sudo[104683]: pam_unix(sudo:session): session closed for user root Sep 22 15:56:21 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-8b5fd5af-8275-4685-b9de-19f9005b0a15 tempest-VolumeDependencyTests-1291485210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-62b589a2-5362-4f3a-8d41-abc51acd6885 1073741824" returned: 0 in 0.600s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:56:21 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-8b5fd5af-8275-4685-b9de-19f9005b0a15 tempest-VolumeDependencyTests-1291485210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-62b589a2-5362-4f3a-8d41-abc51acd6885 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:56:21 devstack sudo[104692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-62b589a2-5362-4f3a-8d41-abc51acd6885 Sep 22 15:56:21 devstack sudo[104692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:56:21 devstack sudo[104689]: pam_unix(sudo:session): session closed for user root Sep 22 15:56:21 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-a96e878d-345b-4f35-85ba-657c891f72de tempest-CreateVolumesFromSnapshotTest-1406547820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc" returned: 0 in 0.301s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:56:21 devstack cinder-volume[86212]: DEBUG cinder.manager [None req-a96e878d-345b-4f35-85ba-657c891f72de tempest-CreateVolumesFromSnapshotTest-1406547820 None] Notifying Schedulers of capabilities ... {{(pid=86212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 15:56:21 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-a96e878d-345b-4f35-85ba-657c891f72de tempest-CreateVolumesFromSnapshotTest-1406547820 None] Deleted volume successfully. Sep 22 15:56:21 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-a96e878d-345b-4f35-85ba-657c891f72de tempest-CreateVolumesFromSnapshotTest-1406547820 None] Lock "cinder-a70bc76d-af4c-4af6-ab46-3400d84760a7-delete_volume" released by "delete_volume" :: held 1.747s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:56:21 devstack sudo[104692]: pam_unix(sudo:session): session closed for user root Sep 22 15:56:21 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-8b5fd5af-8275-4685-b9de-19f9005b0a15 tempest-VolumeDependencyTests-1291485210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-62b589a2-5362-4f3a-8d41-abc51acd6885" returned: 0 in 0.308s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:56:21 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-8b5fd5af-8275-4685-b9de-19f9005b0a15 tempest-VolumeDependencyTests-1291485210 None] <== create_volume: return (967ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'} {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 15:56:21 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-8b5fd5af-8275-4685-b9de-19f9005b0a15 tempest-VolumeDependencyTests-1291485210 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.972s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:56:21 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-038d4ed2-eff4-492f-803f-7677f06ae78f tempest-CreateVolumesFromImageTest-1870167345 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.895s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:56:21 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-038d4ed2-eff4-492f-803f-7677f06ae78f tempest-CreateVolumesFromImageTest-1870167345 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:56:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-141303090',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49b91e70-8aae-462d-936d-f2c9fbf72dfb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7288268a2184b768aae50c9ad97e2a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:56:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:56:19Z,use_quota=True,user_id='1a37851380ab4e2797e898d6d532f712',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)}" {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 15:56:21 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-038d4ed2-eff4-492f-803f-7677f06ae78f tempest-CreateVolumesFromImageTest-1870167345 None] Creating volume 49b91e70-8aae-462d-936d-f2c9fbf72dfb {{(pid=86212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 15:56:21 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-038d4ed2-eff4-492f-803f-7677f06ae78f tempest-CreateVolumesFromImageTest-1870167345 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:56:21 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-038d4ed2-eff4-492f-803f-7677f06ae78f tempest-CreateVolumesFromImageTest-1870167345 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:56:21 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-038d4ed2-eff4-492f-803f-7677f06ae78f tempest-CreateVolumesFromImageTest-1870167345 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:56:21 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-038d4ed2-eff4-492f-803f-7677f06ae78f tempest-CreateVolumesFromImageTest-1870167345 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:56:21 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-038d4ed2-eff4-492f-803f-7677f06ae78f tempest-CreateVolumesFromImageTest-1870167345 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:56:21 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-038d4ed2-eff4-492f-803f-7677f06ae78f tempest-CreateVolumesFromImageTest-1870167345 None] Selected osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 as target Quobyte volume. {{(pid=86212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 15:56:21 devstack cinder-volume[86212]: INFO cinder.volume.drivers.remotefs [None req-038d4ed2-eff4-492f-803f-7677f06ae78f tempest-CreateVolumesFromImageTest-1870167345 None] casted to osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 Sep 22 15:56:21 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-038d4ed2-eff4-492f-803f-7677f06ae78f tempest-CreateVolumesFromImageTest-1870167345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-49b91e70-8aae-462d-936d-f2c9fbf72dfb 1073741824 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:56:21 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-8b5fd5af-8275-4685-b9de-19f9005b0a15 tempest-VolumeDependencyTests-1291485210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (678c08dc-f7da-48f5-8166-e32c8f2bfe20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-62b589a2-5362-4f3a-8d41-abc51acd6885', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:56:21 devstack sudo[104696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-49b91e70-8aae-462d-936d-f2c9fbf72dfb 1073741824 Sep 22 15:56:21 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-8b5fd5af-8275-4685-b9de-19f9005b0a15 tempest-VolumeDependencyTests-1291485210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cca77d3d-2dda-4e10-bf29-e71e43a00ed1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:56:21 devstack sudo[104696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:56:21 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-8b5fd5af-8275-4685-b9de-19f9005b0a15 tempest-VolumeDependencyTests-1291485210 None] Volume volume-62b589a2-5362-4f3a-8d41-abc51acd6885 (62b589a2-5362-4f3a-8d41-abc51acd6885): created successfully Sep 22 15:56:21 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-8b5fd5af-8275-4685-b9de-19f9005b0a15 tempest-VolumeDependencyTests-1291485210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cca77d3d-2dda-4e10-bf29-e71e43a00ed1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:56:21 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-8b5fd5af-8275-4685-b9de-19f9005b0a15 tempest-VolumeDependencyTests-1291485210 None] Flow 'volume_create_manager' (e118960b-6488-448f-99d3-85c285372975) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:56:21 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-8b5fd5af-8275-4685-b9de-19f9005b0a15 tempest-VolumeDependencyTests-1291485210 None] Created volume successfully. Sep 22 15:56:21 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-cceeea97-9cf0-4951-b210-34bbbdba353e tempest-CreateVolumesFromSnapshotTest-1406547820 None] Acquiring lock "cinder-d3820c96-9deb-4ae6-9b3f-483f6264971e-delete_volume" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:56:21 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-cceeea97-9cf0-4951-b210-34bbbdba353e tempest-CreateVolumesFromSnapshotTest-1406547820 None] Lock "cinder-d3820c96-9deb-4ae6-9b3f-483f6264971e-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:56:21 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-cceeea97-9cf0-4951-b210-34bbbdba353e tempest-CreateVolumesFromSnapshotTest-1406547820 None] Acquiring lock "cinder-quobyte-d3820c96-9deb-4ae6-9b3f-483f6264971e" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:56:21 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-cceeea97-9cf0-4951-b210-34bbbdba353e tempest-CreateVolumesFromSnapshotTest-1406547820 None] Lock "cinder-quobyte-d3820c96-9deb-4ae6-9b3f-483f6264971e" acquired by "delete_volume" :: waited 0.027s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:56:21 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8cba01c-5939-4fbd-b298-d9bf4d54b544]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:56:21 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-cceeea97-9cf0-4951-b210-34bbbdba353e tempest-CreateVolumesFromSnapshotTest-1406547820 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-d3820c96-9deb-4ae6-9b3f-483f6264971e {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:56:21 devstack sudo[104701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-d3820c96-9deb-4ae6-9b3f-483f6264971e Sep 22 15:56:21 devstack sudo[104701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:56:21 devstack sudo[104696]: pam_unix(sudo:session): session closed for user root Sep 22 15:56:21 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-038d4ed2-eff4-492f-803f-7677f06ae78f tempest-CreateVolumesFromImageTest-1870167345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-49b91e70-8aae-462d-936d-f2c9fbf72dfb 1073741824" returned: 0 in 0.563s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:56:21 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-038d4ed2-eff4-492f-803f-7677f06ae78f tempest-CreateVolumesFromImageTest-1870167345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-49b91e70-8aae-462d-936d-f2c9fbf72dfb {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:56:22 devstack sudo[104703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-49b91e70-8aae-462d-936d-f2c9fbf72dfb Sep 22 15:56:22 devstack sudo[104703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:56:22 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-5a281ea3-6f23-417c-a3ab-1979c0bc46a5 tempest-VolumeDependencyTests-1291485210 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:56:22 devstack sudo[104701]: pam_unix(sudo:session): session closed for user root Sep 22 15:56:22 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-cceeea97-9cf0-4951-b210-34bbbdba353e tempest-CreateVolumesFromSnapshotTest-1406547820 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-d3820c96-9deb-4ae6-9b3f-483f6264971e" returned: 0 in 0.439s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:56:22 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-cceeea97-9cf0-4951-b210-34bbbdba353e tempest-CreateVolumesFromSnapshotTest-1406547820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-d3820c96-9deb-4ae6-9b3f-483f6264971e {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:56:22 devstack sudo[104709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-d3820c96-9deb-4ae6-9b3f-483f6264971e Sep 22 15:56:22 devstack sudo[104709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:56:22 devstack sudo[104703]: pam_unix(sudo:session): session closed for user root Sep 22 15:56:22 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-038d4ed2-eff4-492f-803f-7677f06ae78f tempest-CreateVolumesFromImageTest-1870167345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-49b91e70-8aae-462d-936d-f2c9fbf72dfb" returned: 0 in 0.296s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:56:22 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-038d4ed2-eff4-492f-803f-7677f06ae78f tempest-CreateVolumesFromImageTest-1870167345 None] <== create_volume: return (906ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'} {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 15:56:22 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-038d4ed2-eff4-492f-803f-7677f06ae78f tempest-CreateVolumesFromImageTest-1870167345 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.909s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:56:22 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-c5a681c8-cbdf-442b-825b-5c17e3826112 tempest-CreateVolumesFromImageTest-1870167345 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.477s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:56:22 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-c5a681c8-cbdf-442b-825b-5c17e3826112 tempest-CreateVolumesFromImageTest-1870167345 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:56:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1695493413',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b072eb0a-c9cd-4159-aaae-061b3421b8a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7288268a2184b768aae50c9ad97e2a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:56:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:56:20Z,use_quota=True,user_id='1a37851380ab4e2797e898d6d532f712',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)}" {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 15:56:22 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-c5a681c8-cbdf-442b-825b-5c17e3826112 tempest-CreateVolumesFromImageTest-1870167345 None] Creating volume b072eb0a-c9cd-4159-aaae-061b3421b8a3 {{(pid=86212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 15:56:22 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-c5a681c8-cbdf-442b-825b-5c17e3826112 tempest-CreateVolumesFromImageTest-1870167345 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:56:22 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-c5a681c8-cbdf-442b-825b-5c17e3826112 tempest-CreateVolumesFromImageTest-1870167345 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:56:22 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-c5a681c8-cbdf-442b-825b-5c17e3826112 tempest-CreateVolumesFromImageTest-1870167345 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:56:22 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-c5a681c8-cbdf-442b-825b-5c17e3826112 tempest-CreateVolumesFromImageTest-1870167345 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:56:22 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-c5a681c8-cbdf-442b-825b-5c17e3826112 tempest-CreateVolumesFromImageTest-1870167345 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:56:22 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-c5a681c8-cbdf-442b-825b-5c17e3826112 tempest-CreateVolumesFromImageTest-1870167345 None] Selected osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 as target Quobyte volume. {{(pid=86212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 15:56:22 devstack cinder-volume[86212]: INFO cinder.volume.drivers.remotefs [None req-c5a681c8-cbdf-442b-825b-5c17e3826112 tempest-CreateVolumesFromImageTest-1870167345 None] casted to osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 Sep 22 15:56:22 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-c5a681c8-cbdf-442b-825b-5c17e3826112 tempest-CreateVolumesFromImageTest-1870167345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b072eb0a-c9cd-4159-aaae-061b3421b8a3 1073741824 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:56:22 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-038d4ed2-eff4-492f-803f-7677f06ae78f tempest-CreateVolumesFromImageTest-1870167345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d932f505-eacb-49e7-8a09-66432f16b6dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-49b91e70-8aae-462d-936d-f2c9fbf72dfb', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:56:22 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-038d4ed2-eff4-492f-803f-7677f06ae78f tempest-CreateVolumesFromImageTest-1870167345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff011fe4-d49c-45bd-8c0a-071849ea9ffc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:56:22 devstack sudo[104711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b072eb0a-c9cd-4159-aaae-061b3421b8a3 1073741824 Sep 22 15:56:22 devstack sudo[104711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:56:22 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-038d4ed2-eff4-492f-803f-7677f06ae78f tempest-CreateVolumesFromImageTest-1870167345 None] Volume volume-49b91e70-8aae-462d-936d-f2c9fbf72dfb (49b91e70-8aae-462d-936d-f2c9fbf72dfb): created successfully Sep 22 15:56:22 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-038d4ed2-eff4-492f-803f-7677f06ae78f tempest-CreateVolumesFromImageTest-1870167345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff011fe4-d49c-45bd-8c0a-071849ea9ffc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:56:22 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-038d4ed2-eff4-492f-803f-7677f06ae78f tempest-CreateVolumesFromImageTest-1870167345 None] Flow 'volume_create_manager' (05da25eb-f6e4-42f9-a323-0ee7674533ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:56:22 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-038d4ed2-eff4-492f-803f-7677f06ae78f tempest-CreateVolumesFromImageTest-1870167345 None] Created volume successfully. Sep 22 15:56:22 devstack sudo[104709]: pam_unix(sudo:session): session closed for user root Sep 22 15:56:22 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-cceeea97-9cf0-4951-b210-34bbbdba353e tempest-CreateVolumesFromSnapshotTest-1406547820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-d3820c96-9deb-4ae6-9b3f-483f6264971e" returned: 0 in 0.290s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:56:22 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-cceeea97-9cf0-4951-b210-34bbbdba353e tempest-CreateVolumesFromSnapshotTest-1406547820 None] Lock "cinder-quobyte-d3820c96-9deb-4ae6-9b3f-483f6264971e" released by "delete_volume" :: held 0.803s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:56:22 devstack cinder-volume[86212]: DEBUG cinder.quota [None req-cceeea97-9cf0-4951-b210-34bbbdba353e tempest-CreateVolumesFromSnapshotTest-1406547820 None] Created reservations ['352ec95b-e3f0-4e29-ac8b-f923ccee2580', 'f8d31734-c686-4937-8fdd-59672a4383c0', '2a72fc42-2cfa-4b73-ba27-75d4b31ad97e', '7182dd99-0445-45a9-a551-45fc99a8fc14'] {{(pid=86212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 15:56:22 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-cceeea97-9cf0-4951-b210-34bbbdba353e tempest-CreateVolumesFromSnapshotTest-1406547820 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:56:22 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-cceeea97-9cf0-4951-b210-34bbbdba353e tempest-CreateVolumesFromSnapshotTest-1406547820 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:56:22 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-cceeea97-9cf0-4951-b210-34bbbdba353e tempest-CreateVolumesFromSnapshotTest-1406547820 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:56:22 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-cceeea97-9cf0-4951-b210-34bbbdba353e tempest-CreateVolumesFromSnapshotTest-1406547820 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:56:22 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-cceeea97-9cf0-4951-b210-34bbbdba353e tempest-CreateVolumesFromSnapshotTest-1406547820 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:56:22 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-cceeea97-9cf0-4951-b210-34bbbdba353e tempest-CreateVolumesFromSnapshotTest-1406547820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:56:22 devstack sudo[104718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc Sep 22 15:56:22 devstack sudo[104718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:56:22 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-97c03c7a-36ff-456d-b317-16ea6b21e50a tempest-CreateVolumesFromSnapshotTest-1406547820 None] Acquiring lock "cinder-7bb1e354-c41f-4002-89a6-14b158f4331a-delete_snapshot" by "delete_snapshot" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:56:22 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-97c03c7a-36ff-456d-b317-16ea6b21e50a tempest-CreateVolumesFromSnapshotTest-1406547820 None] Lock "cinder-7bb1e354-c41f-4002-89a6-14b158f4331a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:56:22 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-97c03c7a-36ff-456d-b317-16ea6b21e50a tempest-CreateVolumesFromSnapshotTest-1406547820 None] Acquiring lock "cinder-quobyte-ce918ec7-3c0c-4f95-8f74-5e76be25bd61" by "delete_snapshot" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:56:22 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-97c03c7a-36ff-456d-b317-16ea6b21e50a tempest-CreateVolumesFromSnapshotTest-1406547820 None] Lock "cinder-quobyte-ce918ec7-3c0c-4f95-8f74-5e76be25bd61" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:56:22 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-97c03c7a-36ff-456d-b317-16ea6b21e50a tempest-CreateVolumesFromSnapshotTest-1406547820 None] Acquiring lock "cinder-quobyte-7bb1e354-c41f-4002-89a6-14b158f4331a" by "_delete_snapshot" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:56:22 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-97c03c7a-36ff-456d-b317-16ea6b21e50a tempest-CreateVolumesFromSnapshotTest-1406547820 None] Lock "cinder-quobyte-7bb1e354-c41f-4002-89a6-14b158f4331a" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:56:22 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-97c03c7a-36ff-456d-b317-16ea6b21e50a tempest-CreateVolumesFromSnapshotTest-1406547820 None] Deleting offline snapshot 7bb1e354-c41f-4002-89a6-14b158f4331a of volume ce918ec7-3c0c-4f95-8f74-5e76be25bd61 {{(pid=86212) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 22 15:56:22 devstack sudo[104711]: pam_unix(sudo:session): session closed for user root Sep 22 15:56:22 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-97c03c7a-36ff-456d-b317-16ea6b21e50a tempest-CreateVolumesFromSnapshotTest-1406547820 None] snapshot_file for this snap is: volume-ce918ec7-3c0c-4f95-8f74-5e76be25bd61.7bb1e354-c41f-4002-89a6-14b158f4331a {{(pid=86212) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 22 15:56:22 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-c5a681c8-cbdf-442b-825b-5c17e3826112 tempest-CreateVolumesFromImageTest-1870167345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b072eb0a-c9cd-4159-aaae-061b3421b8a3 1073741824" returned: 0 in 0.650s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:56:22 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4e39f3d-761a-4878-9699-97407ebba96f]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:56:22 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-97c03c7a-36ff-456d-b317-16ea6b21e50a tempest-CreateVolumesFromSnapshotTest-1406547820 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-ce918ec7-3c0c-4f95-8f74-5e76be25bd61.7bb1e354-c41f-4002-89a6-14b158f4331a {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:56:23 devstack sudo[104718]: pam_unix(sudo:session): session closed for user root Sep 22 15:56:23 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-cceeea97-9cf0-4951-b210-34bbbdba353e tempest-CreateVolumesFromSnapshotTest-1406547820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc" returned: 0 in 0.308s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:56:23 devstack cinder-volume[86212]: DEBUG cinder.manager [None req-cceeea97-9cf0-4951-b210-34bbbdba353e tempest-CreateVolumesFromSnapshotTest-1406547820 None] Notifying Schedulers of capabilities ... {{(pid=86212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 15:56:23 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-cceeea97-9cf0-4951-b210-34bbbdba353e tempest-CreateVolumesFromSnapshotTest-1406547820 None] Deleted volume successfully. Sep 22 15:56:23 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-c5a681c8-cbdf-442b-825b-5c17e3826112 tempest-CreateVolumesFromImageTest-1870167345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b072eb0a-c9cd-4159-aaae-061b3421b8a3 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:56:23 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-cceeea97-9cf0-4951-b210-34bbbdba353e tempest-CreateVolumesFromSnapshotTest-1406547820 None] Lock "cinder-d3820c96-9deb-4ae6-9b3f-483f6264971e-delete_volume" released by "delete_volume" :: held 1.413s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:56:23 devstack sudo[104724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b072eb0a-c9cd-4159-aaae-061b3421b8a3 Sep 22 15:56:23 devstack sudo[104724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:56:23 devstack sudo[104723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-ce918ec7-3c0c-4f95-8f74-5e76be25bd61.7bb1e354-c41f-4002-89a6-14b158f4331a Sep 22 15:56:23 devstack sudo[104723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:56:23 devstack sudo[104724]: pam_unix(sudo:session): session closed for user root Sep 22 15:56:23 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-c5a681c8-cbdf-442b-825b-5c17e3826112 tempest-CreateVolumesFromImageTest-1870167345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b072eb0a-c9cd-4159-aaae-061b3421b8a3" returned: 0 in 0.287s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:56:23 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-c5a681c8-cbdf-442b-825b-5c17e3826112 tempest-CreateVolumesFromImageTest-1870167345 None] <== create_volume: return (1033ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'} {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 15:56:23 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-c5a681c8-cbdf-442b-825b-5c17e3826112 tempest-CreateVolumesFromImageTest-1870167345 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.037s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:56:23 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-4041f2bd-91a2-46d4-8dbd-0fc6ab8423c5 tempest-CreateVolumesFromImageTest-1870167345 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.940s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:56:23 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-4041f2bd-91a2-46d4-8dbd-0fc6ab8423c5 tempest-CreateVolumesFromImageTest-1870167345 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:56:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1918489224',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b570bbc-7321-4893-bdfe-181bb9e00bc2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7288268a2184b768aae50c9ad97e2a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:56:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:56:20Z,use_quota=True,user_id='1a37851380ab4e2797e898d6d532f712',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)}" {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 15:56:23 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-4041f2bd-91a2-46d4-8dbd-0fc6ab8423c5 tempest-CreateVolumesFromImageTest-1870167345 None] Creating volume 2b570bbc-7321-4893-bdfe-181bb9e00bc2 {{(pid=86212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 15:56:23 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-4041f2bd-91a2-46d4-8dbd-0fc6ab8423c5 tempest-CreateVolumesFromImageTest-1870167345 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:56:23 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-4041f2bd-91a2-46d4-8dbd-0fc6ab8423c5 tempest-CreateVolumesFromImageTest-1870167345 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:56:23 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-4041f2bd-91a2-46d4-8dbd-0fc6ab8423c5 tempest-CreateVolumesFromImageTest-1870167345 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:56:23 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-4041f2bd-91a2-46d4-8dbd-0fc6ab8423c5 tempest-CreateVolumesFromImageTest-1870167345 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:56:23 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-4041f2bd-91a2-46d4-8dbd-0fc6ab8423c5 tempest-CreateVolumesFromImageTest-1870167345 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:56:23 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-4041f2bd-91a2-46d4-8dbd-0fc6ab8423c5 tempest-CreateVolumesFromImageTest-1870167345 None] Selected osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 as target Quobyte volume. {{(pid=86212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 15:56:23 devstack cinder-volume[86212]: INFO cinder.volume.drivers.remotefs [None req-4041f2bd-91a2-46d4-8dbd-0fc6ab8423c5 tempest-CreateVolumesFromImageTest-1870167345 None] casted to osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 Sep 22 15:56:23 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-4041f2bd-91a2-46d4-8dbd-0fc6ab8423c5 tempest-CreateVolumesFromImageTest-1870167345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2b570bbc-7321-4893-bdfe-181bb9e00bc2 1073741824 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:56:23 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-c5a681c8-cbdf-442b-825b-5c17e3826112 tempest-CreateVolumesFromImageTest-1870167345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cad6da50-79a2-4cbb-863e-899d1db06e92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b072eb0a-c9cd-4159-aaae-061b3421b8a3', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:56:23 devstack sudo[104730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2b570bbc-7321-4893-bdfe-181bb9e00bc2 1073741824 Sep 22 15:56:23 devstack sudo[104730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:56:23 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-c5a681c8-cbdf-442b-825b-5c17e3826112 tempest-CreateVolumesFromImageTest-1870167345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1141c5f-7139-49f4-b832-e4e5e77c20c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:56:23 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-c5a681c8-cbdf-442b-825b-5c17e3826112 tempest-CreateVolumesFromImageTest-1870167345 None] Volume volume-b072eb0a-c9cd-4159-aaae-061b3421b8a3 (b072eb0a-c9cd-4159-aaae-061b3421b8a3): created successfully Sep 22 15:56:23 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-c5a681c8-cbdf-442b-825b-5c17e3826112 tempest-CreateVolumesFromImageTest-1870167345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1141c5f-7139-49f4-b832-e4e5e77c20c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:56:23 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-c5a681c8-cbdf-442b-825b-5c17e3826112 tempest-CreateVolumesFromImageTest-1870167345 None] Flow 'volume_create_manager' (86719cdf-af40-463d-bc9f-86fd0d3ed74e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:56:23 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-c5a681c8-cbdf-442b-825b-5c17e3826112 tempest-CreateVolumesFromImageTest-1870167345 None] Created volume successfully. Sep 22 15:56:23 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-97c03c7a-36ff-456d-b317-16ea6b21e50a tempest-CreateVolumesFromSnapshotTest-1406547820 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-ce918ec7-3c0c-4f95-8f74-5e76be25bd61.7bb1e354-c41f-4002-89a6-14b158f4331a" returned: 0 in 0.472s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:56:23 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-97c03c7a-36ff-456d-b317-16ea6b21e50a tempest-CreateVolumesFromSnapshotTest-1406547820 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ce918ec7-3c0c-4f95-8f74-5e76be25bd61(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86212) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 22 15:56:23 devstack sudo[104723]: pam_unix(sudo:session): session closed for user root Sep 22 15:56:23 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8c43700-43cb-48b6-afbd-e2ac47fbef81]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:56:23 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-97c03c7a-36ff-456d-b317-16ea6b21e50a tempest-CreateVolumesFromSnapshotTest-1406547820 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-ce918ec7-3c0c-4f95-8f74-5e76be25bd61 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:56:23 devstack sudo[104733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-ce918ec7-3c0c-4f95-8f74-5e76be25bd61 Sep 22 15:56:23 devstack sudo[104733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:56:23 devstack sudo[104730]: pam_unix(sudo:session): session closed for user root Sep 22 15:56:23 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-4041f2bd-91a2-46d4-8dbd-0fc6ab8423c5 tempest-CreateVolumesFromImageTest-1870167345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2b570bbc-7321-4893-bdfe-181bb9e00bc2 1073741824" returned: 0 in 0.475s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:56:23 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-4041f2bd-91a2-46d4-8dbd-0fc6ab8423c5 tempest-CreateVolumesFromImageTest-1870167345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2b570bbc-7321-4893-bdfe-181bb9e00bc2 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:56:23 devstack sudo[104733]: pam_unix(sudo:session): session closed for user root Sep 22 15:56:23 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-97c03c7a-36ff-456d-b317-16ea6b21e50a tempest-CreateVolumesFromSnapshotTest-1406547820 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-ce918ec7-3c0c-4f95-8f74-5e76be25bd61" returned: 0 in 0.379s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:56:23 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-97c03c7a-36ff-456d-b317-16ea6b21e50a tempest-CreateVolumesFromSnapshotTest-1406547820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-ce918ec7-3c0c-4f95-8f74-5e76be25bd61.7bb1e354-c41f-4002-89a6-14b158f4331a {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:56:23 devstack sudo[104741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2b570bbc-7321-4893-bdfe-181bb9e00bc2 Sep 22 15:56:23 devstack sudo[104741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:56:23 devstack sudo[104742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-ce918ec7-3c0c-4f95-8f74-5e76be25bd61.7bb1e354-c41f-4002-89a6-14b158f4331a Sep 22 15:56:23 devstack sudo[104742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:56:24 devstack sudo[104741]: pam_unix(sudo:session): session closed for user root Sep 22 15:56:24 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-4041f2bd-91a2-46d4-8dbd-0fc6ab8423c5 tempest-CreateVolumesFromImageTest-1870167345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2b570bbc-7321-4893-bdfe-181bb9e00bc2" returned: 0 in 0.262s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:56:24 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-4041f2bd-91a2-46d4-8dbd-0fc6ab8423c5 tempest-CreateVolumesFromImageTest-1870167345 None] <== create_volume: return (784ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'} {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 15:56:24 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-4041f2bd-91a2-46d4-8dbd-0fc6ab8423c5 tempest-CreateVolumesFromImageTest-1870167345 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.787s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:56:24 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-5a281ea3-6f23-417c-a3ab-1979c0bc46a5 tempest-VolumeDependencyTests-1291485210 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:56:24 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-4041f2bd-91a2-46d4-8dbd-0fc6ab8423c5 tempest-CreateVolumesFromImageTest-1870167345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82a3e6bc-c6bf-4d16-8e7f-72e4652df0e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b570bbc-7321-4893-bdfe-181bb9e00bc2', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:56:24 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-4041f2bd-91a2-46d4-8dbd-0fc6ab8423c5 tempest-CreateVolumesFromImageTest-1870167345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3605b85-db48-40f5-ab18-9c8e05b74d66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:56:24 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-5a281ea3-6f23-417c-a3ab-1979c0bc46a5 tempest-VolumeDependencyTests-1291485210 None] Creating offline snapshot 33bb63b8-0998-4f12-9617-706fd6d5310d of volume 62b589a2-5362-4f3a-8d41-abc51acd6885 {{(pid=86212) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 22 15:56:24 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-4041f2bd-91a2-46d4-8dbd-0fc6ab8423c5 tempest-CreateVolumesFromImageTest-1870167345 None] Volume volume-2b570bbc-7321-4893-bdfe-181bb9e00bc2 (2b570bbc-7321-4893-bdfe-181bb9e00bc2): created successfully Sep 22 15:56:24 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-4041f2bd-91a2-46d4-8dbd-0fc6ab8423c5 tempest-CreateVolumesFromImageTest-1870167345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3605b85-db48-40f5-ab18-9c8e05b74d66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:56:24 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-4041f2bd-91a2-46d4-8dbd-0fc6ab8423c5 tempest-CreateVolumesFromImageTest-1870167345 None] Flow 'volume_create_manager' (b308fb67-d537-498c-976f-8ba551174df1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:56:24 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[ced30819-3682-481e-9386-a809e08aed98]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:56:24 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-5a281ea3-6f23-417c-a3ab-1979c0bc46a5 tempest-VolumeDependencyTests-1291485210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-62b589a2-5362-4f3a-8d41-abc51acd6885 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:56:24 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-4041f2bd-91a2-46d4-8dbd-0fc6ab8423c5 tempest-CreateVolumesFromImageTest-1870167345 None] Created volume successfully. Sep 22 15:56:24 devstack sudo[104742]: pam_unix(sudo:session): session closed for user root Sep 22 15:56:24 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-97c03c7a-36ff-456d-b317-16ea6b21e50a tempest-CreateVolumesFromSnapshotTest-1406547820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-ce918ec7-3c0c-4f95-8f74-5e76be25bd61.7bb1e354-c41f-4002-89a6-14b158f4331a" returned: 0 in 0.391s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:56:24 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-97c03c7a-36ff-456d-b317-16ea6b21e50a tempest-CreateVolumesFromSnapshotTest-1406547820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-ce918ec7-3c0c-4f95-8f74-5e76be25bd61.7bb1e354-c41f-4002-89a6-14b158f4331a {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:56:24 devstack sudo[104751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-ce918ec7-3c0c-4f95-8f74-5e76be25bd61.7bb1e354-c41f-4002-89a6-14b158f4331a Sep 22 15:56:24 devstack sudo[104751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:56:24 devstack sudo[104750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-62b589a2-5362-4f3a-8d41-abc51acd6885 Sep 22 15:56:24 devstack sudo[104750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:56:24 devstack sudo[104751]: pam_unix(sudo:session): session closed for user root Sep 22 15:56:24 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-97c03c7a-36ff-456d-b317-16ea6b21e50a tempest-CreateVolumesFromSnapshotTest-1406547820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-ce918ec7-3c0c-4f95-8f74-5e76be25bd61.7bb1e354-c41f-4002-89a6-14b158f4331a" returned: 0 in 0.278s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:56:24 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-97c03c7a-36ff-456d-b317-16ea6b21e50a tempest-CreateVolumesFromSnapshotTest-1406547820 None] Lock "cinder-quobyte-7bb1e354-c41f-4002-89a6-14b158f4331a" released by "_delete_snapshot" :: held 1.667s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:56:24 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-97c03c7a-36ff-456d-b317-16ea6b21e50a tempest-CreateVolumesFromSnapshotTest-1406547820 None] Lock "cinder-quobyte-ce918ec7-3c0c-4f95-8f74-5e76be25bd61" released by "delete_snapshot" :: held 1.705s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:56:24 devstack sudo[104750]: pam_unix(sudo:session): session closed for user root Sep 22 15:56:24 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-5a281ea3-6f23-417c-a3ab-1979c0bc46a5 tempest-VolumeDependencyTests-1291485210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-62b589a2-5362-4f3a-8d41-abc51acd6885" returned: 0 in 0.462s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:56:24 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-5a281ea3-6f23-417c-a3ab-1979c0bc46a5 tempest-VolumeDependencyTests-1291485210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-62b589a2-5362-4f3a-8d41-abc51acd6885,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-62b589a2-5362-4f3a-8d41-abc51acd6885.33bb63b8-0998-4f12-9617-706fd6d5310d 1G {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:56:24 devstack sudo[104758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-62b589a2-5362-4f3a-8d41-abc51acd6885,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-62b589a2-5362-4f3a-8d41-abc51acd6885.33bb63b8-0998-4f12-9617-706fd6d5310d 1G Sep 22 15:56:24 devstack sudo[104758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:56:24 devstack cinder-volume[86212]: DEBUG cinder.quota [None req-97c03c7a-36ff-456d-b317-16ea6b21e50a tempest-CreateVolumesFromSnapshotTest-1406547820 None] Created reservations ['e3861e3a-c241-41c0-9d0e-00059afc2fea', '7f0015d7-8b48-4f96-9037-4e6c9eb9dd11', 'e78f6ffb-c112-40aa-b852-bc6c6d71dcf8', '4c847102-a964-4983-8361-539eb21c62e2'] {{(pid=86212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 15:56:24 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-31be97b1-fcbf-447f-816f-decabdbb0a53 tempest-CreateVolumesFromImageTest-1870167345 None] Acquiring lock "cinder-2b570bbc-7321-4893-bdfe-181bb9e00bc2-delete_volume" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:56:24 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-31be97b1-fcbf-447f-816f-decabdbb0a53 tempest-CreateVolumesFromImageTest-1870167345 None] Lock "cinder-2b570bbc-7321-4893-bdfe-181bb9e00bc2-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:56:24 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-97c03c7a-36ff-456d-b317-16ea6b21e50a tempest-CreateVolumesFromSnapshotTest-1406547820 None] Delete snapshot completed successfully. Sep 22 15:56:24 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-31be97b1-fcbf-447f-816f-decabdbb0a53 tempest-CreateVolumesFromImageTest-1870167345 None] Acquiring lock "cinder-quobyte-2b570bbc-7321-4893-bdfe-181bb9e00bc2" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:56:24 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-97c03c7a-36ff-456d-b317-16ea6b21e50a tempest-CreateVolumesFromSnapshotTest-1406547820 None] Lock "cinder-7bb1e354-c41f-4002-89a6-14b158f4331a-delete_snapshot" released by "delete_snapshot" :: held 1.998s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:56:24 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-31be97b1-fcbf-447f-816f-decabdbb0a53 tempest-CreateVolumesFromImageTest-1870167345 None] Lock "cinder-quobyte-2b570bbc-7321-4893-bdfe-181bb9e00bc2" acquired by "delete_volume" :: waited 0.023s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:56:24 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f1b9a06-3e2b-4203-a114-c509016e17f6]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:56:24 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-31be97b1-fcbf-447f-816f-decabdbb0a53 tempest-CreateVolumesFromImageTest-1870167345 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2b570bbc-7321-4893-bdfe-181bb9e00bc2 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:56:25 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-83220ca5-8efa-41f1-9e32-c0d70add9630 tempest-CreateVolumesFromSnapshotTest-1406547820 None] Acquiring lock "cinder-ce918ec7-3c0c-4f95-8f74-5e76be25bd61-delete_volume" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:56:25 devstack sudo[104762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2b570bbc-7321-4893-bdfe-181bb9e00bc2 Sep 22 15:56:25 devstack sudo[104762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:56:25 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-83220ca5-8efa-41f1-9e32-c0d70add9630 tempest-CreateVolumesFromSnapshotTest-1406547820 None] Lock "cinder-ce918ec7-3c0c-4f95-8f74-5e76be25bd61-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:56:25 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-83220ca5-8efa-41f1-9e32-c0d70add9630 tempest-CreateVolumesFromSnapshotTest-1406547820 None] Acquiring lock "cinder-quobyte-ce918ec7-3c0c-4f95-8f74-5e76be25bd61" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:56:25 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-83220ca5-8efa-41f1-9e32-c0d70add9630 tempest-CreateVolumesFromSnapshotTest-1406547820 None] Lock "cinder-quobyte-ce918ec7-3c0c-4f95-8f74-5e76be25bd61" acquired by "delete_volume" :: waited 0.022s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:56:25 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[5997540d-696d-4f63-8976-215ab879401d]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:56:25 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-83220ca5-8efa-41f1-9e32-c0d70add9630 tempest-CreateVolumesFromSnapshotTest-1406547820 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-ce918ec7-3c0c-4f95-8f74-5e76be25bd61 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:56:25 devstack sudo[104758]: pam_unix(sudo:session): session closed for user root Sep 22 15:56:25 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-5a281ea3-6f23-417c-a3ab-1979c0bc46a5 tempest-VolumeDependencyTests-1291485210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-62b589a2-5362-4f3a-8d41-abc51acd6885,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-62b589a2-5362-4f3a-8d41-abc51acd6885.33bb63b8-0998-4f12-9617-706fd6d5310d 1G" returned: 0 in 0.610s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:56:25 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-5a281ea3-6f23-417c-a3ab-1979c0bc46a5 tempest-VolumeDependencyTests-1291485210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-62b589a2-5362-4f3a-8d41-abc51acd6885 -F qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-62b589a2-5362-4f3a-8d41-abc51acd6885.33bb63b8-0998-4f12-9617-706fd6d5310d {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:56:25 devstack sudo[104769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-62b589a2-5362-4f3a-8d41-abc51acd6885 -F qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-62b589a2-5362-4f3a-8d41-abc51acd6885.33bb63b8-0998-4f12-9617-706fd6d5310d Sep 22 15:56:25 devstack sudo[104769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:56:25 devstack sudo[104768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-ce918ec7-3c0c-4f95-8f74-5e76be25bd61 Sep 22 15:56:25 devstack sudo[104768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:56:25 devstack sudo[104762]: pam_unix(sudo:session): session closed for user root Sep 22 15:56:25 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-31be97b1-fcbf-447f-816f-decabdbb0a53 tempest-CreateVolumesFromImageTest-1870167345 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2b570bbc-7321-4893-bdfe-181bb9e00bc2" returned: 0 in 0.499s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:56:25 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-31be97b1-fcbf-447f-816f-decabdbb0a53 tempest-CreateVolumesFromImageTest-1870167345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2b570bbc-7321-4893-bdfe-181bb9e00bc2 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:56:25 devstack sudo[104776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2b570bbc-7321-4893-bdfe-181bb9e00bc2 Sep 22 15:56:25 devstack sudo[104776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:56:25 devstack sudo[104769]: pam_unix(sudo:session): session closed for user root Sep 22 15:56:25 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-5a281ea3-6f23-417c-a3ab-1979c0bc46a5 tempest-VolumeDependencyTests-1291485210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-62b589a2-5362-4f3a-8d41-abc51acd6885 -F qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-62b589a2-5362-4f3a-8d41-abc51acd6885.33bb63b8-0998-4f12-9617-706fd6d5310d" returned: 0 in 0.352s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:56:25 devstack cinder-volume[86212]: WARNING cinder.volume.drivers.remotefs [None req-5a281ea3-6f23-417c-a3ab-1979c0bc46a5 tempest-VolumeDependencyTests-1291485210 None] /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-62b589a2-5362-4f3a-8d41-abc51acd6885.33bb63b8-0998-4f12-9617-706fd6d5310d is being set with open permissions: ugo+rw Sep 22 15:56:25 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-5a281ea3-6f23-417c-a3ab-1979c0bc46a5 tempest-VolumeDependencyTests-1291485210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-62b589a2-5362-4f3a-8d41-abc51acd6885.33bb63b8-0998-4f12-9617-706fd6d5310d {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:56:25 devstack sudo[104784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-62b589a2-5362-4f3a-8d41-abc51acd6885.33bb63b8-0998-4f12-9617-706fd6d5310d Sep 22 15:56:25 devstack sudo[104784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:56:25 devstack sudo[104768]: pam_unix(sudo:session): session closed for user root Sep 22 15:56:25 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-83220ca5-8efa-41f1-9e32-c0d70add9630 tempest-CreateVolumesFromSnapshotTest-1406547820 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-ce918ec7-3c0c-4f95-8f74-5e76be25bd61" returned: 0 in 0.523s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:56:25 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-83220ca5-8efa-41f1-9e32-c0d70add9630 tempest-CreateVolumesFromSnapshotTest-1406547820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-ce918ec7-3c0c-4f95-8f74-5e76be25bd61 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:56:25 devstack sudo[104776]: pam_unix(sudo:session): session closed for user root Sep 22 15:56:25 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-31be97b1-fcbf-447f-816f-decabdbb0a53 tempest-CreateVolumesFromImageTest-1870167345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2b570bbc-7321-4893-bdfe-181bb9e00bc2" returned: 0 in 0.367s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:56:25 devstack sudo[104788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-ce918ec7-3c0c-4f95-8f74-5e76be25bd61 Sep 22 15:56:25 devstack sudo[104788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:56:25 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-31be97b1-fcbf-447f-816f-decabdbb0a53 tempest-CreateVolumesFromImageTest-1870167345 None] Lock "cinder-quobyte-2b570bbc-7321-4893-bdfe-181bb9e00bc2" released by "delete_volume" :: held 0.926s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:56:25 devstack cinder-volume[86212]: DEBUG cinder.quota [None req-31be97b1-fcbf-447f-816f-decabdbb0a53 tempest-CreateVolumesFromImageTest-1870167345 None] Created reservations ['46f140e5-3012-4144-b075-04cc5afb1e3e', 'f0c1a4ed-aa82-4cb9-915b-171479c11938', 'ef6f9635-e6a0-4a22-8446-157843c176e0', '7c61a3df-790c-489d-a147-ec7b485f76e4'] {{(pid=86212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 15:56:25 devstack sudo[104784]: pam_unix(sudo:session): session closed for user root Sep 22 15:56:25 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-5a281ea3-6f23-417c-a3ab-1979c0bc46a5 tempest-VolumeDependencyTests-1291485210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-62b589a2-5362-4f3a-8d41-abc51acd6885.33bb63b8-0998-4f12-9617-706fd6d5310d" returned: 0 in 0.348s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:56:26 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-31be97b1-fcbf-447f-816f-decabdbb0a53 tempest-CreateVolumesFromImageTest-1870167345 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:56:26 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-31be97b1-fcbf-447f-816f-decabdbb0a53 tempest-CreateVolumesFromImageTest-1870167345 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:56:26 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-31be97b1-fcbf-447f-816f-decabdbb0a53 tempest-CreateVolumesFromImageTest-1870167345 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:56:26 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-31be97b1-fcbf-447f-816f-decabdbb0a53 tempest-CreateVolumesFromImageTest-1870167345 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:56:26 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-31be97b1-fcbf-447f-816f-decabdbb0a53 tempest-CreateVolumesFromImageTest-1870167345 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:56:26 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-31be97b1-fcbf-447f-816f-decabdbb0a53 tempest-CreateVolumesFromImageTest-1870167345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:56:26 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-5a281ea3-6f23-417c-a3ab-1979c0bc46a5 tempest-VolumeDependencyTests-1291485210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-62b589a2-5362-4f3a-8d41-abc51acd6885.info {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:56:26 devstack sudo[104791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc Sep 22 15:56:26 devstack sudo[104791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:56:26 devstack sudo[104793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-62b589a2-5362-4f3a-8d41-abc51acd6885.info Sep 22 15:56:26 devstack sudo[104793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:56:26 devstack sudo[104788]: pam_unix(sudo:session): session closed for user root Sep 22 15:56:26 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-83220ca5-8efa-41f1-9e32-c0d70add9630 tempest-CreateVolumesFromSnapshotTest-1406547820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-ce918ec7-3c0c-4f95-8f74-5e76be25bd61" returned: 0 in 0.343s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:56:26 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-83220ca5-8efa-41f1-9e32-c0d70add9630 tempest-CreateVolumesFromSnapshotTest-1406547820 None] Lock "cinder-quobyte-ce918ec7-3c0c-4f95-8f74-5e76be25bd61" released by "delete_volume" :: held 0.957s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:56:26 devstack cinder-volume[86212]: DEBUG cinder.quota [None req-83220ca5-8efa-41f1-9e32-c0d70add9630 tempest-CreateVolumesFromSnapshotTest-1406547820 None] Created reservations ['dc779ca1-d23c-4352-bf8a-86ea1177c39a', 'a76ab043-e68f-4603-add0-a832fd342c91', 'cf63e4dd-398c-4d09-9b7e-8bbc42617920', '749b5a9b-85cc-4e84-be9d-c7f759b77ce8'] {{(pid=86212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 15:56:26 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-83220ca5-8efa-41f1-9e32-c0d70add9630 tempest-CreateVolumesFromSnapshotTest-1406547820 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:56:26 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-83220ca5-8efa-41f1-9e32-c0d70add9630 tempest-CreateVolumesFromSnapshotTest-1406547820 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:56:26 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-83220ca5-8efa-41f1-9e32-c0d70add9630 tempest-CreateVolumesFromSnapshotTest-1406547820 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:56:26 devstack sudo[104791]: pam_unix(sudo:session): session closed for user root Sep 22 15:56:26 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-83220ca5-8efa-41f1-9e32-c0d70add9630 tempest-CreateVolumesFromSnapshotTest-1406547820 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:56:26 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-83220ca5-8efa-41f1-9e32-c0d70add9630 tempest-CreateVolumesFromSnapshotTest-1406547820 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:56:26 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-83220ca5-8efa-41f1-9e32-c0d70add9630 tempest-CreateVolumesFromSnapshotTest-1406547820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:56:26 devstack sudo[104793]: pam_unix(sudo:session): session closed for user root Sep 22 15:56:26 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-31be97b1-fcbf-447f-816f-decabdbb0a53 tempest-CreateVolumesFromImageTest-1870167345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc" returned: 0 in 0.335s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:56:26 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-5a281ea3-6f23-417c-a3ab-1979c0bc46a5 tempest-VolumeDependencyTests-1291485210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-62b589a2-5362-4f3a-8d41-abc51acd6885.info" returned: 0 in 0.318s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:56:26 devstack cinder-volume[86212]: DEBUG cinder.manager [None req-31be97b1-fcbf-447f-816f-decabdbb0a53 tempest-CreateVolumesFromImageTest-1870167345 None] Notifying Schedulers of capabilities ... {{(pid=86212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 15:56:26 devstack cinder-volume[86212]: WARNING cinder.volume.drivers.remotefs [None req-5a281ea3-6f23-417c-a3ab-1979c0bc46a5 tempest-VolumeDependencyTests-1291485210 None] /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-62b589a2-5362-4f3a-8d41-abc51acd6885.info is being set with open permissions: ugo+rw Sep 22 15:56:26 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-5a281ea3-6f23-417c-a3ab-1979c0bc46a5 tempest-VolumeDependencyTests-1291485210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-62b589a2-5362-4f3a-8d41-abc51acd6885.info {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:56:26 devstack sudo[104798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc Sep 22 15:56:26 devstack sudo[104798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:56:26 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-31be97b1-fcbf-447f-816f-decabdbb0a53 tempest-CreateVolumesFromImageTest-1870167345 None] Deleted volume successfully. Sep 22 15:56:26 devstack sudo[104799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-62b589a2-5362-4f3a-8d41-abc51acd6885.info Sep 22 15:56:26 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-31be97b1-fcbf-447f-816f-decabdbb0a53 tempest-CreateVolumesFromImageTest-1870167345 None] Lock "cinder-2b570bbc-7321-4893-bdfe-181bb9e00bc2-delete_volume" released by "delete_volume" :: held 1.615s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:56:26 devstack sudo[104799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:56:26 devstack sudo[104798]: pam_unix(sudo:session): session closed for user root Sep 22 15:56:26 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-83220ca5-8efa-41f1-9e32-c0d70add9630 tempest-CreateVolumesFromSnapshotTest-1406547820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc" returned: 0 in 0.298s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:56:26 devstack cinder-volume[86212]: DEBUG cinder.manager [None req-83220ca5-8efa-41f1-9e32-c0d70add9630 tempest-CreateVolumesFromSnapshotTest-1406547820 None] Notifying Schedulers of capabilities ... {{(pid=86212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 15:56:26 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-83220ca5-8efa-41f1-9e32-c0d70add9630 tempest-CreateVolumesFromSnapshotTest-1406547820 None] Deleted volume successfully. Sep 22 15:56:26 devstack sudo[104799]: pam_unix(sudo:session): session closed for user root Sep 22 15:56:26 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-83220ca5-8efa-41f1-9e32-c0d70add9630 tempest-CreateVolumesFromSnapshotTest-1406547820 None] Lock "cinder-ce918ec7-3c0c-4f95-8f74-5e76be25bd61-delete_volume" released by "delete_volume" :: held 1.571s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:56:26 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-5a281ea3-6f23-417c-a3ab-1979c0bc46a5 tempest-VolumeDependencyTests-1291485210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-62b589a2-5362-4f3a-8d41-abc51acd6885.info" returned: 0 in 0.317s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:56:26 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-5a281ea3-6f23-417c-a3ab-1979c0bc46a5 tempest-VolumeDependencyTests-1291485210 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.572s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:56:26 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-5a281ea3-6f23-417c-a3ab-1979c0bc46a5 tempest-VolumeDependencyTests-1291485210 None] Create snapshot completed successfully Sep 22 15:56:27 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-c4c6caa4-7583-4332-8141-d8dcd7b6b343 tempest-CreateVolumesFromImageTest-1870167345 None] Acquiring lock "cinder-b072eb0a-c9cd-4159-aaae-061b3421b8a3-delete_volume" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:56:27 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-c4c6caa4-7583-4332-8141-d8dcd7b6b343 tempest-CreateVolumesFromImageTest-1870167345 None] Lock "cinder-b072eb0a-c9cd-4159-aaae-061b3421b8a3-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:56:27 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-c4c6caa4-7583-4332-8141-d8dcd7b6b343 tempest-CreateVolumesFromImageTest-1870167345 None] Acquiring lock "cinder-quobyte-b072eb0a-c9cd-4159-aaae-061b3421b8a3" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:56:27 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-c4c6caa4-7583-4332-8141-d8dcd7b6b343 tempest-CreateVolumesFromImageTest-1870167345 None] Lock "cinder-quobyte-b072eb0a-c9cd-4159-aaae-061b3421b8a3" acquired by "delete_volume" :: waited 0.017s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:56:27 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[4714b6a8-801f-4f3c-be16-58bba2cf9ff5]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:56:27 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-c4c6caa4-7583-4332-8141-d8dcd7b6b343 tempest-CreateVolumesFromImageTest-1870167345 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b072eb0a-c9cd-4159-aaae-061b3421b8a3 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:56:27 devstack sudo[104804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b072eb0a-c9cd-4159-aaae-061b3421b8a3 Sep 22 15:56:27 devstack sudo[104804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:56:27 devstack sudo[104804]: pam_unix(sudo:session): session closed for user root Sep 22 15:56:27 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-c4c6caa4-7583-4332-8141-d8dcd7b6b343 tempest-CreateVolumesFromImageTest-1870167345 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b072eb0a-c9cd-4159-aaae-061b3421b8a3" returned: 0 in 0.473s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:56:27 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-c4c6caa4-7583-4332-8141-d8dcd7b6b343 tempest-CreateVolumesFromImageTest-1870167345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b072eb0a-c9cd-4159-aaae-061b3421b8a3 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:56:27 devstack sudo[104809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b072eb0a-c9cd-4159-aaae-061b3421b8a3 Sep 22 15:56:27 devstack sudo[104809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:56:27 devstack sudo[104809]: pam_unix(sudo:session): session closed for user root Sep 22 15:56:27 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-c4c6caa4-7583-4332-8141-d8dcd7b6b343 tempest-CreateVolumesFromImageTest-1870167345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-b072eb0a-c9cd-4159-aaae-061b3421b8a3" returned: 0 in 0.378s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:56:28 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-c4c6caa4-7583-4332-8141-d8dcd7b6b343 tempest-CreateVolumesFromImageTest-1870167345 None] Lock "cinder-quobyte-b072eb0a-c9cd-4159-aaae-061b3421b8a3" released by "delete_volume" :: held 0.921s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:56:28 devstack cinder-volume[86212]: DEBUG cinder.volume.flows.manager.create_volume [None req-d36a47a2-63d8-4b92-90bc-806bfed481a6 tempest-VolumeDependencyTests-1291485210 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 15:56:28 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-d36a47a2-63d8-4b92-90bc-806bfed481a6 tempest-VolumeDependencyTests-1291485210 None] Flow 'volume_create_manager' (70a7ec29-c3b5-432a-95f2-837ab74ea794) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:56:28 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-d36a47a2-63d8-4b92-90bc-806bfed481a6 tempest-VolumeDependencyTests-1291485210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9e28386-d94f-4449-a0f2-48a9cb169bf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:56:28 devstack cinder-volume[86212]: DEBUG cinder.quota [None req-c4c6caa4-7583-4332-8141-d8dcd7b6b343 tempest-CreateVolumesFromImageTest-1870167345 None] Created reservations ['5d21b60b-0dc3-4266-a3aa-3372ca6acba4', 'f84a29c8-94bb-4ada-b818-8f547d9bd51c', 'de87e45d-634d-4409-9c38-e9b5bfe1bc40', '9fe4b16c-b53a-48ce-8226-d75edd0de93a'] {{(pid=86212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 15:56:28 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-d36a47a2-63d8-4b92-90bc-806bfed481a6 tempest-VolumeDependencyTests-1291485210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9e28386-d94f-4449-a0f2-48a9cb169bf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:56:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1732637983',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=540841fa-9687-4040-b6bb-4b6f22bf7ecf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7845e0469934739a12ee152120026e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:56:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=33bb63b8-0998-4f12-9617-706fd6d5310d,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:56:28Z,use_quota=True,user_id='e396d372c7a14b02a1aa84f0d6cd4376',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:56:28 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-d36a47a2-63d8-4b92-90bc-806bfed481a6 tempest-VolumeDependencyTests-1291485210 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e93fee1b-e649-4250-92e9-f9ef3b27c945) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:56:28 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-d36a47a2-63d8-4b92-90bc-806bfed481a6 tempest-VolumeDependencyTests-1291485210 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e93fee1b-e649-4250-92e9-f9ef3b27c945) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:56:28 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-d36a47a2-63d8-4b92-90bc-806bfed481a6 tempest-VolumeDependencyTests-1291485210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25314b57-679e-4ead-ac39-05653948c413) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:56:28 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-d36a47a2-63d8-4b92-90bc-806bfed481a6 tempest-VolumeDependencyTests-1291485210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25314b57-679e-4ead-ac39-05653948c413) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '540841fa-9687-4040-b6bb-4b6f22bf7ecf', 'volume_name': 'volume-540841fa-9687-4040-b6bb-4b6f22bf7ecf', 'volume_size': 1, 'snapshot_id': '33bb63b8-0998-4f12-9617-706fd6d5310d'}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:56:28 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-d36a47a2-63d8-4b92-90bc-806bfed481a6 tempest-VolumeDependencyTests-1291485210 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e2c71e5-5fca-4fb7-bc12-82131ed8fb29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:56:28 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-d36a47a2-63d8-4b92-90bc-806bfed481a6 tempest-VolumeDependencyTests-1291485210 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e2c71e5-5fca-4fb7-bc12-82131ed8fb29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:56:28 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-d36a47a2-63d8-4b92-90bc-806bfed481a6 tempest-VolumeDependencyTests-1291485210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20d24f23-61e3-40a0-a720-f48d60e03622) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:56:28 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-d36a47a2-63d8-4b92-90bc-806bfed481a6 tempest-VolumeDependencyTests-1291485210 None] Volume 540841fa-9687-4040-b6bb-4b6f22bf7ecf: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-540841fa-9687-4040-b6bb-4b6f22bf7ecf', 'volume_size': 1, 'snapshot_id': '33bb63b8-0998-4f12-9617-706fd6d5310d'} Sep 22 15:56:28 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-d36a47a2-63d8-4b92-90bc-806bfed481a6 tempest-VolumeDependencyTests-1291485210 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:56:28 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-d36a47a2-63d8-4b92-90bc-806bfed481a6 tempest-VolumeDependencyTests-1291485210 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:56:28 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-d36a47a2-63d8-4b92-90bc-806bfed481a6 tempest-VolumeDependencyTests-1291485210 None] Acquiring lock "cinder-quobyte-33bb63b8-0998-4f12-9617-706fd6d5310d-540841fa-9687-4040-b6bb-4b6f22bf7ecf" by "_create_volume_from_snapshot" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:56:28 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-d36a47a2-63d8-4b92-90bc-806bfed481a6 tempest-VolumeDependencyTests-1291485210 None] Lock "cinder-quobyte-33bb63b8-0998-4f12-9617-706fd6d5310d-540841fa-9687-4040-b6bb-4b6f22bf7ecf" acquired by "_create_volume_from_snapshot" :: waited 0.026s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:56:28 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-d36a47a2-63d8-4b92-90bc-806bfed481a6 tempest-VolumeDependencyTests-1291485210 None] Creating volume 540841fa-9687-4040-b6bb-4b6f22bf7ecf from snapshot 33bb63b8-0998-4f12-9617-706fd6d5310d {{(pid=86212) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 22 15:56:28 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-d36a47a2-63d8-4b92-90bc-806bfed481a6 tempest-VolumeDependencyTests-1291485210 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:56:28 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-d36a47a2-63d8-4b92-90bc-806bfed481a6 tempest-VolumeDependencyTests-1291485210 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:56:28 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-d36a47a2-63d8-4b92-90bc-806bfed481a6 tempest-VolumeDependencyTests-1291485210 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:56:28 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-d36a47a2-63d8-4b92-90bc-806bfed481a6 tempest-VolumeDependencyTests-1291485210 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:56:28 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-d36a47a2-63d8-4b92-90bc-806bfed481a6 tempest-VolumeDependencyTests-1291485210 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:56:28 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-d36a47a2-63d8-4b92-90bc-806bfed481a6 tempest-VolumeDependencyTests-1291485210 None] Selected osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 as target Quobyte volume. {{(pid=86212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 15:56:28 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-d36a47a2-63d8-4b92-90bc-806bfed481a6 tempest-VolumeDependencyTests-1291485210 None] Acquiring lock "cinder-quobyte-540841fa-9687-4040-b6bb-4b6f22bf7ecf" by "_copy_volume_from_snapshot" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:56:28 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-d36a47a2-63d8-4b92-90bc-806bfed481a6 tempest-VolumeDependencyTests-1291485210 None] Lock "cinder-quobyte-540841fa-9687-4040-b6bb-4b6f22bf7ecf" acquired by "_copy_volume_from_snapshot" :: waited 0.032s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:56:28 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-d36a47a2-63d8-4b92-90bc-806bfed481a6 tempest-VolumeDependencyTests-1291485210 None] snapshot: 33bb63b8-0998-4f12-9617-706fd6d5310d, volume: 540841fa-9687-4040-b6bb-4b6f22bf7ecf, {{(pid=86212) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 22 15:56:28 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-c4c6caa4-7583-4332-8141-d8dcd7b6b343 tempest-CreateVolumesFromImageTest-1870167345 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:56:28 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-c4c6caa4-7583-4332-8141-d8dcd7b6b343 tempest-CreateVolumesFromImageTest-1870167345 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:56:28 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-c4c6caa4-7583-4332-8141-d8dcd7b6b343 tempest-CreateVolumesFromImageTest-1870167345 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:56:28 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-c4c6caa4-7583-4332-8141-d8dcd7b6b343 tempest-CreateVolumesFromImageTest-1870167345 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:56:28 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-c4c6caa4-7583-4332-8141-d8dcd7b6b343 tempest-CreateVolumesFromImageTest-1870167345 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:56:28 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-c4c6caa4-7583-4332-8141-d8dcd7b6b343 tempest-CreateVolumesFromImageTest-1870167345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:56:28 devstack sudo[104813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc Sep 22 15:56:28 devstack sudo[104813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:56:28 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-d36a47a2-63d8-4b92-90bc-806bfed481a6 tempest-VolumeDependencyTests-1291485210 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:56:28 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-d36a47a2-63d8-4b92-90bc-806bfed481a6 tempest-VolumeDependencyTests-1291485210 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:56:28 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-d36a47a2-63d8-4b92-90bc-806bfed481a6 tempest-VolumeDependencyTests-1291485210 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:56:28 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-d36a47a2-63d8-4b92-90bc-806bfed481a6 tempest-VolumeDependencyTests-1291485210 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:56:28 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-d36a47a2-63d8-4b92-90bc-806bfed481a6 tempest-VolumeDependencyTests-1291485210 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:56:28 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac19c1d6-c4b6-45f2-98e0-dc94e59325d8]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:56:28 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-d36a47a2-63d8-4b92-90bc-806bfed481a6 tempest-VolumeDependencyTests-1291485210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-62b589a2-5362-4f3a-8d41-abc51acd6885.33bb63b8-0998-4f12-9617-706fd6d5310d {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:56:28 devstack sudo[104815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-62b589a2-5362-4f3a-8d41-abc51acd6885.33bb63b8-0998-4f12-9617-706fd6d5310d Sep 22 15:56:28 devstack sudo[104815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:56:28 devstack sudo[104813]: pam_unix(sudo:session): session closed for user root Sep 22 15:56:28 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-c4c6caa4-7583-4332-8141-d8dcd7b6b343 tempest-CreateVolumesFromImageTest-1870167345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc" returned: 0 in 0.311s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:56:28 devstack cinder-volume[86212]: DEBUG cinder.manager [None req-c4c6caa4-7583-4332-8141-d8dcd7b6b343 tempest-CreateVolumesFromImageTest-1870167345 None] Notifying Schedulers of capabilities ... {{(pid=86212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 15:56:28 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-c4c6caa4-7583-4332-8141-d8dcd7b6b343 tempest-CreateVolumesFromImageTest-1870167345 None] Deleted volume successfully. Sep 22 15:56:28 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-c4c6caa4-7583-4332-8141-d8dcd7b6b343 tempest-CreateVolumesFromImageTest-1870167345 None] Lock "cinder-b072eb0a-c9cd-4159-aaae-061b3421b8a3-delete_volume" released by "delete_volume" :: held 1.719s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:56:28 devstack sudo[104815]: pam_unix(sudo:session): session closed for user root Sep 22 15:56:28 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-d36a47a2-63d8-4b92-90bc-806bfed481a6 tempest-VolumeDependencyTests-1291485210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-62b589a2-5362-4f3a-8d41-abc51acd6885.33bb63b8-0998-4f12-9617-706fd6d5310d" returned: 0 in 0.523s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:56:28 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-d36a47a2-63d8-4b92-90bc-806bfed481a6 tempest-VolumeDependencyTests-1291485210 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-62b589a2-5362-4f3a-8d41-abc51acd6885(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86212) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 22 15:56:29 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[44ec2d7c-34f9-4452-98d3-ef3fca085a5e]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:56:29 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-d36a47a2-63d8-4b92-90bc-806bfed481a6 tempest-VolumeDependencyTests-1291485210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-62b589a2-5362-4f3a-8d41-abc51acd6885 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:56:29 devstack sudo[104822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-62b589a2-5362-4f3a-8d41-abc51acd6885 Sep 22 15:56:29 devstack sudo[104822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:56:29 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-d071d07f-735c-4e8d-8aa8-285de36547cf tempest-CreateVolumesFromImageTest-1870167345 None] Acquiring lock "cinder-49b91e70-8aae-462d-936d-f2c9fbf72dfb-delete_volume" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:56:29 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-d071d07f-735c-4e8d-8aa8-285de36547cf tempest-CreateVolumesFromImageTest-1870167345 None] Lock "cinder-49b91e70-8aae-462d-936d-f2c9fbf72dfb-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:56:29 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-d071d07f-735c-4e8d-8aa8-285de36547cf tempest-CreateVolumesFromImageTest-1870167345 None] Acquiring lock "cinder-quobyte-49b91e70-8aae-462d-936d-f2c9fbf72dfb" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:56:29 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-d071d07f-735c-4e8d-8aa8-285de36547cf tempest-CreateVolumesFromImageTest-1870167345 None] Lock "cinder-quobyte-49b91e70-8aae-462d-936d-f2c9fbf72dfb" acquired by "delete_volume" :: waited 0.019s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:56:29 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[222a1851-118b-482c-8495-067a42b651cc]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:56:29 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-d071d07f-735c-4e8d-8aa8-285de36547cf tempest-CreateVolumesFromImageTest-1870167345 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-49b91e70-8aae-462d-936d-f2c9fbf72dfb {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:56:29 devstack sudo[104822]: pam_unix(sudo:session): session closed for user root Sep 22 15:56:29 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-d36a47a2-63d8-4b92-90bc-806bfed481a6 tempest-VolumeDependencyTests-1291485210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-62b589a2-5362-4f3a-8d41-abc51acd6885" returned: 0 in 0.527s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:56:29 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-d36a47a2-63d8-4b92-90bc-806bfed481a6 tempest-VolumeDependencyTests-1291485210 None] will copy from snapshot at /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-62b589a2-5362-4f3a-8d41-abc51acd6885 {{(pid=86212) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 22 15:56:29 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-d36a47a2-63d8-4b92-90bc-806bfed481a6 tempest-VolumeDependencyTests-1291485210 None] Creating direct copy from snapshot {{(pid=86212) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 22 15:56:29 devstack cinder-volume[86212]: DEBUG cinder.utils [None req-d36a47a2-63d8-4b92-90bc-806bfed481a6 tempest-VolumeDependencyTests-1291485210 None] Path /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-540841fa-9687-4040-b6bb-4b6f22bf7ecf not found in is_blk_device check {{(pid=86212) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 22 15:56:29 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-d36a47a2-63d8-4b92-90bc-806bfed481a6 tempest-VolumeDependencyTests-1291485210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-62b589a2-5362-4f3a-8d41-abc51acd6885 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-540841fa-9687-4040-b6bb-4b6f22bf7ecf {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:56:29 devstack sudo[104828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-62b589a2-5362-4f3a-8d41-abc51acd6885 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-540841fa-9687-4040-b6bb-4b6f22bf7ecf Sep 22 15:56:29 devstack sudo[104828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:56:29 devstack sudo[104827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-49b91e70-8aae-462d-936d-f2c9fbf72dfb Sep 22 15:56:29 devstack sudo[104827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:56:30 devstack sudo[104827]: pam_unix(sudo:session): session closed for user root Sep 22 15:56:30 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-d071d07f-735c-4e8d-8aa8-285de36547cf tempest-CreateVolumesFromImageTest-1870167345 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-49b91e70-8aae-462d-936d-f2c9fbf72dfb" returned: 0 in 0.528s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:56:30 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-d071d07f-735c-4e8d-8aa8-285de36547cf tempest-CreateVolumesFromImageTest-1870167345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-49b91e70-8aae-462d-936d-f2c9fbf72dfb {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:56:30 devstack sudo[104837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-49b91e70-8aae-462d-936d-f2c9fbf72dfb Sep 22 15:56:30 devstack sudo[104837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:56:30 devstack sudo[104837]: pam_unix(sudo:session): session closed for user root Sep 22 15:56:30 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-d071d07f-735c-4e8d-8aa8-285de36547cf tempest-CreateVolumesFromImageTest-1870167345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-49b91e70-8aae-462d-936d-f2c9fbf72dfb" returned: 0 in 0.356s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:56:30 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-d071d07f-735c-4e8d-8aa8-285de36547cf tempest-CreateVolumesFromImageTest-1870167345 None] Lock "cinder-quobyte-49b91e70-8aae-462d-936d-f2c9fbf72dfb" released by "delete_volume" :: held 0.966s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:56:30 devstack cinder-volume[86212]: DEBUG cinder.quota [None req-d071d07f-735c-4e8d-8aa8-285de36547cf tempest-CreateVolumesFromImageTest-1870167345 None] Created reservations ['7b84f7ac-15b1-490a-92b4-1d9e6834cfa2', '0239213a-87e7-4e65-b14d-bb75a9aa24da', 'e4efca69-7764-4439-b33b-d2a5ddc625b3', '10be463b-a0b0-4848-8e42-1146059411e7'] {{(pid=86212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 15:56:30 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-d071d07f-735c-4e8d-8aa8-285de36547cf tempest-CreateVolumesFromImageTest-1870167345 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:56:30 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-d071d07f-735c-4e8d-8aa8-285de36547cf tempest-CreateVolumesFromImageTest-1870167345 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:56:30 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-d071d07f-735c-4e8d-8aa8-285de36547cf tempest-CreateVolumesFromImageTest-1870167345 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:56:30 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-d071d07f-735c-4e8d-8aa8-285de36547cf tempest-CreateVolumesFromImageTest-1870167345 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:56:30 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-d071d07f-735c-4e8d-8aa8-285de36547cf tempest-CreateVolumesFromImageTest-1870167345 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:56:30 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-d071d07f-735c-4e8d-8aa8-285de36547cf tempest-CreateVolumesFromImageTest-1870167345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:56:30 devstack sudo[104847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc Sep 22 15:56:30 devstack sudo[104847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:56:31 devstack sudo[104847]: pam_unix(sudo:session): session closed for user root Sep 22 15:56:31 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-d071d07f-735c-4e8d-8aa8-285de36547cf tempest-CreateVolumesFromImageTest-1870167345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc" returned: 0 in 0.592s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:56:31 devstack cinder-volume[86212]: DEBUG cinder.manager [None req-d071d07f-735c-4e8d-8aa8-285de36547cf tempest-CreateVolumesFromImageTest-1870167345 None] Notifying Schedulers of capabilities ... {{(pid=86212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 15:56:31 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-d071d07f-735c-4e8d-8aa8-285de36547cf tempest-CreateVolumesFromImageTest-1870167345 None] Deleted volume successfully. Sep 22 15:56:31 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-d071d07f-735c-4e8d-8aa8-285de36547cf tempest-CreateVolumesFromImageTest-1870167345 None] Lock "cinder-49b91e70-8aae-462d-936d-f2c9fbf72dfb-delete_volume" released by "delete_volume" :: held 2.090s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:56:31 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-e402c9f6-206a-4155-bea7-af3d3fa6dea2 tempest-CreateVolumesFromImageTest-1870167345 None] Acquiring lock "cinder-dfe8d334-20c1-4d43-902f-8e70a325ace2-delete_volume" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:56:31 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-e402c9f6-206a-4155-bea7-af3d3fa6dea2 tempest-CreateVolumesFromImageTest-1870167345 None] Lock "cinder-dfe8d334-20c1-4d43-902f-8e70a325ace2-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:56:31 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-e402c9f6-206a-4155-bea7-af3d3fa6dea2 tempest-CreateVolumesFromImageTest-1870167345 None] Acquiring lock "cinder-quobyte-dfe8d334-20c1-4d43-902f-8e70a325ace2" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:56:32 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-e402c9f6-206a-4155-bea7-af3d3fa6dea2 tempest-CreateVolumesFromImageTest-1870167345 None] Lock "cinder-quobyte-dfe8d334-20c1-4d43-902f-8e70a325ace2" acquired by "delete_volume" :: waited 0.048s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:56:32 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[f80c411d-6bd8-4372-b179-27ec9ad68499]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:56:32 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-e402c9f6-206a-4155-bea7-af3d3fa6dea2 tempest-CreateVolumesFromImageTest-1870167345 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-dfe8d334-20c1-4d43-902f-8e70a325ace2 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:56:32 devstack sudo[104850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-dfe8d334-20c1-4d43-902f-8e70a325ace2 Sep 22 15:56:32 devstack sudo[104850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:56:33 devstack sudo[104850]: pam_unix(sudo:session): session closed for user root Sep 22 15:56:33 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-e402c9f6-206a-4155-bea7-af3d3fa6dea2 tempest-CreateVolumesFromImageTest-1870167345 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-dfe8d334-20c1-4d43-902f-8e70a325ace2" returned: 0 in 0.988s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:56:33 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-e402c9f6-206a-4155-bea7-af3d3fa6dea2 tempest-CreateVolumesFromImageTest-1870167345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-dfe8d334-20c1-4d43-902f-8e70a325ace2 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:56:33 devstack sudo[104856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-dfe8d334-20c1-4d43-902f-8e70a325ace2 Sep 22 15:56:33 devstack sudo[104856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:56:33 devstack sudo[104856]: pam_unix(sudo:session): session closed for user root Sep 22 15:56:33 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-e402c9f6-206a-4155-bea7-af3d3fa6dea2 tempest-CreateVolumesFromImageTest-1870167345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-dfe8d334-20c1-4d43-902f-8e70a325ace2" returned: 0 in 0.623s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:56:33 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-e402c9f6-206a-4155-bea7-af3d3fa6dea2 tempest-CreateVolumesFromImageTest-1870167345 None] Lock "cinder-quobyte-dfe8d334-20c1-4d43-902f-8e70a325ace2" released by "delete_volume" :: held 1.726s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:56:33 devstack cinder-volume[86212]: DEBUG cinder.quota [None req-e402c9f6-206a-4155-bea7-af3d3fa6dea2 tempest-CreateVolumesFromImageTest-1870167345 None] Created reservations ['15f0ff47-757b-436d-8ad9-d93e816b1038', '10451564-0689-413d-85ce-0b533b698c1d', 'f620c715-191e-4bc0-aa03-819212871028', '5665c899-09c0-4d6f-8ec2-149989e1a9b3'] {{(pid=86212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 15:56:34 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-e402c9f6-206a-4155-bea7-af3d3fa6dea2 tempest-CreateVolumesFromImageTest-1870167345 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:56:34 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-e402c9f6-206a-4155-bea7-af3d3fa6dea2 tempest-CreateVolumesFromImageTest-1870167345 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:56:34 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-e402c9f6-206a-4155-bea7-af3d3fa6dea2 tempest-CreateVolumesFromImageTest-1870167345 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:56:34 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-e402c9f6-206a-4155-bea7-af3d3fa6dea2 tempest-CreateVolumesFromImageTest-1870167345 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:56:34 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-e402c9f6-206a-4155-bea7-af3d3fa6dea2 tempest-CreateVolumesFromImageTest-1870167345 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:56:34 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-e402c9f6-206a-4155-bea7-af3d3fa6dea2 tempest-CreateVolumesFromImageTest-1870167345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:56:34 devstack sudo[104860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc Sep 22 15:56:34 devstack sudo[104860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:56:34 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-62d68861-db89-4c19-84c5-abfa77668823 tempest-CreateVolumesFromImageTest-1870167345 None] Acquiring lock "cinder-36266a84-667b-4570-9f56-71b87687fb6e-delete_volume" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:56:34 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-62d68861-db89-4c19-84c5-abfa77668823 tempest-CreateVolumesFromImageTest-1870167345 None] Lock "cinder-36266a84-667b-4570-9f56-71b87687fb6e-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:56:34 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-62d68861-db89-4c19-84c5-abfa77668823 tempest-CreateVolumesFromImageTest-1870167345 None] Acquiring lock "cinder-quobyte-36266a84-667b-4570-9f56-71b87687fb6e" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:56:34 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-62d68861-db89-4c19-84c5-abfa77668823 tempest-CreateVolumesFromImageTest-1870167345 None] Lock "cinder-quobyte-36266a84-667b-4570-9f56-71b87687fb6e" acquired by "delete_volume" :: waited 0.027s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:56:34 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a648824-723b-4b35-be59-ce557fc3c86b]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:56:34 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-62d68861-db89-4c19-84c5-abfa77668823 tempest-CreateVolumesFromImageTest-1870167345 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-36266a84-667b-4570-9f56-71b87687fb6e {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:56:34 devstack sudo[104860]: pam_unix(sudo:session): session closed for user root Sep 22 15:56:34 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-e402c9f6-206a-4155-bea7-af3d3fa6dea2 tempest-CreateVolumesFromImageTest-1870167345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc" returned: 0 in 0.725s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:56:34 devstack cinder-volume[86212]: DEBUG cinder.manager [None req-e402c9f6-206a-4155-bea7-af3d3fa6dea2 tempest-CreateVolumesFromImageTest-1870167345 None] Notifying Schedulers of capabilities ... {{(pid=86212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 15:56:34 devstack sudo[104862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-36266a84-667b-4570-9f56-71b87687fb6e Sep 22 15:56:34 devstack sudo[104862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:56:34 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-e402c9f6-206a-4155-bea7-af3d3fa6dea2 tempest-CreateVolumesFromImageTest-1870167345 None] Deleted volume successfully. Sep 22 15:56:34 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-e402c9f6-206a-4155-bea7-af3d3fa6dea2 tempest-CreateVolumesFromImageTest-1870167345 None] Lock "cinder-dfe8d334-20c1-4d43-902f-8e70a325ace2-delete_volume" released by "delete_volume" :: held 2.992s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:56:35 devstack sudo[104862]: pam_unix(sudo:session): session closed for user root Sep 22 15:56:35 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-62d68861-db89-4c19-84c5-abfa77668823 tempest-CreateVolumesFromImageTest-1870167345 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-36266a84-667b-4570-9f56-71b87687fb6e" returned: 0 in 0.838s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:56:35 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-62d68861-db89-4c19-84c5-abfa77668823 tempest-CreateVolumesFromImageTest-1870167345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-36266a84-667b-4570-9f56-71b87687fb6e {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:56:35 devstack sudo[104868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-36266a84-667b-4570-9f56-71b87687fb6e Sep 22 15:56:35 devstack sudo[104868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:56:36 devstack sudo[104868]: pam_unix(sudo:session): session closed for user root Sep 22 15:56:36 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-62d68861-db89-4c19-84c5-abfa77668823 tempest-CreateVolumesFromImageTest-1870167345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-36266a84-667b-4570-9f56-71b87687fb6e" returned: 0 in 0.638s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:56:36 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-62d68861-db89-4c19-84c5-abfa77668823 tempest-CreateVolumesFromImageTest-1870167345 None] Lock "cinder-quobyte-36266a84-667b-4570-9f56-71b87687fb6e" released by "delete_volume" :: held 1.601s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:56:36 devstack cinder-volume[86212]: DEBUG cinder.quota [None req-62d68861-db89-4c19-84c5-abfa77668823 tempest-CreateVolumesFromImageTest-1870167345 None] Created reservations ['d1ac49b6-d5a9-43ee-86d2-9aff6f33eec7', '4b203774-0ebc-475a-b2f1-4c11e65db156', 'ce6f0528-f98d-4ec1-ac4b-ad7113ae3365', '237d4b47-f583-4af2-bc46-cf6a531b78d0'] {{(pid=86212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 15:56:36 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-62d68861-db89-4c19-84c5-abfa77668823 tempest-CreateVolumesFromImageTest-1870167345 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:56:36 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-62d68861-db89-4c19-84c5-abfa77668823 tempest-CreateVolumesFromImageTest-1870167345 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:56:36 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-62d68861-db89-4c19-84c5-abfa77668823 tempest-CreateVolumesFromImageTest-1870167345 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:56:36 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-62d68861-db89-4c19-84c5-abfa77668823 tempest-CreateVolumesFromImageTest-1870167345 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:56:36 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-62d68861-db89-4c19-84c5-abfa77668823 tempest-CreateVolumesFromImageTest-1870167345 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.064s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:56:36 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-62d68861-db89-4c19-84c5-abfa77668823 tempest-CreateVolumesFromImageTest-1870167345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:56:36 devstack sudo[104871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc Sep 22 15:56:36 devstack sudo[104871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:56:37 devstack sudo[104871]: pam_unix(sudo:session): session closed for user root Sep 22 15:56:37 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-62d68861-db89-4c19-84c5-abfa77668823 tempest-CreateVolumesFromImageTest-1870167345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc" returned: 0 in 0.800s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:56:37 devstack cinder-volume[86212]: DEBUG cinder.manager [None req-62d68861-db89-4c19-84c5-abfa77668823 tempest-CreateVolumesFromImageTest-1870167345 None] Notifying Schedulers of capabilities ... {{(pid=86212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 15:56:37 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-62d68861-db89-4c19-84c5-abfa77668823 tempest-CreateVolumesFromImageTest-1870167345 None] Deleted volume successfully. Sep 22 15:56:37 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-62d68861-db89-4c19-84c5-abfa77668823 tempest-CreateVolumesFromImageTest-1870167345 None] Lock "cinder-36266a84-667b-4570-9f56-71b87687fb6e-delete_volume" released by "delete_volume" :: held 2.992s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:56:38 devstack cinder-volume[86212]: DEBUG oslo_service.periodic_task [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86212) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 22 15:56:38 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:56:38 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:56:38 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:56:38 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:56:38 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:56:38 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:56:38 devstack sudo[104875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc Sep 22 15:56:38 devstack sudo[104875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:56:38 devstack cinder-volume[86212]: DEBUG cinder.volume.flows.manager.create_volume [None req-873843e8-16b7-4378-94ec-47c83bcade64 tempest-VolumeImageDependencyTests-200064695 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 15:56:38 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-873843e8-16b7-4378-94ec-47c83bcade64 tempest-VolumeImageDependencyTests-200064695 None] Flow 'volume_create_manager' (56b22b80-92cf-4aee-8bd5-1bd3b5c5ebe6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:56:38 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-873843e8-16b7-4378-94ec-47c83bcade64 tempest-VolumeImageDependencyTests-200064695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d746d28-4a76-49c9-a474-40bef3d06eba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:56:39 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-873843e8-16b7-4378-94ec-47c83bcade64 tempest-VolumeImageDependencyTests-200064695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d746d28-4a76-49c9-a474-40bef3d06eba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:56:38Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa70fd14-d2ad-4ee3-90b7-e9696bffadd3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d337b9f9d52402b8e214591bd5bfffc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:56:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:56:39Z,use_quota=True,user_id='97da8cb00c894d2aa51a2d7ef0afcec0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:56:39 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-873843e8-16b7-4378-94ec-47c83bcade64 tempest-VolumeImageDependencyTests-200064695 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a36d9081-66cf-4384-a6de-02e4f5b2a21f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:56:39 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-873843e8-16b7-4378-94ec-47c83bcade64 tempest-VolumeImageDependencyTests-200064695 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a36d9081-66cf-4384-a6de-02e4f5b2a21f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:56:39 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-873843e8-16b7-4378-94ec-47c83bcade64 tempest-VolumeImageDependencyTests-200064695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d566831e-db32-43d8-94a6-f05fa364cfff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:56:39 devstack cinder-volume[86212]: DEBUG cinder.image.glance [None req-873843e8-16b7-4378-94ec-47c83bcade64 tempest-VolumeImageDependencyTests-200064695 None] Creating Keystone auth plugin from conf {{(pid=86212) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 22 15:56:39 devstack sudo[104875]: pam_unix(sudo:session): session closed for user root Sep 22 15:56:39 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc" returned: 0 in 0.776s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:56:39 devstack cinder-volume[86212]: DEBUG cinder.manager [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] Notifying Schedulers of capabilities ... {{(pid=86212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 15:56:39 devstack cinder-volume[86212]: DEBUG oslo_service.periodic_task [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] Running periodic task VolumeManager._thread_info {{(pid=86212) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 22 15:56:39 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] thread count: 29 {{(pid=86212) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 22 15:56:39 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] thread info: [<_MainThread(MainThread, started 136163191222400)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86212) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 22 15:56:39 devstack sudo[104828]: pam_unix(sudo:session): session closed for user root Sep 22 15:56:39 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-d36a47a2-63d8-4b92-90bc-806bfed481a6 tempest-VolumeDependencyTests-1291485210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-62b589a2-5362-4f3a-8d41-abc51acd6885 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-540841fa-9687-4040-b6bb-4b6f22bf7ecf" returned: 0 in 10.078s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:56:39 devstack cinder-volume[86212]: DEBUG cinder.image.image_utils [None req-d36a47a2-63d8-4b92-90bc-806bfed481a6 tempest-VolumeDependencyTests-1291485210 None] Image conversion details: src /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-62b589a2-5362-4f3a-8d41-abc51acd6885, size 1024.00 MB, duration 10.08 sec, destination /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-540841fa-9687-4040-b6bb-4b6f22bf7ecf {{(pid=86212) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 22 15:56:39 devstack cinder-volume[86212]: INFO cinder.image.image_utils [None req-d36a47a2-63d8-4b92-90bc-806bfed481a6 tempest-VolumeDependencyTests-1291485210 None] Converted 1024.00 MB image at 101.58 MB/s Sep 22 15:56:39 devstack cinder-volume[86212]: WARNING cinder.volume.drivers.remotefs [None req-d36a47a2-63d8-4b92-90bc-806bfed481a6 tempest-VolumeDependencyTests-1291485210 None] /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-540841fa-9687-4040-b6bb-4b6f22bf7ecf is being set with open permissions: ugo+rw Sep 22 15:56:39 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-d36a47a2-63d8-4b92-90bc-806bfed481a6 tempest-VolumeDependencyTests-1291485210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-540841fa-9687-4040-b6bb-4b6f22bf7ecf {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:56:39 devstack sudo[104878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-540841fa-9687-4040-b6bb-4b6f22bf7ecf Sep 22 15:56:39 devstack sudo[104878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:56:39 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-873843e8-16b7-4378-94ec-47c83bcade64 tempest-VolumeImageDependencyTests-200064695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d566831e-db32-43d8-94a6-f05fa364cfff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'fa70fd14-d2ad-4ee3-90b7-e9696bffadd3', 'volume_name': 'volume-fa70fd14-d2ad-4ee3-90b7-e9696bffadd3', 'volume_size': 1, 'image_id': '99a54e06-4d42-4b0b-b899-9a68c597ec5d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/99a54e06-4d42-4b0b-b899-9a68c597ec5d', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '51361128464e86252de89ad99f848aa2', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '9d337b9f9d52402b8e214591bd5bfffc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'cd3ec7996bbad6e42a4a34c6907a4c90e7bf6acdc8ecb60ca01163fbf5c235ffeaa6a0f676bdb987305b193859f59feb03461c2debfc22f1b17b175b6150fc96', 'id': '99a54e06-4d42-4b0b-b899-9a68c597ec5d', 'created_at': datetime.datetime(2026, 9, 22, 13, 56, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 13, 56, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/99a54e06-4d42-4b0b-b899-9a68c597ec5d/file', 'properties': {}}, 'image_service': }' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:56:39 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-873843e8-16b7-4378-94ec-47c83bcade64 tempest-VolumeImageDependencyTests-200064695 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d99026f0-a8a5-48db-98a7-c842bcf83f6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:56:39 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-873843e8-16b7-4378-94ec-47c83bcade64 tempest-VolumeImageDependencyTests-200064695 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d99026f0-a8a5-48db-98a7-c842bcf83f6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:56:39 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-873843e8-16b7-4378-94ec-47c83bcade64 tempest-VolumeImageDependencyTests-200064695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5d92eec-92e0-42f8-b4ab-4394fdc0d0d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:56:39 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-873843e8-16b7-4378-94ec-47c83bcade64 tempest-VolumeImageDependencyTests-200064695 None] Volume fa70fd14-d2ad-4ee3-90b7-e9696bffadd3: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-fa70fd14-d2ad-4ee3-90b7-e9696bffadd3', 'volume_size': 1, 'image_id': '99a54e06-4d42-4b0b-b899-9a68c597ec5d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/99a54e06-4d42-4b0b-b899-9a68c597ec5d', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '51361128464e86252de89ad99f848aa2', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '9d337b9f9d52402b8e214591bd5bfffc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'cd3ec7996bbad6e42a4a34c6907a4c90e7bf6acdc8ecb60ca01163fbf5c235ffeaa6a0f676bdb987305b193859f59feb03461c2debfc22f1b17b175b6150fc96', 'id': '99a54e06-4d42-4b0b-b899-9a68c597ec5d', 'created_at': datetime.datetime(2026, 9, 22, 13, 56, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 13, 56, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/99a54e06-4d42-4b0b-b899-9a68c597ec5d/file', 'properties': {}}, 'image_service': } Sep 22 15:56:39 devstack cinder-volume[86212]: DEBUG cinder.volume.flows.manager.create_volume [None req-873843e8-16b7-4378-94ec-47c83bcade64 tempest-VolumeImageDependencyTests-200064695 None] Trying to clone fa70fd14-d2ad-4ee3-90b7-e9696bffadd3 from image 99a54e06-4d42-4b0b-b899-9a68c597ec5d at location (None, [{'url': 'file:///opt/stack/data/glance/images/99a54e06-4d42-4b0b-b899-9a68c597ec5d', 'metadata': {}}]). {{(pid=86212) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 22 15:56:39 devstack cinder-volume[86212]: DEBUG cinder.image.image_utils [None req-873843e8-16b7-4378-94ec-47c83bcade64 tempest-VolumeImageDependencyTests-200064695 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_99a54e06-4d42-4b0b-b899-9a68c597ec5d_8vpr1exhdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86212) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 22 15:56:39 devstack cinder-volume[86212]: INFO cinder.image.image_utils [None req-873843e8-16b7-4378-94ec-47c83bcade64 tempest-VolumeImageDependencyTests-200064695 None] Image download 0.00 MB at 0.00 MB/s Sep 22 15:56:39 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[39106d35-0388-4586-833d-4f937293ddae]: (4, 'raw') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:56:39 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-873843e8-16b7-4378-94ec-47c83bcade64 tempest-VolumeImageDependencyTests-200064695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_99a54e06-4d42-4b0b-b899-9a68c597ec5d_8vpr1exhdevstack@QuobyteHD {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:56:40 devstack sudo[104878]: pam_unix(sudo:session): session closed for user root Sep 22 15:56:40 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-d36a47a2-63d8-4b92-90bc-806bfed481a6 tempest-VolumeDependencyTests-1291485210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-540841fa-9687-4040-b6bb-4b6f22bf7ecf" returned: 0 in 0.414s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:56:40 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-d36a47a2-63d8-4b92-90bc-806bfed481a6 tempest-VolumeDependencyTests-1291485210 None] Lock "cinder-quobyte-540841fa-9687-4040-b6bb-4b6f22bf7ecf" released by "_copy_volume_from_snapshot" :: held 11.699s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:56:40 devstack sudo[104881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_99a54e06-4d42-4b0b-b899-9a68c597ec5d_8vpr1exhdevstack@QuobyteHD Sep 22 15:56:40 devstack sudo[104881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:56:40 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-d36a47a2-63d8-4b92-90bc-806bfed481a6 tempest-VolumeDependencyTests-1291485210 None] Lock "cinder-quobyte-33bb63b8-0998-4f12-9617-706fd6d5310d-540841fa-9687-4040-b6bb-4b6f22bf7ecf" released by "_create_volume_from_snapshot" :: held 11.804s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:56:40 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-d36a47a2-63d8-4b92-90bc-806bfed481a6 tempest-VolumeDependencyTests-1291485210 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.831s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:56:40 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-d36a47a2-63d8-4b92-90bc-806bfed481a6 tempest-VolumeDependencyTests-1291485210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20d24f23-61e3-40a0-a720-f48d60e03622) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-540841fa-9687-4040-b6bb-4b6f22bf7ecf', 'volume_size': 1, 'snapshot_id': '33bb63b8-0998-4f12-9617-706fd6d5310d'}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:56:40 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-d36a47a2-63d8-4b92-90bc-806bfed481a6 tempest-VolumeDependencyTests-1291485210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (452bf4fa-0e83-466b-876b-b0317e0f931d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:56:40 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-d36a47a2-63d8-4b92-90bc-806bfed481a6 tempest-VolumeDependencyTests-1291485210 None] Volume volume-540841fa-9687-4040-b6bb-4b6f22bf7ecf (540841fa-9687-4040-b6bb-4b6f22bf7ecf): created successfully Sep 22 15:56:40 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-d36a47a2-63d8-4b92-90bc-806bfed481a6 tempest-VolumeDependencyTests-1291485210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (452bf4fa-0e83-466b-876b-b0317e0f931d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:56:40 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-d36a47a2-63d8-4b92-90bc-806bfed481a6 tempest-VolumeDependencyTests-1291485210 None] Flow 'volume_create_manager' (70a7ec29-c3b5-432a-95f2-837ab74ea794) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:56:40 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-d36a47a2-63d8-4b92-90bc-806bfed481a6 tempest-VolumeDependencyTests-1291485210 None] Created volume successfully. Sep 22 15:56:40 devstack sudo[104881]: pam_unix(sudo:session): session closed for user root Sep 22 15:56:40 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-873843e8-16b7-4378-94ec-47c83bcade64 tempest-VolumeImageDependencyTests-200064695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_99a54e06-4d42-4b0b-b899-9a68c597ec5d_8vpr1exhdevstack@QuobyteHD" returned: 0 in 0.484s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:56:40 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-873843e8-16b7-4378-94ec-47c83bcade64 tempest-VolumeImageDependencyTests-200064695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_99a54e06-4d42-4b0b-b899-9a68c597ec5d_8vpr1exhdevstack@QuobyteHD {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:56:40 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-726fe4ff-50d6-486f-97ae-e74ee9d047e7 tempest-VolumeDependencyTests-1291485210 None] Acquiring lock "cinder-33bb63b8-0998-4f12-9617-706fd6d5310d-delete_snapshot" by "delete_snapshot" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:56:40 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-726fe4ff-50d6-486f-97ae-e74ee9d047e7 tempest-VolumeDependencyTests-1291485210 None] Lock "cinder-33bb63b8-0998-4f12-9617-706fd6d5310d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:56:40 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-726fe4ff-50d6-486f-97ae-e74ee9d047e7 tempest-VolumeDependencyTests-1291485210 None] Acquiring lock "cinder-quobyte-62b589a2-5362-4f3a-8d41-abc51acd6885" by "delete_snapshot" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:56:40 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-726fe4ff-50d6-486f-97ae-e74ee9d047e7 tempest-VolumeDependencyTests-1291485210 None] Lock "cinder-quobyte-62b589a2-5362-4f3a-8d41-abc51acd6885" acquired by "delete_snapshot" :: waited 0.041s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:56:40 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-726fe4ff-50d6-486f-97ae-e74ee9d047e7 tempest-VolumeDependencyTests-1291485210 None] Acquiring lock "cinder-quobyte-33bb63b8-0998-4f12-9617-706fd6d5310d" by "_delete_snapshot" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:56:40 devstack sudo[104885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_99a54e06-4d42-4b0b-b899-9a68c597ec5d_8vpr1exhdevstack@QuobyteHD Sep 22 15:56:40 devstack sudo[104885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:56:40 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-726fe4ff-50d6-486f-97ae-e74ee9d047e7 tempest-VolumeDependencyTests-1291485210 None] Lock "cinder-quobyte-33bb63b8-0998-4f12-9617-706fd6d5310d" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:56:40 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-726fe4ff-50d6-486f-97ae-e74ee9d047e7 tempest-VolumeDependencyTests-1291485210 None] Deleting offline snapshot 33bb63b8-0998-4f12-9617-706fd6d5310d of volume 62b589a2-5362-4f3a-8d41-abc51acd6885 {{(pid=86212) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 22 15:56:40 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-726fe4ff-50d6-486f-97ae-e74ee9d047e7 tempest-VolumeDependencyTests-1291485210 None] snapshot_file for this snap is: volume-62b589a2-5362-4f3a-8d41-abc51acd6885.33bb63b8-0998-4f12-9617-706fd6d5310d {{(pid=86212) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 22 15:56:40 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[76ff7133-af81-487a-826f-2c9a8fc9f117]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:56:40 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-726fe4ff-50d6-486f-97ae-e74ee9d047e7 tempest-VolumeDependencyTests-1291485210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-62b589a2-5362-4f3a-8d41-abc51acd6885.33bb63b8-0998-4f12-9617-706fd6d5310d {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:56:40 devstack sudo[104887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-62b589a2-5362-4f3a-8d41-abc51acd6885.33bb63b8-0998-4f12-9617-706fd6d5310d Sep 22 15:56:40 devstack sudo[104887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:56:40 devstack sudo[104885]: pam_unix(sudo:session): session closed for user root Sep 22 15:56:40 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-873843e8-16b7-4378-94ec-47c83bcade64 tempest-VolumeImageDependencyTests-200064695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_99a54e06-4d42-4b0b-b899-9a68c597ec5d_8vpr1exhdevstack@QuobyteHD" returned: 1 in 0.565s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:56:40 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-873843e8-16b7-4378-94ec-47c83bcade64 tempest-VolumeImageDependencyTests-200064695 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_99a54e06-4d42-4b0b-b899-9a68c597ec5d_8vpr1exhdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 22 15:56:41 devstack cinder-volume[86212]: DEBUG cinder.image.image_utils [None req-873843e8-16b7-4378-94ec-47c83bcade64 tempest-VolumeImageDependencyTests-200064695 None] Temporary image 99a54e06-4d42-4b0b-b899-9a68c597ec5d is fetched for user 97da8cb00c894d2aa51a2d7ef0afcec0. {{(pid=86212) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 22 15:56:41 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[84e754f7-8b89-4fe9-b7f1-9a0b63b2bf8c]: (4, 'raw') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:56:41 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-873843e8-16b7-4378-94ec-47c83bcade64 tempest-VolumeImageDependencyTests-200064695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_99a54e06-4d42-4b0b-b899-9a68c597ec5d_8vpr1exhdevstack@QuobyteHD {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:56:41 devstack sudo[104887]: pam_unix(sudo:session): session closed for user root Sep 22 15:56:41 devstack sudo[104892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_99a54e06-4d42-4b0b-b899-9a68c597ec5d_8vpr1exhdevstack@QuobyteHD Sep 22 15:56:41 devstack sudo[104892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:56:41 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-726fe4ff-50d6-486f-97ae-e74ee9d047e7 tempest-VolumeDependencyTests-1291485210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-62b589a2-5362-4f3a-8d41-abc51acd6885.33bb63b8-0998-4f12-9617-706fd6d5310d" returned: 0 in 0.635s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:56:41 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-726fe4ff-50d6-486f-97ae-e74ee9d047e7 tempest-VolumeDependencyTests-1291485210 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-62b589a2-5362-4f3a-8d41-abc51acd6885(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86212) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 22 15:56:41 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[c51b603e-5679-476e-98b8-38a4fd737761]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:56:41 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-726fe4ff-50d6-486f-97ae-e74ee9d047e7 tempest-VolumeDependencyTests-1291485210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-62b589a2-5362-4f3a-8d41-abc51acd6885 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:56:41 devstack sudo[104897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-62b589a2-5362-4f3a-8d41-abc51acd6885 Sep 22 15:56:41 devstack sudo[104897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:56:41 devstack sudo[104892]: pam_unix(sudo:session): session closed for user root Sep 22 15:56:41 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-873843e8-16b7-4378-94ec-47c83bcade64 tempest-VolumeImageDependencyTests-200064695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_99a54e06-4d42-4b0b-b899-9a68c597ec5d_8vpr1exhdevstack@QuobyteHD" returned: 0 in 0.516s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:56:41 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-873843e8-16b7-4378-94ec-47c83bcade64 tempest-VolumeImageDependencyTests-200064695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_99a54e06-4d42-4b0b-b899-9a68c597ec5d_8vpr1exhdevstack@QuobyteHD {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:56:41 devstack sudo[104901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_99a54e06-4d42-4b0b-b899-9a68c597ec5d_8vpr1exhdevstack@QuobyteHD Sep 22 15:56:41 devstack sudo[104901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:56:42 devstack sudo[104897]: pam_unix(sudo:session): session closed for user root Sep 22 15:56:42 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-726fe4ff-50d6-486f-97ae-e74ee9d047e7 tempest-VolumeDependencyTests-1291485210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-62b589a2-5362-4f3a-8d41-abc51acd6885" returned: 0 in 0.812s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:56:42 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-726fe4ff-50d6-486f-97ae-e74ee9d047e7 tempest-VolumeDependencyTests-1291485210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-62b589a2-5362-4f3a-8d41-abc51acd6885.33bb63b8-0998-4f12-9617-706fd6d5310d {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:56:42 devstack sudo[104901]: pam_unix(sudo:session): session closed for user root Sep 22 15:56:42 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-873843e8-16b7-4378-94ec-47c83bcade64 tempest-VolumeImageDependencyTests-200064695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_99a54e06-4d42-4b0b-b899-9a68c597ec5d_8vpr1exhdevstack@QuobyteHD" returned: 1 in 0.577s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:56:42 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-873843e8-16b7-4378-94ec-47c83bcade64 tempest-VolumeImageDependencyTests-200064695 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_99a54e06-4d42-4b0b-b899-9a68c597ec5d_8vpr1exhdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 22 15:56:42 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-873843e8-16b7-4378-94ec-47c83bcade64 tempest-VolumeImageDependencyTests-200064695 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:56:42 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-873843e8-16b7-4378-94ec-47c83bcade64 tempest-VolumeImageDependencyTests-200064695 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:56:42 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-873843e8-16b7-4378-94ec-47c83bcade64 tempest-VolumeImageDependencyTests-200064695 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:56:38Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa70fd14-d2ad-4ee3-90b7-e9696bffadd3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d337b9f9d52402b8e214591bd5bfffc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:56:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:56:39Z,use_quota=True,user_id='97da8cb00c894d2aa51a2d7ef0afcec0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)}" {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 15:56:42 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-873843e8-16b7-4378-94ec-47c83bcade64 tempest-VolumeImageDependencyTests-200064695 None] Creating volume fa70fd14-d2ad-4ee3-90b7-e9696bffadd3 {{(pid=86212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 15:56:42 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-873843e8-16b7-4378-94ec-47c83bcade64 tempest-VolumeImageDependencyTests-200064695 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:56:42 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-873843e8-16b7-4378-94ec-47c83bcade64 tempest-VolumeImageDependencyTests-200064695 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:56:42 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-873843e8-16b7-4378-94ec-47c83bcade64 tempest-VolumeImageDependencyTests-200064695 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:56:42 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-873843e8-16b7-4378-94ec-47c83bcade64 tempest-VolumeImageDependencyTests-200064695 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:56:42 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-873843e8-16b7-4378-94ec-47c83bcade64 tempest-VolumeImageDependencyTests-200064695 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:56:42 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-873843e8-16b7-4378-94ec-47c83bcade64 tempest-VolumeImageDependencyTests-200064695 None] Selected osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 as target Quobyte volume. {{(pid=86212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 15:56:42 devstack cinder-volume[86212]: INFO cinder.volume.drivers.remotefs [None req-873843e8-16b7-4378-94ec-47c83bcade64 tempest-VolumeImageDependencyTests-200064695 None] casted to osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 Sep 22 15:56:42 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-873843e8-16b7-4378-94ec-47c83bcade64 tempest-VolumeImageDependencyTests-200064695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-fa70fd14-d2ad-4ee3-90b7-e9696bffadd3 1073741824 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:56:42 devstack sudo[104910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-62b589a2-5362-4f3a-8d41-abc51acd6885.33bb63b8-0998-4f12-9617-706fd6d5310d Sep 22 15:56:42 devstack sudo[104910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:56:42 devstack sudo[104911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-fa70fd14-d2ad-4ee3-90b7-e9696bffadd3 1073741824 Sep 22 15:56:42 devstack sudo[104911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:56:42 devstack sudo[104910]: pam_unix(sudo:session): session closed for user root Sep 22 15:56:42 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-726fe4ff-50d6-486f-97ae-e74ee9d047e7 tempest-VolumeDependencyTests-1291485210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-62b589a2-5362-4f3a-8d41-abc51acd6885.33bb63b8-0998-4f12-9617-706fd6d5310d" returned: 0 in 0.416s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:56:42 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-726fe4ff-50d6-486f-97ae-e74ee9d047e7 tempest-VolumeDependencyTests-1291485210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-62b589a2-5362-4f3a-8d41-abc51acd6885.33bb63b8-0998-4f12-9617-706fd6d5310d {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:56:42 devstack sudo[104925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-62b589a2-5362-4f3a-8d41-abc51acd6885.33bb63b8-0998-4f12-9617-706fd6d5310d Sep 22 15:56:42 devstack sudo[104925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:56:42 devstack sudo[104911]: pam_unix(sudo:session): session closed for user root Sep 22 15:56:42 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-873843e8-16b7-4378-94ec-47c83bcade64 tempest-VolumeImageDependencyTests-200064695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-fa70fd14-d2ad-4ee3-90b7-e9696bffadd3 1073741824" returned: 0 in 0.645s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:56:42 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-873843e8-16b7-4378-94ec-47c83bcade64 tempest-VolumeImageDependencyTests-200064695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-fa70fd14-d2ad-4ee3-90b7-e9696bffadd3 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:56:42 devstack sudo[104925]: pam_unix(sudo:session): session closed for user root Sep 22 15:56:42 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-726fe4ff-50d6-486f-97ae-e74ee9d047e7 tempest-VolumeDependencyTests-1291485210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-62b589a2-5362-4f3a-8d41-abc51acd6885.33bb63b8-0998-4f12-9617-706fd6d5310d" returned: 0 in 0.335s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:56:42 devstack sudo[104943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-fa70fd14-d2ad-4ee3-90b7-e9696bffadd3 Sep 22 15:56:42 devstack sudo[104943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:56:43 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-726fe4ff-50d6-486f-97ae-e74ee9d047e7 tempest-VolumeDependencyTests-1291485210 None] Lock "cinder-quobyte-33bb63b8-0998-4f12-9617-706fd6d5310d" released by "_delete_snapshot" :: held 2.432s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:56:43 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-726fe4ff-50d6-486f-97ae-e74ee9d047e7 tempest-VolumeDependencyTests-1291485210 None] Lock "cinder-quobyte-62b589a2-5362-4f3a-8d41-abc51acd6885" released by "delete_snapshot" :: held 2.486s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:56:43 devstack cinder-volume[86212]: DEBUG cinder.quota [None req-726fe4ff-50d6-486f-97ae-e74ee9d047e7 tempest-VolumeDependencyTests-1291485210 None] Created reservations ['fbd2af9c-ffaa-4fc0-8839-13db608990cc', '94bf5a2b-6037-4119-9427-894dc131c65f', '27854ecd-193c-4cac-8230-55eefeea06df', 'deac1b2d-e04e-4f5b-a7de-8e24de83caf8'] {{(pid=86212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 15:56:43 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-726fe4ff-50d6-486f-97ae-e74ee9d047e7 tempest-VolumeDependencyTests-1291485210 None] Delete snapshot completed successfully. Sep 22 15:56:43 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-726fe4ff-50d6-486f-97ae-e74ee9d047e7 tempest-VolumeDependencyTests-1291485210 None] Lock "cinder-33bb63b8-0998-4f12-9617-706fd6d5310d-delete_snapshot" released by "delete_snapshot" :: held 2.757s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:56:43 devstack sudo[104943]: pam_unix(sudo:session): session closed for user root Sep 22 15:56:43 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-873843e8-16b7-4378-94ec-47c83bcade64 tempest-VolumeImageDependencyTests-200064695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-fa70fd14-d2ad-4ee3-90b7-e9696bffadd3" returned: 0 in 0.426s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:56:43 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-873843e8-16b7-4378-94ec-47c83bcade64 tempest-VolumeImageDependencyTests-200064695 None] <== create_volume: return (1137ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'} {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 15:56:43 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-873843e8-16b7-4378-94ec-47c83bcade64 tempest-VolumeImageDependencyTests-200064695 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.140s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:56:43 devstack cinder-volume[86212]: DEBUG cinder.volume.volume_utils [None req-873843e8-16b7-4378-94ec-47c83bcade64 tempest-VolumeImageDependencyTests-200064695 None] Attempting download of 99a54e06-4d42-4b0b-b899-9a68c597ec5d ((None, [{'url': 'file:///opt/stack/data/glance/images/99a54e06-4d42-4b0b-b899-9a68c597ec5d', 'metadata': {}}])) to volume fa70fd14-d2ad-4ee3-90b7-e9696bffadd3. {{(pid=86212) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 22 15:56:43 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[566bb361-7281-47ac-854f-a136bee52dfe]: (4, 'raw') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:56:43 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-873843e8-16b7-4378-94ec-47c83bcade64 tempest-VolumeImageDependencyTests-200064695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_99a54e06-4d42-4b0b-b899-9a68c597ec5d_y_fzrmf_ {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:56:43 devstack sudo[104969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_99a54e06-4d42-4b0b-b899-9a68c597ec5d_y_fzrmf_ Sep 22 15:56:43 devstack sudo[104969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:56:43 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-a9b418d1-438c-4be9-b1d4-d11d40c3760c tempest-VolumeDependencyTests-1291485210 None] Acquiring lock "cinder-62b589a2-5362-4f3a-8d41-abc51acd6885-delete_volume" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:56:43 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-a9b418d1-438c-4be9-b1d4-d11d40c3760c tempest-VolumeDependencyTests-1291485210 None] Lock "cinder-62b589a2-5362-4f3a-8d41-abc51acd6885-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:56:43 devstack sudo[104969]: pam_unix(sudo:session): session closed for user root Sep 22 15:56:43 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-873843e8-16b7-4378-94ec-47c83bcade64 tempest-VolumeImageDependencyTests-200064695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_99a54e06-4d42-4b0b-b899-9a68c597ec5d_y_fzrmf_" returned: 0 in 0.462s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:56:43 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-873843e8-16b7-4378-94ec-47c83bcade64 tempest-VolumeImageDependencyTests-200064695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_99a54e06-4d42-4b0b-b899-9a68c597ec5d_y_fzrmf_ {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:56:43 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-a9b418d1-438c-4be9-b1d4-d11d40c3760c tempest-VolumeDependencyTests-1291485210 None] Acquiring lock "cinder-quobyte-62b589a2-5362-4f3a-8d41-abc51acd6885" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:56:44 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-a9b418d1-438c-4be9-b1d4-d11d40c3760c tempest-VolumeDependencyTests-1291485210 None] Lock "cinder-quobyte-62b589a2-5362-4f3a-8d41-abc51acd6885" acquired by "delete_volume" :: waited 0.023s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:56:44 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ffd0bfa-7970-40ff-a126-483223b9178f]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:56:44 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-a9b418d1-438c-4be9-b1d4-d11d40c3760c tempest-VolumeDependencyTests-1291485210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-62b589a2-5362-4f3a-8d41-abc51acd6885 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:56:44 devstack sudo[104973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_99a54e06-4d42-4b0b-b899-9a68c597ec5d_y_fzrmf_ Sep 22 15:56:44 devstack sudo[104973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:56:44 devstack sudo[104974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-62b589a2-5362-4f3a-8d41-abc51acd6885 Sep 22 15:56:44 devstack sudo[104974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:56:44 devstack sudo[104973]: pam_unix(sudo:session): session closed for user root Sep 22 15:56:44 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-873843e8-16b7-4378-94ec-47c83bcade64 tempest-VolumeImageDependencyTests-200064695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_99a54e06-4d42-4b0b-b899-9a68c597ec5d_y_fzrmf_" returned: 1 in 0.414s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:56:44 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-873843e8-16b7-4378-94ec-47c83bcade64 tempest-VolumeImageDependencyTests-200064695 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_99a54e06-4d42-4b0b-b899-9a68c597ec5d_y_fzrmf_' failed. Not Retrying. {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 22 15:56:44 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[3627e643-6937-4971-9f9e-1caece52a962]: (4, 'raw') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:56:44 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-873843e8-16b7-4378-94ec-47c83bcade64 tempest-VolumeImageDependencyTests-200064695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_99a54e06-4d42-4b0b-b899-9a68c597ec5d_8vpr1exhdevstack@QuobyteHD {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:56:44 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-8729aa45-466e-49c8-8db9-5ebfa1cf0dcd tempest-ProjectAdminTests-1639240763 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.568157196045, 'free_capacity_gb': 1775.568157196045, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86212) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 22 15:56:44 devstack sudo[104979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_99a54e06-4d42-4b0b-b899-9a68c597ec5d_8vpr1exhdevstack@QuobyteHD Sep 22 15:56:44 devstack sudo[104979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:56:44 devstack sudo[104974]: pam_unix(sudo:session): session closed for user root Sep 22 15:56:44 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-a9b418d1-438c-4be9-b1d4-d11d40c3760c tempest-VolumeDependencyTests-1291485210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-62b589a2-5362-4f3a-8d41-abc51acd6885" returned: 0 in 0.535s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:56:44 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-a9b418d1-438c-4be9-b1d4-d11d40c3760c tempest-VolumeDependencyTests-1291485210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-62b589a2-5362-4f3a-8d41-abc51acd6885 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:56:44 devstack sudo[104984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-62b589a2-5362-4f3a-8d41-abc51acd6885 Sep 22 15:56:44 devstack sudo[104984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:56:44 devstack sudo[104979]: pam_unix(sudo:session): session closed for user root Sep 22 15:56:44 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-873843e8-16b7-4378-94ec-47c83bcade64 tempest-VolumeImageDependencyTests-200064695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_99a54e06-4d42-4b0b-b899-9a68c597ec5d_8vpr1exhdevstack@QuobyteHD" returned: 0 in 0.397s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:56:44 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-873843e8-16b7-4378-94ec-47c83bcade64 tempest-VolumeImageDependencyTests-200064695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_99a54e06-4d42-4b0b-b899-9a68c597ec5d_8vpr1exhdevstack@QuobyteHD {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:56:44 devstack sudo[104988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_99a54e06-4d42-4b0b-b899-9a68c597ec5d_8vpr1exhdevstack@QuobyteHD Sep 22 15:56:44 devstack sudo[104988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:56:44 devstack sudo[104984]: pam_unix(sudo:session): session closed for user root Sep 22 15:56:44 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-a9b418d1-438c-4be9-b1d4-d11d40c3760c tempest-VolumeDependencyTests-1291485210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-62b589a2-5362-4f3a-8d41-abc51acd6885" returned: 0 in 0.304s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:56:44 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-a9b418d1-438c-4be9-b1d4-d11d40c3760c tempest-VolumeDependencyTests-1291485210 None] Lock "cinder-quobyte-62b589a2-5362-4f3a-8d41-abc51acd6885" released by "delete_volume" :: held 0.925s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:56:45 devstack cinder-volume[86212]: DEBUG cinder.quota [None req-a9b418d1-438c-4be9-b1d4-d11d40c3760c tempest-VolumeDependencyTests-1291485210 None] Created reservations ['9abf6b76-5e3b-4702-b55c-854aef2a7b58', 'c902f3e0-1534-4ee3-8767-5d5099047f52', 'c5431c7f-6115-4cb4-9600-2ced0f4a10bc', 'c69b70aa-21a2-4d80-91bb-c24ede2f8b34'] {{(pid=86212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 15:56:45 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-a9b418d1-438c-4be9-b1d4-d11d40c3760c tempest-VolumeDependencyTests-1291485210 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:56:45 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-a9b418d1-438c-4be9-b1d4-d11d40c3760c tempest-VolumeDependencyTests-1291485210 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:56:45 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-a9b418d1-438c-4be9-b1d4-d11d40c3760c tempest-VolumeDependencyTests-1291485210 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:56:45 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-a9b418d1-438c-4be9-b1d4-d11d40c3760c tempest-VolumeDependencyTests-1291485210 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:56:45 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-a9b418d1-438c-4be9-b1d4-d11d40c3760c tempest-VolumeDependencyTests-1291485210 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:56:45 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-a9b418d1-438c-4be9-b1d4-d11d40c3760c tempest-VolumeDependencyTests-1291485210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:56:45 devstack sudo[104992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc Sep 22 15:56:45 devstack sudo[104992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:56:45 devstack sudo[104988]: pam_unix(sudo:session): session closed for user root Sep 22 15:56:45 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-873843e8-16b7-4378-94ec-47c83bcade64 tempest-VolumeImageDependencyTests-200064695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_99a54e06-4d42-4b0b-b899-9a68c597ec5d_8vpr1exhdevstack@QuobyteHD" returned: 1 in 0.413s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:56:45 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-873843e8-16b7-4378-94ec-47c83bcade64 tempest-VolumeImageDependencyTests-200064695 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_99a54e06-4d42-4b0b-b899-9a68c597ec5d_8vpr1exhdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 22 15:56:45 devstack cinder-volume[86212]: DEBUG cinder.image.image_utils [None req-873843e8-16b7-4378-94ec-47c83bcade64 tempest-VolumeImageDependencyTests-200064695 None] 99a54e06-4d42-4b0b-b899-9a68c597ec5d was raw, converting to qcow2 {{(pid=86212) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 22 15:56:45 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-873843e8-16b7-4378-94ec-47c83bcade64 tempest-VolumeImageDependencyTests-200064695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_99a54e06-4d42-4b0b-b899-9a68c597ec5d_8vpr1exhdevstack@QuobyteHD /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-fa70fd14-d2ad-4ee3-90b7-e9696bffadd3 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:56:45 devstack sudo[104996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_99a54e06-4d42-4b0b-b899-9a68c597ec5d_8vpr1exhdevstack@QuobyteHD /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-fa70fd14-d2ad-4ee3-90b7-e9696bffadd3 Sep 22 15:56:45 devstack sudo[104996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:56:45 devstack sudo[104992]: pam_unix(sudo:session): session closed for user root Sep 22 15:56:45 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-a9b418d1-438c-4be9-b1d4-d11d40c3760c tempest-VolumeDependencyTests-1291485210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc" returned: 0 in 0.289s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:56:45 devstack cinder-volume[86212]: DEBUG cinder.manager [None req-a9b418d1-438c-4be9-b1d4-d11d40c3760c tempest-VolumeDependencyTests-1291485210 None] Notifying Schedulers of capabilities ... {{(pid=86212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 15:56:45 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-a9b418d1-438c-4be9-b1d4-d11d40c3760c tempest-VolumeDependencyTests-1291485210 None] Deleted volume successfully. Sep 22 15:56:45 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-a9b418d1-438c-4be9-b1d4-d11d40c3760c tempest-VolumeDependencyTests-1291485210 None] Lock "cinder-62b589a2-5362-4f3a-8d41-abc51acd6885-delete_volume" released by "delete_volume" :: held 1.528s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:56:45 devstack sudo[104996]: pam_unix(sudo:session): session closed for user root Sep 22 15:56:45 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-873843e8-16b7-4378-94ec-47c83bcade64 tempest-VolumeImageDependencyTests-200064695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_99a54e06-4d42-4b0b-b899-9a68c597ec5d_8vpr1exhdevstack@QuobyteHD /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-fa70fd14-d2ad-4ee3-90b7-e9696bffadd3" returned: 0 in 0.581s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:56:45 devstack cinder-volume[86212]: DEBUG cinder.image.image_utils [None req-873843e8-16b7-4378-94ec-47c83bcade64 tempest-VolumeImageDependencyTests-200064695 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_99a54e06-4d42-4b0b-b899-9a68c597ec5d_8vpr1exhdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-fa70fd14-d2ad-4ee3-90b7-e9696bffadd3 {{(pid=86212) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 22 15:56:45 devstack cinder-volume[86212]: INFO cinder.image.image_utils [None req-873843e8-16b7-4378-94ec-47c83bcade64 tempest-VolumeImageDependencyTests-200064695 None] Converted 0.00 MB image at 0.00 MB/s Sep 22 15:56:45 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-873843e8-16b7-4378-94ec-47c83bcade64 tempest-VolumeImageDependencyTests-200064695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-fa70fd14-d2ad-4ee3-90b7-e9696bffadd3 1G {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:56:45 devstack sudo[105003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-fa70fd14-d2ad-4ee3-90b7-e9696bffadd3 1G Sep 22 15:56:45 devstack sudo[105003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:56:46 devstack sudo[105003]: pam_unix(sudo:session): session closed for user root Sep 22 15:56:46 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-873843e8-16b7-4378-94ec-47c83bcade64 tempest-VolumeImageDependencyTests-200064695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-fa70fd14-d2ad-4ee3-90b7-e9696bffadd3 1G" returned: 0 in 0.413s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:56:46 devstack cinder-volume[86212]: DEBUG cinder.volume.volume_utils [None req-873843e8-16b7-4378-94ec-47c83bcade64 tempest-VolumeImageDependencyTests-200064695 None] Downloaded image 99a54e06-4d42-4b0b-b899-9a68c597ec5d ((None, [{'url': 'file:///opt/stack/data/glance/images/99a54e06-4d42-4b0b-b899-9a68c597ec5d', 'metadata': {}}])) to volume fa70fd14-d2ad-4ee3-90b7-e9696bffadd3 successfully. {{(pid=86212) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 22 15:56:46 devstack cinder-volume[86212]: DEBUG cinder.image.image_utils [None req-873843e8-16b7-4378-94ec-47c83bcade64 tempest-VolumeImageDependencyTests-200064695 None] Temporary image 99a54e06-4d42-4b0b-b899-9a68c597ec5d for user 97da8cb00c894d2aa51a2d7ef0afcec0 is deleted. {{(pid=86212) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 22 15:56:46 devstack cinder-volume[86212]: DEBUG cinder.volume.volume_utils [None req-873843e8-16b7-4378-94ec-47c83bcade64 tempest-VolumeImageDependencyTests-200064695 None] Marking volume fa70fd14-d2ad-4ee3-90b7-e9696bffadd3 as bootable. {{(pid=86212) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 22 15:56:46 devstack cinder-volume[86212]: DEBUG cinder.volume.flows.manager.create_volume [None req-873843e8-16b7-4378-94ec-47c83bcade64 tempest-VolumeImageDependencyTests-200064695 None] Copying metadata from image 99a54e06-4d42-4b0b-b899-9a68c597ec5d to fa70fd14-d2ad-4ee3-90b7-e9696bffadd3. {{(pid=86212) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 22 15:56:46 devstack cinder-volume[86212]: DEBUG cinder.volume.flows.manager.create_volume [None req-873843e8-16b7-4378-94ec-47c83bcade64 tempest-VolumeImageDependencyTests-200064695 None] Creating volume glance metadata for volume fa70fd14-d2ad-4ee3-90b7-e9696bffadd3 backed by image 99a54e06-4d42-4b0b-b899-9a68c597ec5d with: {'image_id': '99a54e06-4d42-4b0b-b899-9a68c597ec5d', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '51361128464e86252de89ad99f848aa2', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86212) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 22 15:56:46 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-84325a2e-5a11-4e53-8c85-c71b799585ee tempest-VolumeDependencyTests-1291485210 None] Acquiring lock "cinder-540841fa-9687-4040-b6bb-4b6f22bf7ecf-delete_volume" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:56:46 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-84325a2e-5a11-4e53-8c85-c71b799585ee tempest-VolumeDependencyTests-1291485210 None] Lock "cinder-540841fa-9687-4040-b6bb-4b6f22bf7ecf-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:56:46 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-84325a2e-5a11-4e53-8c85-c71b799585ee tempest-VolumeDependencyTests-1291485210 None] Acquiring lock "cinder-quobyte-540841fa-9687-4040-b6bb-4b6f22bf7ecf" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:56:46 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-873843e8-16b7-4378-94ec-47c83bcade64 tempest-VolumeImageDependencyTests-200064695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5d92eec-92e0-42f8-b4ab-4394fdc0d0d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa70fd14-d2ad-4ee3-90b7-e9696bffadd3', 'volume_size': 1, 'image_id': '99a54e06-4d42-4b0b-b899-9a68c597ec5d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/99a54e06-4d42-4b0b-b899-9a68c597ec5d', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '51361128464e86252de89ad99f848aa2', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '9d337b9f9d52402b8e214591bd5bfffc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'cd3ec7996bbad6e42a4a34c6907a4c90e7bf6acdc8ecb60ca01163fbf5c235ffeaa6a0f676bdb987305b193859f59feb03461c2debfc22f1b17b175b6150fc96', 'id': '99a54e06-4d42-4b0b-b899-9a68c597ec5d', 'created_at': datetime.datetime(2026, 9, 22, 13, 56, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 13, 56, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/99a54e06-4d42-4b0b-b899-9a68c597ec5d/file', 'properties': {}}, 'image_service': }' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:56:46 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-873843e8-16b7-4378-94ec-47c83bcade64 tempest-VolumeImageDependencyTests-200064695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a91c2117-3cf7-4382-ba83-9d516ba626d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:56:46 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-84325a2e-5a11-4e53-8c85-c71b799585ee tempest-VolumeDependencyTests-1291485210 None] Lock "cinder-quobyte-540841fa-9687-4040-b6bb-4b6f22bf7ecf" acquired by "delete_volume" :: waited 0.045s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:56:46 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-873843e8-16b7-4378-94ec-47c83bcade64 tempest-VolumeImageDependencyTests-200064695 None] Volume volume-fa70fd14-d2ad-4ee3-90b7-e9696bffadd3 (fa70fd14-d2ad-4ee3-90b7-e9696bffadd3): created successfully Sep 22 15:56:46 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-873843e8-16b7-4378-94ec-47c83bcade64 tempest-VolumeImageDependencyTests-200064695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a91c2117-3cf7-4382-ba83-9d516ba626d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:56:46 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-873843e8-16b7-4378-94ec-47c83bcade64 tempest-VolumeImageDependencyTests-200064695 None] Flow 'volume_create_manager' (56b22b80-92cf-4aee-8bd5-1bd3b5c5ebe6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:56:46 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[6710e2d6-9467-4770-8682-ba4d170e3069]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:56:46 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-84325a2e-5a11-4e53-8c85-c71b799585ee tempest-VolumeDependencyTests-1291485210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-540841fa-9687-4040-b6bb-4b6f22bf7ecf {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:56:46 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-873843e8-16b7-4378-94ec-47c83bcade64 tempest-VolumeImageDependencyTests-200064695 None] Created volume successfully. Sep 22 15:56:46 devstack sudo[105008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-540841fa-9687-4040-b6bb-4b6f22bf7ecf Sep 22 15:56:46 devstack sudo[105008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:56:46 devstack sudo[105008]: pam_unix(sudo:session): session closed for user root Sep 22 15:56:46 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-84325a2e-5a11-4e53-8c85-c71b799585ee tempest-VolumeDependencyTests-1291485210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-540841fa-9687-4040-b6bb-4b6f22bf7ecf" returned: 0 in 0.444s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:56:46 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-84325a2e-5a11-4e53-8c85-c71b799585ee tempest-VolumeDependencyTests-1291485210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-540841fa-9687-4040-b6bb-4b6f22bf7ecf {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:56:46 devstack sudo[105013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-540841fa-9687-4040-b6bb-4b6f22bf7ecf Sep 22 15:56:46 devstack sudo[105013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:56:47 devstack sudo[105013]: pam_unix(sudo:session): session closed for user root Sep 22 15:56:47 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-84325a2e-5a11-4e53-8c85-c71b799585ee tempest-VolumeDependencyTests-1291485210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-540841fa-9687-4040-b6bb-4b6f22bf7ecf" returned: 0 in 0.285s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:56:47 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-84325a2e-5a11-4e53-8c85-c71b799585ee tempest-VolumeDependencyTests-1291485210 None] Lock "cinder-quobyte-540841fa-9687-4040-b6bb-4b6f22bf7ecf" released by "delete_volume" :: held 0.809s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:56:47 devstack cinder-volume[86212]: DEBUG cinder.quota [None req-84325a2e-5a11-4e53-8c85-c71b799585ee tempest-VolumeDependencyTests-1291485210 None] Created reservations ['c0102fef-c861-4b4b-95d8-9124611d542b', '68e8f41b-f863-406b-a519-fb47db5e36e5', '62f9b6f1-42f3-4351-9ef2-f5017307cc14', 'a4d38c28-5494-4452-b075-7af6159e52b9'] {{(pid=86212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 15:56:47 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-84325a2e-5a11-4e53-8c85-c71b799585ee tempest-VolumeDependencyTests-1291485210 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:56:47 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-84325a2e-5a11-4e53-8c85-c71b799585ee tempest-VolumeDependencyTests-1291485210 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:56:47 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-84325a2e-5a11-4e53-8c85-c71b799585ee tempest-VolumeDependencyTests-1291485210 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:56:47 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-84325a2e-5a11-4e53-8c85-c71b799585ee tempest-VolumeDependencyTests-1291485210 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:56:47 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-84325a2e-5a11-4e53-8c85-c71b799585ee tempest-VolumeDependencyTests-1291485210 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:56:47 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-84325a2e-5a11-4e53-8c85-c71b799585ee tempest-VolumeDependencyTests-1291485210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:56:47 devstack sudo[105016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc Sep 22 15:56:47 devstack sudo[105016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:56:47 devstack sudo[105016]: pam_unix(sudo:session): session closed for user root Sep 22 15:56:47 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-b913f822-9ad7-4580-b774-109e6443ec3c tempest-VolumeImageDependencyTests-200064695 None] Acquiring lock "cinder-fa70fd14-d2ad-4ee3-90b7-e9696bffadd3-delete_volume" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:56:47 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-84325a2e-5a11-4e53-8c85-c71b799585ee tempest-VolumeDependencyTests-1291485210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc" returned: 0 in 0.417s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:56:47 devstack cinder-volume[86212]: DEBUG cinder.manager [None req-84325a2e-5a11-4e53-8c85-c71b799585ee tempest-VolumeDependencyTests-1291485210 None] Notifying Schedulers of capabilities ... {{(pid=86212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 15:56:47 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-84325a2e-5a11-4e53-8c85-c71b799585ee tempest-VolumeDependencyTests-1291485210 None] Deleted volume successfully. Sep 22 15:56:47 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-b913f822-9ad7-4580-b774-109e6443ec3c tempest-VolumeImageDependencyTests-200064695 None] Lock "cinder-fa70fd14-d2ad-4ee3-90b7-e9696bffadd3-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:56:47 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-84325a2e-5a11-4e53-8c85-c71b799585ee tempest-VolumeDependencyTests-1291485210 None] Lock "cinder-540841fa-9687-4040-b6bb-4b6f22bf7ecf-delete_volume" released by "delete_volume" :: held 1.585s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:56:47 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-b913f822-9ad7-4580-b774-109e6443ec3c tempest-VolumeImageDependencyTests-200064695 None] Acquiring lock "cinder-quobyte-fa70fd14-d2ad-4ee3-90b7-e9696bffadd3" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:56:47 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-b913f822-9ad7-4580-b774-109e6443ec3c tempest-VolumeImageDependencyTests-200064695 None] Lock "cinder-quobyte-fa70fd14-d2ad-4ee3-90b7-e9696bffadd3" acquired by "delete_volume" :: waited 0.029s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:56:47 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e9beab1-d4e2-481a-81d7-775ce4fe1784]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:56:47 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-b913f822-9ad7-4580-b774-109e6443ec3c tempest-VolumeImageDependencyTests-200064695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-fa70fd14-d2ad-4ee3-90b7-e9696bffadd3 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:56:48 devstack sudo[105021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-fa70fd14-d2ad-4ee3-90b7-e9696bffadd3 Sep 22 15:56:48 devstack sudo[105021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:56:48 devstack sudo[105021]: pam_unix(sudo:session): session closed for user root Sep 22 15:56:48 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-b913f822-9ad7-4580-b774-109e6443ec3c tempest-VolumeImageDependencyTests-200064695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-fa70fd14-d2ad-4ee3-90b7-e9696bffadd3" returned: 0 in 0.588s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:56:48 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-b913f822-9ad7-4580-b774-109e6443ec3c tempest-VolumeImageDependencyTests-200064695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-fa70fd14-d2ad-4ee3-90b7-e9696bffadd3 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:56:48 devstack sudo[105026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-fa70fd14-d2ad-4ee3-90b7-e9696bffadd3 Sep 22 15:56:48 devstack sudo[105026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:56:48 devstack sudo[105026]: pam_unix(sudo:session): session closed for user root Sep 22 15:56:48 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-b913f822-9ad7-4580-b774-109e6443ec3c tempest-VolumeImageDependencyTests-200064695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-fa70fd14-d2ad-4ee3-90b7-e9696bffadd3" returned: 0 in 0.378s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:56:48 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-b913f822-9ad7-4580-b774-109e6443ec3c tempest-VolumeImageDependencyTests-200064695 None] Lock "cinder-quobyte-fa70fd14-d2ad-4ee3-90b7-e9696bffadd3" released by "delete_volume" :: held 1.060s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:56:49 devstack cinder-volume[86212]: DEBUG cinder.quota [None req-b913f822-9ad7-4580-b774-109e6443ec3c tempest-VolumeImageDependencyTests-200064695 None] Created reservations ['e667f4b4-23fb-4803-aedc-e6abd3d5a17e', 'd92fddf5-fba3-4079-ab20-44aa69c1dbff', 'd3c3d7e9-de2c-4f47-a0aa-e2b0299ef1e4', '063c2169-2106-4e1d-9ede-050c63f64a5c'] {{(pid=86212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 15:56:49 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-b913f822-9ad7-4580-b774-109e6443ec3c tempest-VolumeImageDependencyTests-200064695 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:56:49 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-b913f822-9ad7-4580-b774-109e6443ec3c tempest-VolumeImageDependencyTests-200064695 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:56:49 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-b913f822-9ad7-4580-b774-109e6443ec3c tempest-VolumeImageDependencyTests-200064695 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:56:49 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-b913f822-9ad7-4580-b774-109e6443ec3c tempest-VolumeImageDependencyTests-200064695 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:56:49 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-b913f822-9ad7-4580-b774-109e6443ec3c tempest-VolumeImageDependencyTests-200064695 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:56:49 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-b913f822-9ad7-4580-b774-109e6443ec3c tempest-VolumeImageDependencyTests-200064695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:56:49 devstack sudo[105029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc Sep 22 15:56:49 devstack sudo[105029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:56:49 devstack sudo[105029]: pam_unix(sudo:session): session closed for user root Sep 22 15:56:49 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-b913f822-9ad7-4580-b774-109e6443ec3c tempest-VolumeImageDependencyTests-200064695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc" returned: 0 in 0.322s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:56:49 devstack cinder-volume[86212]: DEBUG cinder.manager [None req-b913f822-9ad7-4580-b774-109e6443ec3c tempest-VolumeImageDependencyTests-200064695 None] Notifying Schedulers of capabilities ... {{(pid=86212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 15:56:49 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-b913f822-9ad7-4580-b774-109e6443ec3c tempest-VolumeImageDependencyTests-200064695 None] Deleted volume successfully. Sep 22 15:56:49 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-b913f822-9ad7-4580-b774-109e6443ec3c tempest-VolumeImageDependencyTests-200064695 None] Lock "cinder-fa70fd14-d2ad-4ee3-90b7-e9696bffadd3-delete_volume" released by "delete_volume" :: held 1.711s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:56:59 devstack cinder-volume[86212]: DEBUG dbcounter [-] [86212] Writing DB stats cinder:UPDATE=270,cinder:SELECT=202,cinder:DELETE=23,cinder:INSERT=72 {{(pid=86212) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 22 15:56:59 devstack cinder-volume[86212]: DEBUG dbcounter [-] [86212] Writing DB stats cinder:SELECT=200,cinder:INSERT=77,cinder:UPDATE=284,cinder:DELETE=26 {{(pid=86212) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 22 15:57:01 devstack cinder-volume[86212]: DEBUG cinder.volume.flows.manager.create_volume [None req-024a1a8f-2cf0-45d0-a7a5-8ad7d7e80b46 tempest-SnapshotDependencyTests-1094644060 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 15:57:01 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-024a1a8f-2cf0-45d0-a7a5-8ad7d7e80b46 tempest-SnapshotDependencyTests-1094644060 None] Flow 'volume_create_manager' (e199d08a-360c-4256-83d5-30b7e52fda3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:57:01 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-024a1a8f-2cf0-45d0-a7a5-8ad7d7e80b46 tempest-SnapshotDependencyTests-1094644060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6e68062-8499-4159-abd6-ca8de083e5dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:57:01 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-024a1a8f-2cf0-45d0-a7a5-8ad7d7e80b46 tempest-SnapshotDependencyTests-1094644060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6e68062-8499-4159-abd6-ca8de083e5dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:57:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1973069881',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82a10e1f-f8ca-4617-9f30-e3f86f6cadd6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4cc9de4ccec24a669b13302122f07ac4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:57:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:57:01Z,use_quota=True,user_id='d7ad8103fdea42eb90dbfe4a02857066',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:57:01 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-024a1a8f-2cf0-45d0-a7a5-8ad7d7e80b46 tempest-SnapshotDependencyTests-1094644060 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6e0a9de-2007-4bc8-9ae6-447179ca1003) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:57:01 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-024a1a8f-2cf0-45d0-a7a5-8ad7d7e80b46 tempest-SnapshotDependencyTests-1094644060 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6e0a9de-2007-4bc8-9ae6-447179ca1003) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:57:01 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-024a1a8f-2cf0-45d0-a7a5-8ad7d7e80b46 tempest-SnapshotDependencyTests-1094644060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b658258-da7e-4d1f-8f66-963d9a96df7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:57:01 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-024a1a8f-2cf0-45d0-a7a5-8ad7d7e80b46 tempest-SnapshotDependencyTests-1094644060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b658258-da7e-4d1f-8f66-963d9a96df7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '82a10e1f-f8ca-4617-9f30-e3f86f6cadd6', 'volume_name': 'volume-82a10e1f-f8ca-4617-9f30-e3f86f6cadd6', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:57:01 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-024a1a8f-2cf0-45d0-a7a5-8ad7d7e80b46 tempest-SnapshotDependencyTests-1094644060 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c03ae794-31e6-41f5-b493-e6b7e4a540c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:57:01 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-024a1a8f-2cf0-45d0-a7a5-8ad7d7e80b46 tempest-SnapshotDependencyTests-1094644060 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c03ae794-31e6-41f5-b493-e6b7e4a540c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:57:01 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-024a1a8f-2cf0-45d0-a7a5-8ad7d7e80b46 tempest-SnapshotDependencyTests-1094644060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8cdbbe97-1d43-4f82-bccb-4d0ceee18cfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:57:01 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-024a1a8f-2cf0-45d0-a7a5-8ad7d7e80b46 tempest-SnapshotDependencyTests-1094644060 None] Volume 82a10e1f-f8ca-4617-9f30-e3f86f6cadd6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-82a10e1f-f8ca-4617-9f30-e3f86f6cadd6', 'volume_size': 1} Sep 22 15:57:01 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-024a1a8f-2cf0-45d0-a7a5-8ad7d7e80b46 tempest-SnapshotDependencyTests-1094644060 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:57:01 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-024a1a8f-2cf0-45d0-a7a5-8ad7d7e80b46 tempest-SnapshotDependencyTests-1094644060 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:57:01 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-024a1a8f-2cf0-45d0-a7a5-8ad7d7e80b46 tempest-SnapshotDependencyTests-1094644060 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:57:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1973069881',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82a10e1f-f8ca-4617-9f30-e3f86f6cadd6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4cc9de4ccec24a669b13302122f07ac4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:57:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:57:01Z,use_quota=True,user_id='d7ad8103fdea42eb90dbfe4a02857066',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)}" {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 15:57:01 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-024a1a8f-2cf0-45d0-a7a5-8ad7d7e80b46 tempest-SnapshotDependencyTests-1094644060 None] Creating volume 82a10e1f-f8ca-4617-9f30-e3f86f6cadd6 {{(pid=86212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 15:57:01 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-024a1a8f-2cf0-45d0-a7a5-8ad7d7e80b46 tempest-SnapshotDependencyTests-1094644060 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:57:01 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-024a1a8f-2cf0-45d0-a7a5-8ad7d7e80b46 tempest-SnapshotDependencyTests-1094644060 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:57:01 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-024a1a8f-2cf0-45d0-a7a5-8ad7d7e80b46 tempest-SnapshotDependencyTests-1094644060 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:57:01 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-024a1a8f-2cf0-45d0-a7a5-8ad7d7e80b46 tempest-SnapshotDependencyTests-1094644060 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:57:01 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-024a1a8f-2cf0-45d0-a7a5-8ad7d7e80b46 tempest-SnapshotDependencyTests-1094644060 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:57:01 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-024a1a8f-2cf0-45d0-a7a5-8ad7d7e80b46 tempest-SnapshotDependencyTests-1094644060 None] Selected osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 as target Quobyte volume. {{(pid=86212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 15:57:01 devstack cinder-volume[86212]: INFO cinder.volume.drivers.remotefs [None req-024a1a8f-2cf0-45d0-a7a5-8ad7d7e80b46 tempest-SnapshotDependencyTests-1094644060 None] casted to osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 Sep 22 15:57:01 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-024a1a8f-2cf0-45d0-a7a5-8ad7d7e80b46 tempest-SnapshotDependencyTests-1094644060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-82a10e1f-f8ca-4617-9f30-e3f86f6cadd6 1073741824 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:57:01 devstack sudo[105039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-82a10e1f-f8ca-4617-9f30-e3f86f6cadd6 1073741824 Sep 22 15:57:01 devstack sudo[105039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:57:01 devstack sudo[105039]: pam_unix(sudo:session): session closed for user root Sep 22 15:57:01 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-024a1a8f-2cf0-45d0-a7a5-8ad7d7e80b46 tempest-SnapshotDependencyTests-1094644060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-82a10e1f-f8ca-4617-9f30-e3f86f6cadd6 1073741824" returned: 0 in 0.565s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:57:01 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-024a1a8f-2cf0-45d0-a7a5-8ad7d7e80b46 tempest-SnapshotDependencyTests-1094644060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-82a10e1f-f8ca-4617-9f30-e3f86f6cadd6 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:57:01 devstack sudo[105045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-82a10e1f-f8ca-4617-9f30-e3f86f6cadd6 Sep 22 15:57:01 devstack sudo[105045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:57:02 devstack sudo[105045]: pam_unix(sudo:session): session closed for user root Sep 22 15:57:02 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-024a1a8f-2cf0-45d0-a7a5-8ad7d7e80b46 tempest-SnapshotDependencyTests-1094644060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-82a10e1f-f8ca-4617-9f30-e3f86f6cadd6" returned: 0 in 0.312s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:57:02 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-024a1a8f-2cf0-45d0-a7a5-8ad7d7e80b46 tempest-SnapshotDependencyTests-1094644060 None] <== create_volume: return (933ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'} {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 15:57:02 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-024a1a8f-2cf0-45d0-a7a5-8ad7d7e80b46 tempest-SnapshotDependencyTests-1094644060 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.938s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:57:02 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-024a1a8f-2cf0-45d0-a7a5-8ad7d7e80b46 tempest-SnapshotDependencyTests-1094644060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8cdbbe97-1d43-4f82-bccb-4d0ceee18cfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-82a10e1f-f8ca-4617-9f30-e3f86f6cadd6', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:57:02 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-024a1a8f-2cf0-45d0-a7a5-8ad7d7e80b46 tempest-SnapshotDependencyTests-1094644060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70fbc627-9951-4c59-bf6d-b87658f24dde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:57:02 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-024a1a8f-2cf0-45d0-a7a5-8ad7d7e80b46 tempest-SnapshotDependencyTests-1094644060 None] Volume volume-82a10e1f-f8ca-4617-9f30-e3f86f6cadd6 (82a10e1f-f8ca-4617-9f30-e3f86f6cadd6): created successfully Sep 22 15:57:02 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-024a1a8f-2cf0-45d0-a7a5-8ad7d7e80b46 tempest-SnapshotDependencyTests-1094644060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70fbc627-9951-4c59-bf6d-b87658f24dde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:57:02 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-024a1a8f-2cf0-45d0-a7a5-8ad7d7e80b46 tempest-SnapshotDependencyTests-1094644060 None] Flow 'volume_create_manager' (e199d08a-360c-4256-83d5-30b7e52fda3b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:57:02 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-024a1a8f-2cf0-45d0-a7a5-8ad7d7e80b46 tempest-SnapshotDependencyTests-1094644060 None] Created volume successfully. Sep 22 15:57:03 devstack cinder-volume[86212]: DEBUG cinder.volume.flows.manager.create_volume [None req-eadef7bd-335e-44c5-bc50-578acd079fad tempest-ProjectMemberTests-1095658523 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 15:57:03 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-eadef7bd-335e-44c5-bc50-578acd079fad tempest-ProjectMemberTests-1095658523 None] Flow 'volume_create_manager' (8a80f12a-4860-4a50-9c0d-0c9645dcc009) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:57:03 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-eadef7bd-335e-44c5-bc50-578acd079fad tempest-ProjectMemberTests-1095658523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (461e5839-9869-4db7-a330-0139773b9ea7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:57:03 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-eadef7bd-335e-44c5-bc50-578acd079fad tempest-ProjectMemberTests-1095658523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (461e5839-9869-4db7-a330-0139773b9ea7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:57:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1902187193',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c1d677a-0068-47d5-82cd-110fa5fb40af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e3beb47e92e4a8c9efa3433374c2e0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:57:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:57:03Z,use_quota=True,user_id='c4cc884fb51643ee9efb176f88d0543f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:57:03 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-eadef7bd-335e-44c5-bc50-578acd079fad tempest-ProjectMemberTests-1095658523 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed346d35-2eab-4900-b21a-1e8595e3495e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:57:03 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-eadef7bd-335e-44c5-bc50-578acd079fad tempest-ProjectMemberTests-1095658523 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed346d35-2eab-4900-b21a-1e8595e3495e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:57:03 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-eadef7bd-335e-44c5-bc50-578acd079fad tempest-ProjectMemberTests-1095658523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aba77cfc-67cd-42de-84a9-3e39401d4359) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:57:03 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-eadef7bd-335e-44c5-bc50-578acd079fad tempest-ProjectMemberTests-1095658523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aba77cfc-67cd-42de-84a9-3e39401d4359) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8c1d677a-0068-47d5-82cd-110fa5fb40af', 'volume_name': 'volume-8c1d677a-0068-47d5-82cd-110fa5fb40af', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:57:03 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-eadef7bd-335e-44c5-bc50-578acd079fad tempest-ProjectMemberTests-1095658523 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30abc006-ea78-4402-8b30-2f3a6503a8ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:57:03 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-eadef7bd-335e-44c5-bc50-578acd079fad tempest-ProjectMemberTests-1095658523 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30abc006-ea78-4402-8b30-2f3a6503a8ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:57:03 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-eadef7bd-335e-44c5-bc50-578acd079fad tempest-ProjectMemberTests-1095658523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d378ec25-b337-4cd1-be99-381ecb95f3e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:57:03 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-eadef7bd-335e-44c5-bc50-578acd079fad tempest-ProjectMemberTests-1095658523 None] Volume 8c1d677a-0068-47d5-82cd-110fa5fb40af: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8c1d677a-0068-47d5-82cd-110fa5fb40af', 'volume_size': 1} Sep 22 15:57:03 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-eadef7bd-335e-44c5-bc50-578acd079fad tempest-ProjectMemberTests-1095658523 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:57:03 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-eadef7bd-335e-44c5-bc50-578acd079fad tempest-ProjectMemberTests-1095658523 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:57:03 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-eadef7bd-335e-44c5-bc50-578acd079fad tempest-ProjectMemberTests-1095658523 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:57:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1902187193',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c1d677a-0068-47d5-82cd-110fa5fb40af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e3beb47e92e4a8c9efa3433374c2e0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:57:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:57:03Z,use_quota=True,user_id='c4cc884fb51643ee9efb176f88d0543f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)}" {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 15:57:03 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-eadef7bd-335e-44c5-bc50-578acd079fad tempest-ProjectMemberTests-1095658523 None] Creating volume 8c1d677a-0068-47d5-82cd-110fa5fb40af {{(pid=86212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 15:57:03 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-eadef7bd-335e-44c5-bc50-578acd079fad tempest-ProjectMemberTests-1095658523 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:57:03 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-eadef7bd-335e-44c5-bc50-578acd079fad tempest-ProjectMemberTests-1095658523 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:57:03 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-eadef7bd-335e-44c5-bc50-578acd079fad tempest-ProjectMemberTests-1095658523 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:57:03 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-eadef7bd-335e-44c5-bc50-578acd079fad tempest-ProjectMemberTests-1095658523 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:57:03 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-eadef7bd-335e-44c5-bc50-578acd079fad tempest-ProjectMemberTests-1095658523 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:57:03 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-eadef7bd-335e-44c5-bc50-578acd079fad tempest-ProjectMemberTests-1095658523 None] Selected osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 as target Quobyte volume. {{(pid=86212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 15:57:03 devstack cinder-volume[86212]: INFO cinder.volume.drivers.remotefs [None req-eadef7bd-335e-44c5-bc50-578acd079fad tempest-ProjectMemberTests-1095658523 None] casted to osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 Sep 22 15:57:03 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-eadef7bd-335e-44c5-bc50-578acd079fad tempest-ProjectMemberTests-1095658523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8c1d677a-0068-47d5-82cd-110fa5fb40af 1073741824 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:57:03 devstack sudo[105048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8c1d677a-0068-47d5-82cd-110fa5fb40af 1073741824 Sep 22 15:57:03 devstack sudo[105048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:57:03 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-693a51bf-72a5-4d0a-8ba1-a90c7ea8ca5a tempest-SnapshotDependencyTests-1094644060 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:57:04 devstack sudo[105048]: pam_unix(sudo:session): session closed for user root Sep 22 15:57:04 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-eadef7bd-335e-44c5-bc50-578acd079fad tempest-ProjectMemberTests-1095658523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8c1d677a-0068-47d5-82cd-110fa5fb40af 1073741824" returned: 0 in 0.563s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:57:04 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-eadef7bd-335e-44c5-bc50-578acd079fad tempest-ProjectMemberTests-1095658523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8c1d677a-0068-47d5-82cd-110fa5fb40af {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:57:04 devstack sudo[105055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8c1d677a-0068-47d5-82cd-110fa5fb40af Sep 22 15:57:04 devstack sudo[105055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:57:04 devstack sudo[105055]: pam_unix(sudo:session): session closed for user root Sep 22 15:57:04 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-eadef7bd-335e-44c5-bc50-578acd079fad tempest-ProjectMemberTests-1095658523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8c1d677a-0068-47d5-82cd-110fa5fb40af" returned: 0 in 0.280s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:57:04 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-eadef7bd-335e-44c5-bc50-578acd079fad tempest-ProjectMemberTests-1095658523 None] <== create_volume: return (890ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'} {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 15:57:04 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-eadef7bd-335e-44c5-bc50-578acd079fad tempest-ProjectMemberTests-1095658523 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.893s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:57:04 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-693a51bf-72a5-4d0a-8ba1-a90c7ea8ca5a tempest-SnapshotDependencyTests-1094644060 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.756s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:57:04 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-eadef7bd-335e-44c5-bc50-578acd079fad tempest-ProjectMemberTests-1095658523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d378ec25-b337-4cd1-be99-381ecb95f3e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c1d677a-0068-47d5-82cd-110fa5fb40af', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:57:04 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-eadef7bd-335e-44c5-bc50-578acd079fad tempest-ProjectMemberTests-1095658523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c033c451-c4db-427e-bf0f-9a4ae0dd1bcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:57:04 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-693a51bf-72a5-4d0a-8ba1-a90c7ea8ca5a tempest-SnapshotDependencyTests-1094644060 None] Creating offline snapshot b30e74c8-a9b8-4731-abd2-02bb7734e583 of volume 82a10e1f-f8ca-4617-9f30-e3f86f6cadd6 {{(pid=86212) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 22 15:57:04 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-eadef7bd-335e-44c5-bc50-578acd079fad tempest-ProjectMemberTests-1095658523 None] Volume volume-8c1d677a-0068-47d5-82cd-110fa5fb40af (8c1d677a-0068-47d5-82cd-110fa5fb40af): created successfully Sep 22 15:57:04 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-eadef7bd-335e-44c5-bc50-578acd079fad tempest-ProjectMemberTests-1095658523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c033c451-c4db-427e-bf0f-9a4ae0dd1bcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:57:04 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-eadef7bd-335e-44c5-bc50-578acd079fad tempest-ProjectMemberTests-1095658523 None] Flow 'volume_create_manager' (8a80f12a-4860-4a50-9c0d-0c9645dcc009) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:57:04 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb4b8c72-b7f9-4074-a36a-ea4088c9c618]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:57:04 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-693a51bf-72a5-4d0a-8ba1-a90c7ea8ca5a tempest-SnapshotDependencyTests-1094644060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-82a10e1f-f8ca-4617-9f30-e3f86f6cadd6 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:57:04 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-eadef7bd-335e-44c5-bc50-578acd079fad tempest-ProjectMemberTests-1095658523 None] Created volume successfully. Sep 22 15:57:04 devstack sudo[105058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-82a10e1f-f8ca-4617-9f30-e3f86f6cadd6 Sep 22 15:57:04 devstack sudo[105058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:57:04 devstack sudo[105058]: pam_unix(sudo:session): session closed for user root Sep 22 15:57:04 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-693a51bf-72a5-4d0a-8ba1-a90c7ea8ca5a tempest-SnapshotDependencyTests-1094644060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-82a10e1f-f8ca-4617-9f30-e3f86f6cadd6" returned: 0 in 0.411s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:57:04 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-693a51bf-72a5-4d0a-8ba1-a90c7ea8ca5a tempest-SnapshotDependencyTests-1094644060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-82a10e1f-f8ca-4617-9f30-e3f86f6cadd6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-82a10e1f-f8ca-4617-9f30-e3f86f6cadd6.b30e74c8-a9b8-4731-abd2-02bb7734e583 1G {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:57:04 devstack sudo[105063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-82a10e1f-f8ca-4617-9f30-e3f86f6cadd6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-82a10e1f-f8ca-4617-9f30-e3f86f6cadd6.b30e74c8-a9b8-4731-abd2-02bb7734e583 1G Sep 22 15:57:04 devstack sudo[105063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:57:05 devstack sudo[105063]: pam_unix(sudo:session): session closed for user root Sep 22 15:57:05 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-693a51bf-72a5-4d0a-8ba1-a90c7ea8ca5a tempest-SnapshotDependencyTests-1094644060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-82a10e1f-f8ca-4617-9f30-e3f86f6cadd6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-82a10e1f-f8ca-4617-9f30-e3f86f6cadd6.b30e74c8-a9b8-4731-abd2-02bb7734e583 1G" returned: 0 in 0.479s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:57:05 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-693a51bf-72a5-4d0a-8ba1-a90c7ea8ca5a tempest-SnapshotDependencyTests-1094644060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-82a10e1f-f8ca-4617-9f30-e3f86f6cadd6 -F qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-82a10e1f-f8ca-4617-9f30-e3f86f6cadd6.b30e74c8-a9b8-4731-abd2-02bb7734e583 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:57:05 devstack sudo[105070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-82a10e1f-f8ca-4617-9f30-e3f86f6cadd6 -F qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-82a10e1f-f8ca-4617-9f30-e3f86f6cadd6.b30e74c8-a9b8-4731-abd2-02bb7734e583 Sep 22 15:57:05 devstack sudo[105070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:57:05 devstack sudo[105070]: pam_unix(sudo:session): session closed for user root Sep 22 15:57:05 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-693a51bf-72a5-4d0a-8ba1-a90c7ea8ca5a tempest-SnapshotDependencyTests-1094644060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-82a10e1f-f8ca-4617-9f30-e3f86f6cadd6 -F qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-82a10e1f-f8ca-4617-9f30-e3f86f6cadd6.b30e74c8-a9b8-4731-abd2-02bb7734e583" returned: 0 in 0.379s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:57:05 devstack cinder-volume[86212]: WARNING cinder.volume.drivers.remotefs [None req-693a51bf-72a5-4d0a-8ba1-a90c7ea8ca5a tempest-SnapshotDependencyTests-1094644060 None] /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-82a10e1f-f8ca-4617-9f30-e3f86f6cadd6.b30e74c8-a9b8-4731-abd2-02bb7734e583 is being set with open permissions: ugo+rw Sep 22 15:57:05 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-693a51bf-72a5-4d0a-8ba1-a90c7ea8ca5a tempest-SnapshotDependencyTests-1094644060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-82a10e1f-f8ca-4617-9f30-e3f86f6cadd6.b30e74c8-a9b8-4731-abd2-02bb7734e583 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:57:05 devstack sudo[105075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-82a10e1f-f8ca-4617-9f30-e3f86f6cadd6.b30e74c8-a9b8-4731-abd2-02bb7734e583 Sep 22 15:57:05 devstack sudo[105075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:57:05 devstack sudo[105075]: pam_unix(sudo:session): session closed for user root Sep 22 15:57:05 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-693a51bf-72a5-4d0a-8ba1-a90c7ea8ca5a tempest-SnapshotDependencyTests-1094644060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-82a10e1f-f8ca-4617-9f30-e3f86f6cadd6.b30e74c8-a9b8-4731-abd2-02bb7734e583" returned: 0 in 0.278s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:57:06 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-693a51bf-72a5-4d0a-8ba1-a90c7ea8ca5a tempest-SnapshotDependencyTests-1094644060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-82a10e1f-f8ca-4617-9f30-e3f86f6cadd6.info {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:57:06 devstack sudo[105078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-82a10e1f-f8ca-4617-9f30-e3f86f6cadd6.info Sep 22 15:57:06 devstack sudo[105078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:57:06 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-9811b873-31f4-4955-b9f4-ac9f6a4a5fb6 tempest-ProjectMemberTests-1095658523 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:57:06 devstack sudo[105078]: pam_unix(sudo:session): session closed for user root Sep 22 15:57:06 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-693a51bf-72a5-4d0a-8ba1-a90c7ea8ca5a tempest-SnapshotDependencyTests-1094644060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-82a10e1f-f8ca-4617-9f30-e3f86f6cadd6.info" returned: 0 in 0.308s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:57:06 devstack cinder-volume[86212]: WARNING cinder.volume.drivers.remotefs [None req-693a51bf-72a5-4d0a-8ba1-a90c7ea8ca5a tempest-SnapshotDependencyTests-1094644060 None] /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-82a10e1f-f8ca-4617-9f30-e3f86f6cadd6.info is being set with open permissions: ugo+rw Sep 22 15:57:06 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-693a51bf-72a5-4d0a-8ba1-a90c7ea8ca5a tempest-SnapshotDependencyTests-1094644060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-82a10e1f-f8ca-4617-9f30-e3f86f6cadd6.info {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:57:06 devstack sudo[105081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-82a10e1f-f8ca-4617-9f30-e3f86f6cadd6.info Sep 22 15:57:06 devstack sudo[105081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:57:06 devstack sudo[105081]: pam_unix(sudo:session): session closed for user root Sep 22 15:57:06 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-693a51bf-72a5-4d0a-8ba1-a90c7ea8ca5a tempest-SnapshotDependencyTests-1094644060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-82a10e1f-f8ca-4617-9f30-e3f86f6cadd6.info" returned: 0 in 0.262s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:57:06 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-693a51bf-72a5-4d0a-8ba1-a90c7ea8ca5a tempest-SnapshotDependencyTests-1094644060 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.272s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:57:06 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-9811b873-31f4-4955-b9f4-ac9f6a4a5fb6 tempest-ProjectMemberTests-1095658523 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.477s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:57:06 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-9811b873-31f4-4955-b9f4-ac9f6a4a5fb6 tempest-ProjectMemberTests-1095658523 None] Creating offline snapshot c2af0a82-963b-4993-99c1-a0cca34d3c1d of volume 8c1d677a-0068-47d5-82cd-110fa5fb40af {{(pid=86212) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 22 15:57:06 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-693a51bf-72a5-4d0a-8ba1-a90c7ea8ca5a tempest-SnapshotDependencyTests-1094644060 None] Create snapshot completed successfully Sep 22 15:57:06 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[91a0906b-80a5-48c0-beac-0398f7d16b58]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:57:06 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-9811b873-31f4-4955-b9f4-ac9f6a4a5fb6 tempest-ProjectMemberTests-1095658523 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8c1d677a-0068-47d5-82cd-110fa5fb40af {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:57:06 devstack sudo[105084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8c1d677a-0068-47d5-82cd-110fa5fb40af Sep 22 15:57:06 devstack sudo[105084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:57:07 devstack sudo[105084]: pam_unix(sudo:session): session closed for user root Sep 22 15:57:07 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-9811b873-31f4-4955-b9f4-ac9f6a4a5fb6 tempest-ProjectMemberTests-1095658523 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8c1d677a-0068-47d5-82cd-110fa5fb40af" returned: 0 in 0.418s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:57:07 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-9811b873-31f4-4955-b9f4-ac9f6a4a5fb6 tempest-ProjectMemberTests-1095658523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8c1d677a-0068-47d5-82cd-110fa5fb40af,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8c1d677a-0068-47d5-82cd-110fa5fb40af.c2af0a82-963b-4993-99c1-a0cca34d3c1d 1G {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:57:07 devstack sudo[105089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8c1d677a-0068-47d5-82cd-110fa5fb40af,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8c1d677a-0068-47d5-82cd-110fa5fb40af.c2af0a82-963b-4993-99c1-a0cca34d3c1d 1G Sep 22 15:57:07 devstack sudo[105089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:57:07 devstack sudo[105089]: pam_unix(sudo:session): session closed for user root Sep 22 15:57:07 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-9811b873-31f4-4955-b9f4-ac9f6a4a5fb6 tempest-ProjectMemberTests-1095658523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8c1d677a-0068-47d5-82cd-110fa5fb40af,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8c1d677a-0068-47d5-82cd-110fa5fb40af.c2af0a82-963b-4993-99c1-a0cca34d3c1d 1G" returned: 0 in 0.486s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:57:07 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-9811b873-31f4-4955-b9f4-ac9f6a4a5fb6 tempest-ProjectMemberTests-1095658523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8c1d677a-0068-47d5-82cd-110fa5fb40af -F qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8c1d677a-0068-47d5-82cd-110fa5fb40af.c2af0a82-963b-4993-99c1-a0cca34d3c1d {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:57:07 devstack sudo[105095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8c1d677a-0068-47d5-82cd-110fa5fb40af -F qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8c1d677a-0068-47d5-82cd-110fa5fb40af.c2af0a82-963b-4993-99c1-a0cca34d3c1d Sep 22 15:57:07 devstack sudo[105095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:57:07 devstack cinder-volume[86212]: DEBUG cinder.volume.flows.manager.create_volume [None req-89fe14ef-28ce-410f-8b07-3c11e8ae23c3 tempest-ProjectReaderTests-935921131 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 15:57:07 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-89fe14ef-28ce-410f-8b07-3c11e8ae23c3 tempest-ProjectReaderTests-935921131 None] Flow 'volume_create_manager' (2d31f10e-ee1c-42c0-a11e-a0c3182f7bfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:57:07 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-89fe14ef-28ce-410f-8b07-3c11e8ae23c3 tempest-ProjectReaderTests-935921131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b7e9a4e-4c1f-4e0d-b4c6-3a368664c1e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:57:08 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-89fe14ef-28ce-410f-8b07-3c11e8ae23c3 tempest-ProjectReaderTests-935921131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b7e9a4e-4c1f-4e0d-b4c6-3a368664c1e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:57:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1413239688',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed7093d1-6c4d-4530-9d2d-58d93cc9358d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66f65086b6a64de1ba2276ac92d5d7c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:57:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:57:08Z,use_quota=True,user_id='7ea5d0f2935e43e681ac626ca99e4635',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:57:08 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-89fe14ef-28ce-410f-8b07-3c11e8ae23c3 tempest-ProjectReaderTests-935921131 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54b69596-713b-4d24-9b03-7bcd8dbc965a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:57:08 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-89fe14ef-28ce-410f-8b07-3c11e8ae23c3 tempest-ProjectReaderTests-935921131 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54b69596-713b-4d24-9b03-7bcd8dbc965a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:57:08 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-89fe14ef-28ce-410f-8b07-3c11e8ae23c3 tempest-ProjectReaderTests-935921131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0830c24-eb0b-4f80-8ad8-b6e6702046d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:57:08 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-89fe14ef-28ce-410f-8b07-3c11e8ae23c3 tempest-ProjectReaderTests-935921131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0830c24-eb0b-4f80-8ad8-b6e6702046d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed7093d1-6c4d-4530-9d2d-58d93cc9358d', 'volume_name': 'volume-ed7093d1-6c4d-4530-9d2d-58d93cc9358d', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:57:08 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-89fe14ef-28ce-410f-8b07-3c11e8ae23c3 tempest-ProjectReaderTests-935921131 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8cf74246-8cd8-424d-b811-f1cc2e229076) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:57:08 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-89fe14ef-28ce-410f-8b07-3c11e8ae23c3 tempest-ProjectReaderTests-935921131 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8cf74246-8cd8-424d-b811-f1cc2e229076) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:57:08 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-89fe14ef-28ce-410f-8b07-3c11e8ae23c3 tempest-ProjectReaderTests-935921131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dea9a01c-bb12-4643-b009-b47304040219) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:57:08 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-89fe14ef-28ce-410f-8b07-3c11e8ae23c3 tempest-ProjectReaderTests-935921131 None] Volume ed7093d1-6c4d-4530-9d2d-58d93cc9358d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed7093d1-6c4d-4530-9d2d-58d93cc9358d', 'volume_size': 1} Sep 22 15:57:08 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-89fe14ef-28ce-410f-8b07-3c11e8ae23c3 tempest-ProjectReaderTests-935921131 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:57:08 devstack sudo[105095]: pam_unix(sudo:session): session closed for user root Sep 22 15:57:08 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-9811b873-31f4-4955-b9f4-ac9f6a4a5fb6 tempest-ProjectMemberTests-1095658523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8c1d677a-0068-47d5-82cd-110fa5fb40af -F qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8c1d677a-0068-47d5-82cd-110fa5fb40af.c2af0a82-963b-4993-99c1-a0cca34d3c1d" returned: 0 in 0.447s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:57:08 devstack cinder-volume[86212]: WARNING cinder.volume.drivers.remotefs [None req-9811b873-31f4-4955-b9f4-ac9f6a4a5fb6 tempest-ProjectMemberTests-1095658523 None] /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8c1d677a-0068-47d5-82cd-110fa5fb40af.c2af0a82-963b-4993-99c1-a0cca34d3c1d is being set with open permissions: ugo+rw Sep 22 15:57:08 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-9811b873-31f4-4955-b9f4-ac9f6a4a5fb6 tempest-ProjectMemberTests-1095658523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8c1d677a-0068-47d5-82cd-110fa5fb40af.c2af0a82-963b-4993-99c1-a0cca34d3c1d {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:57:08 devstack sudo[105101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8c1d677a-0068-47d5-82cd-110fa5fb40af.c2af0a82-963b-4993-99c1-a0cca34d3c1d Sep 22 15:57:08 devstack sudo[105101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:57:08 devstack sudo[105101]: pam_unix(sudo:session): session closed for user root Sep 22 15:57:08 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-9811b873-31f4-4955-b9f4-ac9f6a4a5fb6 tempest-ProjectMemberTests-1095658523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8c1d677a-0068-47d5-82cd-110fa5fb40af.c2af0a82-963b-4993-99c1-a0cca34d3c1d" returned: 0 in 0.303s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:57:08 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-9811b873-31f4-4955-b9f4-ac9f6a4a5fb6 tempest-ProjectMemberTests-1095658523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8c1d677a-0068-47d5-82cd-110fa5fb40af.info {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:57:08 devstack sudo[105104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8c1d677a-0068-47d5-82cd-110fa5fb40af.info Sep 22 15:57:08 devstack sudo[105104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:57:08 devstack cinder-volume[86212]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a8e6829-9dd9-4096-a80a-6f934d7e42e3 tempest-SnapshotDependencyTests-1094644060 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 15:57:08 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-4a8e6829-9dd9-4096-a80a-6f934d7e42e3 tempest-SnapshotDependencyTests-1094644060 None] Flow 'volume_create_manager' (c2cda549-98c7-4fed-85c6-d4e7206afde5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:57:08 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-4a8e6829-9dd9-4096-a80a-6f934d7e42e3 tempest-SnapshotDependencyTests-1094644060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef7b3185-f440-44c7-baad-e9d83ea9567c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:57:08 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-4a8e6829-9dd9-4096-a80a-6f934d7e42e3 tempest-SnapshotDependencyTests-1094644060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef7b3185-f440-44c7-baad-e9d83ea9567c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:57:08Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=957e2e34-c372-45cc-b9bd-fe7d4c2a8d97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4cc9de4ccec24a669b13302122f07ac4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:57:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=b30e74c8-a9b8-4731-abd2-02bb7734e583,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:57:08Z,use_quota=True,user_id='d7ad8103fdea42eb90dbfe4a02857066',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:57:08 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-4a8e6829-9dd9-4096-a80a-6f934d7e42e3 tempest-SnapshotDependencyTests-1094644060 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d6ae290-4b78-42e5-a777-6a2acf7ffe66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:57:08 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-4a8e6829-9dd9-4096-a80a-6f934d7e42e3 tempest-SnapshotDependencyTests-1094644060 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d6ae290-4b78-42e5-a777-6a2acf7ffe66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:57:08 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-4a8e6829-9dd9-4096-a80a-6f934d7e42e3 tempest-SnapshotDependencyTests-1094644060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1fd60cce-209e-4ed8-acd4-08e3eae4c9ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:57:08 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-4a8e6829-9dd9-4096-a80a-6f934d7e42e3 tempest-SnapshotDependencyTests-1094644060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1fd60cce-209e-4ed8-acd4-08e3eae4c9ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '957e2e34-c372-45cc-b9bd-fe7d4c2a8d97', 'volume_name': 'volume-957e2e34-c372-45cc-b9bd-fe7d4c2a8d97', 'volume_size': 1, 'snapshot_id': 'b30e74c8-a9b8-4731-abd2-02bb7734e583'}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:57:08 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-4a8e6829-9dd9-4096-a80a-6f934d7e42e3 tempest-SnapshotDependencyTests-1094644060 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (046650cb-c049-4ee0-ae87-9788126130af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:57:08 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-4a8e6829-9dd9-4096-a80a-6f934d7e42e3 tempest-SnapshotDependencyTests-1094644060 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (046650cb-c049-4ee0-ae87-9788126130af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:57:08 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-4a8e6829-9dd9-4096-a80a-6f934d7e42e3 tempest-SnapshotDependencyTests-1094644060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95679a00-b0fe-4fa0-bcec-32fa45069479) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:57:08 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-4a8e6829-9dd9-4096-a80a-6f934d7e42e3 tempest-SnapshotDependencyTests-1094644060 None] Volume 957e2e34-c372-45cc-b9bd-fe7d4c2a8d97: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-957e2e34-c372-45cc-b9bd-fe7d4c2a8d97', 'volume_size': 1, 'snapshot_id': 'b30e74c8-a9b8-4731-abd2-02bb7734e583'} Sep 22 15:57:08 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-4a8e6829-9dd9-4096-a80a-6f934d7e42e3 tempest-SnapshotDependencyTests-1094644060 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:57:08 devstack sudo[105104]: pam_unix(sudo:session): session closed for user root Sep 22 15:57:08 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-9811b873-31f4-4955-b9f4-ac9f6a4a5fb6 tempest-ProjectMemberTests-1095658523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8c1d677a-0068-47d5-82cd-110fa5fb40af.info" returned: 0 in 0.296s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:57:08 devstack cinder-volume[86212]: WARNING cinder.volume.drivers.remotefs [None req-9811b873-31f4-4955-b9f4-ac9f6a4a5fb6 tempest-ProjectMemberTests-1095658523 None] /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8c1d677a-0068-47d5-82cd-110fa5fb40af.info is being set with open permissions: ugo+rw Sep 22 15:57:08 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-9811b873-31f4-4955-b9f4-ac9f6a4a5fb6 tempest-ProjectMemberTests-1095658523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8c1d677a-0068-47d5-82cd-110fa5fb40af.info {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:57:08 devstack sudo[105107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8c1d677a-0068-47d5-82cd-110fa5fb40af.info Sep 22 15:57:08 devstack sudo[105107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:57:08 devstack sudo[105107]: pam_unix(sudo:session): session closed for user root Sep 22 15:57:08 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-9811b873-31f4-4955-b9f4-ac9f6a4a5fb6 tempest-ProjectMemberTests-1095658523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8c1d677a-0068-47d5-82cd-110fa5fb40af.info" returned: 0 in 0.271s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:57:09 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-9811b873-31f4-4955-b9f4-ac9f6a4a5fb6 tempest-ProjectMemberTests-1095658523 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.356s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:57:09 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-89fe14ef-28ce-410f-8b07-3c11e8ae23c3 tempest-ProjectReaderTests-935921131 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.952s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:57:09 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-89fe14ef-28ce-410f-8b07-3c11e8ae23c3 tempest-ProjectReaderTests-935921131 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:57:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1413239688',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed7093d1-6c4d-4530-9d2d-58d93cc9358d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66f65086b6a64de1ba2276ac92d5d7c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:57:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:57:08Z,use_quota=True,user_id='7ea5d0f2935e43e681ac626ca99e4635',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)}" {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 15:57:09 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-89fe14ef-28ce-410f-8b07-3c11e8ae23c3 tempest-ProjectReaderTests-935921131 None] Creating volume ed7093d1-6c4d-4530-9d2d-58d93cc9358d {{(pid=86212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 15:57:09 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-89fe14ef-28ce-410f-8b07-3c11e8ae23c3 tempest-ProjectReaderTests-935921131 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:57:09 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-89fe14ef-28ce-410f-8b07-3c11e8ae23c3 tempest-ProjectReaderTests-935921131 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:57:09 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-89fe14ef-28ce-410f-8b07-3c11e8ae23c3 tempest-ProjectReaderTests-935921131 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:57:09 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-89fe14ef-28ce-410f-8b07-3c11e8ae23c3 tempest-ProjectReaderTests-935921131 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:57:09 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-89fe14ef-28ce-410f-8b07-3c11e8ae23c3 tempest-ProjectReaderTests-935921131 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:57:09 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-89fe14ef-28ce-410f-8b07-3c11e8ae23c3 tempest-ProjectReaderTests-935921131 None] Selected osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 as target Quobyte volume. {{(pid=86212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 15:57:09 devstack cinder-volume[86212]: INFO cinder.volume.drivers.remotefs [None req-89fe14ef-28ce-410f-8b07-3c11e8ae23c3 tempest-ProjectReaderTests-935921131 None] casted to osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 Sep 22 15:57:09 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-89fe14ef-28ce-410f-8b07-3c11e8ae23c3 tempest-ProjectReaderTests-935921131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-ed7093d1-6c4d-4530-9d2d-58d93cc9358d 1073741824 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:57:09 devstack sudo[105110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-ed7093d1-6c4d-4530-9d2d-58d93cc9358d 1073741824 Sep 22 15:57:09 devstack sudo[105110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:57:09 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-9811b873-31f4-4955-b9f4-ac9f6a4a5fb6 tempest-ProjectMemberTests-1095658523 None] Create snapshot completed successfully Sep 22 15:57:09 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-8b405f35-494f-4706-9e85-bbe3306df1ce tempest-ProjectMemberTests-1095658523 None] Acquiring lock "cinder-c2af0a82-963b-4993-99c1-a0cca34d3c1d-delete_snapshot" by "delete_snapshot" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:57:09 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-8b405f35-494f-4706-9e85-bbe3306df1ce tempest-ProjectMemberTests-1095658523 None] Lock "cinder-c2af0a82-963b-4993-99c1-a0cca34d3c1d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:57:09 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-8b405f35-494f-4706-9e85-bbe3306df1ce tempest-ProjectMemberTests-1095658523 None] Acquiring lock "cinder-quobyte-8c1d677a-0068-47d5-82cd-110fa5fb40af" by "delete_snapshot" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:57:09 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-8b405f35-494f-4706-9e85-bbe3306df1ce tempest-ProjectMemberTests-1095658523 None] Lock "cinder-quobyte-8c1d677a-0068-47d5-82cd-110fa5fb40af" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:57:09 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-8b405f35-494f-4706-9e85-bbe3306df1ce tempest-ProjectMemberTests-1095658523 None] Acquiring lock "cinder-quobyte-c2af0a82-963b-4993-99c1-a0cca34d3c1d" by "_delete_snapshot" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:57:09 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-8b405f35-494f-4706-9e85-bbe3306df1ce tempest-ProjectMemberTests-1095658523 None] Lock "cinder-quobyte-c2af0a82-963b-4993-99c1-a0cca34d3c1d" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:57:09 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-8b405f35-494f-4706-9e85-bbe3306df1ce tempest-ProjectMemberTests-1095658523 None] Deleting offline snapshot c2af0a82-963b-4993-99c1-a0cca34d3c1d of volume 8c1d677a-0068-47d5-82cd-110fa5fb40af {{(pid=86212) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 22 15:57:09 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-8b405f35-494f-4706-9e85-bbe3306df1ce tempest-ProjectMemberTests-1095658523 None] snapshot_file for this snap is: volume-8c1d677a-0068-47d5-82cd-110fa5fb40af.c2af0a82-963b-4993-99c1-a0cca34d3c1d {{(pid=86212) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 22 15:57:09 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[913b57dc-f2d0-4231-8b8c-dc0fbe7a7fb2]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:57:09 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-8b405f35-494f-4706-9e85-bbe3306df1ce tempest-ProjectMemberTests-1095658523 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8c1d677a-0068-47d5-82cd-110fa5fb40af.c2af0a82-963b-4993-99c1-a0cca34d3c1d {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:57:09 devstack sudo[105110]: pam_unix(sudo:session): session closed for user root Sep 22 15:57:09 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-89fe14ef-28ce-410f-8b07-3c11e8ae23c3 tempest-ProjectReaderTests-935921131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-ed7093d1-6c4d-4530-9d2d-58d93cc9358d 1073741824" returned: 0 in 0.506s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:57:09 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-89fe14ef-28ce-410f-8b07-3c11e8ae23c3 tempest-ProjectReaderTests-935921131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-ed7093d1-6c4d-4530-9d2d-58d93cc9358d {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:57:09 devstack sudo[105116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8c1d677a-0068-47d5-82cd-110fa5fb40af.c2af0a82-963b-4993-99c1-a0cca34d3c1d Sep 22 15:57:09 devstack sudo[105116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:57:09 devstack sudo[105117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-ed7093d1-6c4d-4530-9d2d-58d93cc9358d Sep 22 15:57:09 devstack sudo[105117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:57:09 devstack sudo[105117]: pam_unix(sudo:session): session closed for user root Sep 22 15:57:09 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-89fe14ef-28ce-410f-8b07-3c11e8ae23c3 tempest-ProjectReaderTests-935921131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-ed7093d1-6c4d-4530-9d2d-58d93cc9358d" returned: 0 in 0.298s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:57:09 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-89fe14ef-28ce-410f-8b07-3c11e8ae23c3 tempest-ProjectReaderTests-935921131 None] <== create_volume: return (850ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'} {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 15:57:09 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-89fe14ef-28ce-410f-8b07-3c11e8ae23c3 tempest-ProjectReaderTests-935921131 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.852s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:57:09 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-4a8e6829-9dd9-4096-a80a-6f934d7e42e3 tempest-SnapshotDependencyTests-1094644060 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.237s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:57:09 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-4a8e6829-9dd9-4096-a80a-6f934d7e42e3 tempest-SnapshotDependencyTests-1094644060 None] Acquiring lock "cinder-quobyte-b30e74c8-a9b8-4731-abd2-02bb7734e583-957e2e34-c372-45cc-b9bd-fe7d4c2a8d97" by "_create_volume_from_snapshot" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:57:09 devstack sudo[105116]: pam_unix(sudo:session): session closed for user root Sep 22 15:57:09 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-8b405f35-494f-4706-9e85-bbe3306df1ce tempest-ProjectMemberTests-1095658523 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8c1d677a-0068-47d5-82cd-110fa5fb40af.c2af0a82-963b-4993-99c1-a0cca34d3c1d" returned: 0 in 0.439s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:57:09 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-8b405f35-494f-4706-9e85-bbe3306df1ce tempest-ProjectMemberTests-1095658523 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8c1d677a-0068-47d5-82cd-110fa5fb40af(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86212) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 22 15:57:09 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-89fe14ef-28ce-410f-8b07-3c11e8ae23c3 tempest-ProjectReaderTests-935921131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dea9a01c-bb12-4643-b009-b47304040219) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed7093d1-6c4d-4530-9d2d-58d93cc9358d', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:57:09 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-89fe14ef-28ce-410f-8b07-3c11e8ae23c3 tempest-ProjectReaderTests-935921131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4191d606-86c0-4ea6-abb1-ea3e0c1c1f79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:57:09 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-4a8e6829-9dd9-4096-a80a-6f934d7e42e3 tempest-SnapshotDependencyTests-1094644060 None] Lock "cinder-quobyte-b30e74c8-a9b8-4731-abd2-02bb7734e583-957e2e34-c372-45cc-b9bd-fe7d4c2a8d97" acquired by "_create_volume_from_snapshot" :: waited 0.082s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:57:09 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-4a8e6829-9dd9-4096-a80a-6f934d7e42e3 tempest-SnapshotDependencyTests-1094644060 None] Creating volume 957e2e34-c372-45cc-b9bd-fe7d4c2a8d97 from snapshot b30e74c8-a9b8-4731-abd2-02bb7734e583 {{(pid=86212) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 22 15:57:09 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-4a8e6829-9dd9-4096-a80a-6f934d7e42e3 tempest-SnapshotDependencyTests-1094644060 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:57:09 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-4a8e6829-9dd9-4096-a80a-6f934d7e42e3 tempest-SnapshotDependencyTests-1094644060 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:57:09 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-4a8e6829-9dd9-4096-a80a-6f934d7e42e3 tempest-SnapshotDependencyTests-1094644060 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:57:09 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-4a8e6829-9dd9-4096-a80a-6f934d7e42e3 tempest-SnapshotDependencyTests-1094644060 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:57:09 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-4a8e6829-9dd9-4096-a80a-6f934d7e42e3 tempest-SnapshotDependencyTests-1094644060 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:57:09 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-4a8e6829-9dd9-4096-a80a-6f934d7e42e3 tempest-SnapshotDependencyTests-1094644060 None] Selected osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 as target Quobyte volume. {{(pid=86212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 15:57:09 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-4a8e6829-9dd9-4096-a80a-6f934d7e42e3 tempest-SnapshotDependencyTests-1094644060 None] Acquiring lock "cinder-quobyte-957e2e34-c372-45cc-b9bd-fe7d4c2a8d97" by "_copy_volume_from_snapshot" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:57:09 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[158ebee9-c5d2-448f-b7fe-afd65277ee20]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:57:09 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-8b405f35-494f-4706-9e85-bbe3306df1ce tempest-ProjectMemberTests-1095658523 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8c1d677a-0068-47d5-82cd-110fa5fb40af {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:57:09 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-4a8e6829-9dd9-4096-a80a-6f934d7e42e3 tempest-SnapshotDependencyTests-1094644060 None] Lock "cinder-quobyte-957e2e34-c372-45cc-b9bd-fe7d4c2a8d97" acquired by "_copy_volume_from_snapshot" :: waited 0.033s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:57:09 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-4a8e6829-9dd9-4096-a80a-6f934d7e42e3 tempest-SnapshotDependencyTests-1094644060 None] snapshot: b30e74c8-a9b8-4731-abd2-02bb7734e583, volume: 957e2e34-c372-45cc-b9bd-fe7d4c2a8d97, {{(pid=86212) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 22 15:57:10 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-89fe14ef-28ce-410f-8b07-3c11e8ae23c3 tempest-ProjectReaderTests-935921131 None] Volume volume-ed7093d1-6c4d-4530-9d2d-58d93cc9358d (ed7093d1-6c4d-4530-9d2d-58d93cc9358d): created successfully Sep 22 15:57:10 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-89fe14ef-28ce-410f-8b07-3c11e8ae23c3 tempest-ProjectReaderTests-935921131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4191d606-86c0-4ea6-abb1-ea3e0c1c1f79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:57:10 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-89fe14ef-28ce-410f-8b07-3c11e8ae23c3 tempest-ProjectReaderTests-935921131 None] Flow 'volume_create_manager' (2d31f10e-ee1c-42c0-a11e-a0c3182f7bfb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:57:10 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-4a8e6829-9dd9-4096-a80a-6f934d7e42e3 tempest-SnapshotDependencyTests-1094644060 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:57:10 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-4a8e6829-9dd9-4096-a80a-6f934d7e42e3 tempest-SnapshotDependencyTests-1094644060 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:57:10 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-4a8e6829-9dd9-4096-a80a-6f934d7e42e3 tempest-SnapshotDependencyTests-1094644060 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:57:10 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-4a8e6829-9dd9-4096-a80a-6f934d7e42e3 tempest-SnapshotDependencyTests-1094644060 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:57:10 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-4a8e6829-9dd9-4096-a80a-6f934d7e42e3 tempest-SnapshotDependencyTests-1094644060 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:57:10 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-89fe14ef-28ce-410f-8b07-3c11e8ae23c3 tempest-ProjectReaderTests-935921131 None] Created volume successfully. Sep 22 15:57:10 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ee0ac65-7dee-456d-8941-01dfc7667b7a]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:57:10 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-4a8e6829-9dd9-4096-a80a-6f934d7e42e3 tempest-SnapshotDependencyTests-1094644060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-82a10e1f-f8ca-4617-9f30-e3f86f6cadd6.b30e74c8-a9b8-4731-abd2-02bb7734e583 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:57:10 devstack sudo[105125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8c1d677a-0068-47d5-82cd-110fa5fb40af Sep 22 15:57:10 devstack sudo[105125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:57:10 devstack sudo[105126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-82a10e1f-f8ca-4617-9f30-e3f86f6cadd6.b30e74c8-a9b8-4731-abd2-02bb7734e583 Sep 22 15:57:10 devstack sudo[105126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:57:10 devstack sudo[105125]: pam_unix(sudo:session): session closed for user root Sep 22 15:57:10 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-8b405f35-494f-4706-9e85-bbe3306df1ce tempest-ProjectMemberTests-1095658523 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8c1d677a-0068-47d5-82cd-110fa5fb40af" returned: 0 in 0.456s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:57:10 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-8b405f35-494f-4706-9e85-bbe3306df1ce tempest-ProjectMemberTests-1095658523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8c1d677a-0068-47d5-82cd-110fa5fb40af.c2af0a82-963b-4993-99c1-a0cca34d3c1d {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:57:10 devstack sudo[105133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8c1d677a-0068-47d5-82cd-110fa5fb40af.c2af0a82-963b-4993-99c1-a0cca34d3c1d Sep 22 15:57:10 devstack sudo[105133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:57:10 devstack sudo[105126]: pam_unix(sudo:session): session closed for user root Sep 22 15:57:10 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-4a8e6829-9dd9-4096-a80a-6f934d7e42e3 tempest-SnapshotDependencyTests-1094644060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-82a10e1f-f8ca-4617-9f30-e3f86f6cadd6.b30e74c8-a9b8-4731-abd2-02bb7734e583" returned: 0 in 0.485s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:57:10 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-4a8e6829-9dd9-4096-a80a-6f934d7e42e3 tempest-SnapshotDependencyTests-1094644060 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-82a10e1f-f8ca-4617-9f30-e3f86f6cadd6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86212) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 22 15:57:10 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fdbbe25-7a5d-437e-8cc7-d5eebe132d36]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:57:10 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-4a8e6829-9dd9-4096-a80a-6f934d7e42e3 tempest-SnapshotDependencyTests-1094644060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-82a10e1f-f8ca-4617-9f30-e3f86f6cadd6 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:57:10 devstack sudo[105138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-82a10e1f-f8ca-4617-9f30-e3f86f6cadd6 Sep 22 15:57:10 devstack sudo[105138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:57:10 devstack sudo[105133]: pam_unix(sudo:session): session closed for user root Sep 22 15:57:10 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-8b405f35-494f-4706-9e85-bbe3306df1ce tempest-ProjectMemberTests-1095658523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8c1d677a-0068-47d5-82cd-110fa5fb40af.c2af0a82-963b-4993-99c1-a0cca34d3c1d" returned: 0 in 0.427s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:57:10 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-8b405f35-494f-4706-9e85-bbe3306df1ce tempest-ProjectMemberTests-1095658523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8c1d677a-0068-47d5-82cd-110fa5fb40af.c2af0a82-963b-4993-99c1-a0cca34d3c1d {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:57:10 devstack sudo[105143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8c1d677a-0068-47d5-82cd-110fa5fb40af.c2af0a82-963b-4993-99c1-a0cca34d3c1d Sep 22 15:57:10 devstack sudo[105143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:57:11 devstack sudo[105138]: pam_unix(sudo:session): session closed for user root Sep 22 15:57:11 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-4a8e6829-9dd9-4096-a80a-6f934d7e42e3 tempest-SnapshotDependencyTests-1094644060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-82a10e1f-f8ca-4617-9f30-e3f86f6cadd6" returned: 0 in 0.457s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:57:11 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-4a8e6829-9dd9-4096-a80a-6f934d7e42e3 tempest-SnapshotDependencyTests-1094644060 None] will copy from snapshot at /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-82a10e1f-f8ca-4617-9f30-e3f86f6cadd6 {{(pid=86212) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 22 15:57:11 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-4a8e6829-9dd9-4096-a80a-6f934d7e42e3 tempest-SnapshotDependencyTests-1094644060 None] Creating direct copy from snapshot {{(pid=86212) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 22 15:57:11 devstack cinder-volume[86212]: DEBUG cinder.utils [None req-4a8e6829-9dd9-4096-a80a-6f934d7e42e3 tempest-SnapshotDependencyTests-1094644060 None] Path /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-957e2e34-c372-45cc-b9bd-fe7d4c2a8d97 not found in is_blk_device check {{(pid=86212) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 22 15:57:11 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-4a8e6829-9dd9-4096-a80a-6f934d7e42e3 tempest-SnapshotDependencyTests-1094644060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-82a10e1f-f8ca-4617-9f30-e3f86f6cadd6 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-957e2e34-c372-45cc-b9bd-fe7d4c2a8d97 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:57:11 devstack sudo[105149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-82a10e1f-f8ca-4617-9f30-e3f86f6cadd6 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-957e2e34-c372-45cc-b9bd-fe7d4c2a8d97 Sep 22 15:57:11 devstack sudo[105149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:57:11 devstack sudo[105143]: pam_unix(sudo:session): session closed for user root Sep 22 15:57:11 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-8b405f35-494f-4706-9e85-bbe3306df1ce tempest-ProjectMemberTests-1095658523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8c1d677a-0068-47d5-82cd-110fa5fb40af.c2af0a82-963b-4993-99c1-a0cca34d3c1d" returned: 0 in 0.291s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:57:11 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-8b405f35-494f-4706-9e85-bbe3306df1ce tempest-ProjectMemberTests-1095658523 None] Lock "cinder-quobyte-c2af0a82-963b-4993-99c1-a0cca34d3c1d" released by "_delete_snapshot" :: held 1.798s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:57:11 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-8b405f35-494f-4706-9e85-bbe3306df1ce tempest-ProjectMemberTests-1095658523 None] Lock "cinder-quobyte-8c1d677a-0068-47d5-82cd-110fa5fb40af" released by "delete_snapshot" :: held 1.834s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:57:11 devstack cinder-volume[86212]: DEBUG cinder.quota [None req-8b405f35-494f-4706-9e85-bbe3306df1ce tempest-ProjectMemberTests-1095658523 None] Created reservations ['dd1499b3-15d9-46d2-9018-957aa8fb2165', '63728377-35dd-45e4-8671-667997ca7dc2', 'd12bea66-1c73-4545-8ed9-017de38e0b5e', '5a42b3bc-b738-4dea-a436-252eac2ee63f'] {{(pid=86212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 15:57:11 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-8b405f35-494f-4706-9e85-bbe3306df1ce tempest-ProjectMemberTests-1095658523 None] Delete snapshot completed successfully. Sep 22 15:57:11 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-8b405f35-494f-4706-9e85-bbe3306df1ce tempest-ProjectMemberTests-1095658523 None] Lock "cinder-c2af0a82-963b-4993-99c1-a0cca34d3c1d-delete_snapshot" released by "delete_snapshot" :: held 2.015s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:57:11 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-c8f34b83-0539-47db-993e-728e862b78ec tempest-ProjectReaderTests-935921131 None] Acquiring lock "cinder-ed7093d1-6c4d-4530-9d2d-58d93cc9358d-delete_volume" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:57:11 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-7580f91b-99ed-4b77-bc8b-62a71ac565a8 tempest-ProjectMemberTests-1095658523 None] Acquiring lock "cinder-8c1d677a-0068-47d5-82cd-110fa5fb40af-delete_volume" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:57:11 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-c8f34b83-0539-47db-993e-728e862b78ec tempest-ProjectReaderTests-935921131 None] Lock "cinder-ed7093d1-6c4d-4530-9d2d-58d93cc9358d-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:57:11 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-7580f91b-99ed-4b77-bc8b-62a71ac565a8 tempest-ProjectMemberTests-1095658523 None] Lock "cinder-8c1d677a-0068-47d5-82cd-110fa5fb40af-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:57:11 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-c8f34b83-0539-47db-993e-728e862b78ec tempest-ProjectReaderTests-935921131 None] Acquiring lock "cinder-quobyte-ed7093d1-6c4d-4530-9d2d-58d93cc9358d" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:57:11 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-c8f34b83-0539-47db-993e-728e862b78ec tempest-ProjectReaderTests-935921131 None] Lock "cinder-quobyte-ed7093d1-6c4d-4530-9d2d-58d93cc9358d" acquired by "delete_volume" :: waited 0.029s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:57:11 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[075953fa-2692-4400-88fc-c09b690c134e]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:57:11 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-c8f34b83-0539-47db-993e-728e862b78ec tempest-ProjectReaderTests-935921131 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-ed7093d1-6c4d-4530-9d2d-58d93cc9358d {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:57:11 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-7580f91b-99ed-4b77-bc8b-62a71ac565a8 tempest-ProjectMemberTests-1095658523 None] Acquiring lock "cinder-quobyte-8c1d677a-0068-47d5-82cd-110fa5fb40af" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:57:11 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-7580f91b-99ed-4b77-bc8b-62a71ac565a8 tempest-ProjectMemberTests-1095658523 None] Lock "cinder-quobyte-8c1d677a-0068-47d5-82cd-110fa5fb40af" acquired by "delete_volume" :: waited 0.055s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:57:11 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb73632f-ee4a-4203-b105-a4728f172f1f]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:57:11 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-7580f91b-99ed-4b77-bc8b-62a71ac565a8 tempest-ProjectMemberTests-1095658523 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8c1d677a-0068-47d5-82cd-110fa5fb40af {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:57:11 devstack sudo[105157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-ed7093d1-6c4d-4530-9d2d-58d93cc9358d Sep 22 15:57:11 devstack sudo[105157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:57:12 devstack sudo[105163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8c1d677a-0068-47d5-82cd-110fa5fb40af Sep 22 15:57:12 devstack sudo[105163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:57:12 devstack sudo[105157]: pam_unix(sudo:session): session closed for user root Sep 22 15:57:12 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-c8f34b83-0539-47db-993e-728e862b78ec tempest-ProjectReaderTests-935921131 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-ed7093d1-6c4d-4530-9d2d-58d93cc9358d" returned: 0 in 0.701s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:57:12 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-c8f34b83-0539-47db-993e-728e862b78ec tempest-ProjectReaderTests-935921131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-ed7093d1-6c4d-4530-9d2d-58d93cc9358d {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:57:12 devstack sudo[105169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-ed7093d1-6c4d-4530-9d2d-58d93cc9358d Sep 22 15:57:12 devstack sudo[105169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:57:12 devstack sudo[105163]: pam_unix(sudo:session): session closed for user root Sep 22 15:57:12 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-7580f91b-99ed-4b77-bc8b-62a71ac565a8 tempest-ProjectMemberTests-1095658523 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8c1d677a-0068-47d5-82cd-110fa5fb40af" returned: 0 in 0.762s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:57:12 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-7580f91b-99ed-4b77-bc8b-62a71ac565a8 tempest-ProjectMemberTests-1095658523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8c1d677a-0068-47d5-82cd-110fa5fb40af {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:57:12 devstack sudo[105174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8c1d677a-0068-47d5-82cd-110fa5fb40af Sep 22 15:57:12 devstack sudo[105174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:57:13 devstack sudo[105169]: pam_unix(sudo:session): session closed for user root Sep 22 15:57:13 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-c8f34b83-0539-47db-993e-728e862b78ec tempest-ProjectReaderTests-935921131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-ed7093d1-6c4d-4530-9d2d-58d93cc9358d" returned: 0 in 0.654s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:57:13 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-c8f34b83-0539-47db-993e-728e862b78ec tempest-ProjectReaderTests-935921131 None] Lock "cinder-quobyte-ed7093d1-6c4d-4530-9d2d-58d93cc9358d" released by "delete_volume" :: held 1.431s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:57:13 devstack sudo[105174]: pam_unix(sudo:session): session closed for user root Sep 22 15:57:13 devstack cinder-volume[86212]: DEBUG cinder.quota [None req-c8f34b83-0539-47db-993e-728e862b78ec tempest-ProjectReaderTests-935921131 None] Created reservations ['9ff968f2-467d-4c4f-b9e7-b5f169c44a11', '9122e721-511e-45d8-9ee9-3a194935df41', '9f24d13d-ef73-4ce3-a244-0a98b538a7eb', '8e8b5dc4-b033-47dd-9dda-4439baeb4aed'] {{(pid=86212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 15:57:13 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-7580f91b-99ed-4b77-bc8b-62a71ac565a8 tempest-ProjectMemberTests-1095658523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8c1d677a-0068-47d5-82cd-110fa5fb40af" returned: 0 in 0.558s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:57:13 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-7580f91b-99ed-4b77-bc8b-62a71ac565a8 tempest-ProjectMemberTests-1095658523 None] Lock "cinder-quobyte-8c1d677a-0068-47d5-82cd-110fa5fb40af" released by "delete_volume" :: held 1.483s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:57:13 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-c8f34b83-0539-47db-993e-728e862b78ec tempest-ProjectReaderTests-935921131 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:57:13 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-c8f34b83-0539-47db-993e-728e862b78ec tempest-ProjectReaderTests-935921131 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:57:13 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-c8f34b83-0539-47db-993e-728e862b78ec tempest-ProjectReaderTests-935921131 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:57:13 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-c8f34b83-0539-47db-993e-728e862b78ec tempest-ProjectReaderTests-935921131 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:57:13 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-c8f34b83-0539-47db-993e-728e862b78ec tempest-ProjectReaderTests-935921131 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:57:13 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-c8f34b83-0539-47db-993e-728e862b78ec tempest-ProjectReaderTests-935921131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:57:13 devstack cinder-volume[86212]: DEBUG cinder.quota [None req-7580f91b-99ed-4b77-bc8b-62a71ac565a8 tempest-ProjectMemberTests-1095658523 None] Created reservations ['cc07d236-e279-43ab-a865-2b6b77839f19', '4fadb859-95cf-47e3-9103-be2f491ac9cc', '255db86d-c68b-4f26-8f64-34fab52a242e', '42808de1-d69f-49f6-aebc-4d36a513a888'] {{(pid=86212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 15:57:13 devstack sudo[105178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc Sep 22 15:57:13 devstack sudo[105178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:57:13 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-7580f91b-99ed-4b77-bc8b-62a71ac565a8 tempest-ProjectMemberTests-1095658523 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:57:13 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-7580f91b-99ed-4b77-bc8b-62a71ac565a8 tempest-ProjectMemberTests-1095658523 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:57:13 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-7580f91b-99ed-4b77-bc8b-62a71ac565a8 tempest-ProjectMemberTests-1095658523 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:57:13 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-7580f91b-99ed-4b77-bc8b-62a71ac565a8 tempest-ProjectMemberTests-1095658523 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:57:13 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-7580f91b-99ed-4b77-bc8b-62a71ac565a8 tempest-ProjectMemberTests-1095658523 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:57:13 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-7580f91b-99ed-4b77-bc8b-62a71ac565a8 tempest-ProjectMemberTests-1095658523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:57:13 devstack sudo[105180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc Sep 22 15:57:13 devstack sudo[105180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:57:13 devstack sudo[105178]: pam_unix(sudo:session): session closed for user root Sep 22 15:57:13 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-c8f34b83-0539-47db-993e-728e862b78ec tempest-ProjectReaderTests-935921131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc" returned: 0 in 0.555s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:57:13 devstack cinder-volume[86212]: DEBUG cinder.manager [None req-c8f34b83-0539-47db-993e-728e862b78ec tempest-ProjectReaderTests-935921131 None] Notifying Schedulers of capabilities ... {{(pid=86212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 15:57:13 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-c8f34b83-0539-47db-993e-728e862b78ec tempest-ProjectReaderTests-935921131 None] Deleted volume successfully. Sep 22 15:57:14 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-c8f34b83-0539-47db-993e-728e862b78ec tempest-ProjectReaderTests-935921131 None] Lock "cinder-ed7093d1-6c4d-4530-9d2d-58d93cc9358d-delete_volume" released by "delete_volume" :: held 2.486s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:57:14 devstack sudo[105180]: pam_unix(sudo:session): session closed for user root Sep 22 15:57:14 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-7580f91b-99ed-4b77-bc8b-62a71ac565a8 tempest-ProjectMemberTests-1095658523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc" returned: 0 in 0.798s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:57:14 devstack cinder-volume[86212]: DEBUG cinder.manager [None req-7580f91b-99ed-4b77-bc8b-62a71ac565a8 tempest-ProjectMemberTests-1095658523 None] Notifying Schedulers of capabilities ... {{(pid=86212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 15:57:14 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-7580f91b-99ed-4b77-bc8b-62a71ac565a8 tempest-ProjectMemberTests-1095658523 None] Deleted volume successfully. Sep 22 15:57:14 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-7580f91b-99ed-4b77-bc8b-62a71ac565a8 tempest-ProjectMemberTests-1095658523 None] Lock "cinder-8c1d677a-0068-47d5-82cd-110fa5fb40af-delete_volume" released by "delete_volume" :: held 2.792s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:57:15 devstack cinder-volume[86212]: DEBUG cinder.volume.flows.manager.create_volume [None req-675367e0-59fb-4dd6-b607-b5541b2a28dd tempest-ProjectReaderTests-935921131 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 15:57:15 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-675367e0-59fb-4dd6-b607-b5541b2a28dd tempest-ProjectReaderTests-935921131 None] Flow 'volume_create_manager' (10ff37a7-10b7-41dc-9f2e-3ea91a40b282) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:57:15 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-675367e0-59fb-4dd6-b607-b5541b2a28dd tempest-ProjectReaderTests-935921131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76f73ef0-314b-4833-880e-e4732ed52897) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:57:15 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-675367e0-59fb-4dd6-b607-b5541b2a28dd tempest-ProjectReaderTests-935921131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76f73ef0-314b-4833-880e-e4732ed52897) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:57:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2043128183',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6bcc31ff-24d3-4800-880d-b87bcdacd49d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66f65086b6a64de1ba2276ac92d5d7c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:57:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:57:15Z,use_quota=True,user_id='7ea5d0f2935e43e681ac626ca99e4635',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:57:15 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-675367e0-59fb-4dd6-b607-b5541b2a28dd tempest-ProjectReaderTests-935921131 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02f03080-ee4b-4913-beb5-bf62180ca733) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:57:15 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-675367e0-59fb-4dd6-b607-b5541b2a28dd tempest-ProjectReaderTests-935921131 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02f03080-ee4b-4913-beb5-bf62180ca733) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:57:15 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-675367e0-59fb-4dd6-b607-b5541b2a28dd tempest-ProjectReaderTests-935921131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e7c313e-4bc6-429e-961c-bdcbe3baa1b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:57:15 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-675367e0-59fb-4dd6-b607-b5541b2a28dd tempest-ProjectReaderTests-935921131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e7c313e-4bc6-429e-961c-bdcbe3baa1b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6bcc31ff-24d3-4800-880d-b87bcdacd49d', 'volume_name': 'volume-6bcc31ff-24d3-4800-880d-b87bcdacd49d', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:57:15 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-675367e0-59fb-4dd6-b607-b5541b2a28dd tempest-ProjectReaderTests-935921131 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d35aabfd-dc11-471b-ad4e-f3288a6bcdb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:57:15 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-675367e0-59fb-4dd6-b607-b5541b2a28dd tempest-ProjectReaderTests-935921131 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d35aabfd-dc11-471b-ad4e-f3288a6bcdb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:57:15 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-675367e0-59fb-4dd6-b607-b5541b2a28dd tempest-ProjectReaderTests-935921131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e3dad38-35c9-42f9-811f-a3fff6823a16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:57:15 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-675367e0-59fb-4dd6-b607-b5541b2a28dd tempest-ProjectReaderTests-935921131 None] Volume 6bcc31ff-24d3-4800-880d-b87bcdacd49d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6bcc31ff-24d3-4800-880d-b87bcdacd49d', 'volume_size': 1} Sep 22 15:57:15 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-675367e0-59fb-4dd6-b607-b5541b2a28dd tempest-ProjectReaderTests-935921131 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:57:15 devstack cinder-volume[86212]: DEBUG cinder.volume.flows.manager.create_volume [None req-adb064e2-68bd-4009-8264-ebfd53f7c76a tempest-ProjectMemberTests-1095658523 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 15:57:15 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-adb064e2-68bd-4009-8264-ebfd53f7c76a tempest-ProjectMemberTests-1095658523 None] Flow 'volume_create_manager' (aa66ed2c-3ed6-4f6e-8b48-94c047a9ab3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:57:15 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-adb064e2-68bd-4009-8264-ebfd53f7c76a tempest-ProjectMemberTests-1095658523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ccfd4a6-db5c-455e-81fe-86e6bb38f74e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:57:15 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-adb064e2-68bd-4009-8264-ebfd53f7c76a tempest-ProjectMemberTests-1095658523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ccfd4a6-db5c-455e-81fe-86e6bb38f74e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:57:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1801278779',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=414d3ab9-75f0-47aa-83eb-a4c49bf504be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e3beb47e92e4a8c9efa3433374c2e0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:57:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:57:15Z,use_quota=True,user_id='c4cc884fb51643ee9efb176f88d0543f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:57:15 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-adb064e2-68bd-4009-8264-ebfd53f7c76a tempest-ProjectMemberTests-1095658523 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (170c7ce6-59a9-40a6-badb-bce177f55dab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:57:15 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-adb064e2-68bd-4009-8264-ebfd53f7c76a tempest-ProjectMemberTests-1095658523 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (170c7ce6-59a9-40a6-badb-bce177f55dab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:57:15 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-adb064e2-68bd-4009-8264-ebfd53f7c76a tempest-ProjectMemberTests-1095658523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfc90758-85c2-46e3-80d6-e47e4744f0f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:57:15 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-adb064e2-68bd-4009-8264-ebfd53f7c76a tempest-ProjectMemberTests-1095658523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfc90758-85c2-46e3-80d6-e47e4744f0f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '414d3ab9-75f0-47aa-83eb-a4c49bf504be', 'volume_name': 'volume-414d3ab9-75f0-47aa-83eb-a4c49bf504be', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:57:15 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-adb064e2-68bd-4009-8264-ebfd53f7c76a tempest-ProjectMemberTests-1095658523 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a890fd6-3fd3-4524-9b7b-bfbff2fc7713) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:57:15 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-adb064e2-68bd-4009-8264-ebfd53f7c76a tempest-ProjectMemberTests-1095658523 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a890fd6-3fd3-4524-9b7b-bfbff2fc7713) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:57:15 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-adb064e2-68bd-4009-8264-ebfd53f7c76a tempest-ProjectMemberTests-1095658523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58e093e5-bbee-4cf2-9b85-318103a9db55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:57:15 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-adb064e2-68bd-4009-8264-ebfd53f7c76a tempest-ProjectMemberTests-1095658523 None] Volume 414d3ab9-75f0-47aa-83eb-a4c49bf504be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-414d3ab9-75f0-47aa-83eb-a4c49bf504be', 'volume_size': 1} Sep 22 15:57:15 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-adb064e2-68bd-4009-8264-ebfd53f7c76a tempest-ProjectMemberTests-1095658523 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:57:19 devstack sudo[105149]: pam_unix(sudo:session): session closed for user root Sep 22 15:57:19 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-4a8e6829-9dd9-4096-a80a-6f934d7e42e3 tempest-SnapshotDependencyTests-1094644060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-82a10e1f-f8ca-4617-9f30-e3f86f6cadd6 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-957e2e34-c372-45cc-b9bd-fe7d4c2a8d97" returned: 0 in 8.288s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:57:19 devstack cinder-volume[86212]: DEBUG cinder.image.image_utils [None req-4a8e6829-9dd9-4096-a80a-6f934d7e42e3 tempest-SnapshotDependencyTests-1094644060 None] Image conversion details: src /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-82a10e1f-f8ca-4617-9f30-e3f86f6cadd6, size 1024.00 MB, duration 8.29 sec, destination /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-957e2e34-c372-45cc-b9bd-fe7d4c2a8d97 {{(pid=86212) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 22 15:57:19 devstack cinder-volume[86212]: INFO cinder.image.image_utils [None req-4a8e6829-9dd9-4096-a80a-6f934d7e42e3 tempest-SnapshotDependencyTests-1094644060 None] Converted 1024.00 MB image at 123.54 MB/s Sep 22 15:57:19 devstack cinder-volume[86212]: WARNING cinder.volume.drivers.remotefs [None req-4a8e6829-9dd9-4096-a80a-6f934d7e42e3 tempest-SnapshotDependencyTests-1094644060 None] /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-957e2e34-c372-45cc-b9bd-fe7d4c2a8d97 is being set with open permissions: ugo+rw Sep 22 15:57:19 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-4a8e6829-9dd9-4096-a80a-6f934d7e42e3 tempest-SnapshotDependencyTests-1094644060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-957e2e34-c372-45cc-b9bd-fe7d4c2a8d97 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:57:19 devstack sudo[105186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-957e2e34-c372-45cc-b9bd-fe7d4c2a8d97 Sep 22 15:57:19 devstack sudo[105186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:57:19 devstack sudo[105186]: pam_unix(sudo:session): session closed for user root Sep 22 15:57:19 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-4a8e6829-9dd9-4096-a80a-6f934d7e42e3 tempest-SnapshotDependencyTests-1094644060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-957e2e34-c372-45cc-b9bd-fe7d4c2a8d97" returned: 0 in 0.280s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:57:19 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-4a8e6829-9dd9-4096-a80a-6f934d7e42e3 tempest-SnapshotDependencyTests-1094644060 None] Lock "cinder-quobyte-957e2e34-c372-45cc-b9bd-fe7d4c2a8d97" released by "_copy_volume_from_snapshot" :: held 9.628s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:57:19 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-4a8e6829-9dd9-4096-a80a-6f934d7e42e3 tempest-SnapshotDependencyTests-1094644060 None] Lock "cinder-quobyte-b30e74c8-a9b8-4731-abd2-02bb7734e583-957e2e34-c372-45cc-b9bd-fe7d4c2a8d97" released by "_create_volume_from_snapshot" :: held 9.714s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:57:19 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-4a8e6829-9dd9-4096-a80a-6f934d7e42e3 tempest-SnapshotDependencyTests-1094644060 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.798s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:57:19 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-675367e0-59fb-4dd6-b607-b5541b2a28dd tempest-ProjectReaderTests-935921131 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.332s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:57:19 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-675367e0-59fb-4dd6-b607-b5541b2a28dd tempest-ProjectReaderTests-935921131 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:57:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2043128183',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6bcc31ff-24d3-4800-880d-b87bcdacd49d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66f65086b6a64de1ba2276ac92d5d7c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:57:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:57:15Z,use_quota=True,user_id='7ea5d0f2935e43e681ac626ca99e4635',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)}" {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 15:57:19 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-675367e0-59fb-4dd6-b607-b5541b2a28dd tempest-ProjectReaderTests-935921131 None] Creating volume 6bcc31ff-24d3-4800-880d-b87bcdacd49d {{(pid=86212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 15:57:19 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-675367e0-59fb-4dd6-b607-b5541b2a28dd tempest-ProjectReaderTests-935921131 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:57:19 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-675367e0-59fb-4dd6-b607-b5541b2a28dd tempest-ProjectReaderTests-935921131 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:57:19 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-675367e0-59fb-4dd6-b607-b5541b2a28dd tempest-ProjectReaderTests-935921131 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:57:19 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-675367e0-59fb-4dd6-b607-b5541b2a28dd tempest-ProjectReaderTests-935921131 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:57:19 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-675367e0-59fb-4dd6-b607-b5541b2a28dd tempest-ProjectReaderTests-935921131 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:57:19 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-675367e0-59fb-4dd6-b607-b5541b2a28dd tempest-ProjectReaderTests-935921131 None] Selected osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 as target Quobyte volume. {{(pid=86212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 15:57:19 devstack cinder-volume[86212]: INFO cinder.volume.drivers.remotefs [None req-675367e0-59fb-4dd6-b607-b5541b2a28dd tempest-ProjectReaderTests-935921131 None] casted to osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 Sep 22 15:57:19 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-675367e0-59fb-4dd6-b607-b5541b2a28dd tempest-ProjectReaderTests-935921131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-6bcc31ff-24d3-4800-880d-b87bcdacd49d 1073741824 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:57:19 devstack sudo[105190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-6bcc31ff-24d3-4800-880d-b87bcdacd49d 1073741824 Sep 22 15:57:19 devstack sudo[105190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:57:19 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-4a8e6829-9dd9-4096-a80a-6f934d7e42e3 tempest-SnapshotDependencyTests-1094644060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95679a00-b0fe-4fa0-bcec-32fa45069479) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-957e2e34-c372-45cc-b9bd-fe7d4c2a8d97', 'volume_size': 1, 'snapshot_id': 'b30e74c8-a9b8-4731-abd2-02bb7734e583'}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:57:19 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-4a8e6829-9dd9-4096-a80a-6f934d7e42e3 tempest-SnapshotDependencyTests-1094644060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1489d78-aae1-41c2-9c2f-7ce589abfed9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:57:19 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-4a8e6829-9dd9-4096-a80a-6f934d7e42e3 tempest-SnapshotDependencyTests-1094644060 None] Volume volume-957e2e34-c372-45cc-b9bd-fe7d4c2a8d97 (957e2e34-c372-45cc-b9bd-fe7d4c2a8d97): created successfully Sep 22 15:57:19 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-4a8e6829-9dd9-4096-a80a-6f934d7e42e3 tempest-SnapshotDependencyTests-1094644060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1489d78-aae1-41c2-9c2f-7ce589abfed9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:57:19 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-4a8e6829-9dd9-4096-a80a-6f934d7e42e3 tempest-SnapshotDependencyTests-1094644060 None] Flow 'volume_create_manager' (c2cda549-98c7-4fed-85c6-d4e7206afde5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:57:19 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-4a8e6829-9dd9-4096-a80a-6f934d7e42e3 tempest-SnapshotDependencyTests-1094644060 None] Created volume successfully. Sep 22 15:57:20 devstack sudo[105190]: pam_unix(sudo:session): session closed for user root Sep 22 15:57:20 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-675367e0-59fb-4dd6-b607-b5541b2a28dd tempest-ProjectReaderTests-935921131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-6bcc31ff-24d3-4800-880d-b87bcdacd49d 1073741824" returned: 0 in 0.462s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:57:20 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-675367e0-59fb-4dd6-b607-b5541b2a28dd tempest-ProjectReaderTests-935921131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-6bcc31ff-24d3-4800-880d-b87bcdacd49d {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:57:20 devstack sudo[105196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-6bcc31ff-24d3-4800-880d-b87bcdacd49d Sep 22 15:57:20 devstack sudo[105196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:57:20 devstack sudo[105196]: pam_unix(sudo:session): session closed for user root Sep 22 15:57:20 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-3f20b0ad-1b67-49aa-88d9-7660c9c4c1c7 tempest-SnapshotDependencyTests-1094644060 None] Acquiring lock "cinder-b30e74c8-a9b8-4731-abd2-02bb7734e583-delete_snapshot" by "delete_snapshot" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:57:20 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-675367e0-59fb-4dd6-b607-b5541b2a28dd tempest-ProjectReaderTests-935921131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-6bcc31ff-24d3-4800-880d-b87bcdacd49d" returned: 0 in 0.266s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:57:20 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-675367e0-59fb-4dd6-b607-b5541b2a28dd tempest-ProjectReaderTests-935921131 None] <== create_volume: return (772ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'} {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 15:57:20 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-675367e0-59fb-4dd6-b607-b5541b2a28dd tempest-ProjectReaderTests-935921131 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.776s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:57:20 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-adb064e2-68bd-4009-8264-ebfd53f7c76a tempest-ProjectMemberTests-1095658523 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.997s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:57:20 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-adb064e2-68bd-4009-8264-ebfd53f7c76a tempest-ProjectMemberTests-1095658523 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:57:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1801278779',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=414d3ab9-75f0-47aa-83eb-a4c49bf504be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e3beb47e92e4a8c9efa3433374c2e0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:57:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:57:15Z,use_quota=True,user_id='c4cc884fb51643ee9efb176f88d0543f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)}" {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 15:57:20 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-adb064e2-68bd-4009-8264-ebfd53f7c76a tempest-ProjectMemberTests-1095658523 None] Creating volume 414d3ab9-75f0-47aa-83eb-a4c49bf504be {{(pid=86212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 15:57:20 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-adb064e2-68bd-4009-8264-ebfd53f7c76a tempest-ProjectMemberTests-1095658523 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:57:20 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-adb064e2-68bd-4009-8264-ebfd53f7c76a tempest-ProjectMemberTests-1095658523 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:57:20 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-adb064e2-68bd-4009-8264-ebfd53f7c76a tempest-ProjectMemberTests-1095658523 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:57:20 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-adb064e2-68bd-4009-8264-ebfd53f7c76a tempest-ProjectMemberTests-1095658523 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:57:20 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-adb064e2-68bd-4009-8264-ebfd53f7c76a tempest-ProjectMemberTests-1095658523 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:57:20 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-adb064e2-68bd-4009-8264-ebfd53f7c76a tempest-ProjectMemberTests-1095658523 None] Selected osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 as target Quobyte volume. {{(pid=86212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 15:57:20 devstack cinder-volume[86212]: INFO cinder.volume.drivers.remotefs [None req-adb064e2-68bd-4009-8264-ebfd53f7c76a tempest-ProjectMemberTests-1095658523 None] casted to osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 Sep 22 15:57:20 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-adb064e2-68bd-4009-8264-ebfd53f7c76a tempest-ProjectMemberTests-1095658523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-414d3ab9-75f0-47aa-83eb-a4c49bf504be 1073741824 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:57:20 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-3f20b0ad-1b67-49aa-88d9-7660c9c4c1c7 tempest-SnapshotDependencyTests-1094644060 None] Lock "cinder-b30e74c8-a9b8-4731-abd2-02bb7734e583-delete_snapshot" acquired by "delete_snapshot" :: waited 0.054s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:57:20 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-3f20b0ad-1b67-49aa-88d9-7660c9c4c1c7 tempest-SnapshotDependencyTests-1094644060 None] Acquiring lock "cinder-quobyte-82a10e1f-f8ca-4617-9f30-e3f86f6cadd6" by "delete_snapshot" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:57:20 devstack sudo[105199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-414d3ab9-75f0-47aa-83eb-a4c49bf504be 1073741824 Sep 22 15:57:20 devstack sudo[105199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:57:20 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-675367e0-59fb-4dd6-b607-b5541b2a28dd tempest-ProjectReaderTests-935921131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e3dad38-35c9-42f9-811f-a3fff6823a16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6bcc31ff-24d3-4800-880d-b87bcdacd49d', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:57:20 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-675367e0-59fb-4dd6-b607-b5541b2a28dd tempest-ProjectReaderTests-935921131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d09c385-221e-4200-bbea-aa748f2ab2fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:57:20 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-3f20b0ad-1b67-49aa-88d9-7660c9c4c1c7 tempest-SnapshotDependencyTests-1094644060 None] Lock "cinder-quobyte-82a10e1f-f8ca-4617-9f30-e3f86f6cadd6" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:57:20 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-3f20b0ad-1b67-49aa-88d9-7660c9c4c1c7 tempest-SnapshotDependencyTests-1094644060 None] Acquiring lock "cinder-quobyte-b30e74c8-a9b8-4731-abd2-02bb7734e583" by "_delete_snapshot" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:57:20 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-675367e0-59fb-4dd6-b607-b5541b2a28dd tempest-ProjectReaderTests-935921131 None] Volume volume-6bcc31ff-24d3-4800-880d-b87bcdacd49d (6bcc31ff-24d3-4800-880d-b87bcdacd49d): created successfully Sep 22 15:57:20 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-675367e0-59fb-4dd6-b607-b5541b2a28dd tempest-ProjectReaderTests-935921131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d09c385-221e-4200-bbea-aa748f2ab2fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:57:20 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-675367e0-59fb-4dd6-b607-b5541b2a28dd tempest-ProjectReaderTests-935921131 None] Flow 'volume_create_manager' (10ff37a7-10b7-41dc-9f2e-3ea91a40b282) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:57:20 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-3f20b0ad-1b67-49aa-88d9-7660c9c4c1c7 tempest-SnapshotDependencyTests-1094644060 None] Lock "cinder-quobyte-b30e74c8-a9b8-4731-abd2-02bb7734e583" acquired by "_delete_snapshot" :: waited 0.036s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:57:20 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-3f20b0ad-1b67-49aa-88d9-7660c9c4c1c7 tempest-SnapshotDependencyTests-1094644060 None] Deleting offline snapshot b30e74c8-a9b8-4731-abd2-02bb7734e583 of volume 82a10e1f-f8ca-4617-9f30-e3f86f6cadd6 {{(pid=86212) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 22 15:57:20 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-3f20b0ad-1b67-49aa-88d9-7660c9c4c1c7 tempest-SnapshotDependencyTests-1094644060 None] snapshot_file for this snap is: volume-82a10e1f-f8ca-4617-9f30-e3f86f6cadd6.b30e74c8-a9b8-4731-abd2-02bb7734e583 {{(pid=86212) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 22 15:57:20 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-675367e0-59fb-4dd6-b607-b5541b2a28dd tempest-ProjectReaderTests-935921131 None] Created volume successfully. Sep 22 15:57:20 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[a53cf08d-1152-4f92-bbfe-ae2ce62cb0bb]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:57:20 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-3f20b0ad-1b67-49aa-88d9-7660c9c4c1c7 tempest-SnapshotDependencyTests-1094644060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-82a10e1f-f8ca-4617-9f30-e3f86f6cadd6.b30e74c8-a9b8-4731-abd2-02bb7734e583 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:57:20 devstack sudo[105201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-82a10e1f-f8ca-4617-9f30-e3f86f6cadd6.b30e74c8-a9b8-4731-abd2-02bb7734e583 Sep 22 15:57:20 devstack sudo[105201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:57:20 devstack sudo[105199]: pam_unix(sudo:session): session closed for user root Sep 22 15:57:20 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-adb064e2-68bd-4009-8264-ebfd53f7c76a tempest-ProjectMemberTests-1095658523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-414d3ab9-75f0-47aa-83eb-a4c49bf504be 1073741824" returned: 0 in 0.451s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:57:20 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-adb064e2-68bd-4009-8264-ebfd53f7c76a tempest-ProjectMemberTests-1095658523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-414d3ab9-75f0-47aa-83eb-a4c49bf504be {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:57:20 devstack sudo[105210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-414d3ab9-75f0-47aa-83eb-a4c49bf504be Sep 22 15:57:20 devstack sudo[105210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:57:21 devstack sudo[105201]: pam_unix(sudo:session): session closed for user root Sep 22 15:57:21 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-3f20b0ad-1b67-49aa-88d9-7660c9c4c1c7 tempest-SnapshotDependencyTests-1094644060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-82a10e1f-f8ca-4617-9f30-e3f86f6cadd6.b30e74c8-a9b8-4731-abd2-02bb7734e583" returned: 0 in 0.413s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:57:21 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-3f20b0ad-1b67-49aa-88d9-7660c9c4c1c7 tempest-SnapshotDependencyTests-1094644060 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-82a10e1f-f8ca-4617-9f30-e3f86f6cadd6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86212) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 22 15:57:21 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[458d979d-0bc4-4f14-9c90-7e8a7fac06ae]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:57:21 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-3f20b0ad-1b67-49aa-88d9-7660c9c4c1c7 tempest-SnapshotDependencyTests-1094644060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-82a10e1f-f8ca-4617-9f30-e3f86f6cadd6 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:57:21 devstack sudo[105212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-82a10e1f-f8ca-4617-9f30-e3f86f6cadd6 Sep 22 15:57:21 devstack sudo[105212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:57:21 devstack sudo[105210]: pam_unix(sudo:session): session closed for user root Sep 22 15:57:21 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-adb064e2-68bd-4009-8264-ebfd53f7c76a tempest-ProjectMemberTests-1095658523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-414d3ab9-75f0-47aa-83eb-a4c49bf504be" returned: 0 in 0.257s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:57:21 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-adb064e2-68bd-4009-8264-ebfd53f7c76a tempest-ProjectMemberTests-1095658523 None] <== create_volume: return (757ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'} {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 15:57:21 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-adb064e2-68bd-4009-8264-ebfd53f7c76a tempest-ProjectMemberTests-1095658523 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.760s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:57:21 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-adb064e2-68bd-4009-8264-ebfd53f7c76a tempest-ProjectMemberTests-1095658523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58e093e5-bbee-4cf2-9b85-318103a9db55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-414d3ab9-75f0-47aa-83eb-a4c49bf504be', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:57:21 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-adb064e2-68bd-4009-8264-ebfd53f7c76a tempest-ProjectMemberTests-1095658523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (edbd8172-9860-498b-bc3b-e05a42da35ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:57:21 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-adb064e2-68bd-4009-8264-ebfd53f7c76a tempest-ProjectMemberTests-1095658523 None] Volume volume-414d3ab9-75f0-47aa-83eb-a4c49bf504be (414d3ab9-75f0-47aa-83eb-a4c49bf504be): created successfully Sep 22 15:57:21 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-adb064e2-68bd-4009-8264-ebfd53f7c76a tempest-ProjectMemberTests-1095658523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (edbd8172-9860-498b-bc3b-e05a42da35ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:57:21 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-adb064e2-68bd-4009-8264-ebfd53f7c76a tempest-ProjectMemberTests-1095658523 None] Flow 'volume_create_manager' (aa66ed2c-3ed6-4f6e-8b48-94c047a9ab3e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:57:21 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-adb064e2-68bd-4009-8264-ebfd53f7c76a tempest-ProjectMemberTests-1095658523 None] Created volume successfully. Sep 22 15:57:21 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-eb9f230b-d340-4760-8a8d-304db6e7618a tempest-ProjectReaderTests-935921131 None] Acquiring lock "cinder-6bcc31ff-24d3-4800-880d-b87bcdacd49d-delete_volume" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:57:21 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-eb9f230b-d340-4760-8a8d-304db6e7618a tempest-ProjectReaderTests-935921131 None] Lock "cinder-6bcc31ff-24d3-4800-880d-b87bcdacd49d-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:57:21 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-eb9f230b-d340-4760-8a8d-304db6e7618a tempest-ProjectReaderTests-935921131 None] Acquiring lock "cinder-quobyte-6bcc31ff-24d3-4800-880d-b87bcdacd49d" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:57:21 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-eb9f230b-d340-4760-8a8d-304db6e7618a tempest-ProjectReaderTests-935921131 None] Lock "cinder-quobyte-6bcc31ff-24d3-4800-880d-b87bcdacd49d" acquired by "delete_volume" :: waited 0.017s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:57:21 devstack sudo[105212]: pam_unix(sudo:session): session closed for user root Sep 22 15:57:21 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-3f20b0ad-1b67-49aa-88d9-7660c9c4c1c7 tempest-SnapshotDependencyTests-1094644060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-82a10e1f-f8ca-4617-9f30-e3f86f6cadd6" returned: 0 in 0.605s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:57:21 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-3f20b0ad-1b67-49aa-88d9-7660c9c4c1c7 tempest-SnapshotDependencyTests-1094644060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-82a10e1f-f8ca-4617-9f30-e3f86f6cadd6.b30e74c8-a9b8-4731-abd2-02bb7734e583 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:57:21 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[a207dd9a-0c1c-4b65-bc36-44a59fec598b]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:57:21 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-eb9f230b-d340-4760-8a8d-304db6e7618a tempest-ProjectReaderTests-935921131 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-6bcc31ff-24d3-4800-880d-b87bcdacd49d {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:57:21 devstack sudo[105218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-82a10e1f-f8ca-4617-9f30-e3f86f6cadd6.b30e74c8-a9b8-4731-abd2-02bb7734e583 Sep 22 15:57:21 devstack sudo[105218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:57:21 devstack sudo[105219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-6bcc31ff-24d3-4800-880d-b87bcdacd49d Sep 22 15:57:21 devstack sudo[105219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:57:21 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-d1ccbafc-1c71-4779-9fce-409435410ad0 tempest-ProjectMemberTests-1095658523 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:57:21 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-d1ccbafc-1c71-4779-9fce-409435410ad0 tempest-ProjectMemberTests-1095658523 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:57:21 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-d1ccbafc-1c71-4779-9fce-409435410ad0 tempest-ProjectMemberTests-1095658523 None] Creating offline snapshot 5d97412a-7ebc-417e-b30b-f2eeef937981 of volume 414d3ab9-75f0-47aa-83eb-a4c49bf504be {{(pid=86212) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 22 15:57:21 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bbbce8a-a332-45f0-9424-a24ea80e0e0b]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:57:21 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-d1ccbafc-1c71-4779-9fce-409435410ad0 tempest-ProjectMemberTests-1095658523 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-414d3ab9-75f0-47aa-83eb-a4c49bf504be {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:57:22 devstack sudo[105224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-414d3ab9-75f0-47aa-83eb-a4c49bf504be Sep 22 15:57:22 devstack sudo[105224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:57:22 devstack sudo[105218]: pam_unix(sudo:session): session closed for user root Sep 22 15:57:22 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-3f20b0ad-1b67-49aa-88d9-7660c9c4c1c7 tempest-SnapshotDependencyTests-1094644060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-82a10e1f-f8ca-4617-9f30-e3f86f6cadd6.b30e74c8-a9b8-4731-abd2-02bb7734e583" returned: 0 in 0.411s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:57:22 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-3f20b0ad-1b67-49aa-88d9-7660c9c4c1c7 tempest-SnapshotDependencyTests-1094644060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-82a10e1f-f8ca-4617-9f30-e3f86f6cadd6.b30e74c8-a9b8-4731-abd2-02bb7734e583 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:57:22 devstack sudo[105229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-82a10e1f-f8ca-4617-9f30-e3f86f6cadd6.b30e74c8-a9b8-4731-abd2-02bb7734e583 Sep 22 15:57:22 devstack sudo[105229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:57:22 devstack sudo[105219]: pam_unix(sudo:session): session closed for user root Sep 22 15:57:22 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-eb9f230b-d340-4760-8a8d-304db6e7618a tempest-ProjectReaderTests-935921131 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-6bcc31ff-24d3-4800-880d-b87bcdacd49d" returned: 0 in 0.487s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:57:22 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-eb9f230b-d340-4760-8a8d-304db6e7618a tempest-ProjectReaderTests-935921131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-6bcc31ff-24d3-4800-880d-b87bcdacd49d {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:57:22 devstack sudo[105232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-6bcc31ff-24d3-4800-880d-b87bcdacd49d Sep 22 15:57:22 devstack sudo[105232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:57:22 devstack sudo[105229]: pam_unix(sudo:session): session closed for user root Sep 22 15:57:22 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-3f20b0ad-1b67-49aa-88d9-7660c9c4c1c7 tempest-SnapshotDependencyTests-1094644060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-82a10e1f-f8ca-4617-9f30-e3f86f6cadd6.b30e74c8-a9b8-4731-abd2-02bb7734e583" returned: 0 in 0.276s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:57:22 devstack sudo[105224]: pam_unix(sudo:session): session closed for user root Sep 22 15:57:22 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-d1ccbafc-1c71-4779-9fce-409435410ad0 tempest-ProjectMemberTests-1095658523 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-414d3ab9-75f0-47aa-83eb-a4c49bf504be" returned: 0 in 0.458s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:57:22 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-d1ccbafc-1c71-4779-9fce-409435410ad0 tempest-ProjectMemberTests-1095658523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-414d3ab9-75f0-47aa-83eb-a4c49bf504be,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-414d3ab9-75f0-47aa-83eb-a4c49bf504be.5d97412a-7ebc-417e-b30b-f2eeef937981 1G {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:57:22 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-3f20b0ad-1b67-49aa-88d9-7660c9c4c1c7 tempest-SnapshotDependencyTests-1094644060 None] Lock "cinder-quobyte-b30e74c8-a9b8-4731-abd2-02bb7734e583" released by "_delete_snapshot" :: held 1.834s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:57:22 devstack sudo[105232]: pam_unix(sudo:session): session closed for user root Sep 22 15:57:22 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-3f20b0ad-1b67-49aa-88d9-7660c9c4c1c7 tempest-SnapshotDependencyTests-1094644060 None] Lock "cinder-quobyte-82a10e1f-f8ca-4617-9f30-e3f86f6cadd6" released by "delete_snapshot" :: held 1.887s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:57:22 devstack sudo[105239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-414d3ab9-75f0-47aa-83eb-a4c49bf504be,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-414d3ab9-75f0-47aa-83eb-a4c49bf504be.5d97412a-7ebc-417e-b30b-f2eeef937981 1G Sep 22 15:57:22 devstack sudo[105239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:57:22 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-eb9f230b-d340-4760-8a8d-304db6e7618a tempest-ProjectReaderTests-935921131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-6bcc31ff-24d3-4800-880d-b87bcdacd49d" returned: 0 in 0.259s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:57:22 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-eb9f230b-d340-4760-8a8d-304db6e7618a tempest-ProjectReaderTests-935921131 None] Lock "cinder-quobyte-6bcc31ff-24d3-4800-880d-b87bcdacd49d" released by "delete_volume" :: held 0.808s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:57:22 devstack cinder-volume[86212]: DEBUG cinder.quota [None req-3f20b0ad-1b67-49aa-88d9-7660c9c4c1c7 tempest-SnapshotDependencyTests-1094644060 None] Created reservations ['ea4dc6ae-2ea4-44a9-91dd-fcfc4068c251', '98c48fff-d69e-441d-a8fd-fab723ad292b', 'be08259f-7705-472c-999f-de5c707c3d0b', '2f697b4d-432c-4881-8e8b-379ff711a87a'] {{(pid=86212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 15:57:22 devstack cinder-volume[86212]: DEBUG cinder.quota [None req-eb9f230b-d340-4760-8a8d-304db6e7618a tempest-ProjectReaderTests-935921131 None] Created reservations ['35c7a430-a393-42d8-853d-cf5e9b080373', '00a77dc5-95eb-40b9-80cf-14fabeb366d7', 'f83536d9-7845-407b-9745-537dcb47314f', '1d6f2e1b-b8d8-4b84-bd8f-4d18566fd3b3'] {{(pid=86212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 15:57:22 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-3f20b0ad-1b67-49aa-88d9-7660c9c4c1c7 tempest-SnapshotDependencyTests-1094644060 None] Delete snapshot completed successfully. Sep 22 15:57:22 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-3f20b0ad-1b67-49aa-88d9-7660c9c4c1c7 tempest-SnapshotDependencyTests-1094644060 None] Lock "cinder-b30e74c8-a9b8-4731-abd2-02bb7734e583-delete_snapshot" released by "delete_snapshot" :: held 2.126s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:57:22 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-eb9f230b-d340-4760-8a8d-304db6e7618a tempest-ProjectReaderTests-935921131 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:57:22 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-eb9f230b-d340-4760-8a8d-304db6e7618a tempest-ProjectReaderTests-935921131 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:57:22 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-eb9f230b-d340-4760-8a8d-304db6e7618a tempest-ProjectReaderTests-935921131 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:57:22 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-eb9f230b-d340-4760-8a8d-304db6e7618a tempest-ProjectReaderTests-935921131 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:57:22 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-eb9f230b-d340-4760-8a8d-304db6e7618a tempest-ProjectReaderTests-935921131 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:57:22 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-eb9f230b-d340-4760-8a8d-304db6e7618a tempest-ProjectReaderTests-935921131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:57:22 devstack sudo[105244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc Sep 22 15:57:22 devstack sudo[105244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:57:22 devstack sudo[105239]: pam_unix(sudo:session): session closed for user root Sep 22 15:57:22 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-d1ccbafc-1c71-4779-9fce-409435410ad0 tempest-ProjectMemberTests-1095658523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-414d3ab9-75f0-47aa-83eb-a4c49bf504be,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-414d3ab9-75f0-47aa-83eb-a4c49bf504be.5d97412a-7ebc-417e-b30b-f2eeef937981 1G" returned: 0 in 0.521s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:57:22 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-d1ccbafc-1c71-4779-9fce-409435410ad0 tempest-ProjectMemberTests-1095658523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-414d3ab9-75f0-47aa-83eb-a4c49bf504be -F qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-414d3ab9-75f0-47aa-83eb-a4c49bf504be.5d97412a-7ebc-417e-b30b-f2eeef937981 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:57:22 devstack sudo[105248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-414d3ab9-75f0-47aa-83eb-a4c49bf504be -F qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-414d3ab9-75f0-47aa-83eb-a4c49bf504be.5d97412a-7ebc-417e-b30b-f2eeef937981 Sep 22 15:57:22 devstack sudo[105248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:57:22 devstack sudo[105244]: pam_unix(sudo:session): session closed for user root Sep 22 15:57:22 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-eb9f230b-d340-4760-8a8d-304db6e7618a tempest-ProjectReaderTests-935921131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc" returned: 0 in 0.316s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:57:22 devstack cinder-volume[86212]: DEBUG cinder.manager [None req-eb9f230b-d340-4760-8a8d-304db6e7618a tempest-ProjectReaderTests-935921131 None] Notifying Schedulers of capabilities ... {{(pid=86212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 15:57:22 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-eb9f230b-d340-4760-8a8d-304db6e7618a tempest-ProjectReaderTests-935921131 None] Deleted volume successfully. Sep 22 15:57:23 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-eb9f230b-d340-4760-8a8d-304db6e7618a tempest-ProjectReaderTests-935921131 None] Lock "cinder-6bcc31ff-24d3-4800-880d-b87bcdacd49d-delete_volume" released by "delete_volume" :: held 1.425s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:57:23 devstack sudo[105248]: pam_unix(sudo:session): session closed for user root Sep 22 15:57:23 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-d1ccbafc-1c71-4779-9fce-409435410ad0 tempest-ProjectMemberTests-1095658523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-414d3ab9-75f0-47aa-83eb-a4c49bf504be -F qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-414d3ab9-75f0-47aa-83eb-a4c49bf504be.5d97412a-7ebc-417e-b30b-f2eeef937981" returned: 0 in 0.325s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:57:23 devstack cinder-volume[86212]: WARNING cinder.volume.drivers.remotefs [None req-d1ccbafc-1c71-4779-9fce-409435410ad0 tempest-ProjectMemberTests-1095658523 None] /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-414d3ab9-75f0-47aa-83eb-a4c49bf504be.5d97412a-7ebc-417e-b30b-f2eeef937981 is being set with open permissions: ugo+rw Sep 22 15:57:23 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-d1ccbafc-1c71-4779-9fce-409435410ad0 tempest-ProjectMemberTests-1095658523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-414d3ab9-75f0-47aa-83eb-a4c49bf504be.5d97412a-7ebc-417e-b30b-f2eeef937981 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:57:23 devstack sudo[105255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-414d3ab9-75f0-47aa-83eb-a4c49bf504be.5d97412a-7ebc-417e-b30b-f2eeef937981 Sep 22 15:57:23 devstack sudo[105255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:57:23 devstack sudo[105255]: pam_unix(sudo:session): session closed for user root Sep 22 15:57:23 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-d1ccbafc-1c71-4779-9fce-409435410ad0 tempest-ProjectMemberTests-1095658523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-414d3ab9-75f0-47aa-83eb-a4c49bf504be.5d97412a-7ebc-417e-b30b-f2eeef937981" returned: 0 in 0.259s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:57:23 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-d1ccbafc-1c71-4779-9fce-409435410ad0 tempest-ProjectMemberTests-1095658523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-414d3ab9-75f0-47aa-83eb-a4c49bf504be.info {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:57:23 devstack sudo[105258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-414d3ab9-75f0-47aa-83eb-a4c49bf504be.info Sep 22 15:57:23 devstack sudo[105258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:57:23 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-8ab93ab9-8b0f-4ac0-aad2-131f261abe3e tempest-SnapshotDependencyTests-1094644060 None] Acquiring lock "cinder-82a10e1f-f8ca-4617-9f30-e3f86f6cadd6-delete_volume" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:57:23 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-8ab93ab9-8b0f-4ac0-aad2-131f261abe3e tempest-SnapshotDependencyTests-1094644060 None] Lock "cinder-82a10e1f-f8ca-4617-9f30-e3f86f6cadd6-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:57:23 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-8ab93ab9-8b0f-4ac0-aad2-131f261abe3e tempest-SnapshotDependencyTests-1094644060 None] Acquiring lock "cinder-quobyte-82a10e1f-f8ca-4617-9f30-e3f86f6cadd6" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:57:23 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-8ab93ab9-8b0f-4ac0-aad2-131f261abe3e tempest-SnapshotDependencyTests-1094644060 None] Lock "cinder-quobyte-82a10e1f-f8ca-4617-9f30-e3f86f6cadd6" acquired by "delete_volume" :: waited 0.019s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:57:23 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[d483ea50-8026-46d5-bd5e-1798c50952e0]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:57:23 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-8ab93ab9-8b0f-4ac0-aad2-131f261abe3e tempest-SnapshotDependencyTests-1094644060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-82a10e1f-f8ca-4617-9f30-e3f86f6cadd6 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:57:23 devstack sudo[105258]: pam_unix(sudo:session): session closed for user root Sep 22 15:57:23 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-d1ccbafc-1c71-4779-9fce-409435410ad0 tempest-ProjectMemberTests-1095658523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-414d3ab9-75f0-47aa-83eb-a4c49bf504be.info" returned: 0 in 0.328s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:57:23 devstack cinder-volume[86212]: WARNING cinder.volume.drivers.remotefs [None req-d1ccbafc-1c71-4779-9fce-409435410ad0 tempest-ProjectMemberTests-1095658523 None] /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-414d3ab9-75f0-47aa-83eb-a4c49bf504be.info is being set with open permissions: ugo+rw Sep 22 15:57:23 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-d1ccbafc-1c71-4779-9fce-409435410ad0 tempest-ProjectMemberTests-1095658523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-414d3ab9-75f0-47aa-83eb-a4c49bf504be.info {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:57:23 devstack sudo[105262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-414d3ab9-75f0-47aa-83eb-a4c49bf504be.info Sep 22 15:57:23 devstack sudo[105262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:57:23 devstack sudo[105261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-82a10e1f-f8ca-4617-9f30-e3f86f6cadd6 Sep 22 15:57:23 devstack sudo[105261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:57:24 devstack sudo[105262]: pam_unix(sudo:session): session closed for user root Sep 22 15:57:24 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-d1ccbafc-1c71-4779-9fce-409435410ad0 tempest-ProjectMemberTests-1095658523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-414d3ab9-75f0-47aa-83eb-a4c49bf504be.info" returned: 0 in 0.276s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:57:24 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-d1ccbafc-1c71-4779-9fce-409435410ad0 tempest-ProjectMemberTests-1095658523 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.261s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:57:24 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-d1ccbafc-1c71-4779-9fce-409435410ad0 tempest-ProjectMemberTests-1095658523 None] Create snapshot completed successfully Sep 22 15:57:24 devstack sudo[105261]: pam_unix(sudo:session): session closed for user root Sep 22 15:57:24 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-8ab93ab9-8b0f-4ac0-aad2-131f261abe3e tempest-SnapshotDependencyTests-1094644060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-82a10e1f-f8ca-4617-9f30-e3f86f6cadd6" returned: 0 in 0.425s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:57:24 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-8ab93ab9-8b0f-4ac0-aad2-131f261abe3e tempest-SnapshotDependencyTests-1094644060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-82a10e1f-f8ca-4617-9f30-e3f86f6cadd6 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:57:24 devstack sudo[105269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-82a10e1f-f8ca-4617-9f30-e3f86f6cadd6 Sep 22 15:57:24 devstack sudo[105269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:57:24 devstack sudo[105269]: pam_unix(sudo:session): session closed for user root Sep 22 15:57:24 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-8ab93ab9-8b0f-4ac0-aad2-131f261abe3e tempest-SnapshotDependencyTests-1094644060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-82a10e1f-f8ca-4617-9f30-e3f86f6cadd6" returned: 0 in 0.267s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:57:24 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-8ab93ab9-8b0f-4ac0-aad2-131f261abe3e tempest-SnapshotDependencyTests-1094644060 None] Lock "cinder-quobyte-82a10e1f-f8ca-4617-9f30-e3f86f6cadd6" released by "delete_volume" :: held 0.784s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:57:24 devstack cinder-volume[86212]: DEBUG cinder.quota [None req-8ab93ab9-8b0f-4ac0-aad2-131f261abe3e tempest-SnapshotDependencyTests-1094644060 None] Created reservations ['871c089c-c3b4-46b5-a148-89a2e0b79ea9', 'eb3e9457-cbc3-475f-8d2c-0899acd8345c', '11b6cf11-a61c-4a7d-95d0-f883f67edb03', 'a68f86cb-43fa-47e4-b481-3a26d0c6e649'] {{(pid=86212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 15:57:24 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-8ab93ab9-8b0f-4ac0-aad2-131f261abe3e tempest-SnapshotDependencyTests-1094644060 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:57:24 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-8ab93ab9-8b0f-4ac0-aad2-131f261abe3e tempest-SnapshotDependencyTests-1094644060 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:57:24 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-8ab93ab9-8b0f-4ac0-aad2-131f261abe3e tempest-SnapshotDependencyTests-1094644060 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:57:24 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-8ab93ab9-8b0f-4ac0-aad2-131f261abe3e tempest-SnapshotDependencyTests-1094644060 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:57:24 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-8ab93ab9-8b0f-4ac0-aad2-131f261abe3e tempest-SnapshotDependencyTests-1094644060 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:57:24 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-8ab93ab9-8b0f-4ac0-aad2-131f261abe3e tempest-SnapshotDependencyTests-1094644060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:57:24 devstack sudo[105272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc Sep 22 15:57:24 devstack sudo[105272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:57:24 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-4752382e-53a8-4294-9065-38417306fbcd tempest-SnapshotDependencyTests-1094644060 None] Acquiring lock "cinder-957e2e34-c372-45cc-b9bd-fe7d4c2a8d97-delete_volume" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:57:24 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-4752382e-53a8-4294-9065-38417306fbcd tempest-SnapshotDependencyTests-1094644060 None] Lock "cinder-957e2e34-c372-45cc-b9bd-fe7d4c2a8d97-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:57:24 devstack sudo[105272]: pam_unix(sudo:session): session closed for user root Sep 22 15:57:24 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-4752382e-53a8-4294-9065-38417306fbcd tempest-SnapshotDependencyTests-1094644060 None] Acquiring lock "cinder-quobyte-957e2e34-c372-45cc-b9bd-fe7d4c2a8d97" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:57:24 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-8ab93ab9-8b0f-4ac0-aad2-131f261abe3e tempest-SnapshotDependencyTests-1094644060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc" returned: 0 in 0.300s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:57:24 devstack cinder-volume[86212]: DEBUG cinder.manager [None req-8ab93ab9-8b0f-4ac0-aad2-131f261abe3e tempest-SnapshotDependencyTests-1094644060 None] Notifying Schedulers of capabilities ... {{(pid=86212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 15:57:24 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-8ab93ab9-8b0f-4ac0-aad2-131f261abe3e tempest-SnapshotDependencyTests-1094644060 None] Deleted volume successfully. Sep 22 15:57:24 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-4752382e-53a8-4294-9065-38417306fbcd tempest-SnapshotDependencyTests-1094644060 None] Lock "cinder-quobyte-957e2e34-c372-45cc-b9bd-fe7d4c2a8d97" acquired by "delete_volume" :: waited 0.020s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:57:25 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-8ab93ab9-8b0f-4ac0-aad2-131f261abe3e tempest-SnapshotDependencyTests-1094644060 None] Lock "cinder-82a10e1f-f8ca-4617-9f30-e3f86f6cadd6-delete_volume" released by "delete_volume" :: held 1.331s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:57:25 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[49218c06-01df-4a34-9227-c4e3f7cedecf]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:57:25 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-4752382e-53a8-4294-9065-38417306fbcd tempest-SnapshotDependencyTests-1094644060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-957e2e34-c372-45cc-b9bd-fe7d4c2a8d97 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:57:25 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-e655728e-07c0-46ed-883a-66ee9358e431 tempest-ProjectMemberTests-1095658523 None] Acquiring lock "cinder-5d97412a-7ebc-417e-b30b-f2eeef937981-delete_snapshot" by "delete_snapshot" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:57:25 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-e655728e-07c0-46ed-883a-66ee9358e431 tempest-ProjectMemberTests-1095658523 None] Lock "cinder-5d97412a-7ebc-417e-b30b-f2eeef937981-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:57:25 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-e655728e-07c0-46ed-883a-66ee9358e431 tempest-ProjectMemberTests-1095658523 None] Acquiring lock "cinder-quobyte-414d3ab9-75f0-47aa-83eb-a4c49bf504be" by "delete_snapshot" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:57:25 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-e655728e-07c0-46ed-883a-66ee9358e431 tempest-ProjectMemberTests-1095658523 None] Lock "cinder-quobyte-414d3ab9-75f0-47aa-83eb-a4c49bf504be" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:57:25 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-e655728e-07c0-46ed-883a-66ee9358e431 tempest-ProjectMemberTests-1095658523 None] Acquiring lock "cinder-quobyte-5d97412a-7ebc-417e-b30b-f2eeef937981" by "_delete_snapshot" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:57:25 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-e655728e-07c0-46ed-883a-66ee9358e431 tempest-ProjectMemberTests-1095658523 None] Lock "cinder-quobyte-5d97412a-7ebc-417e-b30b-f2eeef937981" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:57:25 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-e655728e-07c0-46ed-883a-66ee9358e431 tempest-ProjectMemberTests-1095658523 None] Deleting offline snapshot 5d97412a-7ebc-417e-b30b-f2eeef937981 of volume 414d3ab9-75f0-47aa-83eb-a4c49bf504be {{(pid=86212) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 22 15:57:25 devstack sudo[105277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-957e2e34-c372-45cc-b9bd-fe7d4c2a8d97 Sep 22 15:57:25 devstack sudo[105277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:57:25 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-e655728e-07c0-46ed-883a-66ee9358e431 tempest-ProjectMemberTests-1095658523 None] snapshot_file for this snap is: volume-414d3ab9-75f0-47aa-83eb-a4c49bf504be.5d97412a-7ebc-417e-b30b-f2eeef937981 {{(pid=86212) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 22 15:57:25 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[2771405c-ab14-4c44-96e6-3ed32a1d0d9e]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:57:25 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-e655728e-07c0-46ed-883a-66ee9358e431 tempest-ProjectMemberTests-1095658523 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-414d3ab9-75f0-47aa-83eb-a4c49bf504be.5d97412a-7ebc-417e-b30b-f2eeef937981 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:57:25 devstack sudo[105279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-414d3ab9-75f0-47aa-83eb-a4c49bf504be.5d97412a-7ebc-417e-b30b-f2eeef937981 Sep 22 15:57:25 devstack sudo[105279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:57:25 devstack sudo[105277]: pam_unix(sudo:session): session closed for user root Sep 22 15:57:25 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-4752382e-53a8-4294-9065-38417306fbcd tempest-SnapshotDependencyTests-1094644060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-957e2e34-c372-45cc-b9bd-fe7d4c2a8d97" returned: 0 in 0.376s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:57:25 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-4752382e-53a8-4294-9065-38417306fbcd tempest-SnapshotDependencyTests-1094644060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-957e2e34-c372-45cc-b9bd-fe7d4c2a8d97 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:57:25 devstack sudo[105284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-957e2e34-c372-45cc-b9bd-fe7d4c2a8d97 Sep 22 15:57:25 devstack sudo[105284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:57:25 devstack sudo[105279]: pam_unix(sudo:session): session closed for user root Sep 22 15:57:25 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-e655728e-07c0-46ed-883a-66ee9358e431 tempest-ProjectMemberTests-1095658523 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-414d3ab9-75f0-47aa-83eb-a4c49bf504be.5d97412a-7ebc-417e-b30b-f2eeef937981" returned: 0 in 0.380s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:57:25 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-e655728e-07c0-46ed-883a-66ee9358e431 tempest-ProjectMemberTests-1095658523 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-414d3ab9-75f0-47aa-83eb-a4c49bf504be(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86212) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 22 15:57:25 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[6854b318-2440-4f87-8898-e7093fecd7c0]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:57:25 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-e655728e-07c0-46ed-883a-66ee9358e431 tempest-ProjectMemberTests-1095658523 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-414d3ab9-75f0-47aa-83eb-a4c49bf504be {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:57:25 devstack sudo[105284]: pam_unix(sudo:session): session closed for user root Sep 22 15:57:25 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-4752382e-53a8-4294-9065-38417306fbcd tempest-SnapshotDependencyTests-1094644060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-957e2e34-c372-45cc-b9bd-fe7d4c2a8d97" returned: 0 in 0.256s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:57:25 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-4752382e-53a8-4294-9065-38417306fbcd tempest-SnapshotDependencyTests-1094644060 None] Lock "cinder-quobyte-957e2e34-c372-45cc-b9bd-fe7d4c2a8d97" released by "delete_volume" :: held 0.695s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:57:25 devstack sudo[105289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-414d3ab9-75f0-47aa-83eb-a4c49bf504be Sep 22 15:57:25 devstack sudo[105289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:57:25 devstack cinder-volume[86212]: DEBUG cinder.quota [None req-4752382e-53a8-4294-9065-38417306fbcd tempest-SnapshotDependencyTests-1094644060 None] Created reservations ['9668f67e-7318-4d4d-98d4-5bc9e9d382d7', '1e97dbfb-43a9-436d-8330-a7f32b710e89', 'f116a7d3-f927-4318-b0de-1d8d3c3eff98', 'bcd19589-725a-4387-be32-8b48dd1b74e6'] {{(pid=86212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 15:57:25 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-4752382e-53a8-4294-9065-38417306fbcd tempest-SnapshotDependencyTests-1094644060 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:57:25 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-4752382e-53a8-4294-9065-38417306fbcd tempest-SnapshotDependencyTests-1094644060 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:57:25 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-4752382e-53a8-4294-9065-38417306fbcd tempest-SnapshotDependencyTests-1094644060 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:57:25 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-4752382e-53a8-4294-9065-38417306fbcd tempest-SnapshotDependencyTests-1094644060 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:57:25 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-4752382e-53a8-4294-9065-38417306fbcd tempest-SnapshotDependencyTests-1094644060 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:57:25 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-4752382e-53a8-4294-9065-38417306fbcd tempest-SnapshotDependencyTests-1094644060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:57:25 devstack sudo[105292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc Sep 22 15:57:25 devstack sudo[105292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:57:25 devstack sudo[105289]: pam_unix(sudo:session): session closed for user root Sep 22 15:57:25 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-e655728e-07c0-46ed-883a-66ee9358e431 tempest-ProjectMemberTests-1095658523 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-414d3ab9-75f0-47aa-83eb-a4c49bf504be" returned: 0 in 0.382s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:57:25 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-e655728e-07c0-46ed-883a-66ee9358e431 tempest-ProjectMemberTests-1095658523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-414d3ab9-75f0-47aa-83eb-a4c49bf504be.5d97412a-7ebc-417e-b30b-f2eeef937981 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:57:25 devstack sudo[105297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-414d3ab9-75f0-47aa-83eb-a4c49bf504be.5d97412a-7ebc-417e-b30b-f2eeef937981 Sep 22 15:57:25 devstack sudo[105297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:57:26 devstack sudo[105292]: pam_unix(sudo:session): session closed for user root Sep 22 15:57:26 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-4752382e-53a8-4294-9065-38417306fbcd tempest-SnapshotDependencyTests-1094644060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc" returned: 0 in 0.263s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:57:26 devstack cinder-volume[86212]: DEBUG cinder.manager [None req-4752382e-53a8-4294-9065-38417306fbcd tempest-SnapshotDependencyTests-1094644060 None] Notifying Schedulers of capabilities ... {{(pid=86212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 15:57:26 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-4752382e-53a8-4294-9065-38417306fbcd tempest-SnapshotDependencyTests-1094644060 None] Deleted volume successfully. Sep 22 15:57:26 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-4752382e-53a8-4294-9065-38417306fbcd tempest-SnapshotDependencyTests-1094644060 None] Lock "cinder-957e2e34-c372-45cc-b9bd-fe7d4c2a8d97-delete_volume" released by "delete_volume" :: held 1.236s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:57:26 devstack sudo[105297]: pam_unix(sudo:session): session closed for user root Sep 22 15:57:26 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-e655728e-07c0-46ed-883a-66ee9358e431 tempest-ProjectMemberTests-1095658523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-414d3ab9-75f0-47aa-83eb-a4c49bf504be.5d97412a-7ebc-417e-b30b-f2eeef937981" returned: 0 in 0.384s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:57:26 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-e655728e-07c0-46ed-883a-66ee9358e431 tempest-ProjectMemberTests-1095658523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-414d3ab9-75f0-47aa-83eb-a4c49bf504be.5d97412a-7ebc-417e-b30b-f2eeef937981 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:57:26 devstack sudo[105303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-414d3ab9-75f0-47aa-83eb-a4c49bf504be.5d97412a-7ebc-417e-b30b-f2eeef937981 Sep 22 15:57:26 devstack sudo[105303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:57:26 devstack sudo[105303]: pam_unix(sudo:session): session closed for user root Sep 22 15:57:26 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-e655728e-07c0-46ed-883a-66ee9358e431 tempest-ProjectMemberTests-1095658523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-414d3ab9-75f0-47aa-83eb-a4c49bf504be.5d97412a-7ebc-417e-b30b-f2eeef937981" returned: 0 in 0.254s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:57:26 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-e655728e-07c0-46ed-883a-66ee9358e431 tempest-ProjectMemberTests-1095658523 None] Lock "cinder-quobyte-5d97412a-7ebc-417e-b30b-f2eeef937981" released by "_delete_snapshot" :: held 1.518s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:57:26 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-e655728e-07c0-46ed-883a-66ee9358e431 tempest-ProjectMemberTests-1095658523 None] Lock "cinder-quobyte-414d3ab9-75f0-47aa-83eb-a4c49bf504be" released by "delete_snapshot" :: held 1.541s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:57:26 devstack cinder-volume[86212]: DEBUG cinder.quota [None req-e655728e-07c0-46ed-883a-66ee9358e431 tempest-ProjectMemberTests-1095658523 None] Created reservations ['2187dd88-9fb0-4738-bff8-af79859455bb', 'aea801a0-a367-412b-a27e-699b319506db', 'ad0b2940-4e4c-4dfe-8b83-fada82c1d3d0', '7e951e83-f276-43ee-b5a9-d6f26aa62b08'] {{(pid=86212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 15:57:26 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-e655728e-07c0-46ed-883a-66ee9358e431 tempest-ProjectMemberTests-1095658523 None] Delete snapshot completed successfully. Sep 22 15:57:26 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-e655728e-07c0-46ed-883a-66ee9358e431 tempest-ProjectMemberTests-1095658523 None] Lock "cinder-5d97412a-7ebc-417e-b30b-f2eeef937981-delete_snapshot" released by "delete_snapshot" :: held 1.694s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:57:27 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-5ae7ce91-17ce-49fa-8965-b34ae2377944 tempest-ProjectMemberTests-1095658523 None] Acquiring lock "cinder-414d3ab9-75f0-47aa-83eb-a4c49bf504be-delete_volume" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:57:27 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-5ae7ce91-17ce-49fa-8965-b34ae2377944 tempest-ProjectMemberTests-1095658523 None] Lock "cinder-414d3ab9-75f0-47aa-83eb-a4c49bf504be-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:57:27 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-5ae7ce91-17ce-49fa-8965-b34ae2377944 tempest-ProjectMemberTests-1095658523 None] Acquiring lock "cinder-quobyte-414d3ab9-75f0-47aa-83eb-a4c49bf504be" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:57:27 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-5ae7ce91-17ce-49fa-8965-b34ae2377944 tempest-ProjectMemberTests-1095658523 None] Lock "cinder-quobyte-414d3ab9-75f0-47aa-83eb-a4c49bf504be" acquired by "delete_volume" :: waited 0.018s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:57:27 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[60f69556-2b34-4715-96be-8e7210c8983d]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:57:27 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-5ae7ce91-17ce-49fa-8965-b34ae2377944 tempest-ProjectMemberTests-1095658523 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-414d3ab9-75f0-47aa-83eb-a4c49bf504be {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:57:27 devstack sudo[105306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-414d3ab9-75f0-47aa-83eb-a4c49bf504be Sep 22 15:57:27 devstack sudo[105306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:57:27 devstack sudo[105306]: pam_unix(sudo:session): session closed for user root Sep 22 15:57:27 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-5ae7ce91-17ce-49fa-8965-b34ae2377944 tempest-ProjectMemberTests-1095658523 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-414d3ab9-75f0-47aa-83eb-a4c49bf504be" returned: 0 in 0.401s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:57:27 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-5ae7ce91-17ce-49fa-8965-b34ae2377944 tempest-ProjectMemberTests-1095658523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-414d3ab9-75f0-47aa-83eb-a4c49bf504be {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:57:27 devstack sudo[105312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-414d3ab9-75f0-47aa-83eb-a4c49bf504be Sep 22 15:57:27 devstack sudo[105312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:57:28 devstack sudo[105312]: pam_unix(sudo:session): session closed for user root Sep 22 15:57:28 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-5ae7ce91-17ce-49fa-8965-b34ae2377944 tempest-ProjectMemberTests-1095658523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-414d3ab9-75f0-47aa-83eb-a4c49bf504be" returned: 0 in 0.256s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:57:28 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-5ae7ce91-17ce-49fa-8965-b34ae2377944 tempest-ProjectMemberTests-1095658523 None] Lock "cinder-quobyte-414d3ab9-75f0-47aa-83eb-a4c49bf504be" released by "delete_volume" :: held 0.721s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:57:28 devstack cinder-volume[86212]: DEBUG cinder.quota [None req-5ae7ce91-17ce-49fa-8965-b34ae2377944 tempest-ProjectMemberTests-1095658523 None] Created reservations ['ba151fd9-0178-4bc2-9798-35fc0db1c2bf', '97bfc6a6-c182-45ca-a4d2-724ec95fee6c', '73a73595-5a3c-4be6-80d8-af70bb87917e', '4ab95647-394f-41f9-a036-4c7269a8ef86'] {{(pid=86212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 15:57:28 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-5ae7ce91-17ce-49fa-8965-b34ae2377944 tempest-ProjectMemberTests-1095658523 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:57:28 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-5ae7ce91-17ce-49fa-8965-b34ae2377944 tempest-ProjectMemberTests-1095658523 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:57:28 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-5ae7ce91-17ce-49fa-8965-b34ae2377944 tempest-ProjectMemberTests-1095658523 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:57:28 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-5ae7ce91-17ce-49fa-8965-b34ae2377944 tempest-ProjectMemberTests-1095658523 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:57:28 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-5ae7ce91-17ce-49fa-8965-b34ae2377944 tempest-ProjectMemberTests-1095658523 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:57:28 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-5ae7ce91-17ce-49fa-8965-b34ae2377944 tempest-ProjectMemberTests-1095658523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:57:28 devstack sudo[105316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc Sep 22 15:57:28 devstack sudo[105316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:57:28 devstack sudo[105316]: pam_unix(sudo:session): session closed for user root Sep 22 15:57:28 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-5ae7ce91-17ce-49fa-8965-b34ae2377944 tempest-ProjectMemberTests-1095658523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc" returned: 0 in 0.275s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:57:28 devstack cinder-volume[86212]: DEBUG cinder.manager [None req-5ae7ce91-17ce-49fa-8965-b34ae2377944 tempest-ProjectMemberTests-1095658523 None] Notifying Schedulers of capabilities ... {{(pid=86212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 15:57:28 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-5ae7ce91-17ce-49fa-8965-b34ae2377944 tempest-ProjectMemberTests-1095658523 None] Deleted volume successfully. Sep 22 15:57:28 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-5ae7ce91-17ce-49fa-8965-b34ae2377944 tempest-ProjectMemberTests-1095658523 None] Lock "cinder-414d3ab9-75f0-47aa-83eb-a4c49bf504be-delete_volume" released by "delete_volume" :: held 1.207s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:57:28 devstack cinder-volume[86212]: DEBUG cinder.volume.flows.manager.create_volume [None req-de18ea24-6588-44e7-bd60-7b5aa06bbc17 tempest-ProjectMemberTests-1095658523 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 15:57:28 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-de18ea24-6588-44e7-bd60-7b5aa06bbc17 tempest-ProjectMemberTests-1095658523 None] Flow 'volume_create_manager' (a1219fb8-2fb7-43bf-af08-0871a9f71092) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:57:28 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-de18ea24-6588-44e7-bd60-7b5aa06bbc17 tempest-ProjectMemberTests-1095658523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (426c4fbf-378a-43ff-9ed9-ee52d58fc67b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:57:28 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-de18ea24-6588-44e7-bd60-7b5aa06bbc17 tempest-ProjectMemberTests-1095658523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (426c4fbf-378a-43ff-9ed9-ee52d58fc67b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:57:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-291557817',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e82425f-9be0-45dd-9ff2-5b08bd8c5114,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e3beb47e92e4a8c9efa3433374c2e0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:57:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:57:29Z,use_quota=True,user_id='c4cc884fb51643ee9efb176f88d0543f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:57:28 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-de18ea24-6588-44e7-bd60-7b5aa06bbc17 tempest-ProjectMemberTests-1095658523 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31d896a2-5ee3-4fc1-ab9f-9e18f3b3449f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:57:28 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-de18ea24-6588-44e7-bd60-7b5aa06bbc17 tempest-ProjectMemberTests-1095658523 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31d896a2-5ee3-4fc1-ab9f-9e18f3b3449f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:57:28 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-de18ea24-6588-44e7-bd60-7b5aa06bbc17 tempest-ProjectMemberTests-1095658523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db8640a6-3790-48b2-ae01-1057a4244dec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:57:28 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-de18ea24-6588-44e7-bd60-7b5aa06bbc17 tempest-ProjectMemberTests-1095658523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db8640a6-3790-48b2-ae01-1057a4244dec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8e82425f-9be0-45dd-9ff2-5b08bd8c5114', 'volume_name': 'volume-8e82425f-9be0-45dd-9ff2-5b08bd8c5114', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:57:28 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-de18ea24-6588-44e7-bd60-7b5aa06bbc17 tempest-ProjectMemberTests-1095658523 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2530de0-1b86-430e-a9c9-e65d98a0d73f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:57:28 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-de18ea24-6588-44e7-bd60-7b5aa06bbc17 tempest-ProjectMemberTests-1095658523 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2530de0-1b86-430e-a9c9-e65d98a0d73f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:57:28 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-de18ea24-6588-44e7-bd60-7b5aa06bbc17 tempest-ProjectMemberTests-1095658523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (570fbc3a-a359-4141-a186-55b313cf759e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:57:28 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-de18ea24-6588-44e7-bd60-7b5aa06bbc17 tempest-ProjectMemberTests-1095658523 None] Volume 8e82425f-9be0-45dd-9ff2-5b08bd8c5114: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8e82425f-9be0-45dd-9ff2-5b08bd8c5114', 'volume_size': 1} Sep 22 15:57:28 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-de18ea24-6588-44e7-bd60-7b5aa06bbc17 tempest-ProjectMemberTests-1095658523 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:57:28 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-de18ea24-6588-44e7-bd60-7b5aa06bbc17 tempest-ProjectMemberTests-1095658523 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:57:28 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-de18ea24-6588-44e7-bd60-7b5aa06bbc17 tempest-ProjectMemberTests-1095658523 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:57:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-291557817',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e82425f-9be0-45dd-9ff2-5b08bd8c5114,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e3beb47e92e4a8c9efa3433374c2e0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:57:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:57:29Z,use_quota=True,user_id='c4cc884fb51643ee9efb176f88d0543f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)}" {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 15:57:28 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-de18ea24-6588-44e7-bd60-7b5aa06bbc17 tempest-ProjectMemberTests-1095658523 None] Creating volume 8e82425f-9be0-45dd-9ff2-5b08bd8c5114 {{(pid=86212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 15:57:28 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-de18ea24-6588-44e7-bd60-7b5aa06bbc17 tempest-ProjectMemberTests-1095658523 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:57:28 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-de18ea24-6588-44e7-bd60-7b5aa06bbc17 tempest-ProjectMemberTests-1095658523 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:57:28 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-de18ea24-6588-44e7-bd60-7b5aa06bbc17 tempest-ProjectMemberTests-1095658523 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:57:28 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-de18ea24-6588-44e7-bd60-7b5aa06bbc17 tempest-ProjectMemberTests-1095658523 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:57:28 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-de18ea24-6588-44e7-bd60-7b5aa06bbc17 tempest-ProjectMemberTests-1095658523 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:57:28 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-de18ea24-6588-44e7-bd60-7b5aa06bbc17 tempest-ProjectMemberTests-1095658523 None] Selected osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 as target Quobyte volume. {{(pid=86212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 15:57:28 devstack cinder-volume[86212]: INFO cinder.volume.drivers.remotefs [None req-de18ea24-6588-44e7-bd60-7b5aa06bbc17 tempest-ProjectMemberTests-1095658523 None] casted to osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 Sep 22 15:57:28 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-de18ea24-6588-44e7-bd60-7b5aa06bbc17 tempest-ProjectMemberTests-1095658523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8e82425f-9be0-45dd-9ff2-5b08bd8c5114 1073741824 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:57:29 devstack sudo[105319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8e82425f-9be0-45dd-9ff2-5b08bd8c5114 1073741824 Sep 22 15:57:29 devstack sudo[105319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:57:29 devstack sudo[105319]: pam_unix(sudo:session): session closed for user root Sep 22 15:57:29 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-de18ea24-6588-44e7-bd60-7b5aa06bbc17 tempest-ProjectMemberTests-1095658523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8e82425f-9be0-45dd-9ff2-5b08bd8c5114 1073741824" returned: 0 in 0.429s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:57:29 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-de18ea24-6588-44e7-bd60-7b5aa06bbc17 tempest-ProjectMemberTests-1095658523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8e82425f-9be0-45dd-9ff2-5b08bd8c5114 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:57:29 devstack sudo[105324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8e82425f-9be0-45dd-9ff2-5b08bd8c5114 Sep 22 15:57:29 devstack sudo[105324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:57:29 devstack sudo[105324]: pam_unix(sudo:session): session closed for user root Sep 22 15:57:29 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-de18ea24-6588-44e7-bd60-7b5aa06bbc17 tempest-ProjectMemberTests-1095658523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8e82425f-9be0-45dd-9ff2-5b08bd8c5114" returned: 0 in 0.266s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:57:29 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-de18ea24-6588-44e7-bd60-7b5aa06bbc17 tempest-ProjectMemberTests-1095658523 None] <== create_volume: return (763ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'} {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 15:57:29 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-de18ea24-6588-44e7-bd60-7b5aa06bbc17 tempest-ProjectMemberTests-1095658523 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.765s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:57:29 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-de18ea24-6588-44e7-bd60-7b5aa06bbc17 tempest-ProjectMemberTests-1095658523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (570fbc3a-a359-4141-a186-55b313cf759e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e82425f-9be0-45dd-9ff2-5b08bd8c5114', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:57:29 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-de18ea24-6588-44e7-bd60-7b5aa06bbc17 tempest-ProjectMemberTests-1095658523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3cdf863-dfb2-40e3-8fbd-c947eac68414) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:57:29 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-de18ea24-6588-44e7-bd60-7b5aa06bbc17 tempest-ProjectMemberTests-1095658523 None] Volume volume-8e82425f-9be0-45dd-9ff2-5b08bd8c5114 (8e82425f-9be0-45dd-9ff2-5b08bd8c5114): created successfully Sep 22 15:57:29 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-de18ea24-6588-44e7-bd60-7b5aa06bbc17 tempest-ProjectMemberTests-1095658523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3cdf863-dfb2-40e3-8fbd-c947eac68414) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:57:29 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-de18ea24-6588-44e7-bd60-7b5aa06bbc17 tempest-ProjectMemberTests-1095658523 None] Flow 'volume_create_manager' (a1219fb8-2fb7-43bf-af08-0871a9f71092) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:57:29 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-de18ea24-6588-44e7-bd60-7b5aa06bbc17 tempest-ProjectMemberTests-1095658523 None] Created volume successfully. Sep 22 15:57:30 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-752ebf3a-de98-4199-8e6a-67077e7fc78f tempest-ProjectMemberTests-1095658523 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:57:30 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-752ebf3a-de98-4199-8e6a-67077e7fc78f tempest-ProjectMemberTests-1095658523 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:57:30 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-752ebf3a-de98-4199-8e6a-67077e7fc78f tempest-ProjectMemberTests-1095658523 None] Creating offline snapshot b1c23c48-d2db-4568-a5bc-c40a6046ab0d of volume 8e82425f-9be0-45dd-9ff2-5b08bd8c5114 {{(pid=86212) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 22 15:57:30 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca750f79-fea7-43c0-8088-c0bea6666402]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:57:30 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-752ebf3a-de98-4199-8e6a-67077e7fc78f tempest-ProjectMemberTests-1095658523 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8e82425f-9be0-45dd-9ff2-5b08bd8c5114 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:57:30 devstack sudo[105327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8e82425f-9be0-45dd-9ff2-5b08bd8c5114 Sep 22 15:57:30 devstack sudo[105327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:57:30 devstack sudo[105327]: pam_unix(sudo:session): session closed for user root Sep 22 15:57:30 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-752ebf3a-de98-4199-8e6a-67077e7fc78f tempest-ProjectMemberTests-1095658523 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8e82425f-9be0-45dd-9ff2-5b08bd8c5114" returned: 0 in 0.392s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:57:30 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-752ebf3a-de98-4199-8e6a-67077e7fc78f tempest-ProjectMemberTests-1095658523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8e82425f-9be0-45dd-9ff2-5b08bd8c5114,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8e82425f-9be0-45dd-9ff2-5b08bd8c5114.b1c23c48-d2db-4568-a5bc-c40a6046ab0d 1G {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:57:30 devstack sudo[105333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8e82425f-9be0-45dd-9ff2-5b08bd8c5114,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8e82425f-9be0-45dd-9ff2-5b08bd8c5114.b1c23c48-d2db-4568-a5bc-c40a6046ab0d 1G Sep 22 15:57:30 devstack sudo[105333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:57:31 devstack sudo[105333]: pam_unix(sudo:session): session closed for user root Sep 22 15:57:31 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-752ebf3a-de98-4199-8e6a-67077e7fc78f tempest-ProjectMemberTests-1095658523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8e82425f-9be0-45dd-9ff2-5b08bd8c5114,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8e82425f-9be0-45dd-9ff2-5b08bd8c5114.b1c23c48-d2db-4568-a5bc-c40a6046ab0d 1G" returned: 0 in 0.417s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:57:31 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-752ebf3a-de98-4199-8e6a-67077e7fc78f tempest-ProjectMemberTests-1095658523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8e82425f-9be0-45dd-9ff2-5b08bd8c5114 -F qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8e82425f-9be0-45dd-9ff2-5b08bd8c5114.b1c23c48-d2db-4568-a5bc-c40a6046ab0d {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:57:31 devstack sudo[105339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8e82425f-9be0-45dd-9ff2-5b08bd8c5114 -F qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8e82425f-9be0-45dd-9ff2-5b08bd8c5114.b1c23c48-d2db-4568-a5bc-c40a6046ab0d Sep 22 15:57:31 devstack sudo[105339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:57:31 devstack sudo[105339]: pam_unix(sudo:session): session closed for user root Sep 22 15:57:31 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-752ebf3a-de98-4199-8e6a-67077e7fc78f tempest-ProjectMemberTests-1095658523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8e82425f-9be0-45dd-9ff2-5b08bd8c5114 -F qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8e82425f-9be0-45dd-9ff2-5b08bd8c5114.b1c23c48-d2db-4568-a5bc-c40a6046ab0d" returned: 0 in 0.324s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:57:31 devstack cinder-volume[86212]: WARNING cinder.volume.drivers.remotefs [None req-752ebf3a-de98-4199-8e6a-67077e7fc78f tempest-ProjectMemberTests-1095658523 None] /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8e82425f-9be0-45dd-9ff2-5b08bd8c5114.b1c23c48-d2db-4568-a5bc-c40a6046ab0d is being set with open permissions: ugo+rw Sep 22 15:57:31 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-752ebf3a-de98-4199-8e6a-67077e7fc78f tempest-ProjectMemberTests-1095658523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8e82425f-9be0-45dd-9ff2-5b08bd8c5114.b1c23c48-d2db-4568-a5bc-c40a6046ab0d {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:57:31 devstack sudo[105344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8e82425f-9be0-45dd-9ff2-5b08bd8c5114.b1c23c48-d2db-4568-a5bc-c40a6046ab0d Sep 22 15:57:31 devstack sudo[105344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:57:31 devstack sudo[105344]: pam_unix(sudo:session): session closed for user root Sep 22 15:57:31 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-752ebf3a-de98-4199-8e6a-67077e7fc78f tempest-ProjectMemberTests-1095658523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8e82425f-9be0-45dd-9ff2-5b08bd8c5114.b1c23c48-d2db-4568-a5bc-c40a6046ab0d" returned: 0 in 0.249s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:57:31 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-752ebf3a-de98-4199-8e6a-67077e7fc78f tempest-ProjectMemberTests-1095658523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8e82425f-9be0-45dd-9ff2-5b08bd8c5114.info {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:57:31 devstack sudo[105347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8e82425f-9be0-45dd-9ff2-5b08bd8c5114.info Sep 22 15:57:31 devstack sudo[105347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:57:31 devstack sudo[105347]: pam_unix(sudo:session): session closed for user root Sep 22 15:57:31 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-752ebf3a-de98-4199-8e6a-67077e7fc78f tempest-ProjectMemberTests-1095658523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8e82425f-9be0-45dd-9ff2-5b08bd8c5114.info" returned: 0 in 0.266s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:57:31 devstack cinder-volume[86212]: WARNING cinder.volume.drivers.remotefs [None req-752ebf3a-de98-4199-8e6a-67077e7fc78f tempest-ProjectMemberTests-1095658523 None] /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8e82425f-9be0-45dd-9ff2-5b08bd8c5114.info is being set with open permissions: ugo+rw Sep 22 15:57:31 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-752ebf3a-de98-4199-8e6a-67077e7fc78f tempest-ProjectMemberTests-1095658523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8e82425f-9be0-45dd-9ff2-5b08bd8c5114.info {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:57:31 devstack sudo[105351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8e82425f-9be0-45dd-9ff2-5b08bd8c5114.info Sep 22 15:57:31 devstack sudo[105351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:57:32 devstack sudo[105351]: pam_unix(sudo:session): session closed for user root Sep 22 15:57:32 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-752ebf3a-de98-4199-8e6a-67077e7fc78f tempest-ProjectMemberTests-1095658523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8e82425f-9be0-45dd-9ff2-5b08bd8c5114.info" returned: 0 in 0.271s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:57:32 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-752ebf3a-de98-4199-8e6a-67077e7fc78f tempest-ProjectMemberTests-1095658523 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.022s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:57:32 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-752ebf3a-de98-4199-8e6a-67077e7fc78f tempest-ProjectMemberTests-1095658523 None] Create snapshot completed successfully Sep 22 15:57:33 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-62c5eb21-20ee-4ba8-8bab-bdc9ebe255c9 tempest-ProjectMemberTests-1095658523 None] Acquiring lock "cinder-b1c23c48-d2db-4568-a5bc-c40a6046ab0d-delete_snapshot" by "delete_snapshot" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:57:33 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-62c5eb21-20ee-4ba8-8bab-bdc9ebe255c9 tempest-ProjectMemberTests-1095658523 None] Lock "cinder-b1c23c48-d2db-4568-a5bc-c40a6046ab0d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:57:33 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-62c5eb21-20ee-4ba8-8bab-bdc9ebe255c9 tempest-ProjectMemberTests-1095658523 None] Acquiring lock "cinder-quobyte-8e82425f-9be0-45dd-9ff2-5b08bd8c5114" by "delete_snapshot" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:57:33 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-62c5eb21-20ee-4ba8-8bab-bdc9ebe255c9 tempest-ProjectMemberTests-1095658523 None] Lock "cinder-quobyte-8e82425f-9be0-45dd-9ff2-5b08bd8c5114" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:57:33 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-62c5eb21-20ee-4ba8-8bab-bdc9ebe255c9 tempest-ProjectMemberTests-1095658523 None] Acquiring lock "cinder-quobyte-b1c23c48-d2db-4568-a5bc-c40a6046ab0d" by "_delete_snapshot" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:57:33 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-62c5eb21-20ee-4ba8-8bab-bdc9ebe255c9 tempest-ProjectMemberTests-1095658523 None] Lock "cinder-quobyte-b1c23c48-d2db-4568-a5bc-c40a6046ab0d" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:57:33 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-62c5eb21-20ee-4ba8-8bab-bdc9ebe255c9 tempest-ProjectMemberTests-1095658523 None] Deleting offline snapshot b1c23c48-d2db-4568-a5bc-c40a6046ab0d of volume 8e82425f-9be0-45dd-9ff2-5b08bd8c5114 {{(pid=86212) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 22 15:57:33 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-62c5eb21-20ee-4ba8-8bab-bdc9ebe255c9 tempest-ProjectMemberTests-1095658523 None] snapshot_file for this snap is: volume-8e82425f-9be0-45dd-9ff2-5b08bd8c5114.b1c23c48-d2db-4568-a5bc-c40a6046ab0d {{(pid=86212) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 22 15:57:33 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[6daf3dc6-76e9-432c-a417-f41aee43bd5f]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:57:33 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-62c5eb21-20ee-4ba8-8bab-bdc9ebe255c9 tempest-ProjectMemberTests-1095658523 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8e82425f-9be0-45dd-9ff2-5b08bd8c5114.b1c23c48-d2db-4568-a5bc-c40a6046ab0d {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:57:33 devstack sudo[105354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8e82425f-9be0-45dd-9ff2-5b08bd8c5114.b1c23c48-d2db-4568-a5bc-c40a6046ab0d Sep 22 15:57:33 devstack sudo[105354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:57:33 devstack sudo[105354]: pam_unix(sudo:session): session closed for user root Sep 22 15:57:33 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-62c5eb21-20ee-4ba8-8bab-bdc9ebe255c9 tempest-ProjectMemberTests-1095658523 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8e82425f-9be0-45dd-9ff2-5b08bd8c5114.b1c23c48-d2db-4568-a5bc-c40a6046ab0d" returned: 0 in 0.361s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:57:33 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-62c5eb21-20ee-4ba8-8bab-bdc9ebe255c9 tempest-ProjectMemberTests-1095658523 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8e82425f-9be0-45dd-9ff2-5b08bd8c5114(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86212) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 22 15:57:33 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[666ccc42-a113-4469-a7d3-c524b5a8cd54]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:57:33 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-62c5eb21-20ee-4ba8-8bab-bdc9ebe255c9 tempest-ProjectMemberTests-1095658523 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8e82425f-9be0-45dd-9ff2-5b08bd8c5114 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:57:33 devstack sudo[105360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8e82425f-9be0-45dd-9ff2-5b08bd8c5114 Sep 22 15:57:33 devstack sudo[105360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:57:34 devstack sudo[105360]: pam_unix(sudo:session): session closed for user root Sep 22 15:57:34 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-62c5eb21-20ee-4ba8-8bab-bdc9ebe255c9 tempest-ProjectMemberTests-1095658523 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8e82425f-9be0-45dd-9ff2-5b08bd8c5114" returned: 0 in 0.419s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:57:34 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-62c5eb21-20ee-4ba8-8bab-bdc9ebe255c9 tempest-ProjectMemberTests-1095658523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8e82425f-9be0-45dd-9ff2-5b08bd8c5114.b1c23c48-d2db-4568-a5bc-c40a6046ab0d {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:57:34 devstack sudo[105365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8e82425f-9be0-45dd-9ff2-5b08bd8c5114.b1c23c48-d2db-4568-a5bc-c40a6046ab0d Sep 22 15:57:34 devstack sudo[105365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:57:34 devstack sudo[105365]: pam_unix(sudo:session): session closed for user root Sep 22 15:57:34 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-62c5eb21-20ee-4ba8-8bab-bdc9ebe255c9 tempest-ProjectMemberTests-1095658523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8e82425f-9be0-45dd-9ff2-5b08bd8c5114.b1c23c48-d2db-4568-a5bc-c40a6046ab0d" returned: 0 in 0.357s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:57:34 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-62c5eb21-20ee-4ba8-8bab-bdc9ebe255c9 tempest-ProjectMemberTests-1095658523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8e82425f-9be0-45dd-9ff2-5b08bd8c5114.b1c23c48-d2db-4568-a5bc-c40a6046ab0d {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:57:34 devstack sudo[105371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8e82425f-9be0-45dd-9ff2-5b08bd8c5114.b1c23c48-d2db-4568-a5bc-c40a6046ab0d Sep 22 15:57:34 devstack sudo[105371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:57:34 devstack sudo[105371]: pam_unix(sudo:session): session closed for user root Sep 22 15:57:34 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-62c5eb21-20ee-4ba8-8bab-bdc9ebe255c9 tempest-ProjectMemberTests-1095658523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8e82425f-9be0-45dd-9ff2-5b08bd8c5114.b1c23c48-d2db-4568-a5bc-c40a6046ab0d" returned: 0 in 0.300s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:57:34 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-62c5eb21-20ee-4ba8-8bab-bdc9ebe255c9 tempest-ProjectMemberTests-1095658523 None] Lock "cinder-quobyte-b1c23c48-d2db-4568-a5bc-c40a6046ab0d" released by "_delete_snapshot" :: held 1.567s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:57:34 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-62c5eb21-20ee-4ba8-8bab-bdc9ebe255c9 tempest-ProjectMemberTests-1095658523 None] Lock "cinder-quobyte-8e82425f-9be0-45dd-9ff2-5b08bd8c5114" released by "delete_snapshot" :: held 1.588s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:57:34 devstack cinder-volume[86212]: DEBUG cinder.quota [None req-62c5eb21-20ee-4ba8-8bab-bdc9ebe255c9 tempest-ProjectMemberTests-1095658523 None] Created reservations ['1d299584-364b-4ece-b31d-870509dca5c4', 'cfc098a3-eb9c-4838-9248-9807644ac6a6', '624fe01a-b682-4a00-8b5a-5d7307de16ac', 'fdb5c35d-8cf1-495e-a841-2153772323f6'] {{(pid=86212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 15:57:35 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-62c5eb21-20ee-4ba8-8bab-bdc9ebe255c9 tempest-ProjectMemberTests-1095658523 None] Delete snapshot completed successfully. Sep 22 15:57:35 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-62c5eb21-20ee-4ba8-8bab-bdc9ebe255c9 tempest-ProjectMemberTests-1095658523 None] Lock "cinder-b1c23c48-d2db-4568-a5bc-c40a6046ab0d-delete_snapshot" released by "delete_snapshot" :: held 1.730s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:57:35 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-2fc326ec-099b-40df-94dd-63886bc87fb5 tempest-ProjectMemberTests-1095658523 None] Acquiring lock "cinder-8e82425f-9be0-45dd-9ff2-5b08bd8c5114-delete_volume" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:57:35 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-2fc326ec-099b-40df-94dd-63886bc87fb5 tempest-ProjectMemberTests-1095658523 None] Lock "cinder-8e82425f-9be0-45dd-9ff2-5b08bd8c5114-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:57:35 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-2fc326ec-099b-40df-94dd-63886bc87fb5 tempest-ProjectMemberTests-1095658523 None] Acquiring lock "cinder-quobyte-8e82425f-9be0-45dd-9ff2-5b08bd8c5114" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:57:35 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-2fc326ec-099b-40df-94dd-63886bc87fb5 tempest-ProjectMemberTests-1095658523 None] Lock "cinder-quobyte-8e82425f-9be0-45dd-9ff2-5b08bd8c5114" acquired by "delete_volume" :: waited 0.019s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:57:35 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[d730146e-1d0c-473b-bcb2-645b273e482e]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:57:35 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-2fc326ec-099b-40df-94dd-63886bc87fb5 tempest-ProjectMemberTests-1095658523 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8e82425f-9be0-45dd-9ff2-5b08bd8c5114 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:57:35 devstack sudo[105374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8e82425f-9be0-45dd-9ff2-5b08bd8c5114 Sep 22 15:57:35 devstack sudo[105374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:57:36 devstack sudo[105374]: pam_unix(sudo:session): session closed for user root Sep 22 15:57:36 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-2fc326ec-099b-40df-94dd-63886bc87fb5 tempest-ProjectMemberTests-1095658523 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8e82425f-9be0-45dd-9ff2-5b08bd8c5114" returned: 0 in 0.410s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:57:36 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-2fc326ec-099b-40df-94dd-63886bc87fb5 tempest-ProjectMemberTests-1095658523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8e82425f-9be0-45dd-9ff2-5b08bd8c5114 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:57:36 devstack sudo[105379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8e82425f-9be0-45dd-9ff2-5b08bd8c5114 Sep 22 15:57:36 devstack sudo[105379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:57:36 devstack sudo[105379]: pam_unix(sudo:session): session closed for user root Sep 22 15:57:36 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-2fc326ec-099b-40df-94dd-63886bc87fb5 tempest-ProjectMemberTests-1095658523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8e82425f-9be0-45dd-9ff2-5b08bd8c5114" returned: 0 in 0.250s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:57:36 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-2fc326ec-099b-40df-94dd-63886bc87fb5 tempest-ProjectMemberTests-1095658523 None] Lock "cinder-quobyte-8e82425f-9be0-45dd-9ff2-5b08bd8c5114" released by "delete_volume" :: held 0.756s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:57:36 devstack cinder-volume[86212]: DEBUG cinder.quota [None req-2fc326ec-099b-40df-94dd-63886bc87fb5 tempest-ProjectMemberTests-1095658523 None] Created reservations ['766d5952-f119-41eb-8adb-7d661cc818a6', 'cf770738-43b4-420a-8ac2-ff6c26afb331', 'a476122c-e8f4-49a6-9e8a-678264ff2b1c', 'a9fe456f-30b8-4819-946e-bb4c69642424'] {{(pid=86212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 15:57:36 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-2fc326ec-099b-40df-94dd-63886bc87fb5 tempest-ProjectMemberTests-1095658523 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:57:36 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-2fc326ec-099b-40df-94dd-63886bc87fb5 tempest-ProjectMemberTests-1095658523 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:57:36 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-2fc326ec-099b-40df-94dd-63886bc87fb5 tempest-ProjectMemberTests-1095658523 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:57:36 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-2fc326ec-099b-40df-94dd-63886bc87fb5 tempest-ProjectMemberTests-1095658523 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:57:36 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-2fc326ec-099b-40df-94dd-63886bc87fb5 tempest-ProjectMemberTests-1095658523 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:57:36 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-2fc326ec-099b-40df-94dd-63886bc87fb5 tempest-ProjectMemberTests-1095658523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:57:36 devstack sudo[105382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc Sep 22 15:57:36 devstack sudo[105382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:57:36 devstack sudo[105382]: pam_unix(sudo:session): session closed for user root Sep 22 15:57:36 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-2fc326ec-099b-40df-94dd-63886bc87fb5 tempest-ProjectMemberTests-1095658523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc" returned: 0 in 0.273s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:57:36 devstack cinder-volume[86212]: DEBUG cinder.manager [None req-2fc326ec-099b-40df-94dd-63886bc87fb5 tempest-ProjectMemberTests-1095658523 None] Notifying Schedulers of capabilities ... {{(pid=86212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 15:57:36 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-2fc326ec-099b-40df-94dd-63886bc87fb5 tempest-ProjectMemberTests-1095658523 None] Deleted volume successfully. Sep 22 15:57:36 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-2fc326ec-099b-40df-94dd-63886bc87fb5 tempest-ProjectMemberTests-1095658523 None] Lock "cinder-8e82425f-9be0-45dd-9ff2-5b08bd8c5114-delete_volume" released by "delete_volume" :: held 1.260s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:57:37 devstack cinder-volume[86212]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c2b7235-fb51-46d2-bc87-cfb265b367b1 tempest-ProjectMemberTests-1095658523 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 15:57:37 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-2c2b7235-fb51-46d2-bc87-cfb265b367b1 tempest-ProjectMemberTests-1095658523 None] Flow 'volume_create_manager' (7e8a1d5c-754e-4be5-848b-73d31ecc3a59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:57:37 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-2c2b7235-fb51-46d2-bc87-cfb265b367b1 tempest-ProjectMemberTests-1095658523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e838de7a-863e-42f5-926a-ee161e794043) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:57:37 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-2c2b7235-fb51-46d2-bc87-cfb265b367b1 tempest-ProjectMemberTests-1095658523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e838de7a-863e-42f5-926a-ee161e794043) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:57:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1345091081',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6dd5fd0e-33c9-4e93-bff6-39c08e5de3ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e3beb47e92e4a8c9efa3433374c2e0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:57:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:57:37Z,use_quota=True,user_id='c4cc884fb51643ee9efb176f88d0543f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:57:37 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-2c2b7235-fb51-46d2-bc87-cfb265b367b1 tempest-ProjectMemberTests-1095658523 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6082d891-c8c2-4d9d-ad8c-edddcc8a02bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:57:37 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-2c2b7235-fb51-46d2-bc87-cfb265b367b1 tempest-ProjectMemberTests-1095658523 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6082d891-c8c2-4d9d-ad8c-edddcc8a02bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:57:37 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-2c2b7235-fb51-46d2-bc87-cfb265b367b1 tempest-ProjectMemberTests-1095658523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d8aec65-af7e-488b-8f1a-8d100f38069f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:57:37 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-2c2b7235-fb51-46d2-bc87-cfb265b367b1 tempest-ProjectMemberTests-1095658523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d8aec65-af7e-488b-8f1a-8d100f38069f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6dd5fd0e-33c9-4e93-bff6-39c08e5de3ad', 'volume_name': 'volume-6dd5fd0e-33c9-4e93-bff6-39c08e5de3ad', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:57:37 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-2c2b7235-fb51-46d2-bc87-cfb265b367b1 tempest-ProjectMemberTests-1095658523 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7050bb9b-3d1f-418b-84e3-8f10a123b480) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:57:37 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-2c2b7235-fb51-46d2-bc87-cfb265b367b1 tempest-ProjectMemberTests-1095658523 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7050bb9b-3d1f-418b-84e3-8f10a123b480) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:57:37 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-2c2b7235-fb51-46d2-bc87-cfb265b367b1 tempest-ProjectMemberTests-1095658523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76391c8e-e68a-48f6-b21a-db266e912694) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:57:37 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-2c2b7235-fb51-46d2-bc87-cfb265b367b1 tempest-ProjectMemberTests-1095658523 None] Volume 6dd5fd0e-33c9-4e93-bff6-39c08e5de3ad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6dd5fd0e-33c9-4e93-bff6-39c08e5de3ad', 'volume_size': 1} Sep 22 15:57:37 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-2c2b7235-fb51-46d2-bc87-cfb265b367b1 tempest-ProjectMemberTests-1095658523 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:57:37 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-2c2b7235-fb51-46d2-bc87-cfb265b367b1 tempest-ProjectMemberTests-1095658523 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:57:37 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-2c2b7235-fb51-46d2-bc87-cfb265b367b1 tempest-ProjectMemberTests-1095658523 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:57:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1345091081',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6dd5fd0e-33c9-4e93-bff6-39c08e5de3ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e3beb47e92e4a8c9efa3433374c2e0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:57:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:57:37Z,use_quota=True,user_id='c4cc884fb51643ee9efb176f88d0543f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)}" {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 15:57:37 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-2c2b7235-fb51-46d2-bc87-cfb265b367b1 tempest-ProjectMemberTests-1095658523 None] Creating volume 6dd5fd0e-33c9-4e93-bff6-39c08e5de3ad {{(pid=86212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 15:57:37 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-2c2b7235-fb51-46d2-bc87-cfb265b367b1 tempest-ProjectMemberTests-1095658523 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:57:37 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-2c2b7235-fb51-46d2-bc87-cfb265b367b1 tempest-ProjectMemberTests-1095658523 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:57:37 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-2c2b7235-fb51-46d2-bc87-cfb265b367b1 tempest-ProjectMemberTests-1095658523 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:57:37 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-2c2b7235-fb51-46d2-bc87-cfb265b367b1 tempest-ProjectMemberTests-1095658523 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:57:37 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-2c2b7235-fb51-46d2-bc87-cfb265b367b1 tempest-ProjectMemberTests-1095658523 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:57:37 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-2c2b7235-fb51-46d2-bc87-cfb265b367b1 tempest-ProjectMemberTests-1095658523 None] Selected osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 as target Quobyte volume. {{(pid=86212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 15:57:37 devstack cinder-volume[86212]: INFO cinder.volume.drivers.remotefs [None req-2c2b7235-fb51-46d2-bc87-cfb265b367b1 tempest-ProjectMemberTests-1095658523 None] casted to osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 Sep 22 15:57:37 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-2c2b7235-fb51-46d2-bc87-cfb265b367b1 tempest-ProjectMemberTests-1095658523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-6dd5fd0e-33c9-4e93-bff6-39c08e5de3ad 1073741824 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:57:37 devstack sudo[105385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-6dd5fd0e-33c9-4e93-bff6-39c08e5de3ad 1073741824 Sep 22 15:57:37 devstack sudo[105385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:57:37 devstack sudo[105385]: pam_unix(sudo:session): session closed for user root Sep 22 15:57:37 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-2c2b7235-fb51-46d2-bc87-cfb265b367b1 tempest-ProjectMemberTests-1095658523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-6dd5fd0e-33c9-4e93-bff6-39c08e5de3ad 1073741824" returned: 0 in 0.391s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:57:37 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-2c2b7235-fb51-46d2-bc87-cfb265b367b1 tempest-ProjectMemberTests-1095658523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-6dd5fd0e-33c9-4e93-bff6-39c08e5de3ad {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:57:37 devstack sudo[105390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-6dd5fd0e-33c9-4e93-bff6-39c08e5de3ad Sep 22 15:57:37 devstack sudo[105390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:57:37 devstack sudo[105390]: pam_unix(sudo:session): session closed for user root Sep 22 15:57:37 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-2c2b7235-fb51-46d2-bc87-cfb265b367b1 tempest-ProjectMemberTests-1095658523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-6dd5fd0e-33c9-4e93-bff6-39c08e5de3ad" returned: 0 in 0.241s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:57:37 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-2c2b7235-fb51-46d2-bc87-cfb265b367b1 tempest-ProjectMemberTests-1095658523 None] <== create_volume: return (671ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'} {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 15:57:37 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-2c2b7235-fb51-46d2-bc87-cfb265b367b1 tempest-ProjectMemberTests-1095658523 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.673s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:57:37 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-2c2b7235-fb51-46d2-bc87-cfb265b367b1 tempest-ProjectMemberTests-1095658523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76391c8e-e68a-48f6-b21a-db266e912694) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6dd5fd0e-33c9-4e93-bff6-39c08e5de3ad', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:57:37 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-2c2b7235-fb51-46d2-bc87-cfb265b367b1 tempest-ProjectMemberTests-1095658523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f941874-5540-4629-bbe5-f80f254011c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:57:37 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-2c2b7235-fb51-46d2-bc87-cfb265b367b1 tempest-ProjectMemberTests-1095658523 None] Volume volume-6dd5fd0e-33c9-4e93-bff6-39c08e5de3ad (6dd5fd0e-33c9-4e93-bff6-39c08e5de3ad): created successfully Sep 22 15:57:37 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-2c2b7235-fb51-46d2-bc87-cfb265b367b1 tempest-ProjectMemberTests-1095658523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f941874-5540-4629-bbe5-f80f254011c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:57:37 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-2c2b7235-fb51-46d2-bc87-cfb265b367b1 tempest-ProjectMemberTests-1095658523 None] Flow 'volume_create_manager' (7e8a1d5c-754e-4be5-848b-73d31ecc3a59) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:57:37 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-2c2b7235-fb51-46d2-bc87-cfb265b367b1 tempest-ProjectMemberTests-1095658523 None] Created volume successfully. Sep 22 15:57:38 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-80db2ee8-3a1d-4d4b-9443-e1d6c83d7533 tempest-ProjectMemberTests-1095658523 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:57:38 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-80db2ee8-3a1d-4d4b-9443-e1d6c83d7533 tempest-ProjectMemberTests-1095658523 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:57:38 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-80db2ee8-3a1d-4d4b-9443-e1d6c83d7533 tempest-ProjectMemberTests-1095658523 None] Creating offline snapshot 6ae66b53-1538-4f9c-ba4e-70c2eac0bdca of volume 6dd5fd0e-33c9-4e93-bff6-39c08e5de3ad {{(pid=86212) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 22 15:57:38 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f997068-5dfb-4e55-a4ed-9bcee3769f57]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:57:38 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-80db2ee8-3a1d-4d4b-9443-e1d6c83d7533 tempest-ProjectMemberTests-1095658523 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-6dd5fd0e-33c9-4e93-bff6-39c08e5de3ad {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:57:38 devstack sudo[105394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-6dd5fd0e-33c9-4e93-bff6-39c08e5de3ad Sep 22 15:57:38 devstack sudo[105394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:57:38 devstack cinder-volume[86212]: DEBUG oslo_service.periodic_task [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86212) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 22 15:57:38 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:57:38 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:57:38 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:57:38 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:57:38 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:57:38 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:57:38 devstack sudo[105396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc Sep 22 15:57:38 devstack sudo[105396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:57:38 devstack sudo[105394]: pam_unix(sudo:session): session closed for user root Sep 22 15:57:38 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-80db2ee8-3a1d-4d4b-9443-e1d6c83d7533 tempest-ProjectMemberTests-1095658523 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-6dd5fd0e-33c9-4e93-bff6-39c08e5de3ad" returned: 0 in 0.365s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:57:38 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-80db2ee8-3a1d-4d4b-9443-e1d6c83d7533 tempest-ProjectMemberTests-1095658523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-6dd5fd0e-33c9-4e93-bff6-39c08e5de3ad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-6dd5fd0e-33c9-4e93-bff6-39c08e5de3ad.6ae66b53-1538-4f9c-ba4e-70c2eac0bdca 1G {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:57:38 devstack sudo[105401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-6dd5fd0e-33c9-4e93-bff6-39c08e5de3ad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-6dd5fd0e-33c9-4e93-bff6-39c08e5de3ad.6ae66b53-1538-4f9c-ba4e-70c2eac0bdca 1G Sep 22 15:57:38 devstack sudo[105401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:57:38 devstack sudo[105396]: pam_unix(sudo:session): session closed for user root Sep 22 15:57:38 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc" returned: 0 in 0.257s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:57:38 devstack cinder-volume[86212]: DEBUG cinder.manager [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] Notifying Schedulers of capabilities ... {{(pid=86212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 15:57:38 devstack cinder-volume[86212]: DEBUG oslo_service.periodic_task [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] Running periodic task VolumeManager._thread_info {{(pid=86212) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 22 15:57:38 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] thread count: 29 {{(pid=86212) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 22 15:57:38 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] thread info: [<_MainThread(MainThread, started 136163191222400)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86212) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 22 15:57:39 devstack sudo[105401]: pam_unix(sudo:session): session closed for user root Sep 22 15:57:39 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-80db2ee8-3a1d-4d4b-9443-e1d6c83d7533 tempest-ProjectMemberTests-1095658523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-6dd5fd0e-33c9-4e93-bff6-39c08e5de3ad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-6dd5fd0e-33c9-4e93-bff6-39c08e5de3ad.6ae66b53-1538-4f9c-ba4e-70c2eac0bdca 1G" returned: 0 in 0.385s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:57:39 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-80db2ee8-3a1d-4d4b-9443-e1d6c83d7533 tempest-ProjectMemberTests-1095658523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6dd5fd0e-33c9-4e93-bff6-39c08e5de3ad -F qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-6dd5fd0e-33c9-4e93-bff6-39c08e5de3ad.6ae66b53-1538-4f9c-ba4e-70c2eac0bdca {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:57:39 devstack sudo[105408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6dd5fd0e-33c9-4e93-bff6-39c08e5de3ad -F qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-6dd5fd0e-33c9-4e93-bff6-39c08e5de3ad.6ae66b53-1538-4f9c-ba4e-70c2eac0bdca Sep 22 15:57:39 devstack sudo[105408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:57:39 devstack sudo[105408]: pam_unix(sudo:session): session closed for user root Sep 22 15:57:39 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-80db2ee8-3a1d-4d4b-9443-e1d6c83d7533 tempest-ProjectMemberTests-1095658523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6dd5fd0e-33c9-4e93-bff6-39c08e5de3ad -F qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-6dd5fd0e-33c9-4e93-bff6-39c08e5de3ad.6ae66b53-1538-4f9c-ba4e-70c2eac0bdca" returned: 0 in 0.279s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:57:39 devstack cinder-volume[86212]: WARNING cinder.volume.drivers.remotefs [None req-80db2ee8-3a1d-4d4b-9443-e1d6c83d7533 tempest-ProjectMemberTests-1095658523 None] /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-6dd5fd0e-33c9-4e93-bff6-39c08e5de3ad.6ae66b53-1538-4f9c-ba4e-70c2eac0bdca is being set with open permissions: ugo+rw Sep 22 15:57:39 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-80db2ee8-3a1d-4d4b-9443-e1d6c83d7533 tempest-ProjectMemberTests-1095658523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-6dd5fd0e-33c9-4e93-bff6-39c08e5de3ad.6ae66b53-1538-4f9c-ba4e-70c2eac0bdca {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:57:39 devstack sudo[105413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-6dd5fd0e-33c9-4e93-bff6-39c08e5de3ad.6ae66b53-1538-4f9c-ba4e-70c2eac0bdca Sep 22 15:57:39 devstack sudo[105413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:57:39 devstack sudo[105413]: pam_unix(sudo:session): session closed for user root Sep 22 15:57:39 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-80db2ee8-3a1d-4d4b-9443-e1d6c83d7533 tempest-ProjectMemberTests-1095658523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-6dd5fd0e-33c9-4e93-bff6-39c08e5de3ad.6ae66b53-1538-4f9c-ba4e-70c2eac0bdca" returned: 0 in 0.233s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:57:39 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-80db2ee8-3a1d-4d4b-9443-e1d6c83d7533 tempest-ProjectMemberTests-1095658523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-6dd5fd0e-33c9-4e93-bff6-39c08e5de3ad.info {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:57:39 devstack sudo[105416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-6dd5fd0e-33c9-4e93-bff6-39c08e5de3ad.info Sep 22 15:57:39 devstack sudo[105416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:57:39 devstack sudo[105416]: pam_unix(sudo:session): session closed for user root Sep 22 15:57:39 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-80db2ee8-3a1d-4d4b-9443-e1d6c83d7533 tempest-ProjectMemberTests-1095658523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-6dd5fd0e-33c9-4e93-bff6-39c08e5de3ad.info" returned: 0 in 0.243s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:57:39 devstack cinder-volume[86212]: WARNING cinder.volume.drivers.remotefs [None req-80db2ee8-3a1d-4d4b-9443-e1d6c83d7533 tempest-ProjectMemberTests-1095658523 None] /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-6dd5fd0e-33c9-4e93-bff6-39c08e5de3ad.info is being set with open permissions: ugo+rw Sep 22 15:57:39 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-80db2ee8-3a1d-4d4b-9443-e1d6c83d7533 tempest-ProjectMemberTests-1095658523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-6dd5fd0e-33c9-4e93-bff6-39c08e5de3ad.info {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:57:39 devstack sudo[105419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-6dd5fd0e-33c9-4e93-bff6-39c08e5de3ad.info Sep 22 15:57:39 devstack sudo[105419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:57:40 devstack sudo[105419]: pam_unix(sudo:session): session closed for user root Sep 22 15:57:40 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-80db2ee8-3a1d-4d4b-9443-e1d6c83d7533 tempest-ProjectMemberTests-1095658523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-6dd5fd0e-33c9-4e93-bff6-39c08e5de3ad.info" returned: 0 in 0.230s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:57:40 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-80db2ee8-3a1d-4d4b-9443-e1d6c83d7533 tempest-ProjectMemberTests-1095658523 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.808s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:57:40 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-80db2ee8-3a1d-4d4b-9443-e1d6c83d7533 tempest-ProjectMemberTests-1095658523 None] Create snapshot completed successfully Sep 22 15:57:40 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-a4c30677-5a63-456a-8c91-b886fe1abf12 tempest-ProjectMemberTests-1095658523 None] Acquiring lock "cinder-6ae66b53-1538-4f9c-ba4e-70c2eac0bdca-delete_snapshot" by "delete_snapshot" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:57:40 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-a4c30677-5a63-456a-8c91-b886fe1abf12 tempest-ProjectMemberTests-1095658523 None] Lock "cinder-6ae66b53-1538-4f9c-ba4e-70c2eac0bdca-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:57:40 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-a4c30677-5a63-456a-8c91-b886fe1abf12 tempest-ProjectMemberTests-1095658523 None] Acquiring lock "cinder-quobyte-6dd5fd0e-33c9-4e93-bff6-39c08e5de3ad" by "delete_snapshot" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:57:40 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-a4c30677-5a63-456a-8c91-b886fe1abf12 tempest-ProjectMemberTests-1095658523 None] Lock "cinder-quobyte-6dd5fd0e-33c9-4e93-bff6-39c08e5de3ad" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:57:40 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-a4c30677-5a63-456a-8c91-b886fe1abf12 tempest-ProjectMemberTests-1095658523 None] Acquiring lock "cinder-quobyte-6ae66b53-1538-4f9c-ba4e-70c2eac0bdca" by "_delete_snapshot" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:57:40 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-a4c30677-5a63-456a-8c91-b886fe1abf12 tempest-ProjectMemberTests-1095658523 None] Lock "cinder-quobyte-6ae66b53-1538-4f9c-ba4e-70c2eac0bdca" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:57:40 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-a4c30677-5a63-456a-8c91-b886fe1abf12 tempest-ProjectMemberTests-1095658523 None] Deleting offline snapshot 6ae66b53-1538-4f9c-ba4e-70c2eac0bdca of volume 6dd5fd0e-33c9-4e93-bff6-39c08e5de3ad {{(pid=86212) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 22 15:57:40 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-a4c30677-5a63-456a-8c91-b886fe1abf12 tempest-ProjectMemberTests-1095658523 None] snapshot_file for this snap is: volume-6dd5fd0e-33c9-4e93-bff6-39c08e5de3ad.6ae66b53-1538-4f9c-ba4e-70c2eac0bdca {{(pid=86212) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 22 15:57:40 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[281ec9c7-e315-4c6a-9db3-5dedcffbf4a5]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:57:40 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-a4c30677-5a63-456a-8c91-b886fe1abf12 tempest-ProjectMemberTests-1095658523 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-6dd5fd0e-33c9-4e93-bff6-39c08e5de3ad.6ae66b53-1538-4f9c-ba4e-70c2eac0bdca {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:57:40 devstack sudo[105422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-6dd5fd0e-33c9-4e93-bff6-39c08e5de3ad.6ae66b53-1538-4f9c-ba4e-70c2eac0bdca Sep 22 15:57:40 devstack sudo[105422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:57:40 devstack sudo[105422]: pam_unix(sudo:session): session closed for user root Sep 22 15:57:40 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-a4c30677-5a63-456a-8c91-b886fe1abf12 tempest-ProjectMemberTests-1095658523 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-6dd5fd0e-33c9-4e93-bff6-39c08e5de3ad.6ae66b53-1538-4f9c-ba4e-70c2eac0bdca" returned: 0 in 0.349s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:57:40 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-a4c30677-5a63-456a-8c91-b886fe1abf12 tempest-ProjectMemberTests-1095658523 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6dd5fd0e-33c9-4e93-bff6-39c08e5de3ad(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86212) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 22 15:57:40 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d5487fa-3d17-412a-bbd3-2100ae327c58]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:57:40 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-a4c30677-5a63-456a-8c91-b886fe1abf12 tempest-ProjectMemberTests-1095658523 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-6dd5fd0e-33c9-4e93-bff6-39c08e5de3ad {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:57:40 devstack sudo[105427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-6dd5fd0e-33c9-4e93-bff6-39c08e5de3ad Sep 22 15:57:40 devstack sudo[105427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:57:41 devstack sudo[105427]: pam_unix(sudo:session): session closed for user root Sep 22 15:57:41 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-a4c30677-5a63-456a-8c91-b886fe1abf12 tempest-ProjectMemberTests-1095658523 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-6dd5fd0e-33c9-4e93-bff6-39c08e5de3ad" returned: 0 in 0.347s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:57:41 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-a4c30677-5a63-456a-8c91-b886fe1abf12 tempest-ProjectMemberTests-1095658523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-6dd5fd0e-33c9-4e93-bff6-39c08e5de3ad.6ae66b53-1538-4f9c-ba4e-70c2eac0bdca {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:57:41 devstack sudo[105432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-6dd5fd0e-33c9-4e93-bff6-39c08e5de3ad.6ae66b53-1538-4f9c-ba4e-70c2eac0bdca Sep 22 15:57:41 devstack sudo[105432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:57:41 devstack sudo[105432]: pam_unix(sudo:session): session closed for user root Sep 22 15:57:41 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-a4c30677-5a63-456a-8c91-b886fe1abf12 tempest-ProjectMemberTests-1095658523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-6dd5fd0e-33c9-4e93-bff6-39c08e5de3ad.6ae66b53-1538-4f9c-ba4e-70c2eac0bdca" returned: 0 in 0.319s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:57:41 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-a4c30677-5a63-456a-8c91-b886fe1abf12 tempest-ProjectMemberTests-1095658523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-6dd5fd0e-33c9-4e93-bff6-39c08e5de3ad.6ae66b53-1538-4f9c-ba4e-70c2eac0bdca {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:57:41 devstack sudo[105438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-6dd5fd0e-33c9-4e93-bff6-39c08e5de3ad.6ae66b53-1538-4f9c-ba4e-70c2eac0bdca Sep 22 15:57:41 devstack sudo[105438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:57:41 devstack sudo[105438]: pam_unix(sudo:session): session closed for user root Sep 22 15:57:41 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-a4c30677-5a63-456a-8c91-b886fe1abf12 tempest-ProjectMemberTests-1095658523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-6dd5fd0e-33c9-4e93-bff6-39c08e5de3ad.6ae66b53-1538-4f9c-ba4e-70c2eac0bdca" returned: 0 in 0.241s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:57:41 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-a4c30677-5a63-456a-8c91-b886fe1abf12 tempest-ProjectMemberTests-1095658523 None] Lock "cinder-quobyte-6ae66b53-1538-4f9c-ba4e-70c2eac0bdca" released by "_delete_snapshot" :: held 1.353s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:57:41 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-a4c30677-5a63-456a-8c91-b886fe1abf12 tempest-ProjectMemberTests-1095658523 None] Lock "cinder-quobyte-6dd5fd0e-33c9-4e93-bff6-39c08e5de3ad" released by "delete_snapshot" :: held 1.374s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:57:41 devstack cinder-volume[86212]: DEBUG cinder.quota [None req-a4c30677-5a63-456a-8c91-b886fe1abf12 tempest-ProjectMemberTests-1095658523 None] Created reservations ['753cca65-d13b-4caf-9dc1-ccdeb403bf20', '26b487c3-7d46-4585-b7de-fa1970c242dc', '07f118a3-7e9e-4332-8a6f-0fceb691e355', '71ecd016-a88e-4e4a-8172-da2e2a35476a'] {{(pid=86212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 15:57:41 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-a4c30677-5a63-456a-8c91-b886fe1abf12 tempest-ProjectMemberTests-1095658523 None] Delete snapshot completed successfully. Sep 22 15:57:41 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-a4c30677-5a63-456a-8c91-b886fe1abf12 tempest-ProjectMemberTests-1095658523 None] Lock "cinder-6ae66b53-1538-4f9c-ba4e-70c2eac0bdca-delete_snapshot" released by "delete_snapshot" :: held 1.502s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:57:42 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-fc1ef9de-0833-4853-a9f2-064f032b4f2f tempest-ProjectMemberTests-1095658523 None] Acquiring lock "cinder-6dd5fd0e-33c9-4e93-bff6-39c08e5de3ad-delete_volume" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:57:42 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-fc1ef9de-0833-4853-a9f2-064f032b4f2f tempest-ProjectMemberTests-1095658523 None] Lock "cinder-6dd5fd0e-33c9-4e93-bff6-39c08e5de3ad-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:57:42 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-fc1ef9de-0833-4853-a9f2-064f032b4f2f tempest-ProjectMemberTests-1095658523 None] Acquiring lock "cinder-quobyte-6dd5fd0e-33c9-4e93-bff6-39c08e5de3ad" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:57:42 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-fc1ef9de-0833-4853-a9f2-064f032b4f2f tempest-ProjectMemberTests-1095658523 None] Lock "cinder-quobyte-6dd5fd0e-33c9-4e93-bff6-39c08e5de3ad" acquired by "delete_volume" :: waited 0.014s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:57:42 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ee560f6-e564-4654-81e3-69cf97f0edb9]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:57:42 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-fc1ef9de-0833-4853-a9f2-064f032b4f2f tempest-ProjectMemberTests-1095658523 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-6dd5fd0e-33c9-4e93-bff6-39c08e5de3ad {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:57:42 devstack sudo[105441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-6dd5fd0e-33c9-4e93-bff6-39c08e5de3ad Sep 22 15:57:42 devstack sudo[105441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:57:42 devstack sudo[105441]: pam_unix(sudo:session): session closed for user root Sep 22 15:57:42 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-fc1ef9de-0833-4853-a9f2-064f032b4f2f tempest-ProjectMemberTests-1095658523 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-6dd5fd0e-33c9-4e93-bff6-39c08e5de3ad" returned: 0 in 0.348s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:57:42 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-fc1ef9de-0833-4853-a9f2-064f032b4f2f tempest-ProjectMemberTests-1095658523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-6dd5fd0e-33c9-4e93-bff6-39c08e5de3ad {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:57:42 devstack sudo[105446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-6dd5fd0e-33c9-4e93-bff6-39c08e5de3ad Sep 22 15:57:42 devstack sudo[105446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:57:43 devstack sudo[105446]: pam_unix(sudo:session): session closed for user root Sep 22 15:57:43 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-fc1ef9de-0833-4853-a9f2-064f032b4f2f tempest-ProjectMemberTests-1095658523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-6dd5fd0e-33c9-4e93-bff6-39c08e5de3ad" returned: 0 in 0.237s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:57:43 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-fc1ef9de-0833-4853-a9f2-064f032b4f2f tempest-ProjectMemberTests-1095658523 None] Lock "cinder-quobyte-6dd5fd0e-33c9-4e93-bff6-39c08e5de3ad" released by "delete_volume" :: held 0.642s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:57:43 devstack cinder-volume[86212]: DEBUG cinder.quota [None req-fc1ef9de-0833-4853-a9f2-064f032b4f2f tempest-ProjectMemberTests-1095658523 None] Created reservations ['d6142518-2108-475f-99d0-98282d6503cc', '1d4ef9c1-bd3a-4005-9c7a-96b432ec3012', '334b81fb-ccb7-4828-a470-43a6d94c6f00', '7db1dcc4-a2fc-4f47-92ca-d9747d7028cb'] {{(pid=86212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 15:57:43 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-fc1ef9de-0833-4853-a9f2-064f032b4f2f tempest-ProjectMemberTests-1095658523 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:57:43 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-fc1ef9de-0833-4853-a9f2-064f032b4f2f tempest-ProjectMemberTests-1095658523 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:57:43 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-fc1ef9de-0833-4853-a9f2-064f032b4f2f tempest-ProjectMemberTests-1095658523 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:57:43 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-fc1ef9de-0833-4853-a9f2-064f032b4f2f tempest-ProjectMemberTests-1095658523 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:57:43 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-fc1ef9de-0833-4853-a9f2-064f032b4f2f tempest-ProjectMemberTests-1095658523 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:57:43 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-fc1ef9de-0833-4853-a9f2-064f032b4f2f tempest-ProjectMemberTests-1095658523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:57:43 devstack sudo[105449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc Sep 22 15:57:43 devstack sudo[105449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:57:43 devstack sudo[105449]: pam_unix(sudo:session): session closed for user root Sep 22 15:57:43 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-fc1ef9de-0833-4853-a9f2-064f032b4f2f tempest-ProjectMemberTests-1095658523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc" returned: 0 in 0.236s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:57:43 devstack cinder-volume[86212]: DEBUG cinder.manager [None req-fc1ef9de-0833-4853-a9f2-064f032b4f2f tempest-ProjectMemberTests-1095658523 None] Notifying Schedulers of capabilities ... {{(pid=86212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 15:57:43 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-fc1ef9de-0833-4853-a9f2-064f032b4f2f tempest-ProjectMemberTests-1095658523 None] Deleted volume successfully. Sep 22 15:57:43 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-fc1ef9de-0833-4853-a9f2-064f032b4f2f tempest-ProjectMemberTests-1095658523 None] Lock "cinder-6dd5fd0e-33c9-4e93-bff6-39c08e5de3ad-delete_volume" released by "delete_volume" :: held 1.067s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:57:44 devstack cinder-volume[86212]: DEBUG cinder.volume.flows.manager.create_volume [None req-f967e85d-76e4-4323-b0d6-b6b58b66dc0f tempest-ProjectMemberTests-1095658523 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 15:57:44 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-f967e85d-76e4-4323-b0d6-b6b58b66dc0f tempest-ProjectMemberTests-1095658523 None] Flow 'volume_create_manager' (06a224c1-668b-4b31-a99a-64a2c06a435a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:57:44 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-f967e85d-76e4-4323-b0d6-b6b58b66dc0f tempest-ProjectMemberTests-1095658523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3333b87d-eb77-47d9-91ab-43e947e201cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:57:44 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-f967e85d-76e4-4323-b0d6-b6b58b66dc0f tempest-ProjectMemberTests-1095658523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3333b87d-eb77-47d9-91ab-43e947e201cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:57:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1965237955',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d514f3a9-040c-4961-b37e-1d792270f19b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e3beb47e92e4a8c9efa3433374c2e0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:57:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:57:44Z,use_quota=True,user_id='c4cc884fb51643ee9efb176f88d0543f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:57:44 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-f967e85d-76e4-4323-b0d6-b6b58b66dc0f tempest-ProjectMemberTests-1095658523 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c67f187e-e54b-4c3d-b1a0-18b4051cdea4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:57:44 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-f967e85d-76e4-4323-b0d6-b6b58b66dc0f tempest-ProjectMemberTests-1095658523 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c67f187e-e54b-4c3d-b1a0-18b4051cdea4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:57:44 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-f967e85d-76e4-4323-b0d6-b6b58b66dc0f tempest-ProjectMemberTests-1095658523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f34eea6d-e447-484d-985f-20ef85b9698a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:57:44 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-f967e85d-76e4-4323-b0d6-b6b58b66dc0f tempest-ProjectMemberTests-1095658523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f34eea6d-e447-484d-985f-20ef85b9698a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd514f3a9-040c-4961-b37e-1d792270f19b', 'volume_name': 'volume-d514f3a9-040c-4961-b37e-1d792270f19b', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:57:44 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-f967e85d-76e4-4323-b0d6-b6b58b66dc0f tempest-ProjectMemberTests-1095658523 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0cdf2987-9a5f-42f0-9ee6-ebb9abdcc278) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:57:44 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-f967e85d-76e4-4323-b0d6-b6b58b66dc0f tempest-ProjectMemberTests-1095658523 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0cdf2987-9a5f-42f0-9ee6-ebb9abdcc278) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:57:44 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-f967e85d-76e4-4323-b0d6-b6b58b66dc0f tempest-ProjectMemberTests-1095658523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b4bce45-2294-4439-a365-87e1b6297dac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:57:44 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-f967e85d-76e4-4323-b0d6-b6b58b66dc0f tempest-ProjectMemberTests-1095658523 None] Volume d514f3a9-040c-4961-b37e-1d792270f19b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d514f3a9-040c-4961-b37e-1d792270f19b', 'volume_size': 1} Sep 22 15:57:44 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-f967e85d-76e4-4323-b0d6-b6b58b66dc0f tempest-ProjectMemberTests-1095658523 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:57:44 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-f967e85d-76e4-4323-b0d6-b6b58b66dc0f tempest-ProjectMemberTests-1095658523 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:57:44 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-f967e85d-76e4-4323-b0d6-b6b58b66dc0f tempest-ProjectMemberTests-1095658523 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:57:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1965237955',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d514f3a9-040c-4961-b37e-1d792270f19b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e3beb47e92e4a8c9efa3433374c2e0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:57:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:57:44Z,use_quota=True,user_id='c4cc884fb51643ee9efb176f88d0543f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)}" {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 15:57:44 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-f967e85d-76e4-4323-b0d6-b6b58b66dc0f tempest-ProjectMemberTests-1095658523 None] Creating volume d514f3a9-040c-4961-b37e-1d792270f19b {{(pid=86212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 15:57:44 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-f967e85d-76e4-4323-b0d6-b6b58b66dc0f tempest-ProjectMemberTests-1095658523 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:57:44 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-f967e85d-76e4-4323-b0d6-b6b58b66dc0f tempest-ProjectMemberTests-1095658523 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:57:44 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-f967e85d-76e4-4323-b0d6-b6b58b66dc0f tempest-ProjectMemberTests-1095658523 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:57:44 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-f967e85d-76e4-4323-b0d6-b6b58b66dc0f tempest-ProjectMemberTests-1095658523 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:57:44 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-f967e85d-76e4-4323-b0d6-b6b58b66dc0f tempest-ProjectMemberTests-1095658523 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:57:44 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-f967e85d-76e4-4323-b0d6-b6b58b66dc0f tempest-ProjectMemberTests-1095658523 None] Selected osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 as target Quobyte volume. {{(pid=86212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 15:57:44 devstack cinder-volume[86212]: INFO cinder.volume.drivers.remotefs [None req-f967e85d-76e4-4323-b0d6-b6b58b66dc0f tempest-ProjectMemberTests-1095658523 None] casted to osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 Sep 22 15:57:44 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-f967e85d-76e4-4323-b0d6-b6b58b66dc0f tempest-ProjectMemberTests-1095658523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-d514f3a9-040c-4961-b37e-1d792270f19b 1073741824 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:57:44 devstack sudo[105489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-d514f3a9-040c-4961-b37e-1d792270f19b 1073741824 Sep 22 15:57:44 devstack sudo[105489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:57:44 devstack sudo[105489]: pam_unix(sudo:session): session closed for user root Sep 22 15:57:44 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-f967e85d-76e4-4323-b0d6-b6b58b66dc0f tempest-ProjectMemberTests-1095658523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-d514f3a9-040c-4961-b37e-1d792270f19b 1073741824" returned: 0 in 0.409s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:57:44 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-f967e85d-76e4-4323-b0d6-b6b58b66dc0f tempest-ProjectMemberTests-1095658523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-d514f3a9-040c-4961-b37e-1d792270f19b {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:57:44 devstack sudo[105494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-d514f3a9-040c-4961-b37e-1d792270f19b Sep 22 15:57:44 devstack sudo[105494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:57:44 devstack sudo[105494]: pam_unix(sudo:session): session closed for user root Sep 22 15:57:44 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-f967e85d-76e4-4323-b0d6-b6b58b66dc0f tempest-ProjectMemberTests-1095658523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-d514f3a9-040c-4961-b37e-1d792270f19b" returned: 0 in 0.238s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:57:44 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-f967e85d-76e4-4323-b0d6-b6b58b66dc0f tempest-ProjectMemberTests-1095658523 None] <== create_volume: return (692ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'} {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 15:57:44 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-f967e85d-76e4-4323-b0d6-b6b58b66dc0f tempest-ProjectMemberTests-1095658523 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.694s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:57:44 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-f967e85d-76e4-4323-b0d6-b6b58b66dc0f tempest-ProjectMemberTests-1095658523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b4bce45-2294-4439-a365-87e1b6297dac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d514f3a9-040c-4961-b37e-1d792270f19b', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:57:44 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-f967e85d-76e4-4323-b0d6-b6b58b66dc0f tempest-ProjectMemberTests-1095658523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08b0ec0d-548f-4a04-82f9-fdc31665bed7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:57:44 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-f967e85d-76e4-4323-b0d6-b6b58b66dc0f tempest-ProjectMemberTests-1095658523 None] Volume volume-d514f3a9-040c-4961-b37e-1d792270f19b (d514f3a9-040c-4961-b37e-1d792270f19b): created successfully Sep 22 15:57:44 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-f967e85d-76e4-4323-b0d6-b6b58b66dc0f tempest-ProjectMemberTests-1095658523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08b0ec0d-548f-4a04-82f9-fdc31665bed7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:57:44 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-f967e85d-76e4-4323-b0d6-b6b58b66dc0f tempest-ProjectMemberTests-1095658523 None] Flow 'volume_create_manager' (06a224c1-668b-4b31-a99a-64a2c06a435a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:57:44 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-f967e85d-76e4-4323-b0d6-b6b58b66dc0f tempest-ProjectMemberTests-1095658523 None] Created volume successfully. Sep 22 15:57:45 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-6e9498f7-12e0-495f-b7e0-e32c999b6c75 tempest-ProjectMemberTests-1095658523 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:57:45 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-6e9498f7-12e0-495f-b7e0-e32c999b6c75 tempest-ProjectMemberTests-1095658523 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:57:45 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-6e9498f7-12e0-495f-b7e0-e32c999b6c75 tempest-ProjectMemberTests-1095658523 None] Creating offline snapshot f2a07100-f206-4471-8d74-4aa4452fe0e2 of volume d514f3a9-040c-4961-b37e-1d792270f19b {{(pid=86212) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 22 15:57:45 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[f060b022-8930-41fa-b39c-bc003f2d8466]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:57:45 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-6e9498f7-12e0-495f-b7e0-e32c999b6c75 tempest-ProjectMemberTests-1095658523 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-d514f3a9-040c-4961-b37e-1d792270f19b {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:57:45 devstack sudo[105497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-d514f3a9-040c-4961-b37e-1d792270f19b Sep 22 15:57:45 devstack sudo[105497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:57:45 devstack sudo[105497]: pam_unix(sudo:session): session closed for user root Sep 22 15:57:45 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-6e9498f7-12e0-495f-b7e0-e32c999b6c75 tempest-ProjectMemberTests-1095658523 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-d514f3a9-040c-4961-b37e-1d792270f19b" returned: 0 in 0.347s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:57:45 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-6e9498f7-12e0-495f-b7e0-e32c999b6c75 tempest-ProjectMemberTests-1095658523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-d514f3a9-040c-4961-b37e-1d792270f19b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-d514f3a9-040c-4961-b37e-1d792270f19b.f2a07100-f206-4471-8d74-4aa4452fe0e2 1G {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:57:45 devstack sudo[105502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-d514f3a9-040c-4961-b37e-1d792270f19b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-d514f3a9-040c-4961-b37e-1d792270f19b.f2a07100-f206-4471-8d74-4aa4452fe0e2 1G Sep 22 15:57:45 devstack sudo[105502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:57:46 devstack sudo[105502]: pam_unix(sudo:session): session closed for user root Sep 22 15:57:46 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-6e9498f7-12e0-495f-b7e0-e32c999b6c75 tempest-ProjectMemberTests-1095658523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-d514f3a9-040c-4961-b37e-1d792270f19b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-d514f3a9-040c-4961-b37e-1d792270f19b.f2a07100-f206-4471-8d74-4aa4452fe0e2 1G" returned: 0 in 0.401s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:57:46 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-6e9498f7-12e0-495f-b7e0-e32c999b6c75 tempest-ProjectMemberTests-1095658523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d514f3a9-040c-4961-b37e-1d792270f19b -F qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-d514f3a9-040c-4961-b37e-1d792270f19b.f2a07100-f206-4471-8d74-4aa4452fe0e2 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:57:46 devstack sudo[105508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d514f3a9-040c-4961-b37e-1d792270f19b -F qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-d514f3a9-040c-4961-b37e-1d792270f19b.f2a07100-f206-4471-8d74-4aa4452fe0e2 Sep 22 15:57:46 devstack sudo[105508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:57:46 devstack sudo[105508]: pam_unix(sudo:session): session closed for user root Sep 22 15:57:46 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-6e9498f7-12e0-495f-b7e0-e32c999b6c75 tempest-ProjectMemberTests-1095658523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d514f3a9-040c-4961-b37e-1d792270f19b -F qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-d514f3a9-040c-4961-b37e-1d792270f19b.f2a07100-f206-4471-8d74-4aa4452fe0e2" returned: 0 in 0.293s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:57:46 devstack cinder-volume[86212]: WARNING cinder.volume.drivers.remotefs [None req-6e9498f7-12e0-495f-b7e0-e32c999b6c75 tempest-ProjectMemberTests-1095658523 None] /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-d514f3a9-040c-4961-b37e-1d792270f19b.f2a07100-f206-4471-8d74-4aa4452fe0e2 is being set with open permissions: ugo+rw Sep 22 15:57:46 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-6e9498f7-12e0-495f-b7e0-e32c999b6c75 tempest-ProjectMemberTests-1095658523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-d514f3a9-040c-4961-b37e-1d792270f19b.f2a07100-f206-4471-8d74-4aa4452fe0e2 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:57:46 devstack sudo[105513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-d514f3a9-040c-4961-b37e-1d792270f19b.f2a07100-f206-4471-8d74-4aa4452fe0e2 Sep 22 15:57:46 devstack sudo[105513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:57:46 devstack sudo[105513]: pam_unix(sudo:session): session closed for user root Sep 22 15:57:46 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-6e9498f7-12e0-495f-b7e0-e32c999b6c75 tempest-ProjectMemberTests-1095658523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-d514f3a9-040c-4961-b37e-1d792270f19b.f2a07100-f206-4471-8d74-4aa4452fe0e2" returned: 0 in 0.237s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:57:46 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-6e9498f7-12e0-495f-b7e0-e32c999b6c75 tempest-ProjectMemberTests-1095658523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-d514f3a9-040c-4961-b37e-1d792270f19b.info {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:57:46 devstack sudo[105516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-d514f3a9-040c-4961-b37e-1d792270f19b.info Sep 22 15:57:46 devstack sudo[105516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:57:46 devstack sudo[105516]: pam_unix(sudo:session): session closed for user root Sep 22 15:57:46 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-6e9498f7-12e0-495f-b7e0-e32c999b6c75 tempest-ProjectMemberTests-1095658523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-d514f3a9-040c-4961-b37e-1d792270f19b.info" returned: 0 in 0.253s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:57:46 devstack cinder-volume[86212]: WARNING cinder.volume.drivers.remotefs [None req-6e9498f7-12e0-495f-b7e0-e32c999b6c75 tempest-ProjectMemberTests-1095658523 None] /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-d514f3a9-040c-4961-b37e-1d792270f19b.info is being set with open permissions: ugo+rw Sep 22 15:57:46 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-6e9498f7-12e0-495f-b7e0-e32c999b6c75 tempest-ProjectMemberTests-1095658523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-d514f3a9-040c-4961-b37e-1d792270f19b.info {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:57:46 devstack sudo[105519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-d514f3a9-040c-4961-b37e-1d792270f19b.info Sep 22 15:57:46 devstack sudo[105519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:57:47 devstack sudo[105519]: pam_unix(sudo:session): session closed for user root Sep 22 15:57:47 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-6e9498f7-12e0-495f-b7e0-e32c999b6c75 tempest-ProjectMemberTests-1095658523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-d514f3a9-040c-4961-b37e-1d792270f19b.info" returned: 0 in 0.239s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:57:47 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-6e9498f7-12e0-495f-b7e0-e32c999b6c75 tempest-ProjectMemberTests-1095658523 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.846s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:57:47 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-6e9498f7-12e0-495f-b7e0-e32c999b6c75 tempest-ProjectMemberTests-1095658523 None] Create snapshot completed successfully Sep 22 15:57:47 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-13213665-772a-427b-a299-3598b419ec8c tempest-ProjectMemberTests-1095658523 None] Acquiring lock "cinder-f2a07100-f206-4471-8d74-4aa4452fe0e2-delete_snapshot" by "delete_snapshot" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:57:47 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-13213665-772a-427b-a299-3598b419ec8c tempest-ProjectMemberTests-1095658523 None] Lock "cinder-f2a07100-f206-4471-8d74-4aa4452fe0e2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:57:47 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-13213665-772a-427b-a299-3598b419ec8c tempest-ProjectMemberTests-1095658523 None] Acquiring lock "cinder-quobyte-d514f3a9-040c-4961-b37e-1d792270f19b" by "delete_snapshot" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:57:47 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-13213665-772a-427b-a299-3598b419ec8c tempest-ProjectMemberTests-1095658523 None] Lock "cinder-quobyte-d514f3a9-040c-4961-b37e-1d792270f19b" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:57:47 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-13213665-772a-427b-a299-3598b419ec8c tempest-ProjectMemberTests-1095658523 None] Acquiring lock "cinder-quobyte-f2a07100-f206-4471-8d74-4aa4452fe0e2" by "_delete_snapshot" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:57:47 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-13213665-772a-427b-a299-3598b419ec8c tempest-ProjectMemberTests-1095658523 None] Lock "cinder-quobyte-f2a07100-f206-4471-8d74-4aa4452fe0e2" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:57:47 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-13213665-772a-427b-a299-3598b419ec8c tempest-ProjectMemberTests-1095658523 None] Deleting offline snapshot f2a07100-f206-4471-8d74-4aa4452fe0e2 of volume d514f3a9-040c-4961-b37e-1d792270f19b {{(pid=86212) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 22 15:57:47 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-13213665-772a-427b-a299-3598b419ec8c tempest-ProjectMemberTests-1095658523 None] snapshot_file for this snap is: volume-d514f3a9-040c-4961-b37e-1d792270f19b.f2a07100-f206-4471-8d74-4aa4452fe0e2 {{(pid=86212) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 22 15:57:47 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ed59fbb-61a7-4778-97e5-3c47acdc61cc]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:57:47 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-13213665-772a-427b-a299-3598b419ec8c tempest-ProjectMemberTests-1095658523 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-d514f3a9-040c-4961-b37e-1d792270f19b.f2a07100-f206-4471-8d74-4aa4452fe0e2 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:57:47 devstack sudo[105522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-d514f3a9-040c-4961-b37e-1d792270f19b.f2a07100-f206-4471-8d74-4aa4452fe0e2 Sep 22 15:57:47 devstack sudo[105522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:57:47 devstack sudo[105522]: pam_unix(sudo:session): session closed for user root Sep 22 15:57:47 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-13213665-772a-427b-a299-3598b419ec8c tempest-ProjectMemberTests-1095658523 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-d514f3a9-040c-4961-b37e-1d792270f19b.f2a07100-f206-4471-8d74-4aa4452fe0e2" returned: 0 in 0.349s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:57:47 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-13213665-772a-427b-a299-3598b419ec8c tempest-ProjectMemberTests-1095658523 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d514f3a9-040c-4961-b37e-1d792270f19b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86212) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 22 15:57:47 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d570c1b-f014-4681-9eca-e6683e371cfb]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:57:47 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-13213665-772a-427b-a299-3598b419ec8c tempest-ProjectMemberTests-1095658523 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-d514f3a9-040c-4961-b37e-1d792270f19b {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:57:47 devstack sudo[105527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-d514f3a9-040c-4961-b37e-1d792270f19b Sep 22 15:57:47 devstack sudo[105527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:57:48 devstack sudo[105527]: pam_unix(sudo:session): session closed for user root Sep 22 15:57:48 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-13213665-772a-427b-a299-3598b419ec8c tempest-ProjectMemberTests-1095658523 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-d514f3a9-040c-4961-b37e-1d792270f19b" returned: 0 in 0.365s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:57:48 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-13213665-772a-427b-a299-3598b419ec8c tempest-ProjectMemberTests-1095658523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-d514f3a9-040c-4961-b37e-1d792270f19b.f2a07100-f206-4471-8d74-4aa4452fe0e2 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:57:48 devstack sudo[105533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-d514f3a9-040c-4961-b37e-1d792270f19b.f2a07100-f206-4471-8d74-4aa4452fe0e2 Sep 22 15:57:48 devstack sudo[105533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:57:48 devstack sudo[105533]: pam_unix(sudo:session): session closed for user root Sep 22 15:57:48 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-13213665-772a-427b-a299-3598b419ec8c tempest-ProjectMemberTests-1095658523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-d514f3a9-040c-4961-b37e-1d792270f19b.f2a07100-f206-4471-8d74-4aa4452fe0e2" returned: 0 in 0.320s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:57:48 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-13213665-772a-427b-a299-3598b419ec8c tempest-ProjectMemberTests-1095658523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-d514f3a9-040c-4961-b37e-1d792270f19b.f2a07100-f206-4471-8d74-4aa4452fe0e2 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:57:48 devstack sudo[105539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-d514f3a9-040c-4961-b37e-1d792270f19b.f2a07100-f206-4471-8d74-4aa4452fe0e2 Sep 22 15:57:48 devstack sudo[105539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:57:48 devstack sudo[105539]: pam_unix(sudo:session): session closed for user root Sep 22 15:57:48 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-13213665-772a-427b-a299-3598b419ec8c tempest-ProjectMemberTests-1095658523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-d514f3a9-040c-4961-b37e-1d792270f19b.f2a07100-f206-4471-8d74-4aa4452fe0e2" returned: 0 in 0.262s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:57:48 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-13213665-772a-427b-a299-3598b419ec8c tempest-ProjectMemberTests-1095658523 None] Lock "cinder-quobyte-f2a07100-f206-4471-8d74-4aa4452fe0e2" released by "_delete_snapshot" :: held 1.395s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:57:48 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-13213665-772a-427b-a299-3598b419ec8c tempest-ProjectMemberTests-1095658523 None] Lock "cinder-quobyte-d514f3a9-040c-4961-b37e-1d792270f19b" released by "delete_snapshot" :: held 1.418s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:57:48 devstack cinder-volume[86212]: DEBUG cinder.quota [None req-13213665-772a-427b-a299-3598b419ec8c tempest-ProjectMemberTests-1095658523 None] Created reservations ['dbfd9177-1156-49fa-9e3d-148b42d3004c', '8353f7f2-32f6-4df1-a81b-842a764863f5', '869605c8-87cc-4b90-9789-a7c5c3ff9c8d', '5491b85f-b775-48cb-b90e-cfd12a3a8f89'] {{(pid=86212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 15:57:48 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-13213665-772a-427b-a299-3598b419ec8c tempest-ProjectMemberTests-1095658523 None] Delete snapshot completed successfully. Sep 22 15:57:48 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-13213665-772a-427b-a299-3598b419ec8c tempest-ProjectMemberTests-1095658523 None] Lock "cinder-f2a07100-f206-4471-8d74-4aa4452fe0e2-delete_snapshot" released by "delete_snapshot" :: held 1.563s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:57:49 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-d40c2728-4c67-4be9-8469-504050ebf0cd tempest-ProjectMemberTests-1095658523 None] Acquiring lock "cinder-d514f3a9-040c-4961-b37e-1d792270f19b-delete_volume" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:57:49 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-d40c2728-4c67-4be9-8469-504050ebf0cd tempest-ProjectMemberTests-1095658523 None] Lock "cinder-d514f3a9-040c-4961-b37e-1d792270f19b-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:57:49 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-d40c2728-4c67-4be9-8469-504050ebf0cd tempest-ProjectMemberTests-1095658523 None] Acquiring lock "cinder-quobyte-d514f3a9-040c-4961-b37e-1d792270f19b" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:57:49 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-d40c2728-4c67-4be9-8469-504050ebf0cd tempest-ProjectMemberTests-1095658523 None] Lock "cinder-quobyte-d514f3a9-040c-4961-b37e-1d792270f19b" acquired by "delete_volume" :: waited 0.016s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:57:49 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[e57a2f72-0afa-4bcd-8fe4-ff624e2f9fa4]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:57:49 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-d40c2728-4c67-4be9-8469-504050ebf0cd tempest-ProjectMemberTests-1095658523 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-d514f3a9-040c-4961-b37e-1d792270f19b {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:57:49 devstack sudo[105543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-d514f3a9-040c-4961-b37e-1d792270f19b Sep 22 15:57:49 devstack sudo[105543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:57:50 devstack sudo[105543]: pam_unix(sudo:session): session closed for user root Sep 22 15:57:50 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-d40c2728-4c67-4be9-8469-504050ebf0cd tempest-ProjectMemberTests-1095658523 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-d514f3a9-040c-4961-b37e-1d792270f19b" returned: 0 in 0.355s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:57:50 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-d40c2728-4c67-4be9-8469-504050ebf0cd tempest-ProjectMemberTests-1095658523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-d514f3a9-040c-4961-b37e-1d792270f19b {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:57:50 devstack sudo[105548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-d514f3a9-040c-4961-b37e-1d792270f19b Sep 22 15:57:50 devstack sudo[105548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:57:50 devstack sudo[105548]: pam_unix(sudo:session): session closed for user root Sep 22 15:57:50 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-d40c2728-4c67-4be9-8469-504050ebf0cd tempest-ProjectMemberTests-1095658523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-d514f3a9-040c-4961-b37e-1d792270f19b" returned: 0 in 0.234s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:57:50 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-d40c2728-4c67-4be9-8469-504050ebf0cd tempest-ProjectMemberTests-1095658523 None] Lock "cinder-quobyte-d514f3a9-040c-4961-b37e-1d792270f19b" released by "delete_volume" :: held 0.646s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:57:50 devstack cinder-volume[86212]: DEBUG cinder.quota [None req-d40c2728-4c67-4be9-8469-504050ebf0cd tempest-ProjectMemberTests-1095658523 None] Created reservations ['4a5c1d0d-ebe2-4b0e-bfa8-2d4544065a66', 'd8611360-91db-4a15-9d76-23ea196a8b5d', 'b1cbe5c9-ab51-4b75-974c-21e62353d1bd', '2e85d9f6-076e-4f2b-a0f0-dfab84e52608'] {{(pid=86212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 15:57:50 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-d40c2728-4c67-4be9-8469-504050ebf0cd tempest-ProjectMemberTests-1095658523 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:57:50 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-d40c2728-4c67-4be9-8469-504050ebf0cd tempest-ProjectMemberTests-1095658523 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:57:50 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-d40c2728-4c67-4be9-8469-504050ebf0cd tempest-ProjectMemberTests-1095658523 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:57:50 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-d40c2728-4c67-4be9-8469-504050ebf0cd tempest-ProjectMemberTests-1095658523 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:57:50 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-d40c2728-4c67-4be9-8469-504050ebf0cd tempest-ProjectMemberTests-1095658523 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:57:50 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-d40c2728-4c67-4be9-8469-504050ebf0cd tempest-ProjectMemberTests-1095658523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:57:50 devstack sudo[105551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc Sep 22 15:57:50 devstack sudo[105551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:57:50 devstack sudo[105551]: pam_unix(sudo:session): session closed for user root Sep 22 15:57:50 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-d40c2728-4c67-4be9-8469-504050ebf0cd tempest-ProjectMemberTests-1095658523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc" returned: 0 in 0.240s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:57:50 devstack cinder-volume[86212]: DEBUG cinder.manager [None req-d40c2728-4c67-4be9-8469-504050ebf0cd tempest-ProjectMemberTests-1095658523 None] Notifying Schedulers of capabilities ... {{(pid=86212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 15:57:50 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-d40c2728-4c67-4be9-8469-504050ebf0cd tempest-ProjectMemberTests-1095658523 None] Deleted volume successfully. Sep 22 15:57:50 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-d40c2728-4c67-4be9-8469-504050ebf0cd tempest-ProjectMemberTests-1095658523 None] Lock "cinder-d514f3a9-040c-4961-b37e-1d792270f19b-delete_volume" released by "delete_volume" :: held 1.073s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:57:51 devstack cinder-volume[86212]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9137fa8-1962-4c52-af82-3205fcfbc93c tempest-ProjectMemberTests-1095658523 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 15:57:51 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-c9137fa8-1962-4c52-af82-3205fcfbc93c tempest-ProjectMemberTests-1095658523 None] Flow 'volume_create_manager' (04e8c86f-9262-4da7-bde9-08bd84754c1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:57:51 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-c9137fa8-1962-4c52-af82-3205fcfbc93c tempest-ProjectMemberTests-1095658523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd0f1ab2-3408-4989-91f0-cb3eb22700f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:57:51 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-c9137fa8-1962-4c52-af82-3205fcfbc93c tempest-ProjectMemberTests-1095658523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd0f1ab2-3408-4989-91f0-cb3eb22700f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:57:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-370575284',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2923401-6254-4a8c-ac36-5f875841c953,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e3beb47e92e4a8c9efa3433374c2e0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:57:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:57:51Z,use_quota=True,user_id='c4cc884fb51643ee9efb176f88d0543f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:57:51 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-c9137fa8-1962-4c52-af82-3205fcfbc93c tempest-ProjectMemberTests-1095658523 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a58622e-c7c8-4f08-b894-91ece195f9d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:57:51 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-c9137fa8-1962-4c52-af82-3205fcfbc93c tempest-ProjectMemberTests-1095658523 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a58622e-c7c8-4f08-b894-91ece195f9d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:57:51 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-c9137fa8-1962-4c52-af82-3205fcfbc93c tempest-ProjectMemberTests-1095658523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee21612c-5a72-4a00-9169-d5adf4c56478) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:57:51 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-c9137fa8-1962-4c52-af82-3205fcfbc93c tempest-ProjectMemberTests-1095658523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee21612c-5a72-4a00-9169-d5adf4c56478) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a2923401-6254-4a8c-ac36-5f875841c953', 'volume_name': 'volume-a2923401-6254-4a8c-ac36-5f875841c953', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:57:51 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-c9137fa8-1962-4c52-af82-3205fcfbc93c tempest-ProjectMemberTests-1095658523 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da2dc840-fbeb-4995-9866-26baf77f0450) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:57:51 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-c9137fa8-1962-4c52-af82-3205fcfbc93c tempest-ProjectMemberTests-1095658523 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da2dc840-fbeb-4995-9866-26baf77f0450) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:57:51 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-c9137fa8-1962-4c52-af82-3205fcfbc93c tempest-ProjectMemberTests-1095658523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77002605-0bfd-42aa-8d6b-0fe52884cff5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:57:51 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-c9137fa8-1962-4c52-af82-3205fcfbc93c tempest-ProjectMemberTests-1095658523 None] Volume a2923401-6254-4a8c-ac36-5f875841c953: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a2923401-6254-4a8c-ac36-5f875841c953', 'volume_size': 1} Sep 22 15:57:51 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-c9137fa8-1962-4c52-af82-3205fcfbc93c tempest-ProjectMemberTests-1095658523 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:57:51 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-c9137fa8-1962-4c52-af82-3205fcfbc93c tempest-ProjectMemberTests-1095658523 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:57:51 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-c9137fa8-1962-4c52-af82-3205fcfbc93c tempest-ProjectMemberTests-1095658523 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:57:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-370575284',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2923401-6254-4a8c-ac36-5f875841c953,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e3beb47e92e4a8c9efa3433374c2e0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:57:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:57:51Z,use_quota=True,user_id='c4cc884fb51643ee9efb176f88d0543f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)}" {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 15:57:51 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-c9137fa8-1962-4c52-af82-3205fcfbc93c tempest-ProjectMemberTests-1095658523 None] Creating volume a2923401-6254-4a8c-ac36-5f875841c953 {{(pid=86212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 15:57:51 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-c9137fa8-1962-4c52-af82-3205fcfbc93c tempest-ProjectMemberTests-1095658523 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:57:51 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-c9137fa8-1962-4c52-af82-3205fcfbc93c tempest-ProjectMemberTests-1095658523 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:57:51 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-c9137fa8-1962-4c52-af82-3205fcfbc93c tempest-ProjectMemberTests-1095658523 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:57:51 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-c9137fa8-1962-4c52-af82-3205fcfbc93c tempest-ProjectMemberTests-1095658523 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:57:51 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-c9137fa8-1962-4c52-af82-3205fcfbc93c tempest-ProjectMemberTests-1095658523 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:57:51 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-c9137fa8-1962-4c52-af82-3205fcfbc93c tempest-ProjectMemberTests-1095658523 None] Selected osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 as target Quobyte volume. {{(pid=86212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 15:57:51 devstack cinder-volume[86212]: INFO cinder.volume.drivers.remotefs [None req-c9137fa8-1962-4c52-af82-3205fcfbc93c tempest-ProjectMemberTests-1095658523 None] casted to osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 Sep 22 15:57:51 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-c9137fa8-1962-4c52-af82-3205fcfbc93c tempest-ProjectMemberTests-1095658523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a2923401-6254-4a8c-ac36-5f875841c953 1073741824 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:57:51 devstack sudo[105554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a2923401-6254-4a8c-ac36-5f875841c953 1073741824 Sep 22 15:57:51 devstack sudo[105554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:57:51 devstack sudo[105554]: pam_unix(sudo:session): session closed for user root Sep 22 15:57:51 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-c9137fa8-1962-4c52-af82-3205fcfbc93c tempest-ProjectMemberTests-1095658523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a2923401-6254-4a8c-ac36-5f875841c953 1073741824" returned: 0 in 0.405s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:57:51 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-c9137fa8-1962-4c52-af82-3205fcfbc93c tempest-ProjectMemberTests-1095658523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a2923401-6254-4a8c-ac36-5f875841c953 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:57:51 devstack sudo[105559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a2923401-6254-4a8c-ac36-5f875841c953 Sep 22 15:57:51 devstack sudo[105559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:57:51 devstack sudo[105559]: pam_unix(sudo:session): session closed for user root Sep 22 15:57:51 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-c9137fa8-1962-4c52-af82-3205fcfbc93c tempest-ProjectMemberTests-1095658523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a2923401-6254-4a8c-ac36-5f875841c953" returned: 0 in 0.250s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:57:51 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-c9137fa8-1962-4c52-af82-3205fcfbc93c tempest-ProjectMemberTests-1095658523 None] <== create_volume: return (693ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'} {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 15:57:51 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-c9137fa8-1962-4c52-af82-3205fcfbc93c tempest-ProjectMemberTests-1095658523 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.696s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:57:51 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-c9137fa8-1962-4c52-af82-3205fcfbc93c tempest-ProjectMemberTests-1095658523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77002605-0bfd-42aa-8d6b-0fe52884cff5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a2923401-6254-4a8c-ac36-5f875841c953', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:57:51 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-c9137fa8-1962-4c52-af82-3205fcfbc93c tempest-ProjectMemberTests-1095658523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7792fad6-01de-428a-b8cd-2c3515625602) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:57:51 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-c9137fa8-1962-4c52-af82-3205fcfbc93c tempest-ProjectMemberTests-1095658523 None] Volume volume-a2923401-6254-4a8c-ac36-5f875841c953 (a2923401-6254-4a8c-ac36-5f875841c953): created successfully Sep 22 15:57:51 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-c9137fa8-1962-4c52-af82-3205fcfbc93c tempest-ProjectMemberTests-1095658523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7792fad6-01de-428a-b8cd-2c3515625602) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:57:51 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-c9137fa8-1962-4c52-af82-3205fcfbc93c tempest-ProjectMemberTests-1095658523 None] Flow 'volume_create_manager' (04e8c86f-9262-4da7-bde9-08bd84754c1a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:57:51 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-c9137fa8-1962-4c52-af82-3205fcfbc93c tempest-ProjectMemberTests-1095658523 None] Created volume successfully. Sep 22 15:57:52 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-480e1e8f-b4be-4083-871e-b98b400ac394 tempest-ProjectMemberTests-1095658523 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:57:52 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-480e1e8f-b4be-4083-871e-b98b400ac394 tempest-ProjectMemberTests-1095658523 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:57:52 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-480e1e8f-b4be-4083-871e-b98b400ac394 tempest-ProjectMemberTests-1095658523 None] Creating offline snapshot 737b5da1-43fc-40f2-add9-b2710c60a4e4 of volume a2923401-6254-4a8c-ac36-5f875841c953 {{(pid=86212) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 22 15:57:52 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[88869a71-ed01-42b5-8326-9e09b40dc7bc]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:57:52 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-480e1e8f-b4be-4083-871e-b98b400ac394 tempest-ProjectMemberTests-1095658523 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a2923401-6254-4a8c-ac36-5f875841c953 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:57:52 devstack sudo[105568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a2923401-6254-4a8c-ac36-5f875841c953 Sep 22 15:57:52 devstack sudo[105568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:57:52 devstack sudo[105568]: pam_unix(sudo:session): session closed for user root Sep 22 15:57:52 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-480e1e8f-b4be-4083-871e-b98b400ac394 tempest-ProjectMemberTests-1095658523 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a2923401-6254-4a8c-ac36-5f875841c953" returned: 0 in 0.347s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:57:52 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-480e1e8f-b4be-4083-871e-b98b400ac394 tempest-ProjectMemberTests-1095658523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a2923401-6254-4a8c-ac36-5f875841c953,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a2923401-6254-4a8c-ac36-5f875841c953.737b5da1-43fc-40f2-add9-b2710c60a4e4 1G {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:57:52 devstack sudo[105573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a2923401-6254-4a8c-ac36-5f875841c953,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a2923401-6254-4a8c-ac36-5f875841c953.737b5da1-43fc-40f2-add9-b2710c60a4e4 1G Sep 22 15:57:52 devstack sudo[105573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:57:53 devstack sudo[105573]: pam_unix(sudo:session): session closed for user root Sep 22 15:57:53 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-480e1e8f-b4be-4083-871e-b98b400ac394 tempest-ProjectMemberTests-1095658523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a2923401-6254-4a8c-ac36-5f875841c953,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a2923401-6254-4a8c-ac36-5f875841c953.737b5da1-43fc-40f2-add9-b2710c60a4e4 1G" returned: 0 in 0.374s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:57:53 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-480e1e8f-b4be-4083-871e-b98b400ac394 tempest-ProjectMemberTests-1095658523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a2923401-6254-4a8c-ac36-5f875841c953 -F qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a2923401-6254-4a8c-ac36-5f875841c953.737b5da1-43fc-40f2-add9-b2710c60a4e4 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:57:53 devstack sudo[105578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a2923401-6254-4a8c-ac36-5f875841c953 -F qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a2923401-6254-4a8c-ac36-5f875841c953.737b5da1-43fc-40f2-add9-b2710c60a4e4 Sep 22 15:57:53 devstack sudo[105578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:57:53 devstack sudo[105578]: pam_unix(sudo:session): session closed for user root Sep 22 15:57:53 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-480e1e8f-b4be-4083-871e-b98b400ac394 tempest-ProjectMemberTests-1095658523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a2923401-6254-4a8c-ac36-5f875841c953 -F qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a2923401-6254-4a8c-ac36-5f875841c953.737b5da1-43fc-40f2-add9-b2710c60a4e4" returned: 0 in 0.285s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:57:53 devstack cinder-volume[86212]: WARNING cinder.volume.drivers.remotefs [None req-480e1e8f-b4be-4083-871e-b98b400ac394 tempest-ProjectMemberTests-1095658523 None] /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a2923401-6254-4a8c-ac36-5f875841c953.737b5da1-43fc-40f2-add9-b2710c60a4e4 is being set with open permissions: ugo+rw Sep 22 15:57:53 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-480e1e8f-b4be-4083-871e-b98b400ac394 tempest-ProjectMemberTests-1095658523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a2923401-6254-4a8c-ac36-5f875841c953.737b5da1-43fc-40f2-add9-b2710c60a4e4 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:57:53 devstack sudo[105583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a2923401-6254-4a8c-ac36-5f875841c953.737b5da1-43fc-40f2-add9-b2710c60a4e4 Sep 22 15:57:53 devstack sudo[105583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:57:53 devstack sudo[105583]: pam_unix(sudo:session): session closed for user root Sep 22 15:57:53 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-480e1e8f-b4be-4083-871e-b98b400ac394 tempest-ProjectMemberTests-1095658523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a2923401-6254-4a8c-ac36-5f875841c953.737b5da1-43fc-40f2-add9-b2710c60a4e4" returned: 0 in 0.236s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:57:53 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-480e1e8f-b4be-4083-871e-b98b400ac394 tempest-ProjectMemberTests-1095658523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a2923401-6254-4a8c-ac36-5f875841c953.info {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:57:53 devstack sudo[105586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a2923401-6254-4a8c-ac36-5f875841c953.info Sep 22 15:57:53 devstack sudo[105586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:57:53 devstack sudo[105586]: pam_unix(sudo:session): session closed for user root Sep 22 15:57:53 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-480e1e8f-b4be-4083-871e-b98b400ac394 tempest-ProjectMemberTests-1095658523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a2923401-6254-4a8c-ac36-5f875841c953.info" returned: 0 in 0.245s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:57:53 devstack cinder-volume[86212]: WARNING cinder.volume.drivers.remotefs [None req-480e1e8f-b4be-4083-871e-b98b400ac394 tempest-ProjectMemberTests-1095658523 None] /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a2923401-6254-4a8c-ac36-5f875841c953.info is being set with open permissions: ugo+rw Sep 22 15:57:53 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-480e1e8f-b4be-4083-871e-b98b400ac394 tempest-ProjectMemberTests-1095658523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a2923401-6254-4a8c-ac36-5f875841c953.info {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:57:53 devstack sudo[105589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a2923401-6254-4a8c-ac36-5f875841c953.info Sep 22 15:57:53 devstack sudo[105589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:57:54 devstack sudo[105589]: pam_unix(sudo:session): session closed for user root Sep 22 15:57:54 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-480e1e8f-b4be-4083-871e-b98b400ac394 tempest-ProjectMemberTests-1095658523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a2923401-6254-4a8c-ac36-5f875841c953.info" returned: 0 in 0.229s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:57:54 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-480e1e8f-b4be-4083-871e-b98b400ac394 tempest-ProjectMemberTests-1095658523 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.795s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:57:54 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-480e1e8f-b4be-4083-871e-b98b400ac394 tempest-ProjectMemberTests-1095658523 None] Create snapshot completed successfully Sep 22 15:57:54 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-ed741538-dc7f-4767-9779-15ee5bf3e183 tempest-ProjectMemberTests-1095658523 None] Acquiring lock "cinder-737b5da1-43fc-40f2-add9-b2710c60a4e4-delete_snapshot" by "delete_snapshot" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:57:54 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-ed741538-dc7f-4767-9779-15ee5bf3e183 tempest-ProjectMemberTests-1095658523 None] Lock "cinder-737b5da1-43fc-40f2-add9-b2710c60a4e4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:57:54 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-ed741538-dc7f-4767-9779-15ee5bf3e183 tempest-ProjectMemberTests-1095658523 None] Acquiring lock "cinder-quobyte-a2923401-6254-4a8c-ac36-5f875841c953" by "delete_snapshot" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:57:54 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-ed741538-dc7f-4767-9779-15ee5bf3e183 tempest-ProjectMemberTests-1095658523 None] Lock "cinder-quobyte-a2923401-6254-4a8c-ac36-5f875841c953" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:57:54 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-ed741538-dc7f-4767-9779-15ee5bf3e183 tempest-ProjectMemberTests-1095658523 None] Acquiring lock "cinder-quobyte-737b5da1-43fc-40f2-add9-b2710c60a4e4" by "_delete_snapshot" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:57:54 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-ed741538-dc7f-4767-9779-15ee5bf3e183 tempest-ProjectMemberTests-1095658523 None] Lock "cinder-quobyte-737b5da1-43fc-40f2-add9-b2710c60a4e4" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:57:54 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-ed741538-dc7f-4767-9779-15ee5bf3e183 tempest-ProjectMemberTests-1095658523 None] Deleting offline snapshot 737b5da1-43fc-40f2-add9-b2710c60a4e4 of volume a2923401-6254-4a8c-ac36-5f875841c953 {{(pid=86212) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 22 15:57:54 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-ed741538-dc7f-4767-9779-15ee5bf3e183 tempest-ProjectMemberTests-1095658523 None] snapshot_file for this snap is: volume-a2923401-6254-4a8c-ac36-5f875841c953.737b5da1-43fc-40f2-add9-b2710c60a4e4 {{(pid=86212) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 22 15:57:54 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[25701578-4642-421e-9e69-dc47f43f6c43]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:57:54 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-ed741538-dc7f-4767-9779-15ee5bf3e183 tempest-ProjectMemberTests-1095658523 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a2923401-6254-4a8c-ac36-5f875841c953.737b5da1-43fc-40f2-add9-b2710c60a4e4 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:57:54 devstack sudo[105592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a2923401-6254-4a8c-ac36-5f875841c953.737b5da1-43fc-40f2-add9-b2710c60a4e4 Sep 22 15:57:54 devstack sudo[105592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:57:54 devstack sudo[105592]: pam_unix(sudo:session): session closed for user root Sep 22 15:57:54 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-ed741538-dc7f-4767-9779-15ee5bf3e183 tempest-ProjectMemberTests-1095658523 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a2923401-6254-4a8c-ac36-5f875841c953.737b5da1-43fc-40f2-add9-b2710c60a4e4" returned: 0 in 0.349s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:57:54 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-ed741538-dc7f-4767-9779-15ee5bf3e183 tempest-ProjectMemberTests-1095658523 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a2923401-6254-4a8c-ac36-5f875841c953(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86212) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 22 15:57:54 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[b968bc9d-3fc1-4fcf-8a65-8b1482bc9476]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:57:54 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-ed741538-dc7f-4767-9779-15ee5bf3e183 tempest-ProjectMemberTests-1095658523 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a2923401-6254-4a8c-ac36-5f875841c953 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:57:55 devstack sudo[105597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a2923401-6254-4a8c-ac36-5f875841c953 Sep 22 15:57:55 devstack sudo[105597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:57:55 devstack sudo[105597]: pam_unix(sudo:session): session closed for user root Sep 22 15:57:55 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-ed741538-dc7f-4767-9779-15ee5bf3e183 tempest-ProjectMemberTests-1095658523 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a2923401-6254-4a8c-ac36-5f875841c953" returned: 0 in 0.359s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:57:55 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-ed741538-dc7f-4767-9779-15ee5bf3e183 tempest-ProjectMemberTests-1095658523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a2923401-6254-4a8c-ac36-5f875841c953.737b5da1-43fc-40f2-add9-b2710c60a4e4 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:57:55 devstack sudo[105602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a2923401-6254-4a8c-ac36-5f875841c953.737b5da1-43fc-40f2-add9-b2710c60a4e4 Sep 22 15:57:55 devstack sudo[105602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:57:55 devstack sudo[105602]: pam_unix(sudo:session): session closed for user root Sep 22 15:57:55 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-ed741538-dc7f-4767-9779-15ee5bf3e183 tempest-ProjectMemberTests-1095658523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a2923401-6254-4a8c-ac36-5f875841c953.737b5da1-43fc-40f2-add9-b2710c60a4e4" returned: 0 in 0.332s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:57:55 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-ed741538-dc7f-4767-9779-15ee5bf3e183 tempest-ProjectMemberTests-1095658523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a2923401-6254-4a8c-ac36-5f875841c953.737b5da1-43fc-40f2-add9-b2710c60a4e4 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:57:55 devstack sudo[105607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a2923401-6254-4a8c-ac36-5f875841c953.737b5da1-43fc-40f2-add9-b2710c60a4e4 Sep 22 15:57:55 devstack sudo[105607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:57:55 devstack sudo[105607]: pam_unix(sudo:session): session closed for user root Sep 22 15:57:55 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-ed741538-dc7f-4767-9779-15ee5bf3e183 tempest-ProjectMemberTests-1095658523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a2923401-6254-4a8c-ac36-5f875841c953.737b5da1-43fc-40f2-add9-b2710c60a4e4" returned: 0 in 0.248s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:57:55 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-ed741538-dc7f-4767-9779-15ee5bf3e183 tempest-ProjectMemberTests-1095658523 None] Lock "cinder-quobyte-737b5da1-43fc-40f2-add9-b2710c60a4e4" released by "_delete_snapshot" :: held 1.385s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:57:55 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-ed741538-dc7f-4767-9779-15ee5bf3e183 tempest-ProjectMemberTests-1095658523 None] Lock "cinder-quobyte-a2923401-6254-4a8c-ac36-5f875841c953" released by "delete_snapshot" :: held 1.405s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:57:55 devstack cinder-volume[86212]: DEBUG cinder.quota [None req-ed741538-dc7f-4767-9779-15ee5bf3e183 tempest-ProjectMemberTests-1095658523 None] Created reservations ['ce27c2bf-ea0f-470b-ad19-28bf274ca084', 'a230cbdf-2f45-4fe4-85e9-6fe41023346c', '19f66854-b846-47dc-8174-e720d93ed192', '32fd48ec-974b-4c43-9624-9423b3e54ca8'] {{(pid=86212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 15:57:55 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-ed741538-dc7f-4767-9779-15ee5bf3e183 tempest-ProjectMemberTests-1095658523 None] Delete snapshot completed successfully. Sep 22 15:57:55 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-ed741538-dc7f-4767-9779-15ee5bf3e183 tempest-ProjectMemberTests-1095658523 None] Lock "cinder-737b5da1-43fc-40f2-add9-b2710c60a4e4-delete_snapshot" released by "delete_snapshot" :: held 1.533s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:57:56 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-20b91ab3-c9f0-41fb-8778-4a1e51084936 tempest-ProjectMemberTests-1095658523 None] Acquiring lock "cinder-a2923401-6254-4a8c-ac36-5f875841c953-delete_volume" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:57:56 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-20b91ab3-c9f0-41fb-8778-4a1e51084936 tempest-ProjectMemberTests-1095658523 None] Lock "cinder-a2923401-6254-4a8c-ac36-5f875841c953-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:57:56 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-20b91ab3-c9f0-41fb-8778-4a1e51084936 tempest-ProjectMemberTests-1095658523 None] Acquiring lock "cinder-quobyte-a2923401-6254-4a8c-ac36-5f875841c953" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:57:56 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-20b91ab3-c9f0-41fb-8778-4a1e51084936 tempest-ProjectMemberTests-1095658523 None] Lock "cinder-quobyte-a2923401-6254-4a8c-ac36-5f875841c953" acquired by "delete_volume" :: waited 0.016s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:57:56 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fa4f49d-7b39-4e80-895c-ae1a3387e4b8]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:57:56 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-20b91ab3-c9f0-41fb-8778-4a1e51084936 tempest-ProjectMemberTests-1095658523 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a2923401-6254-4a8c-ac36-5f875841c953 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:57:56 devstack sudo[105610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a2923401-6254-4a8c-ac36-5f875841c953 Sep 22 15:57:56 devstack sudo[105610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:57:57 devstack sudo[105610]: pam_unix(sudo:session): session closed for user root Sep 22 15:57:57 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-20b91ab3-c9f0-41fb-8778-4a1e51084936 tempest-ProjectMemberTests-1095658523 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a2923401-6254-4a8c-ac36-5f875841c953" returned: 0 in 0.345s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:57:57 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-20b91ab3-c9f0-41fb-8778-4a1e51084936 tempest-ProjectMemberTests-1095658523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a2923401-6254-4a8c-ac36-5f875841c953 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:57:57 devstack sudo[105615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a2923401-6254-4a8c-ac36-5f875841c953 Sep 22 15:57:57 devstack sudo[105615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:57:57 devstack sudo[105615]: pam_unix(sudo:session): session closed for user root Sep 22 15:57:57 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-20b91ab3-c9f0-41fb-8778-4a1e51084936 tempest-ProjectMemberTests-1095658523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a2923401-6254-4a8c-ac36-5f875841c953" returned: 0 in 0.241s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:57:57 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-20b91ab3-c9f0-41fb-8778-4a1e51084936 tempest-ProjectMemberTests-1095658523 None] Lock "cinder-quobyte-a2923401-6254-4a8c-ac36-5f875841c953" released by "delete_volume" :: held 0.652s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:57:57 devstack cinder-volume[86212]: DEBUG cinder.quota [None req-20b91ab3-c9f0-41fb-8778-4a1e51084936 tempest-ProjectMemberTests-1095658523 None] Created reservations ['99335a86-a146-4870-801d-0e13e9d69749', 'c485d353-e52e-4707-8c9c-0b1efc9b03a7', '932f54b1-ccfa-46ad-bd5c-832bbfae7a03', '4626855a-788a-4ce6-b866-7588acf94a20'] {{(pid=86212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 15:57:57 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-20b91ab3-c9f0-41fb-8778-4a1e51084936 tempest-ProjectMemberTests-1095658523 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:57:57 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-20b91ab3-c9f0-41fb-8778-4a1e51084936 tempest-ProjectMemberTests-1095658523 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:57:57 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-20b91ab3-c9f0-41fb-8778-4a1e51084936 tempest-ProjectMemberTests-1095658523 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:57:57 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-20b91ab3-c9f0-41fb-8778-4a1e51084936 tempest-ProjectMemberTests-1095658523 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:57:57 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-20b91ab3-c9f0-41fb-8778-4a1e51084936 tempest-ProjectMemberTests-1095658523 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:57:57 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-20b91ab3-c9f0-41fb-8778-4a1e51084936 tempest-ProjectMemberTests-1095658523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:57:57 devstack sudo[105618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc Sep 22 15:57:57 devstack sudo[105618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:57:57 devstack sudo[105618]: pam_unix(sudo:session): session closed for user root Sep 22 15:57:57 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-20b91ab3-c9f0-41fb-8778-4a1e51084936 tempest-ProjectMemberTests-1095658523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc" returned: 0 in 0.253s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:57:57 devstack cinder-volume[86212]: DEBUG cinder.manager [None req-20b91ab3-c9f0-41fb-8778-4a1e51084936 tempest-ProjectMemberTests-1095658523 None] Notifying Schedulers of capabilities ... {{(pid=86212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 15:57:57 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-20b91ab3-c9f0-41fb-8778-4a1e51084936 tempest-ProjectMemberTests-1095658523 None] Deleted volume successfully. Sep 22 15:57:57 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-20b91ab3-c9f0-41fb-8778-4a1e51084936 tempest-ProjectMemberTests-1095658523 None] Lock "cinder-a2923401-6254-4a8c-ac36-5f875841c953-delete_volume" released by "delete_volume" :: held 1.105s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:57:58 devstack cinder-volume[86212]: DEBUG cinder.volume.flows.manager.create_volume [None req-887a0f4e-70b5-4c06-bce0-03f74b4e83c2 tempest-ProjectMemberTests-1095658523 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 15:57:58 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-887a0f4e-70b5-4c06-bce0-03f74b4e83c2 tempest-ProjectMemberTests-1095658523 None] Flow 'volume_create_manager' (8438a0e9-2d07-49cc-8983-dae1438bb8e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:57:58 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-887a0f4e-70b5-4c06-bce0-03f74b4e83c2 tempest-ProjectMemberTests-1095658523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8259ea2a-f9c8-4afd-9eff-3b75378e7dba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:57:58 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-887a0f4e-70b5-4c06-bce0-03f74b4e83c2 tempest-ProjectMemberTests-1095658523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8259ea2a-f9c8-4afd-9eff-3b75378e7dba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:57:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-257024771',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44efcb9b-4a08-4245-ac3d-fe6164ed1d2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e3beb47e92e4a8c9efa3433374c2e0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:57:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:57:58Z,use_quota=True,user_id='c4cc884fb51643ee9efb176f88d0543f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:57:58 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-887a0f4e-70b5-4c06-bce0-03f74b4e83c2 tempest-ProjectMemberTests-1095658523 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbddc49f-5bd0-435f-af55-26e808258fce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:57:58 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-887a0f4e-70b5-4c06-bce0-03f74b4e83c2 tempest-ProjectMemberTests-1095658523 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbddc49f-5bd0-435f-af55-26e808258fce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:57:58 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-887a0f4e-70b5-4c06-bce0-03f74b4e83c2 tempest-ProjectMemberTests-1095658523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e5cf95b-0baf-4d0c-82ed-00ada5038600) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:57:58 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-887a0f4e-70b5-4c06-bce0-03f74b4e83c2 tempest-ProjectMemberTests-1095658523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e5cf95b-0baf-4d0c-82ed-00ada5038600) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '44efcb9b-4a08-4245-ac3d-fe6164ed1d2a', 'volume_name': 'volume-44efcb9b-4a08-4245-ac3d-fe6164ed1d2a', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:57:58 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-887a0f4e-70b5-4c06-bce0-03f74b4e83c2 tempest-ProjectMemberTests-1095658523 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8dbeb19b-e24c-4788-b7fa-f7331dd0b98e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:57:58 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-887a0f4e-70b5-4c06-bce0-03f74b4e83c2 tempest-ProjectMemberTests-1095658523 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8dbeb19b-e24c-4788-b7fa-f7331dd0b98e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:57:58 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-887a0f4e-70b5-4c06-bce0-03f74b4e83c2 tempest-ProjectMemberTests-1095658523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d6dcee8-6f06-4db9-8120-09310ab7e523) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:57:58 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-887a0f4e-70b5-4c06-bce0-03f74b4e83c2 tempest-ProjectMemberTests-1095658523 None] Volume 44efcb9b-4a08-4245-ac3d-fe6164ed1d2a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-44efcb9b-4a08-4245-ac3d-fe6164ed1d2a', 'volume_size': 1} Sep 22 15:57:58 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-887a0f4e-70b5-4c06-bce0-03f74b4e83c2 tempest-ProjectMemberTests-1095658523 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:57:58 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-887a0f4e-70b5-4c06-bce0-03f74b4e83c2 tempest-ProjectMemberTests-1095658523 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:57:58 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-887a0f4e-70b5-4c06-bce0-03f74b4e83c2 tempest-ProjectMemberTests-1095658523 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:57:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-257024771',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44efcb9b-4a08-4245-ac3d-fe6164ed1d2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e3beb47e92e4a8c9efa3433374c2e0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:57:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:57:58Z,use_quota=True,user_id='c4cc884fb51643ee9efb176f88d0543f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)}" {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 15:57:58 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-887a0f4e-70b5-4c06-bce0-03f74b4e83c2 tempest-ProjectMemberTests-1095658523 None] Creating volume 44efcb9b-4a08-4245-ac3d-fe6164ed1d2a {{(pid=86212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 15:57:58 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-887a0f4e-70b5-4c06-bce0-03f74b4e83c2 tempest-ProjectMemberTests-1095658523 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:57:58 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-887a0f4e-70b5-4c06-bce0-03f74b4e83c2 tempest-ProjectMemberTests-1095658523 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:57:58 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-887a0f4e-70b5-4c06-bce0-03f74b4e83c2 tempest-ProjectMemberTests-1095658523 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:57:58 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-887a0f4e-70b5-4c06-bce0-03f74b4e83c2 tempest-ProjectMemberTests-1095658523 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:57:58 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-887a0f4e-70b5-4c06-bce0-03f74b4e83c2 tempest-ProjectMemberTests-1095658523 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:57:58 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-887a0f4e-70b5-4c06-bce0-03f74b4e83c2 tempest-ProjectMemberTests-1095658523 None] Selected osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 as target Quobyte volume. {{(pid=86212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 15:57:58 devstack cinder-volume[86212]: INFO cinder.volume.drivers.remotefs [None req-887a0f4e-70b5-4c06-bce0-03f74b4e83c2 tempest-ProjectMemberTests-1095658523 None] casted to osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 Sep 22 15:57:58 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-887a0f4e-70b5-4c06-bce0-03f74b4e83c2 tempest-ProjectMemberTests-1095658523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-44efcb9b-4a08-4245-ac3d-fe6164ed1d2a 1073741824 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:57:58 devstack sudo[105622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-44efcb9b-4a08-4245-ac3d-fe6164ed1d2a 1073741824 Sep 22 15:57:58 devstack sudo[105622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:57:58 devstack sudo[105622]: pam_unix(sudo:session): session closed for user root Sep 22 15:57:58 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-887a0f4e-70b5-4c06-bce0-03f74b4e83c2 tempest-ProjectMemberTests-1095658523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-44efcb9b-4a08-4245-ac3d-fe6164ed1d2a 1073741824" returned: 0 in 0.410s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:57:58 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-887a0f4e-70b5-4c06-bce0-03f74b4e83c2 tempest-ProjectMemberTests-1095658523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-44efcb9b-4a08-4245-ac3d-fe6164ed1d2a {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:57:58 devstack sudo[105627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-44efcb9b-4a08-4245-ac3d-fe6164ed1d2a Sep 22 15:57:58 devstack sudo[105627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:57:59 devstack sudo[105627]: pam_unix(sudo:session): session closed for user root Sep 22 15:57:59 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-887a0f4e-70b5-4c06-bce0-03f74b4e83c2 tempest-ProjectMemberTests-1095658523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-44efcb9b-4a08-4245-ac3d-fe6164ed1d2a" returned: 0 in 0.234s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:57:59 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-887a0f4e-70b5-4c06-bce0-03f74b4e83c2 tempest-ProjectMemberTests-1095658523 None] <== create_volume: return (682ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'} {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 15:57:59 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-887a0f4e-70b5-4c06-bce0-03f74b4e83c2 tempest-ProjectMemberTests-1095658523 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.685s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:57:59 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-887a0f4e-70b5-4c06-bce0-03f74b4e83c2 tempest-ProjectMemberTests-1095658523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d6dcee8-6f06-4db9-8120-09310ab7e523) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44efcb9b-4a08-4245-ac3d-fe6164ed1d2a', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:57:59 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-887a0f4e-70b5-4c06-bce0-03f74b4e83c2 tempest-ProjectMemberTests-1095658523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a9f31b2-9b72-47e0-b782-eda74c30da24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:57:59 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-887a0f4e-70b5-4c06-bce0-03f74b4e83c2 tempest-ProjectMemberTests-1095658523 None] Volume volume-44efcb9b-4a08-4245-ac3d-fe6164ed1d2a (44efcb9b-4a08-4245-ac3d-fe6164ed1d2a): created successfully Sep 22 15:57:59 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-887a0f4e-70b5-4c06-bce0-03f74b4e83c2 tempest-ProjectMemberTests-1095658523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a9f31b2-9b72-47e0-b782-eda74c30da24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:57:59 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-887a0f4e-70b5-4c06-bce0-03f74b4e83c2 tempest-ProjectMemberTests-1095658523 None] Flow 'volume_create_manager' (8438a0e9-2d07-49cc-8983-dae1438bb8e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:57:59 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-887a0f4e-70b5-4c06-bce0-03f74b4e83c2 tempest-ProjectMemberTests-1095658523 None] Created volume successfully. Sep 22 15:57:59 devstack cinder-volume[86212]: DEBUG dbcounter [-] [86212] Writing DB stats cinder:SELECT=130,cinder:UPDATE=173,cinder:INSERT=44,cinder:DELETE=12 {{(pid=86212) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 22 15:57:59 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-6c98c468-a8d0-4d82-a408-7a30a89eceba tempest-ProjectMemberTests-1095658523 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:57:59 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-6c98c468-a8d0-4d82-a408-7a30a89eceba tempest-ProjectMemberTests-1095658523 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:57:59 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-6c98c468-a8d0-4d82-a408-7a30a89eceba tempest-ProjectMemberTests-1095658523 None] Creating offline snapshot 5174d746-dd5c-4c76-b2b1-6ee86d9b29cb of volume 44efcb9b-4a08-4245-ac3d-fe6164ed1d2a {{(pid=86212) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 22 15:57:59 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[4749318f-0caa-448b-85a8-ad7cc31661ba]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:57:59 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-6c98c468-a8d0-4d82-a408-7a30a89eceba tempest-ProjectMemberTests-1095658523 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-44efcb9b-4a08-4245-ac3d-fe6164ed1d2a {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:57:59 devstack sudo[105630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-44efcb9b-4a08-4245-ac3d-fe6164ed1d2a Sep 22 15:57:59 devstack sudo[105630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:57:59 devstack sudo[105630]: pam_unix(sudo:session): session closed for user root Sep 22 15:57:59 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-6c98c468-a8d0-4d82-a408-7a30a89eceba tempest-ProjectMemberTests-1095658523 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-44efcb9b-4a08-4245-ac3d-fe6164ed1d2a" returned: 0 in 0.351s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:57:59 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-6c98c468-a8d0-4d82-a408-7a30a89eceba tempest-ProjectMemberTests-1095658523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-44efcb9b-4a08-4245-ac3d-fe6164ed1d2a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-44efcb9b-4a08-4245-ac3d-fe6164ed1d2a.5174d746-dd5c-4c76-b2b1-6ee86d9b29cb 1G {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:57:59 devstack sudo[105635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-44efcb9b-4a08-4245-ac3d-fe6164ed1d2a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-44efcb9b-4a08-4245-ac3d-fe6164ed1d2a.5174d746-dd5c-4c76-b2b1-6ee86d9b29cb 1G Sep 22 15:57:59 devstack sudo[105635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:58:00 devstack sudo[105635]: pam_unix(sudo:session): session closed for user root Sep 22 15:58:00 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-6c98c468-a8d0-4d82-a408-7a30a89eceba tempest-ProjectMemberTests-1095658523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-44efcb9b-4a08-4245-ac3d-fe6164ed1d2a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-44efcb9b-4a08-4245-ac3d-fe6164ed1d2a.5174d746-dd5c-4c76-b2b1-6ee86d9b29cb 1G" returned: 0 in 0.374s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:58:00 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-6c98c468-a8d0-4d82-a408-7a30a89eceba tempest-ProjectMemberTests-1095658523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44efcb9b-4a08-4245-ac3d-fe6164ed1d2a -F qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-44efcb9b-4a08-4245-ac3d-fe6164ed1d2a.5174d746-dd5c-4c76-b2b1-6ee86d9b29cb {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:58:00 devstack sudo[105640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44efcb9b-4a08-4245-ac3d-fe6164ed1d2a -F qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-44efcb9b-4a08-4245-ac3d-fe6164ed1d2a.5174d746-dd5c-4c76-b2b1-6ee86d9b29cb Sep 22 15:58:00 devstack sudo[105640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:58:00 devstack sudo[105640]: pam_unix(sudo:session): session closed for user root Sep 22 15:58:00 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-6c98c468-a8d0-4d82-a408-7a30a89eceba tempest-ProjectMemberTests-1095658523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44efcb9b-4a08-4245-ac3d-fe6164ed1d2a -F qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-44efcb9b-4a08-4245-ac3d-fe6164ed1d2a.5174d746-dd5c-4c76-b2b1-6ee86d9b29cb" returned: 0 in 0.280s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:58:00 devstack cinder-volume[86212]: WARNING cinder.volume.drivers.remotefs [None req-6c98c468-a8d0-4d82-a408-7a30a89eceba tempest-ProjectMemberTests-1095658523 None] /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-44efcb9b-4a08-4245-ac3d-fe6164ed1d2a.5174d746-dd5c-4c76-b2b1-6ee86d9b29cb is being set with open permissions: ugo+rw Sep 22 15:58:00 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-6c98c468-a8d0-4d82-a408-7a30a89eceba tempest-ProjectMemberTests-1095658523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-44efcb9b-4a08-4245-ac3d-fe6164ed1d2a.5174d746-dd5c-4c76-b2b1-6ee86d9b29cb {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:58:00 devstack sudo[105645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-44efcb9b-4a08-4245-ac3d-fe6164ed1d2a.5174d746-dd5c-4c76-b2b1-6ee86d9b29cb Sep 22 15:58:00 devstack sudo[105645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:58:00 devstack sudo[105645]: pam_unix(sudo:session): session closed for user root Sep 22 15:58:00 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-6c98c468-a8d0-4d82-a408-7a30a89eceba tempest-ProjectMemberTests-1095658523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-44efcb9b-4a08-4245-ac3d-fe6164ed1d2a.5174d746-dd5c-4c76-b2b1-6ee86d9b29cb" returned: 0 in 0.232s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:58:00 devstack cinder-volume[86212]: DEBUG dbcounter [-] [86212] Writing DB stats cinder:UPDATE=154,cinder:SELECT=128,cinder:DELETE=16,cinder:INSERT=42 {{(pid=86212) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 22 15:58:00 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-6c98c468-a8d0-4d82-a408-7a30a89eceba tempest-ProjectMemberTests-1095658523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-44efcb9b-4a08-4245-ac3d-fe6164ed1d2a.info {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:58:00 devstack sudo[105648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-44efcb9b-4a08-4245-ac3d-fe6164ed1d2a.info Sep 22 15:58:00 devstack sudo[105648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:58:00 devstack sudo[105648]: pam_unix(sudo:session): session closed for user root Sep 22 15:58:00 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-6c98c468-a8d0-4d82-a408-7a30a89eceba tempest-ProjectMemberTests-1095658523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-44efcb9b-4a08-4245-ac3d-fe6164ed1d2a.info" returned: 0 in 0.246s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:58:00 devstack cinder-volume[86212]: WARNING cinder.volume.drivers.remotefs [None req-6c98c468-a8d0-4d82-a408-7a30a89eceba tempest-ProjectMemberTests-1095658523 None] /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-44efcb9b-4a08-4245-ac3d-fe6164ed1d2a.info is being set with open permissions: ugo+rw Sep 22 15:58:00 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-6c98c468-a8d0-4d82-a408-7a30a89eceba tempest-ProjectMemberTests-1095658523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-44efcb9b-4a08-4245-ac3d-fe6164ed1d2a.info {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:58:01 devstack sudo[105651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-44efcb9b-4a08-4245-ac3d-fe6164ed1d2a.info Sep 22 15:58:01 devstack sudo[105651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:58:01 devstack sudo[105651]: pam_unix(sudo:session): session closed for user root Sep 22 15:58:01 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-6c98c468-a8d0-4d82-a408-7a30a89eceba tempest-ProjectMemberTests-1095658523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-44efcb9b-4a08-4245-ac3d-fe6164ed1d2a.info" returned: 0 in 0.238s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:58:01 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-6c98c468-a8d0-4d82-a408-7a30a89eceba tempest-ProjectMemberTests-1095658523 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.801s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:58:01 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-6c98c468-a8d0-4d82-a408-7a30a89eceba tempest-ProjectMemberTests-1095658523 None] Create snapshot completed successfully Sep 22 15:58:01 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-70778513-e3f8-4713-b1a4-841d59488772 tempest-ProjectMemberTests-1095658523 None] Acquiring lock "cinder-5174d746-dd5c-4c76-b2b1-6ee86d9b29cb-delete_snapshot" by "delete_snapshot" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:58:01 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-70778513-e3f8-4713-b1a4-841d59488772 tempest-ProjectMemberTests-1095658523 None] Lock "cinder-5174d746-dd5c-4c76-b2b1-6ee86d9b29cb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:58:01 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-70778513-e3f8-4713-b1a4-841d59488772 tempest-ProjectMemberTests-1095658523 None] Acquiring lock "cinder-quobyte-44efcb9b-4a08-4245-ac3d-fe6164ed1d2a" by "delete_snapshot" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:58:01 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-70778513-e3f8-4713-b1a4-841d59488772 tempest-ProjectMemberTests-1095658523 None] Lock "cinder-quobyte-44efcb9b-4a08-4245-ac3d-fe6164ed1d2a" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:58:01 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-70778513-e3f8-4713-b1a4-841d59488772 tempest-ProjectMemberTests-1095658523 None] Acquiring lock "cinder-quobyte-5174d746-dd5c-4c76-b2b1-6ee86d9b29cb" by "_delete_snapshot" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:58:01 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-70778513-e3f8-4713-b1a4-841d59488772 tempest-ProjectMemberTests-1095658523 None] Lock "cinder-quobyte-5174d746-dd5c-4c76-b2b1-6ee86d9b29cb" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:58:01 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-70778513-e3f8-4713-b1a4-841d59488772 tempest-ProjectMemberTests-1095658523 None] Deleting offline snapshot 5174d746-dd5c-4c76-b2b1-6ee86d9b29cb of volume 44efcb9b-4a08-4245-ac3d-fe6164ed1d2a {{(pid=86212) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 22 15:58:01 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-70778513-e3f8-4713-b1a4-841d59488772 tempest-ProjectMemberTests-1095658523 None] snapshot_file for this snap is: volume-44efcb9b-4a08-4245-ac3d-fe6164ed1d2a.5174d746-dd5c-4c76-b2b1-6ee86d9b29cb {{(pid=86212) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 22 15:58:01 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f7045d3-737e-4ab0-847c-765fe77e11f2]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:58:01 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-70778513-e3f8-4713-b1a4-841d59488772 tempest-ProjectMemberTests-1095658523 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-44efcb9b-4a08-4245-ac3d-fe6164ed1d2a.5174d746-dd5c-4c76-b2b1-6ee86d9b29cb {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:58:01 devstack sudo[105654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-44efcb9b-4a08-4245-ac3d-fe6164ed1d2a.5174d746-dd5c-4c76-b2b1-6ee86d9b29cb Sep 22 15:58:01 devstack sudo[105654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:58:02 devstack sudo[105654]: pam_unix(sudo:session): session closed for user root Sep 22 15:58:02 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-70778513-e3f8-4713-b1a4-841d59488772 tempest-ProjectMemberTests-1095658523 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-44efcb9b-4a08-4245-ac3d-fe6164ed1d2a.5174d746-dd5c-4c76-b2b1-6ee86d9b29cb" returned: 0 in 0.350s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:58:02 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-70778513-e3f8-4713-b1a4-841d59488772 tempest-ProjectMemberTests-1095658523 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-44efcb9b-4a08-4245-ac3d-fe6164ed1d2a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86212) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 22 15:58:02 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4d677a7-5645-423e-8b4c-7e21c611ec86]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:58:02 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-70778513-e3f8-4713-b1a4-841d59488772 tempest-ProjectMemberTests-1095658523 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-44efcb9b-4a08-4245-ac3d-fe6164ed1d2a {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:58:02 devstack sudo[105659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-44efcb9b-4a08-4245-ac3d-fe6164ed1d2a Sep 22 15:58:02 devstack sudo[105659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:58:02 devstack sudo[105659]: pam_unix(sudo:session): session closed for user root Sep 22 15:58:02 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-70778513-e3f8-4713-b1a4-841d59488772 tempest-ProjectMemberTests-1095658523 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-44efcb9b-4a08-4245-ac3d-fe6164ed1d2a" returned: 0 in 0.344s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:58:02 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-70778513-e3f8-4713-b1a4-841d59488772 tempest-ProjectMemberTests-1095658523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-44efcb9b-4a08-4245-ac3d-fe6164ed1d2a.5174d746-dd5c-4c76-b2b1-6ee86d9b29cb {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:58:02 devstack sudo[105664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-44efcb9b-4a08-4245-ac3d-fe6164ed1d2a.5174d746-dd5c-4c76-b2b1-6ee86d9b29cb Sep 22 15:58:02 devstack sudo[105664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:58:02 devstack sudo[105664]: pam_unix(sudo:session): session closed for user root Sep 22 15:58:02 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-70778513-e3f8-4713-b1a4-841d59488772 tempest-ProjectMemberTests-1095658523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-44efcb9b-4a08-4245-ac3d-fe6164ed1d2a.5174d746-dd5c-4c76-b2b1-6ee86d9b29cb" returned: 0 in 0.322s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:58:02 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-70778513-e3f8-4713-b1a4-841d59488772 tempest-ProjectMemberTests-1095658523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-44efcb9b-4a08-4245-ac3d-fe6164ed1d2a.5174d746-dd5c-4c76-b2b1-6ee86d9b29cb {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:58:02 devstack sudo[105669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-44efcb9b-4a08-4245-ac3d-fe6164ed1d2a.5174d746-dd5c-4c76-b2b1-6ee86d9b29cb Sep 22 15:58:02 devstack sudo[105669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:58:02 devstack sudo[105669]: pam_unix(sudo:session): session closed for user root Sep 22 15:58:02 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-70778513-e3f8-4713-b1a4-841d59488772 tempest-ProjectMemberTests-1095658523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-44efcb9b-4a08-4245-ac3d-fe6164ed1d2a.5174d746-dd5c-4c76-b2b1-6ee86d9b29cb" returned: 0 in 0.240s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:58:02 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-70778513-e3f8-4713-b1a4-841d59488772 tempest-ProjectMemberTests-1095658523 None] Lock "cinder-quobyte-5174d746-dd5c-4c76-b2b1-6ee86d9b29cb" released by "_delete_snapshot" :: held 1.344s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:58:02 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-70778513-e3f8-4713-b1a4-841d59488772 tempest-ProjectMemberTests-1095658523 None] Lock "cinder-quobyte-44efcb9b-4a08-4245-ac3d-fe6164ed1d2a" released by "delete_snapshot" :: held 1.365s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:58:03 devstack cinder-volume[86212]: DEBUG cinder.quota [None req-70778513-e3f8-4713-b1a4-841d59488772 tempest-ProjectMemberTests-1095658523 None] Created reservations ['ab99f836-8b53-47c2-99ea-f9422bf133ba', 'de0cf2e9-c29e-4d4b-80f0-3c9a082e6b90', '4b601a92-26d5-4cfb-8dfb-91c4e8264991', '1a15d413-5c8b-4f93-8c1c-c68dad7d575f'] {{(pid=86212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 15:58:03 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-70778513-e3f8-4713-b1a4-841d59488772 tempest-ProjectMemberTests-1095658523 None] Delete snapshot completed successfully. Sep 22 15:58:03 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-70778513-e3f8-4713-b1a4-841d59488772 tempest-ProjectMemberTests-1095658523 None] Lock "cinder-5174d746-dd5c-4c76-b2b1-6ee86d9b29cb-delete_snapshot" released by "delete_snapshot" :: held 1.480s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:58:03 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-f878f5b1-880b-48ac-8451-2df13a711083 tempest-ProjectMemberTests-1095658523 None] Acquiring lock "cinder-44efcb9b-4a08-4245-ac3d-fe6164ed1d2a-delete_volume" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:58:03 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-f878f5b1-880b-48ac-8451-2df13a711083 tempest-ProjectMemberTests-1095658523 None] Lock "cinder-44efcb9b-4a08-4245-ac3d-fe6164ed1d2a-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:58:03 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-f878f5b1-880b-48ac-8451-2df13a711083 tempest-ProjectMemberTests-1095658523 None] Acquiring lock "cinder-quobyte-44efcb9b-4a08-4245-ac3d-fe6164ed1d2a" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:58:03 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-f878f5b1-880b-48ac-8451-2df13a711083 tempest-ProjectMemberTests-1095658523 None] Lock "cinder-quobyte-44efcb9b-4a08-4245-ac3d-fe6164ed1d2a" acquired by "delete_volume" :: waited 0.013s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:58:03 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[96c13697-20d9-4d86-856e-9025564f2b25]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:58:03 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-f878f5b1-880b-48ac-8451-2df13a711083 tempest-ProjectMemberTests-1095658523 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-44efcb9b-4a08-4245-ac3d-fe6164ed1d2a {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:58:03 devstack sudo[105672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-44efcb9b-4a08-4245-ac3d-fe6164ed1d2a Sep 22 15:58:03 devstack sudo[105672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:58:04 devstack sudo[105672]: pam_unix(sudo:session): session closed for user root Sep 22 15:58:04 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-f878f5b1-880b-48ac-8451-2df13a711083 tempest-ProjectMemberTests-1095658523 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-44efcb9b-4a08-4245-ac3d-fe6164ed1d2a" returned: 0 in 0.350s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:58:04 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-f878f5b1-880b-48ac-8451-2df13a711083 tempest-ProjectMemberTests-1095658523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-44efcb9b-4a08-4245-ac3d-fe6164ed1d2a {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:58:04 devstack sudo[105677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-44efcb9b-4a08-4245-ac3d-fe6164ed1d2a Sep 22 15:58:04 devstack sudo[105677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:58:04 devstack sudo[105677]: pam_unix(sudo:session): session closed for user root Sep 22 15:58:04 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-f878f5b1-880b-48ac-8451-2df13a711083 tempest-ProjectMemberTests-1095658523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-44efcb9b-4a08-4245-ac3d-fe6164ed1d2a" returned: 0 in 0.243s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:58:04 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-f878f5b1-880b-48ac-8451-2df13a711083 tempest-ProjectMemberTests-1095658523 None] Lock "cinder-quobyte-44efcb9b-4a08-4245-ac3d-fe6164ed1d2a" released by "delete_volume" :: held 0.653s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:58:04 devstack cinder-volume[86212]: DEBUG cinder.quota [None req-f878f5b1-880b-48ac-8451-2df13a711083 tempest-ProjectMemberTests-1095658523 None] Created reservations ['134c96f4-13e2-4d80-bc2e-c258d850d711', 'c5be1522-65c2-4bf0-a227-0a4f9cacae17', '81eb2409-b21d-4cbf-99a2-b615a66a75e4', '7dd66e7b-2f37-4754-a149-899ba8db60ac'] {{(pid=86212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 15:58:04 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-f878f5b1-880b-48ac-8451-2df13a711083 tempest-ProjectMemberTests-1095658523 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:58:04 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-f878f5b1-880b-48ac-8451-2df13a711083 tempest-ProjectMemberTests-1095658523 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:58:04 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-f878f5b1-880b-48ac-8451-2df13a711083 tempest-ProjectMemberTests-1095658523 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:58:04 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-f878f5b1-880b-48ac-8451-2df13a711083 tempest-ProjectMemberTests-1095658523 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:58:04 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-f878f5b1-880b-48ac-8451-2df13a711083 tempest-ProjectMemberTests-1095658523 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:58:04 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-f878f5b1-880b-48ac-8451-2df13a711083 tempest-ProjectMemberTests-1095658523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:58:04 devstack sudo[105680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc Sep 22 15:58:04 devstack sudo[105680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:58:04 devstack sudo[105680]: pam_unix(sudo:session): session closed for user root Sep 22 15:58:04 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-f878f5b1-880b-48ac-8451-2df13a711083 tempest-ProjectMemberTests-1095658523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc" returned: 0 in 0.252s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:58:04 devstack cinder-volume[86212]: DEBUG cinder.manager [None req-f878f5b1-880b-48ac-8451-2df13a711083 tempest-ProjectMemberTests-1095658523 None] Notifying Schedulers of capabilities ... {{(pid=86212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 15:58:04 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-f878f5b1-880b-48ac-8451-2df13a711083 tempest-ProjectMemberTests-1095658523 None] Deleted volume successfully. Sep 22 15:58:04 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-f878f5b1-880b-48ac-8451-2df13a711083 tempest-ProjectMemberTests-1095658523 None] Lock "cinder-44efcb9b-4a08-4245-ac3d-fe6164ed1d2a-delete_volume" released by "delete_volume" :: held 1.150s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:58:05 devstack cinder-volume[86212]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4642454-b035-4cb5-ab6a-59043a6b397f tempest-ProjectMemberTests-1095658523 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 15:58:05 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-e4642454-b035-4cb5-ab6a-59043a6b397f tempest-ProjectMemberTests-1095658523 None] Flow 'volume_create_manager' (9e8f8078-4878-4291-ba6d-aa9be8893fe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:58:05 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-e4642454-b035-4cb5-ab6a-59043a6b397f tempest-ProjectMemberTests-1095658523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6519d33-ed43-41f9-8b0c-e91f07698de1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:58:05 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-e4642454-b035-4cb5-ab6a-59043a6b397f tempest-ProjectMemberTests-1095658523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6519d33-ed43-41f9-8b0c-e91f07698de1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:58:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1072403888',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2857fc48-1486-4d8f-b105-7c439642fd6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e3beb47e92e4a8c9efa3433374c2e0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:58:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:58:05Z,use_quota=True,user_id='c4cc884fb51643ee9efb176f88d0543f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:58:05 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-e4642454-b035-4cb5-ab6a-59043a6b397f tempest-ProjectMemberTests-1095658523 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2feeda62-9c0e-4c21-82c5-5bfe64dc4f75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:58:05 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-e4642454-b035-4cb5-ab6a-59043a6b397f tempest-ProjectMemberTests-1095658523 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2feeda62-9c0e-4c21-82c5-5bfe64dc4f75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:58:05 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-e4642454-b035-4cb5-ab6a-59043a6b397f tempest-ProjectMemberTests-1095658523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (635de0e7-5097-4789-9220-9ab94ed5c874) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:58:05 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-e4642454-b035-4cb5-ab6a-59043a6b397f tempest-ProjectMemberTests-1095658523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (635de0e7-5097-4789-9220-9ab94ed5c874) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2857fc48-1486-4d8f-b105-7c439642fd6e', 'volume_name': 'volume-2857fc48-1486-4d8f-b105-7c439642fd6e', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:58:05 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-e4642454-b035-4cb5-ab6a-59043a6b397f tempest-ProjectMemberTests-1095658523 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a5fd48e-b7b4-47e9-a230-cf45b9335c8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:58:05 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-e4642454-b035-4cb5-ab6a-59043a6b397f tempest-ProjectMemberTests-1095658523 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a5fd48e-b7b4-47e9-a230-cf45b9335c8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:58:05 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-e4642454-b035-4cb5-ab6a-59043a6b397f tempest-ProjectMemberTests-1095658523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (256a629d-f640-435a-981f-6c0b8a6134a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:58:05 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-e4642454-b035-4cb5-ab6a-59043a6b397f tempest-ProjectMemberTests-1095658523 None] Volume 2857fc48-1486-4d8f-b105-7c439642fd6e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2857fc48-1486-4d8f-b105-7c439642fd6e', 'volume_size': 1} Sep 22 15:58:05 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-e4642454-b035-4cb5-ab6a-59043a6b397f tempest-ProjectMemberTests-1095658523 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:58:05 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-e4642454-b035-4cb5-ab6a-59043a6b397f tempest-ProjectMemberTests-1095658523 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:58:05 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-e4642454-b035-4cb5-ab6a-59043a6b397f tempest-ProjectMemberTests-1095658523 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:58:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1072403888',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2857fc48-1486-4d8f-b105-7c439642fd6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e3beb47e92e4a8c9efa3433374c2e0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:58:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:58:05Z,use_quota=True,user_id='c4cc884fb51643ee9efb176f88d0543f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)}" {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 15:58:05 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-e4642454-b035-4cb5-ab6a-59043a6b397f tempest-ProjectMemberTests-1095658523 None] Creating volume 2857fc48-1486-4d8f-b105-7c439642fd6e {{(pid=86212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 15:58:05 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-e4642454-b035-4cb5-ab6a-59043a6b397f tempest-ProjectMemberTests-1095658523 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:58:05 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-e4642454-b035-4cb5-ab6a-59043a6b397f tempest-ProjectMemberTests-1095658523 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:58:05 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-e4642454-b035-4cb5-ab6a-59043a6b397f tempest-ProjectMemberTests-1095658523 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:58:05 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-e4642454-b035-4cb5-ab6a-59043a6b397f tempest-ProjectMemberTests-1095658523 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:58:05 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-e4642454-b035-4cb5-ab6a-59043a6b397f tempest-ProjectMemberTests-1095658523 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:58:05 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-e4642454-b035-4cb5-ab6a-59043a6b397f tempest-ProjectMemberTests-1095658523 None] Selected osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 as target Quobyte volume. {{(pid=86212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 15:58:05 devstack cinder-volume[86212]: INFO cinder.volume.drivers.remotefs [None req-e4642454-b035-4cb5-ab6a-59043a6b397f tempest-ProjectMemberTests-1095658523 None] casted to osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 Sep 22 15:58:05 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-e4642454-b035-4cb5-ab6a-59043a6b397f tempest-ProjectMemberTests-1095658523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2857fc48-1486-4d8f-b105-7c439642fd6e 1073741824 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:58:05 devstack sudo[105683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2857fc48-1486-4d8f-b105-7c439642fd6e 1073741824 Sep 22 15:58:05 devstack sudo[105683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:58:05 devstack sudo[105683]: pam_unix(sudo:session): session closed for user root Sep 22 15:58:05 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-e4642454-b035-4cb5-ab6a-59043a6b397f tempest-ProjectMemberTests-1095658523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2857fc48-1486-4d8f-b105-7c439642fd6e 1073741824" returned: 0 in 0.413s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:58:05 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-e4642454-b035-4cb5-ab6a-59043a6b397f tempest-ProjectMemberTests-1095658523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2857fc48-1486-4d8f-b105-7c439642fd6e {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:58:05 devstack sudo[105688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2857fc48-1486-4d8f-b105-7c439642fd6e Sep 22 15:58:05 devstack sudo[105688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:58:06 devstack sudo[105688]: pam_unix(sudo:session): session closed for user root Sep 22 15:58:06 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-e4642454-b035-4cb5-ab6a-59043a6b397f tempest-ProjectMemberTests-1095658523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2857fc48-1486-4d8f-b105-7c439642fd6e" returned: 0 in 0.254s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:58:06 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-e4642454-b035-4cb5-ab6a-59043a6b397f tempest-ProjectMemberTests-1095658523 None] <== create_volume: return (709ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'} {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 15:58:06 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-e4642454-b035-4cb5-ab6a-59043a6b397f tempest-ProjectMemberTests-1095658523 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.712s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:58:06 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-e4642454-b035-4cb5-ab6a-59043a6b397f tempest-ProjectMemberTests-1095658523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (256a629d-f640-435a-981f-6c0b8a6134a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2857fc48-1486-4d8f-b105-7c439642fd6e', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:58:06 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-e4642454-b035-4cb5-ab6a-59043a6b397f tempest-ProjectMemberTests-1095658523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f9a4137-c57b-4762-a249-f09f02bfaf1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:58:06 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-e4642454-b035-4cb5-ab6a-59043a6b397f tempest-ProjectMemberTests-1095658523 None] Volume volume-2857fc48-1486-4d8f-b105-7c439642fd6e (2857fc48-1486-4d8f-b105-7c439642fd6e): created successfully Sep 22 15:58:06 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-e4642454-b035-4cb5-ab6a-59043a6b397f tempest-ProjectMemberTests-1095658523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f9a4137-c57b-4762-a249-f09f02bfaf1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:58:06 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-e4642454-b035-4cb5-ab6a-59043a6b397f tempest-ProjectMemberTests-1095658523 None] Flow 'volume_create_manager' (9e8f8078-4878-4291-ba6d-aa9be8893fe3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:58:06 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-e4642454-b035-4cb5-ab6a-59043a6b397f tempest-ProjectMemberTests-1095658523 None] Created volume successfully. Sep 22 15:58:06 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-aafa3600-3a9f-420e-8991-80b5c01ce491 tempest-ProjectMemberTests-1095658523 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:58:06 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-aafa3600-3a9f-420e-8991-80b5c01ce491 tempest-ProjectMemberTests-1095658523 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:58:06 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-aafa3600-3a9f-420e-8991-80b5c01ce491 tempest-ProjectMemberTests-1095658523 None] Creating offline snapshot 4c0430f8-6b49-4cbf-b060-fab2a10a69da of volume 2857fc48-1486-4d8f-b105-7c439642fd6e {{(pid=86212) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 22 15:58:06 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[a608080d-5736-4308-8e80-ac4909fee233]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:58:06 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-aafa3600-3a9f-420e-8991-80b5c01ce491 tempest-ProjectMemberTests-1095658523 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2857fc48-1486-4d8f-b105-7c439642fd6e {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:58:06 devstack sudo[105691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2857fc48-1486-4d8f-b105-7c439642fd6e Sep 22 15:58:06 devstack sudo[105691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:58:06 devstack sudo[105691]: pam_unix(sudo:session): session closed for user root Sep 22 15:58:06 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-aafa3600-3a9f-420e-8991-80b5c01ce491 tempest-ProjectMemberTests-1095658523 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2857fc48-1486-4d8f-b105-7c439642fd6e" returned: 0 in 0.373s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:58:06 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-aafa3600-3a9f-420e-8991-80b5c01ce491 tempest-ProjectMemberTests-1095658523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2857fc48-1486-4d8f-b105-7c439642fd6e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2857fc48-1486-4d8f-b105-7c439642fd6e.4c0430f8-6b49-4cbf-b060-fab2a10a69da 1G {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:58:06 devstack sudo[105696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2857fc48-1486-4d8f-b105-7c439642fd6e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2857fc48-1486-4d8f-b105-7c439642fd6e.4c0430f8-6b49-4cbf-b060-fab2a10a69da 1G Sep 22 15:58:06 devstack sudo[105696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:58:07 devstack sudo[105696]: pam_unix(sudo:session): session closed for user root Sep 22 15:58:07 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-aafa3600-3a9f-420e-8991-80b5c01ce491 tempest-ProjectMemberTests-1095658523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2857fc48-1486-4d8f-b105-7c439642fd6e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2857fc48-1486-4d8f-b105-7c439642fd6e.4c0430f8-6b49-4cbf-b060-fab2a10a69da 1G" returned: 0 in 0.381s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:58:07 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-aafa3600-3a9f-420e-8991-80b5c01ce491 tempest-ProjectMemberTests-1095658523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2857fc48-1486-4d8f-b105-7c439642fd6e -F qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2857fc48-1486-4d8f-b105-7c439642fd6e.4c0430f8-6b49-4cbf-b060-fab2a10a69da {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:58:07 devstack sudo[105702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2857fc48-1486-4d8f-b105-7c439642fd6e -F qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2857fc48-1486-4d8f-b105-7c439642fd6e.4c0430f8-6b49-4cbf-b060-fab2a10a69da Sep 22 15:58:07 devstack sudo[105702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:58:07 devstack sudo[105702]: pam_unix(sudo:session): session closed for user root Sep 22 15:58:07 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-aafa3600-3a9f-420e-8991-80b5c01ce491 tempest-ProjectMemberTests-1095658523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2857fc48-1486-4d8f-b105-7c439642fd6e -F qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2857fc48-1486-4d8f-b105-7c439642fd6e.4c0430f8-6b49-4cbf-b060-fab2a10a69da" returned: 0 in 0.280s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:58:07 devstack cinder-volume[86212]: WARNING cinder.volume.drivers.remotefs [None req-aafa3600-3a9f-420e-8991-80b5c01ce491 tempest-ProjectMemberTests-1095658523 None] /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2857fc48-1486-4d8f-b105-7c439642fd6e.4c0430f8-6b49-4cbf-b060-fab2a10a69da is being set with open permissions: ugo+rw Sep 22 15:58:07 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-aafa3600-3a9f-420e-8991-80b5c01ce491 tempest-ProjectMemberTests-1095658523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2857fc48-1486-4d8f-b105-7c439642fd6e.4c0430f8-6b49-4cbf-b060-fab2a10a69da {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:58:07 devstack sudo[105707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2857fc48-1486-4d8f-b105-7c439642fd6e.4c0430f8-6b49-4cbf-b060-fab2a10a69da Sep 22 15:58:07 devstack sudo[105707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:58:07 devstack sudo[105707]: pam_unix(sudo:session): session closed for user root Sep 22 15:58:07 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-aafa3600-3a9f-420e-8991-80b5c01ce491 tempest-ProjectMemberTests-1095658523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2857fc48-1486-4d8f-b105-7c439642fd6e.4c0430f8-6b49-4cbf-b060-fab2a10a69da" returned: 0 in 0.237s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:58:07 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-aafa3600-3a9f-420e-8991-80b5c01ce491 tempest-ProjectMemberTests-1095658523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2857fc48-1486-4d8f-b105-7c439642fd6e.info {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:58:07 devstack sudo[105710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2857fc48-1486-4d8f-b105-7c439642fd6e.info Sep 22 15:58:07 devstack sudo[105710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:58:08 devstack sudo[105710]: pam_unix(sudo:session): session closed for user root Sep 22 15:58:08 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-aafa3600-3a9f-420e-8991-80b5c01ce491 tempest-ProjectMemberTests-1095658523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2857fc48-1486-4d8f-b105-7c439642fd6e.info" returned: 0 in 0.241s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:58:08 devstack cinder-volume[86212]: WARNING cinder.volume.drivers.remotefs [None req-aafa3600-3a9f-420e-8991-80b5c01ce491 tempest-ProjectMemberTests-1095658523 None] /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2857fc48-1486-4d8f-b105-7c439642fd6e.info is being set with open permissions: ugo+rw Sep 22 15:58:08 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-aafa3600-3a9f-420e-8991-80b5c01ce491 tempest-ProjectMemberTests-1095658523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2857fc48-1486-4d8f-b105-7c439642fd6e.info {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:58:08 devstack sudo[105714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2857fc48-1486-4d8f-b105-7c439642fd6e.info Sep 22 15:58:08 devstack sudo[105714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:58:08 devstack sudo[105714]: pam_unix(sudo:session): session closed for user root Sep 22 15:58:08 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-aafa3600-3a9f-420e-8991-80b5c01ce491 tempest-ProjectMemberTests-1095658523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2857fc48-1486-4d8f-b105-7c439642fd6e.info" returned: 0 in 0.235s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:58:08 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-aafa3600-3a9f-420e-8991-80b5c01ce491 tempest-ProjectMemberTests-1095658523 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.824s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:58:08 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-aafa3600-3a9f-420e-8991-80b5c01ce491 tempest-ProjectMemberTests-1095658523 None] Create snapshot completed successfully Sep 22 15:58:08 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-01ede2c7-4558-498c-8934-23aadc050d87 tempest-ProjectMemberTests-1095658523 None] Acquiring lock "cinder-4c0430f8-6b49-4cbf-b060-fab2a10a69da-delete_snapshot" by "delete_snapshot" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:58:08 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-01ede2c7-4558-498c-8934-23aadc050d87 tempest-ProjectMemberTests-1095658523 None] Lock "cinder-4c0430f8-6b49-4cbf-b060-fab2a10a69da-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:58:08 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-01ede2c7-4558-498c-8934-23aadc050d87 tempest-ProjectMemberTests-1095658523 None] Acquiring lock "cinder-quobyte-2857fc48-1486-4d8f-b105-7c439642fd6e" by "delete_snapshot" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:58:08 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-01ede2c7-4558-498c-8934-23aadc050d87 tempest-ProjectMemberTests-1095658523 None] Lock "cinder-quobyte-2857fc48-1486-4d8f-b105-7c439642fd6e" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:58:08 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-01ede2c7-4558-498c-8934-23aadc050d87 tempest-ProjectMemberTests-1095658523 None] Acquiring lock "cinder-quobyte-4c0430f8-6b49-4cbf-b060-fab2a10a69da" by "_delete_snapshot" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:58:08 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-01ede2c7-4558-498c-8934-23aadc050d87 tempest-ProjectMemberTests-1095658523 None] Lock "cinder-quobyte-4c0430f8-6b49-4cbf-b060-fab2a10a69da" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:58:08 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-01ede2c7-4558-498c-8934-23aadc050d87 tempest-ProjectMemberTests-1095658523 None] Deleting offline snapshot 4c0430f8-6b49-4cbf-b060-fab2a10a69da of volume 2857fc48-1486-4d8f-b105-7c439642fd6e {{(pid=86212) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 22 15:58:08 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-01ede2c7-4558-498c-8934-23aadc050d87 tempest-ProjectMemberTests-1095658523 None] snapshot_file for this snap is: volume-2857fc48-1486-4d8f-b105-7c439642fd6e.4c0430f8-6b49-4cbf-b060-fab2a10a69da {{(pid=86212) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 22 15:58:08 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[c97b7d58-8d1e-474c-8f0b-8c5db713d661]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:58:08 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-01ede2c7-4558-498c-8934-23aadc050d87 tempest-ProjectMemberTests-1095658523 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2857fc48-1486-4d8f-b105-7c439642fd6e.4c0430f8-6b49-4cbf-b060-fab2a10a69da {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:58:08 devstack sudo[105717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2857fc48-1486-4d8f-b105-7c439642fd6e.4c0430f8-6b49-4cbf-b060-fab2a10a69da Sep 22 15:58:08 devstack sudo[105717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:58:09 devstack sudo[105717]: pam_unix(sudo:session): session closed for user root Sep 22 15:58:09 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-01ede2c7-4558-498c-8934-23aadc050d87 tempest-ProjectMemberTests-1095658523 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2857fc48-1486-4d8f-b105-7c439642fd6e.4c0430f8-6b49-4cbf-b060-fab2a10a69da" returned: 0 in 0.343s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:58:09 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-01ede2c7-4558-498c-8934-23aadc050d87 tempest-ProjectMemberTests-1095658523 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2857fc48-1486-4d8f-b105-7c439642fd6e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86212) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 22 15:58:09 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[956c3ac5-4cb1-44b5-a865-82c2d5466b28]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:58:09 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-01ede2c7-4558-498c-8934-23aadc050d87 tempest-ProjectMemberTests-1095658523 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2857fc48-1486-4d8f-b105-7c439642fd6e {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:58:09 devstack sudo[105722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2857fc48-1486-4d8f-b105-7c439642fd6e Sep 22 15:58:09 devstack sudo[105722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:58:09 devstack sudo[105722]: pam_unix(sudo:session): session closed for user root Sep 22 15:58:09 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-01ede2c7-4558-498c-8934-23aadc050d87 tempest-ProjectMemberTests-1095658523 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2857fc48-1486-4d8f-b105-7c439642fd6e" returned: 0 in 0.342s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:58:09 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-01ede2c7-4558-498c-8934-23aadc050d87 tempest-ProjectMemberTests-1095658523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2857fc48-1486-4d8f-b105-7c439642fd6e.4c0430f8-6b49-4cbf-b060-fab2a10a69da {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:58:09 devstack sudo[105727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2857fc48-1486-4d8f-b105-7c439642fd6e.4c0430f8-6b49-4cbf-b060-fab2a10a69da Sep 22 15:58:09 devstack sudo[105727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:58:09 devstack sudo[105727]: pam_unix(sudo:session): session closed for user root Sep 22 15:58:09 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-01ede2c7-4558-498c-8934-23aadc050d87 tempest-ProjectMemberTests-1095658523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2857fc48-1486-4d8f-b105-7c439642fd6e.4c0430f8-6b49-4cbf-b060-fab2a10a69da" returned: 0 in 0.326s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:58:09 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-01ede2c7-4558-498c-8934-23aadc050d87 tempest-ProjectMemberTests-1095658523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2857fc48-1486-4d8f-b105-7c439642fd6e.4c0430f8-6b49-4cbf-b060-fab2a10a69da {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:58:09 devstack sudo[105732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2857fc48-1486-4d8f-b105-7c439642fd6e.4c0430f8-6b49-4cbf-b060-fab2a10a69da Sep 22 15:58:09 devstack sudo[105732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:58:10 devstack sudo[105732]: pam_unix(sudo:session): session closed for user root Sep 22 15:58:10 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-01ede2c7-4558-498c-8934-23aadc050d87 tempest-ProjectMemberTests-1095658523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2857fc48-1486-4d8f-b105-7c439642fd6e.4c0430f8-6b49-4cbf-b060-fab2a10a69da" returned: 0 in 0.246s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:58:10 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-01ede2c7-4558-498c-8934-23aadc050d87 tempest-ProjectMemberTests-1095658523 None] Lock "cinder-quobyte-4c0430f8-6b49-4cbf-b060-fab2a10a69da" released by "_delete_snapshot" :: held 1.348s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:58:10 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-01ede2c7-4558-498c-8934-23aadc050d87 tempest-ProjectMemberTests-1095658523 None] Lock "cinder-quobyte-2857fc48-1486-4d8f-b105-7c439642fd6e" released by "delete_snapshot" :: held 1.370s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:58:10 devstack cinder-volume[86212]: DEBUG cinder.quota [None req-01ede2c7-4558-498c-8934-23aadc050d87 tempest-ProjectMemberTests-1095658523 None] Created reservations ['3de19837-c8a1-4dc4-a50c-b263b35bb499', 'f69da377-ce72-47ec-b9fc-831cb25b85e9', '52b9604f-fa87-4a0f-ae4e-0404fca78815', 'd595deac-85db-475e-964a-f4f2674a0ea1'] {{(pid=86212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 15:58:10 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-01ede2c7-4558-498c-8934-23aadc050d87 tempest-ProjectMemberTests-1095658523 None] Delete snapshot completed successfully. Sep 22 15:58:10 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-01ede2c7-4558-498c-8934-23aadc050d87 tempest-ProjectMemberTests-1095658523 None] Lock "cinder-4c0430f8-6b49-4cbf-b060-fab2a10a69da-delete_snapshot" released by "delete_snapshot" :: held 1.495s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:58:10 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-57cd6e53-3ba6-476f-a364-6df9aee675a2 tempest-ProjectMemberTests-1095658523 None] Acquiring lock "cinder-2857fc48-1486-4d8f-b105-7c439642fd6e-delete_volume" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:58:10 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-57cd6e53-3ba6-476f-a364-6df9aee675a2 tempest-ProjectMemberTests-1095658523 None] Lock "cinder-2857fc48-1486-4d8f-b105-7c439642fd6e-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:58:10 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-57cd6e53-3ba6-476f-a364-6df9aee675a2 tempest-ProjectMemberTests-1095658523 None] Acquiring lock "cinder-quobyte-2857fc48-1486-4d8f-b105-7c439642fd6e" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:58:10 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-57cd6e53-3ba6-476f-a364-6df9aee675a2 tempest-ProjectMemberTests-1095658523 None] Lock "cinder-quobyte-2857fc48-1486-4d8f-b105-7c439642fd6e" acquired by "delete_volume" :: waited 0.015s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:58:10 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e5bd72d-9649-4e29-9da9-56bc31ee6125]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:58:10 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-57cd6e53-3ba6-476f-a364-6df9aee675a2 tempest-ProjectMemberTests-1095658523 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2857fc48-1486-4d8f-b105-7c439642fd6e {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:58:11 devstack sudo[105735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2857fc48-1486-4d8f-b105-7c439642fd6e Sep 22 15:58:11 devstack sudo[105735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:58:11 devstack sudo[105735]: pam_unix(sudo:session): session closed for user root Sep 22 15:58:11 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-57cd6e53-3ba6-476f-a364-6df9aee675a2 tempest-ProjectMemberTests-1095658523 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2857fc48-1486-4d8f-b105-7c439642fd6e" returned: 0 in 0.344s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:58:11 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-57cd6e53-3ba6-476f-a364-6df9aee675a2 tempest-ProjectMemberTests-1095658523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2857fc48-1486-4d8f-b105-7c439642fd6e {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:58:11 devstack sudo[105740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2857fc48-1486-4d8f-b105-7c439642fd6e Sep 22 15:58:11 devstack sudo[105740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:58:11 devstack sudo[105740]: pam_unix(sudo:session): session closed for user root Sep 22 15:58:11 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-57cd6e53-3ba6-476f-a364-6df9aee675a2 tempest-ProjectMemberTests-1095658523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-2857fc48-1486-4d8f-b105-7c439642fd6e" returned: 0 in 0.236s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:58:11 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-57cd6e53-3ba6-476f-a364-6df9aee675a2 tempest-ProjectMemberTests-1095658523 None] Lock "cinder-quobyte-2857fc48-1486-4d8f-b105-7c439642fd6e" released by "delete_volume" :: held 0.638s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:58:11 devstack cinder-volume[86212]: DEBUG cinder.quota [None req-57cd6e53-3ba6-476f-a364-6df9aee675a2 tempest-ProjectMemberTests-1095658523 None] Created reservations ['c69d9c0e-f381-40b6-801f-1e2b38f03632', '7332fea5-6608-404c-8d12-ce414e3978c5', '46a88068-b7fa-46df-ae85-098429a3b1f7', 'f4f42817-ce87-49e1-84a1-514855a7b557'] {{(pid=86212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 15:58:11 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-57cd6e53-3ba6-476f-a364-6df9aee675a2 tempest-ProjectMemberTests-1095658523 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:58:11 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-57cd6e53-3ba6-476f-a364-6df9aee675a2 tempest-ProjectMemberTests-1095658523 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:58:11 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-57cd6e53-3ba6-476f-a364-6df9aee675a2 tempest-ProjectMemberTests-1095658523 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:58:11 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-57cd6e53-3ba6-476f-a364-6df9aee675a2 tempest-ProjectMemberTests-1095658523 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:58:11 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-57cd6e53-3ba6-476f-a364-6df9aee675a2 tempest-ProjectMemberTests-1095658523 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:58:11 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-57cd6e53-3ba6-476f-a364-6df9aee675a2 tempest-ProjectMemberTests-1095658523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:58:11 devstack sudo[105743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc Sep 22 15:58:11 devstack sudo[105743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:58:11 devstack sudo[105743]: pam_unix(sudo:session): session closed for user root Sep 22 15:58:11 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-57cd6e53-3ba6-476f-a364-6df9aee675a2 tempest-ProjectMemberTests-1095658523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc" returned: 0 in 0.245s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:58:11 devstack cinder-volume[86212]: DEBUG cinder.manager [None req-57cd6e53-3ba6-476f-a364-6df9aee675a2 tempest-ProjectMemberTests-1095658523 None] Notifying Schedulers of capabilities ... {{(pid=86212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 15:58:11 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-57cd6e53-3ba6-476f-a364-6df9aee675a2 tempest-ProjectMemberTests-1095658523 None] Deleted volume successfully. Sep 22 15:58:11 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-57cd6e53-3ba6-476f-a364-6df9aee675a2 tempest-ProjectMemberTests-1095658523 None] Lock "cinder-2857fc48-1486-4d8f-b105-7c439642fd6e-delete_volume" released by "delete_volume" :: held 1.093s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:58:12 devstack cinder-volume[86212]: DEBUG cinder.volume.flows.manager.create_volume [None req-54c18b8f-c261-47a9-a3ea-280e058f5124 tempest-ProjectMemberTests-1095658523 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 15:58:12 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-54c18b8f-c261-47a9-a3ea-280e058f5124 tempest-ProjectMemberTests-1095658523 None] Flow 'volume_create_manager' (593e44a9-f733-4831-9cda-64c9b32e3ebc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:58:12 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-54c18b8f-c261-47a9-a3ea-280e058f5124 tempest-ProjectMemberTests-1095658523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50e4bfb5-9d75-4ce8-81af-c3c27db16a0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:58:12 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-54c18b8f-c261-47a9-a3ea-280e058f5124 tempest-ProjectMemberTests-1095658523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50e4bfb5-9d75-4ce8-81af-c3c27db16a0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:58:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-36190788',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6986c81-3a3e-4acd-816f-25c61e3284a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e3beb47e92e4a8c9efa3433374c2e0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:58:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:58:12Z,use_quota=True,user_id='c4cc884fb51643ee9efb176f88d0543f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:58:12 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-54c18b8f-c261-47a9-a3ea-280e058f5124 tempest-ProjectMemberTests-1095658523 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f1e1da2-81f4-4599-bfbe-22a3a194d7e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:58:12 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-54c18b8f-c261-47a9-a3ea-280e058f5124 tempest-ProjectMemberTests-1095658523 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f1e1da2-81f4-4599-bfbe-22a3a194d7e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:58:12 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-54c18b8f-c261-47a9-a3ea-280e058f5124 tempest-ProjectMemberTests-1095658523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6feeeced-a9ae-4d96-af46-6a7a017ae52a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:58:12 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-54c18b8f-c261-47a9-a3ea-280e058f5124 tempest-ProjectMemberTests-1095658523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6feeeced-a9ae-4d96-af46-6a7a017ae52a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a6986c81-3a3e-4acd-816f-25c61e3284a9', 'volume_name': 'volume-a6986c81-3a3e-4acd-816f-25c61e3284a9', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:58:12 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-54c18b8f-c261-47a9-a3ea-280e058f5124 tempest-ProjectMemberTests-1095658523 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93a587c0-0da9-4ab4-96dd-b3ada2d64872) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:58:12 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-54c18b8f-c261-47a9-a3ea-280e058f5124 tempest-ProjectMemberTests-1095658523 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93a587c0-0da9-4ab4-96dd-b3ada2d64872) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:58:12 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-54c18b8f-c261-47a9-a3ea-280e058f5124 tempest-ProjectMemberTests-1095658523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (976edc50-f165-4b77-8335-1b1b915ec65d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:58:12 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-54c18b8f-c261-47a9-a3ea-280e058f5124 tempest-ProjectMemberTests-1095658523 None] Volume a6986c81-3a3e-4acd-816f-25c61e3284a9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a6986c81-3a3e-4acd-816f-25c61e3284a9', 'volume_size': 1} Sep 22 15:58:12 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-54c18b8f-c261-47a9-a3ea-280e058f5124 tempest-ProjectMemberTests-1095658523 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:58:12 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-54c18b8f-c261-47a9-a3ea-280e058f5124 tempest-ProjectMemberTests-1095658523 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:58:12 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-54c18b8f-c261-47a9-a3ea-280e058f5124 tempest-ProjectMemberTests-1095658523 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:58:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-36190788',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6986c81-3a3e-4acd-816f-25c61e3284a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e3beb47e92e4a8c9efa3433374c2e0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:58:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:58:12Z,use_quota=True,user_id='c4cc884fb51643ee9efb176f88d0543f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)}" {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 15:58:12 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-54c18b8f-c261-47a9-a3ea-280e058f5124 tempest-ProjectMemberTests-1095658523 None] Creating volume a6986c81-3a3e-4acd-816f-25c61e3284a9 {{(pid=86212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 15:58:12 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-54c18b8f-c261-47a9-a3ea-280e058f5124 tempest-ProjectMemberTests-1095658523 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:58:12 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-54c18b8f-c261-47a9-a3ea-280e058f5124 tempest-ProjectMemberTests-1095658523 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:58:12 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-54c18b8f-c261-47a9-a3ea-280e058f5124 tempest-ProjectMemberTests-1095658523 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:58:12 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-54c18b8f-c261-47a9-a3ea-280e058f5124 tempest-ProjectMemberTests-1095658523 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:58:12 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-54c18b8f-c261-47a9-a3ea-280e058f5124 tempest-ProjectMemberTests-1095658523 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:58:12 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-54c18b8f-c261-47a9-a3ea-280e058f5124 tempest-ProjectMemberTests-1095658523 None] Selected osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 as target Quobyte volume. {{(pid=86212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 15:58:12 devstack cinder-volume[86212]: INFO cinder.volume.drivers.remotefs [None req-54c18b8f-c261-47a9-a3ea-280e058f5124 tempest-ProjectMemberTests-1095658523 None] casted to osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 Sep 22 15:58:12 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-54c18b8f-c261-47a9-a3ea-280e058f5124 tempest-ProjectMemberTests-1095658523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a6986c81-3a3e-4acd-816f-25c61e3284a9 1073741824 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:58:12 devstack sudo[105746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a6986c81-3a3e-4acd-816f-25c61e3284a9 1073741824 Sep 22 15:58:12 devstack sudo[105746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:58:12 devstack sudo[105746]: pam_unix(sudo:session): session closed for user root Sep 22 15:58:12 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-54c18b8f-c261-47a9-a3ea-280e058f5124 tempest-ProjectMemberTests-1095658523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a6986c81-3a3e-4acd-816f-25c61e3284a9 1073741824" returned: 0 in 0.403s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:58:12 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-54c18b8f-c261-47a9-a3ea-280e058f5124 tempest-ProjectMemberTests-1095658523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a6986c81-3a3e-4acd-816f-25c61e3284a9 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:58:12 devstack sudo[105751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a6986c81-3a3e-4acd-816f-25c61e3284a9 Sep 22 15:58:12 devstack sudo[105751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:58:13 devstack sudo[105751]: pam_unix(sudo:session): session closed for user root Sep 22 15:58:13 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-54c18b8f-c261-47a9-a3ea-280e058f5124 tempest-ProjectMemberTests-1095658523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a6986c81-3a3e-4acd-816f-25c61e3284a9" returned: 0 in 0.238s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:58:13 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-54c18b8f-c261-47a9-a3ea-280e058f5124 tempest-ProjectMemberTests-1095658523 None] <== create_volume: return (682ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'} {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 15:58:13 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-54c18b8f-c261-47a9-a3ea-280e058f5124 tempest-ProjectMemberTests-1095658523 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.685s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:58:13 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-54c18b8f-c261-47a9-a3ea-280e058f5124 tempest-ProjectMemberTests-1095658523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (976edc50-f165-4b77-8335-1b1b915ec65d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6986c81-3a3e-4acd-816f-25c61e3284a9', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:58:13 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-54c18b8f-c261-47a9-a3ea-280e058f5124 tempest-ProjectMemberTests-1095658523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (583f0bc0-b3f5-417d-8c8e-cfde7f74fc02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:58:13 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-54c18b8f-c261-47a9-a3ea-280e058f5124 tempest-ProjectMemberTests-1095658523 None] Volume volume-a6986c81-3a3e-4acd-816f-25c61e3284a9 (a6986c81-3a3e-4acd-816f-25c61e3284a9): created successfully Sep 22 15:58:13 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-54c18b8f-c261-47a9-a3ea-280e058f5124 tempest-ProjectMemberTests-1095658523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (583f0bc0-b3f5-417d-8c8e-cfde7f74fc02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:58:13 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-54c18b8f-c261-47a9-a3ea-280e058f5124 tempest-ProjectMemberTests-1095658523 None] Flow 'volume_create_manager' (593e44a9-f733-4831-9cda-64c9b32e3ebc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:58:13 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-54c18b8f-c261-47a9-a3ea-280e058f5124 tempest-ProjectMemberTests-1095658523 None] Created volume successfully. Sep 22 15:58:13 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-cb247cfc-ce8f-480c-942d-78dda78dc1d4 tempest-ProjectMemberTests-1095658523 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:58:13 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-cb247cfc-ce8f-480c-942d-78dda78dc1d4 tempest-ProjectMemberTests-1095658523 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:58:13 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-cb247cfc-ce8f-480c-942d-78dda78dc1d4 tempest-ProjectMemberTests-1095658523 None] Creating offline snapshot 46bb4369-3b6b-461d-9d87-acafe0dbf642 of volume a6986c81-3a3e-4acd-816f-25c61e3284a9 {{(pid=86212) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 22 15:58:13 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa28839f-717a-4c48-9553-780bd69169bd]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:58:13 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-cb247cfc-ce8f-480c-942d-78dda78dc1d4 tempest-ProjectMemberTests-1095658523 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a6986c81-3a3e-4acd-816f-25c61e3284a9 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:58:13 devstack sudo[105754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a6986c81-3a3e-4acd-816f-25c61e3284a9 Sep 22 15:58:13 devstack sudo[105754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:58:13 devstack sudo[105754]: pam_unix(sudo:session): session closed for user root Sep 22 15:58:13 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-cb247cfc-ce8f-480c-942d-78dda78dc1d4 tempest-ProjectMemberTests-1095658523 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a6986c81-3a3e-4acd-816f-25c61e3284a9" returned: 0 in 0.356s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:58:13 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-cb247cfc-ce8f-480c-942d-78dda78dc1d4 tempest-ProjectMemberTests-1095658523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a6986c81-3a3e-4acd-816f-25c61e3284a9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a6986c81-3a3e-4acd-816f-25c61e3284a9.46bb4369-3b6b-461d-9d87-acafe0dbf642 1G {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:58:13 devstack sudo[105759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a6986c81-3a3e-4acd-816f-25c61e3284a9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a6986c81-3a3e-4acd-816f-25c61e3284a9.46bb4369-3b6b-461d-9d87-acafe0dbf642 1G Sep 22 15:58:13 devstack sudo[105759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:58:14 devstack sudo[105759]: pam_unix(sudo:session): session closed for user root Sep 22 15:58:14 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-cb247cfc-ce8f-480c-942d-78dda78dc1d4 tempest-ProjectMemberTests-1095658523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a6986c81-3a3e-4acd-816f-25c61e3284a9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a6986c81-3a3e-4acd-816f-25c61e3284a9.46bb4369-3b6b-461d-9d87-acafe0dbf642 1G" returned: 0 in 0.369s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:58:14 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-cb247cfc-ce8f-480c-942d-78dda78dc1d4 tempest-ProjectMemberTests-1095658523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a6986c81-3a3e-4acd-816f-25c61e3284a9 -F qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a6986c81-3a3e-4acd-816f-25c61e3284a9.46bb4369-3b6b-461d-9d87-acafe0dbf642 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:58:14 devstack sudo[105764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a6986c81-3a3e-4acd-816f-25c61e3284a9 -F qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a6986c81-3a3e-4acd-816f-25c61e3284a9.46bb4369-3b6b-461d-9d87-acafe0dbf642 Sep 22 15:58:14 devstack sudo[105764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:58:14 devstack sudo[105764]: pam_unix(sudo:session): session closed for user root Sep 22 15:58:14 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-cb247cfc-ce8f-480c-942d-78dda78dc1d4 tempest-ProjectMemberTests-1095658523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a6986c81-3a3e-4acd-816f-25c61e3284a9 -F qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a6986c81-3a3e-4acd-816f-25c61e3284a9.46bb4369-3b6b-461d-9d87-acafe0dbf642" returned: 0 in 0.282s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:58:14 devstack cinder-volume[86212]: WARNING cinder.volume.drivers.remotefs [None req-cb247cfc-ce8f-480c-942d-78dda78dc1d4 tempest-ProjectMemberTests-1095658523 None] /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a6986c81-3a3e-4acd-816f-25c61e3284a9.46bb4369-3b6b-461d-9d87-acafe0dbf642 is being set with open permissions: ugo+rw Sep 22 15:58:14 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-cb247cfc-ce8f-480c-942d-78dda78dc1d4 tempest-ProjectMemberTests-1095658523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a6986c81-3a3e-4acd-816f-25c61e3284a9.46bb4369-3b6b-461d-9d87-acafe0dbf642 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:58:14 devstack sudo[105769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a6986c81-3a3e-4acd-816f-25c61e3284a9.46bb4369-3b6b-461d-9d87-acafe0dbf642 Sep 22 15:58:14 devstack sudo[105769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:58:14 devstack sudo[105769]: pam_unix(sudo:session): session closed for user root Sep 22 15:58:14 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-cb247cfc-ce8f-480c-942d-78dda78dc1d4 tempest-ProjectMemberTests-1095658523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a6986c81-3a3e-4acd-816f-25c61e3284a9.46bb4369-3b6b-461d-9d87-acafe0dbf642" returned: 0 in 0.238s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:58:14 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-cb247cfc-ce8f-480c-942d-78dda78dc1d4 tempest-ProjectMemberTests-1095658523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a6986c81-3a3e-4acd-816f-25c61e3284a9.info {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:58:14 devstack sudo[105772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a6986c81-3a3e-4acd-816f-25c61e3284a9.info Sep 22 15:58:14 devstack sudo[105772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:58:15 devstack sudo[105772]: pam_unix(sudo:session): session closed for user root Sep 22 15:58:15 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-cb247cfc-ce8f-480c-942d-78dda78dc1d4 tempest-ProjectMemberTests-1095658523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a6986c81-3a3e-4acd-816f-25c61e3284a9.info" returned: 0 in 0.247s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:58:15 devstack cinder-volume[86212]: WARNING cinder.volume.drivers.remotefs [None req-cb247cfc-ce8f-480c-942d-78dda78dc1d4 tempest-ProjectMemberTests-1095658523 None] /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a6986c81-3a3e-4acd-816f-25c61e3284a9.info is being set with open permissions: ugo+rw Sep 22 15:58:15 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-cb247cfc-ce8f-480c-942d-78dda78dc1d4 tempest-ProjectMemberTests-1095658523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a6986c81-3a3e-4acd-816f-25c61e3284a9.info {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:58:15 devstack sudo[105775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a6986c81-3a3e-4acd-816f-25c61e3284a9.info Sep 22 15:58:15 devstack sudo[105775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:58:15 devstack sudo[105775]: pam_unix(sudo:session): session closed for user root Sep 22 15:58:15 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-cb247cfc-ce8f-480c-942d-78dda78dc1d4 tempest-ProjectMemberTests-1095658523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a6986c81-3a3e-4acd-816f-25c61e3284a9.info" returned: 0 in 0.232s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:58:15 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-cb247cfc-ce8f-480c-942d-78dda78dc1d4 tempest-ProjectMemberTests-1095658523 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.798s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:58:15 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-cb247cfc-ce8f-480c-942d-78dda78dc1d4 tempest-ProjectMemberTests-1095658523 None] Create snapshot completed successfully Sep 22 15:58:15 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-ace7e169-d2dc-4bd6-9329-0ebedb8510dc tempest-ProjectMemberTests-1095658523 None] Acquiring lock "cinder-46bb4369-3b6b-461d-9d87-acafe0dbf642-delete_snapshot" by "delete_snapshot" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:58:15 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-ace7e169-d2dc-4bd6-9329-0ebedb8510dc tempest-ProjectMemberTests-1095658523 None] Lock "cinder-46bb4369-3b6b-461d-9d87-acafe0dbf642-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:58:15 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-ace7e169-d2dc-4bd6-9329-0ebedb8510dc tempest-ProjectMemberTests-1095658523 None] Acquiring lock "cinder-quobyte-a6986c81-3a3e-4acd-816f-25c61e3284a9" by "delete_snapshot" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:58:15 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-ace7e169-d2dc-4bd6-9329-0ebedb8510dc tempest-ProjectMemberTests-1095658523 None] Lock "cinder-quobyte-a6986c81-3a3e-4acd-816f-25c61e3284a9" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:58:15 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-ace7e169-d2dc-4bd6-9329-0ebedb8510dc tempest-ProjectMemberTests-1095658523 None] Acquiring lock "cinder-quobyte-46bb4369-3b6b-461d-9d87-acafe0dbf642" by "_delete_snapshot" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:58:15 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-ace7e169-d2dc-4bd6-9329-0ebedb8510dc tempest-ProjectMemberTests-1095658523 None] Lock "cinder-quobyte-46bb4369-3b6b-461d-9d87-acafe0dbf642" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:58:15 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-ace7e169-d2dc-4bd6-9329-0ebedb8510dc tempest-ProjectMemberTests-1095658523 None] Deleting offline snapshot 46bb4369-3b6b-461d-9d87-acafe0dbf642 of volume a6986c81-3a3e-4acd-816f-25c61e3284a9 {{(pid=86212) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 22 15:58:15 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-ace7e169-d2dc-4bd6-9329-0ebedb8510dc tempest-ProjectMemberTests-1095658523 None] snapshot_file for this snap is: volume-a6986c81-3a3e-4acd-816f-25c61e3284a9.46bb4369-3b6b-461d-9d87-acafe0dbf642 {{(pid=86212) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 22 15:58:15 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bdaf547-163c-4405-a8ce-c09894c502c2]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:58:15 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-ace7e169-d2dc-4bd6-9329-0ebedb8510dc tempest-ProjectMemberTests-1095658523 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a6986c81-3a3e-4acd-816f-25c61e3284a9.46bb4369-3b6b-461d-9d87-acafe0dbf642 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:58:15 devstack sudo[105778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a6986c81-3a3e-4acd-816f-25c61e3284a9.46bb4369-3b6b-461d-9d87-acafe0dbf642 Sep 22 15:58:15 devstack sudo[105778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:58:16 devstack sudo[105778]: pam_unix(sudo:session): session closed for user root Sep 22 15:58:16 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-ace7e169-d2dc-4bd6-9329-0ebedb8510dc tempest-ProjectMemberTests-1095658523 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a6986c81-3a3e-4acd-816f-25c61e3284a9.46bb4369-3b6b-461d-9d87-acafe0dbf642" returned: 0 in 0.354s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:58:16 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-ace7e169-d2dc-4bd6-9329-0ebedb8510dc tempest-ProjectMemberTests-1095658523 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a6986c81-3a3e-4acd-816f-25c61e3284a9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86212) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 22 15:58:16 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0a07e3e-7f13-4169-8b6a-f1d28caa443d]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:58:16 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-ace7e169-d2dc-4bd6-9329-0ebedb8510dc tempest-ProjectMemberTests-1095658523 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a6986c81-3a3e-4acd-816f-25c61e3284a9 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:58:16 devstack sudo[105783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a6986c81-3a3e-4acd-816f-25c61e3284a9 Sep 22 15:58:16 devstack sudo[105783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:58:16 devstack sudo[105783]: pam_unix(sudo:session): session closed for user root Sep 22 15:58:16 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-ace7e169-d2dc-4bd6-9329-0ebedb8510dc tempest-ProjectMemberTests-1095658523 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a6986c81-3a3e-4acd-816f-25c61e3284a9" returned: 0 in 0.349s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:58:16 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-ace7e169-d2dc-4bd6-9329-0ebedb8510dc tempest-ProjectMemberTests-1095658523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a6986c81-3a3e-4acd-816f-25c61e3284a9.46bb4369-3b6b-461d-9d87-acafe0dbf642 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:58:16 devstack sudo[105788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a6986c81-3a3e-4acd-816f-25c61e3284a9.46bb4369-3b6b-461d-9d87-acafe0dbf642 Sep 22 15:58:16 devstack sudo[105788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:58:16 devstack sudo[105788]: pam_unix(sudo:session): session closed for user root Sep 22 15:58:16 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-ace7e169-d2dc-4bd6-9329-0ebedb8510dc tempest-ProjectMemberTests-1095658523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a6986c81-3a3e-4acd-816f-25c61e3284a9.46bb4369-3b6b-461d-9d87-acafe0dbf642" returned: 0 in 0.341s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:58:16 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-ace7e169-d2dc-4bd6-9329-0ebedb8510dc tempest-ProjectMemberTests-1095658523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a6986c81-3a3e-4acd-816f-25c61e3284a9.46bb4369-3b6b-461d-9d87-acafe0dbf642 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:58:16 devstack sudo[105793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a6986c81-3a3e-4acd-816f-25c61e3284a9.46bb4369-3b6b-461d-9d87-acafe0dbf642 Sep 22 15:58:16 devstack sudo[105793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:58:17 devstack sudo[105793]: pam_unix(sudo:session): session closed for user root Sep 22 15:58:17 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-ace7e169-d2dc-4bd6-9329-0ebedb8510dc tempest-ProjectMemberTests-1095658523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a6986c81-3a3e-4acd-816f-25c61e3284a9.46bb4369-3b6b-461d-9d87-acafe0dbf642" returned: 0 in 0.253s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:58:17 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-ace7e169-d2dc-4bd6-9329-0ebedb8510dc tempest-ProjectMemberTests-1095658523 None] Lock "cinder-quobyte-46bb4369-3b6b-461d-9d87-acafe0dbf642" released by "_delete_snapshot" :: held 1.391s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:58:17 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-ace7e169-d2dc-4bd6-9329-0ebedb8510dc tempest-ProjectMemberTests-1095658523 None] Lock "cinder-quobyte-a6986c81-3a3e-4acd-816f-25c61e3284a9" released by "delete_snapshot" :: held 1.413s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:58:17 devstack cinder-volume[86212]: DEBUG cinder.quota [None req-ace7e169-d2dc-4bd6-9329-0ebedb8510dc tempest-ProjectMemberTests-1095658523 None] Created reservations ['a2e04e17-499f-4bce-b19c-126bf83a8451', 'c1a44653-cdcc-40d5-91be-048d56fd431b', 'e4aa8ac9-86de-4e2a-a48a-b945ebe6443a', 'ba78ab3a-47ad-4ed7-9e50-86c6890926ae'] {{(pid=86212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 15:58:17 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-ace7e169-d2dc-4bd6-9329-0ebedb8510dc tempest-ProjectMemberTests-1095658523 None] Delete snapshot completed successfully. Sep 22 15:58:17 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-ace7e169-d2dc-4bd6-9329-0ebedb8510dc tempest-ProjectMemberTests-1095658523 None] Lock "cinder-46bb4369-3b6b-461d-9d87-acafe0dbf642-delete_snapshot" released by "delete_snapshot" :: held 1.554s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:58:17 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-2616b67c-67f2-400b-831a-d191a30a8d7b tempest-ProjectMemberTests-1095658523 None] Acquiring lock "cinder-a6986c81-3a3e-4acd-816f-25c61e3284a9-delete_volume" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:58:17 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-2616b67c-67f2-400b-831a-d191a30a8d7b tempest-ProjectMemberTests-1095658523 None] Lock "cinder-a6986c81-3a3e-4acd-816f-25c61e3284a9-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:58:17 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-2616b67c-67f2-400b-831a-d191a30a8d7b tempest-ProjectMemberTests-1095658523 None] Acquiring lock "cinder-quobyte-a6986c81-3a3e-4acd-816f-25c61e3284a9" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:58:17 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-2616b67c-67f2-400b-831a-d191a30a8d7b tempest-ProjectMemberTests-1095658523 None] Lock "cinder-quobyte-a6986c81-3a3e-4acd-816f-25c61e3284a9" acquired by "delete_volume" :: waited 0.016s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:58:18 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[0435a20f-adc8-480f-bb24-c2b15ef63f3e]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:58:18 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-2616b67c-67f2-400b-831a-d191a30a8d7b tempest-ProjectMemberTests-1095658523 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a6986c81-3a3e-4acd-816f-25c61e3284a9 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:58:18 devstack sudo[105797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a6986c81-3a3e-4acd-816f-25c61e3284a9 Sep 22 15:58:18 devstack sudo[105797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:58:18 devstack sudo[105797]: pam_unix(sudo:session): session closed for user root Sep 22 15:58:18 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-2616b67c-67f2-400b-831a-d191a30a8d7b tempest-ProjectMemberTests-1095658523 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a6986c81-3a3e-4acd-816f-25c61e3284a9" returned: 0 in 0.361s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:58:18 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-2616b67c-67f2-400b-831a-d191a30a8d7b tempest-ProjectMemberTests-1095658523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a6986c81-3a3e-4acd-816f-25c61e3284a9 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:58:18 devstack sudo[105802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a6986c81-3a3e-4acd-816f-25c61e3284a9 Sep 22 15:58:18 devstack sudo[105802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:58:18 devstack sudo[105802]: pam_unix(sudo:session): session closed for user root Sep 22 15:58:18 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-2616b67c-67f2-400b-831a-d191a30a8d7b tempest-ProjectMemberTests-1095658523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-a6986c81-3a3e-4acd-816f-25c61e3284a9" returned: 0 in 0.239s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:58:18 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-2616b67c-67f2-400b-831a-d191a30a8d7b tempest-ProjectMemberTests-1095658523 None] Lock "cinder-quobyte-a6986c81-3a3e-4acd-816f-25c61e3284a9" released by "delete_volume" :: held 0.662s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:58:18 devstack cinder-volume[86212]: DEBUG cinder.quota [None req-2616b67c-67f2-400b-831a-d191a30a8d7b tempest-ProjectMemberTests-1095658523 None] Created reservations ['4b812484-5358-4a64-9bbc-b1736c34a93b', '74e7ab1f-5880-4ca0-bae8-dfd424b3b3b6', '243ddd01-67eb-4203-a76a-6cfd231d3395', '922d2ac3-ee5e-47bf-8d02-93d505e73996'] {{(pid=86212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 15:58:18 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-2616b67c-67f2-400b-831a-d191a30a8d7b tempest-ProjectMemberTests-1095658523 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:58:18 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-2616b67c-67f2-400b-831a-d191a30a8d7b tempest-ProjectMemberTests-1095658523 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:58:18 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-2616b67c-67f2-400b-831a-d191a30a8d7b tempest-ProjectMemberTests-1095658523 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:58:18 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-2616b67c-67f2-400b-831a-d191a30a8d7b tempest-ProjectMemberTests-1095658523 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:58:18 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-2616b67c-67f2-400b-831a-d191a30a8d7b tempest-ProjectMemberTests-1095658523 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:58:18 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-2616b67c-67f2-400b-831a-d191a30a8d7b tempest-ProjectMemberTests-1095658523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:58:18 devstack sudo[105805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc Sep 22 15:58:18 devstack sudo[105805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:58:19 devstack sudo[105805]: pam_unix(sudo:session): session closed for user root Sep 22 15:58:19 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-2616b67c-67f2-400b-831a-d191a30a8d7b tempest-ProjectMemberTests-1095658523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc" returned: 0 in 0.238s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:58:19 devstack cinder-volume[86212]: DEBUG cinder.manager [None req-2616b67c-67f2-400b-831a-d191a30a8d7b tempest-ProjectMemberTests-1095658523 None] Notifying Schedulers of capabilities ... {{(pid=86212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 15:58:19 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-2616b67c-67f2-400b-831a-d191a30a8d7b tempest-ProjectMemberTests-1095658523 None] Deleted volume successfully. Sep 22 15:58:19 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-2616b67c-67f2-400b-831a-d191a30a8d7b tempest-ProjectMemberTests-1095658523 None] Lock "cinder-a6986c81-3a3e-4acd-816f-25c61e3284a9-delete_volume" released by "delete_volume" :: held 1.098s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:58:22 devstack cinder-volume[86212]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f9d71e6-97cc-4a42-b274-2c83a7140b04 tempest-ProjectReaderTests-895612456 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 15:58:22 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-9f9d71e6-97cc-4a42-b274-2c83a7140b04 tempest-ProjectReaderTests-895612456 None] Flow 'volume_create_manager' (35a775e3-2231-4609-9a16-efad3ccd82e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:58:22 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-9f9d71e6-97cc-4a42-b274-2c83a7140b04 tempest-ProjectReaderTests-895612456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (946a097f-e965-43ee-94a7-49acb7fa1741) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:58:22 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-9f9d71e6-97cc-4a42-b274-2c83a7140b04 tempest-ProjectReaderTests-895612456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (946a097f-e965-43ee-94a7-49acb7fa1741) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:58:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1398898881',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d21a5e2-7379-407a-8236-b9eda7d32925,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da280e2e52fe4085be9215a2825e0715',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:58:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:58:22Z,use_quota=True,user_id='b5717331c2e5451da006c3e41b079876',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:58:22 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-9f9d71e6-97cc-4a42-b274-2c83a7140b04 tempest-ProjectReaderTests-895612456 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c7f463f-233f-42ee-8bb6-49dec288f2b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:58:22 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-9f9d71e6-97cc-4a42-b274-2c83a7140b04 tempest-ProjectReaderTests-895612456 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c7f463f-233f-42ee-8bb6-49dec288f2b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:58:22 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-9f9d71e6-97cc-4a42-b274-2c83a7140b04 tempest-ProjectReaderTests-895612456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c983ee8-1b79-4b4a-aa51-7091ec35466c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:58:22 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-9f9d71e6-97cc-4a42-b274-2c83a7140b04 tempest-ProjectReaderTests-895612456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c983ee8-1b79-4b4a-aa51-7091ec35466c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d21a5e2-7379-407a-8236-b9eda7d32925', 'volume_name': 'volume-7d21a5e2-7379-407a-8236-b9eda7d32925', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:58:22 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-9f9d71e6-97cc-4a42-b274-2c83a7140b04 tempest-ProjectReaderTests-895612456 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e8e862b-a12d-422b-9b92-5c7a5da85475) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:58:22 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-9f9d71e6-97cc-4a42-b274-2c83a7140b04 tempest-ProjectReaderTests-895612456 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e8e862b-a12d-422b-9b92-5c7a5da85475) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:58:22 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-9f9d71e6-97cc-4a42-b274-2c83a7140b04 tempest-ProjectReaderTests-895612456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68dd6719-c407-4c4a-864b-0d94c5f82fa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:58:22 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-9f9d71e6-97cc-4a42-b274-2c83a7140b04 tempest-ProjectReaderTests-895612456 None] Volume 7d21a5e2-7379-407a-8236-b9eda7d32925: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d21a5e2-7379-407a-8236-b9eda7d32925', 'volume_size': 1} Sep 22 15:58:22 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-9f9d71e6-97cc-4a42-b274-2c83a7140b04 tempest-ProjectReaderTests-895612456 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:58:22 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-9f9d71e6-97cc-4a42-b274-2c83a7140b04 tempest-ProjectReaderTests-895612456 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:58:22 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-9f9d71e6-97cc-4a42-b274-2c83a7140b04 tempest-ProjectReaderTests-895612456 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:58:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1398898881',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d21a5e2-7379-407a-8236-b9eda7d32925,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da280e2e52fe4085be9215a2825e0715',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:58:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:58:22Z,use_quota=True,user_id='b5717331c2e5451da006c3e41b079876',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)}" {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 15:58:22 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-9f9d71e6-97cc-4a42-b274-2c83a7140b04 tempest-ProjectReaderTests-895612456 None] Creating volume 7d21a5e2-7379-407a-8236-b9eda7d32925 {{(pid=86212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 15:58:22 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-9f9d71e6-97cc-4a42-b274-2c83a7140b04 tempest-ProjectReaderTests-895612456 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:58:22 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-9f9d71e6-97cc-4a42-b274-2c83a7140b04 tempest-ProjectReaderTests-895612456 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:58:22 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-9f9d71e6-97cc-4a42-b274-2c83a7140b04 tempest-ProjectReaderTests-895612456 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:58:22 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-9f9d71e6-97cc-4a42-b274-2c83a7140b04 tempest-ProjectReaderTests-895612456 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:58:22 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-9f9d71e6-97cc-4a42-b274-2c83a7140b04 tempest-ProjectReaderTests-895612456 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:58:22 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-9f9d71e6-97cc-4a42-b274-2c83a7140b04 tempest-ProjectReaderTests-895612456 None] Selected osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 as target Quobyte volume. {{(pid=86212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 15:58:22 devstack cinder-volume[86212]: INFO cinder.volume.drivers.remotefs [None req-9f9d71e6-97cc-4a42-b274-2c83a7140b04 tempest-ProjectReaderTests-895612456 None] casted to osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 Sep 22 15:58:22 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-9f9d71e6-97cc-4a42-b274-2c83a7140b04 tempest-ProjectReaderTests-895612456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-7d21a5e2-7379-407a-8236-b9eda7d32925 1073741824 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:58:22 devstack sudo[105810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-7d21a5e2-7379-407a-8236-b9eda7d32925 1073741824 Sep 22 15:58:22 devstack sudo[105810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:58:22 devstack sudo[105810]: pam_unix(sudo:session): session closed for user root Sep 22 15:58:22 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-9f9d71e6-97cc-4a42-b274-2c83a7140b04 tempest-ProjectReaderTests-895612456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-7d21a5e2-7379-407a-8236-b9eda7d32925 1073741824" returned: 0 in 0.406s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:58:22 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-9f9d71e6-97cc-4a42-b274-2c83a7140b04 tempest-ProjectReaderTests-895612456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-7d21a5e2-7379-407a-8236-b9eda7d32925 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:58:22 devstack sudo[105815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-7d21a5e2-7379-407a-8236-b9eda7d32925 Sep 22 15:58:22 devstack sudo[105815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:58:23 devstack sudo[105815]: pam_unix(sudo:session): session closed for user root Sep 22 15:58:23 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-9f9d71e6-97cc-4a42-b274-2c83a7140b04 tempest-ProjectReaderTests-895612456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-7d21a5e2-7379-407a-8236-b9eda7d32925" returned: 0 in 0.237s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:58:23 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-9f9d71e6-97cc-4a42-b274-2c83a7140b04 tempest-ProjectReaderTests-895612456 None] <== create_volume: return (682ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'} {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 15:58:23 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-9f9d71e6-97cc-4a42-b274-2c83a7140b04 tempest-ProjectReaderTests-895612456 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.686s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:58:23 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-9f9d71e6-97cc-4a42-b274-2c83a7140b04 tempest-ProjectReaderTests-895612456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68dd6719-c407-4c4a-864b-0d94c5f82fa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d21a5e2-7379-407a-8236-b9eda7d32925', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:58:23 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-9f9d71e6-97cc-4a42-b274-2c83a7140b04 tempest-ProjectReaderTests-895612456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fa23549-2b34-4461-a812-cd1990ebccd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:58:23 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-9f9d71e6-97cc-4a42-b274-2c83a7140b04 tempest-ProjectReaderTests-895612456 None] Volume volume-7d21a5e2-7379-407a-8236-b9eda7d32925 (7d21a5e2-7379-407a-8236-b9eda7d32925): created successfully Sep 22 15:58:23 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-9f9d71e6-97cc-4a42-b274-2c83a7140b04 tempest-ProjectReaderTests-895612456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fa23549-2b34-4461-a812-cd1990ebccd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:58:23 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-9f9d71e6-97cc-4a42-b274-2c83a7140b04 tempest-ProjectReaderTests-895612456 None] Flow 'volume_create_manager' (35a775e3-2231-4609-9a16-efad3ccd82e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:58:23 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-9f9d71e6-97cc-4a42-b274-2c83a7140b04 tempest-ProjectReaderTests-895612456 None] Created volume successfully. Sep 22 15:58:23 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-4066632b-e214-489e-b422-c1633098042e tempest-ProjectReaderTests-895612456 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:58:23 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-4066632b-e214-489e-b422-c1633098042e tempest-ProjectReaderTests-895612456 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:58:23 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-4066632b-e214-489e-b422-c1633098042e tempest-ProjectReaderTests-895612456 None] Creating offline snapshot 1d243e6a-4486-489d-ad68-54a1184b2c86 of volume 7d21a5e2-7379-407a-8236-b9eda7d32925 {{(pid=86212) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 22 15:58:23 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf57b10f-8091-415d-8d3f-fb82d203066b]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:58:23 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-4066632b-e214-489e-b422-c1633098042e tempest-ProjectReaderTests-895612456 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-7d21a5e2-7379-407a-8236-b9eda7d32925 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:58:23 devstack sudo[105818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-7d21a5e2-7379-407a-8236-b9eda7d32925 Sep 22 15:58:23 devstack sudo[105818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:58:23 devstack sudo[105818]: pam_unix(sudo:session): session closed for user root Sep 22 15:58:23 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-4066632b-e214-489e-b422-c1633098042e tempest-ProjectReaderTests-895612456 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-7d21a5e2-7379-407a-8236-b9eda7d32925" returned: 0 in 0.377s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:58:23 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-4066632b-e214-489e-b422-c1633098042e tempest-ProjectReaderTests-895612456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-7d21a5e2-7379-407a-8236-b9eda7d32925,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-7d21a5e2-7379-407a-8236-b9eda7d32925.1d243e6a-4486-489d-ad68-54a1184b2c86 1G {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:58:24 devstack sudo[105823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-7d21a5e2-7379-407a-8236-b9eda7d32925,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-7d21a5e2-7379-407a-8236-b9eda7d32925.1d243e6a-4486-489d-ad68-54a1184b2c86 1G Sep 22 15:58:24 devstack sudo[105823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:58:24 devstack sudo[105823]: pam_unix(sudo:session): session closed for user root Sep 22 15:58:24 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-4066632b-e214-489e-b422-c1633098042e tempest-ProjectReaderTests-895612456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-7d21a5e2-7379-407a-8236-b9eda7d32925,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-7d21a5e2-7379-407a-8236-b9eda7d32925.1d243e6a-4486-489d-ad68-54a1184b2c86 1G" returned: 0 in 0.388s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:58:24 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-4066632b-e214-489e-b422-c1633098042e tempest-ProjectReaderTests-895612456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7d21a5e2-7379-407a-8236-b9eda7d32925 -F qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-7d21a5e2-7379-407a-8236-b9eda7d32925.1d243e6a-4486-489d-ad68-54a1184b2c86 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:58:24 devstack sudo[105829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7d21a5e2-7379-407a-8236-b9eda7d32925 -F qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-7d21a5e2-7379-407a-8236-b9eda7d32925.1d243e6a-4486-489d-ad68-54a1184b2c86 Sep 22 15:58:24 devstack sudo[105829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:58:24 devstack sudo[105829]: pam_unix(sudo:session): session closed for user root Sep 22 15:58:24 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-4066632b-e214-489e-b422-c1633098042e tempest-ProjectReaderTests-895612456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7d21a5e2-7379-407a-8236-b9eda7d32925 -F qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-7d21a5e2-7379-407a-8236-b9eda7d32925.1d243e6a-4486-489d-ad68-54a1184b2c86" returned: 0 in 0.285s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:58:24 devstack cinder-volume[86212]: WARNING cinder.volume.drivers.remotefs [None req-4066632b-e214-489e-b422-c1633098042e tempest-ProjectReaderTests-895612456 None] /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-7d21a5e2-7379-407a-8236-b9eda7d32925.1d243e6a-4486-489d-ad68-54a1184b2c86 is being set with open permissions: ugo+rw Sep 22 15:58:24 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-4066632b-e214-489e-b422-c1633098042e tempest-ProjectReaderTests-895612456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-7d21a5e2-7379-407a-8236-b9eda7d32925.1d243e6a-4486-489d-ad68-54a1184b2c86 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:58:24 devstack sudo[105834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-7d21a5e2-7379-407a-8236-b9eda7d32925.1d243e6a-4486-489d-ad68-54a1184b2c86 Sep 22 15:58:24 devstack sudo[105834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:58:24 devstack sudo[105834]: pam_unix(sudo:session): session closed for user root Sep 22 15:58:24 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-4066632b-e214-489e-b422-c1633098042e tempest-ProjectReaderTests-895612456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-7d21a5e2-7379-407a-8236-b9eda7d32925.1d243e6a-4486-489d-ad68-54a1184b2c86" returned: 0 in 0.239s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:58:24 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-4066632b-e214-489e-b422-c1633098042e tempest-ProjectReaderTests-895612456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-7d21a5e2-7379-407a-8236-b9eda7d32925.info {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:58:24 devstack sudo[105839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-7d21a5e2-7379-407a-8236-b9eda7d32925.info Sep 22 15:58:24 devstack sudo[105839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:58:25 devstack sudo[105839]: pam_unix(sudo:session): session closed for user root Sep 22 15:58:25 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-4066632b-e214-489e-b422-c1633098042e tempest-ProjectReaderTests-895612456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-7d21a5e2-7379-407a-8236-b9eda7d32925.info" returned: 0 in 0.239s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:58:25 devstack cinder-volume[86212]: WARNING cinder.volume.drivers.remotefs [None req-4066632b-e214-489e-b422-c1633098042e tempest-ProjectReaderTests-895612456 None] /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-7d21a5e2-7379-407a-8236-b9eda7d32925.info is being set with open permissions: ugo+rw Sep 22 15:58:25 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-4066632b-e214-489e-b422-c1633098042e tempest-ProjectReaderTests-895612456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-7d21a5e2-7379-407a-8236-b9eda7d32925.info {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:58:25 devstack sudo[105842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-7d21a5e2-7379-407a-8236-b9eda7d32925.info Sep 22 15:58:25 devstack sudo[105842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:58:25 devstack sudo[105842]: pam_unix(sudo:session): session closed for user root Sep 22 15:58:25 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-4066632b-e214-489e-b422-c1633098042e tempest-ProjectReaderTests-895612456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-7d21a5e2-7379-407a-8236-b9eda7d32925.info" returned: 0 in 0.233s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:58:25 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-4066632b-e214-489e-b422-c1633098042e tempest-ProjectReaderTests-895612456 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.839s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:58:25 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-4066632b-e214-489e-b422-c1633098042e tempest-ProjectReaderTests-895612456 None] Create snapshot completed successfully Sep 22 15:58:25 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-128b9f7a-643c-4f77-be06-53ac2eb2a158 tempest-ProjectReaderTests-895612456 None] Acquiring lock "cinder-1d243e6a-4486-489d-ad68-54a1184b2c86-delete_snapshot" by "delete_snapshot" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:58:25 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-128b9f7a-643c-4f77-be06-53ac2eb2a158 tempest-ProjectReaderTests-895612456 None] Lock "cinder-1d243e6a-4486-489d-ad68-54a1184b2c86-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:58:25 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-128b9f7a-643c-4f77-be06-53ac2eb2a158 tempest-ProjectReaderTests-895612456 None] Acquiring lock "cinder-quobyte-7d21a5e2-7379-407a-8236-b9eda7d32925" by "delete_snapshot" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:58:25 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-128b9f7a-643c-4f77-be06-53ac2eb2a158 tempest-ProjectReaderTests-895612456 None] Lock "cinder-quobyte-7d21a5e2-7379-407a-8236-b9eda7d32925" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:58:25 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-128b9f7a-643c-4f77-be06-53ac2eb2a158 tempest-ProjectReaderTests-895612456 None] Acquiring lock "cinder-quobyte-1d243e6a-4486-489d-ad68-54a1184b2c86" by "_delete_snapshot" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:58:25 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-128b9f7a-643c-4f77-be06-53ac2eb2a158 tempest-ProjectReaderTests-895612456 None] Lock "cinder-quobyte-1d243e6a-4486-489d-ad68-54a1184b2c86" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:58:25 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-128b9f7a-643c-4f77-be06-53ac2eb2a158 tempest-ProjectReaderTests-895612456 None] Deleting offline snapshot 1d243e6a-4486-489d-ad68-54a1184b2c86 of volume 7d21a5e2-7379-407a-8236-b9eda7d32925 {{(pid=86212) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 22 15:58:25 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-128b9f7a-643c-4f77-be06-53ac2eb2a158 tempest-ProjectReaderTests-895612456 None] snapshot_file for this snap is: volume-7d21a5e2-7379-407a-8236-b9eda7d32925.1d243e6a-4486-489d-ad68-54a1184b2c86 {{(pid=86212) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 22 15:58:25 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[64d668b9-6d1b-46f6-9601-889106d3f634]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:58:25 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-128b9f7a-643c-4f77-be06-53ac2eb2a158 tempest-ProjectReaderTests-895612456 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-7d21a5e2-7379-407a-8236-b9eda7d32925.1d243e6a-4486-489d-ad68-54a1184b2c86 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:58:26 devstack sudo[105845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-7d21a5e2-7379-407a-8236-b9eda7d32925.1d243e6a-4486-489d-ad68-54a1184b2c86 Sep 22 15:58:26 devstack sudo[105845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:58:26 devstack sudo[105845]: pam_unix(sudo:session): session closed for user root Sep 22 15:58:26 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-128b9f7a-643c-4f77-be06-53ac2eb2a158 tempest-ProjectReaderTests-895612456 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-7d21a5e2-7379-407a-8236-b9eda7d32925.1d243e6a-4486-489d-ad68-54a1184b2c86" returned: 0 in 0.353s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:58:26 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-128b9f7a-643c-4f77-be06-53ac2eb2a158 tempest-ProjectReaderTests-895612456 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7d21a5e2-7379-407a-8236-b9eda7d32925(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86212) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 22 15:58:26 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[77fe9215-946f-4d41-97b5-623201cea987]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:58:26 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-128b9f7a-643c-4f77-be06-53ac2eb2a158 tempest-ProjectReaderTests-895612456 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-7d21a5e2-7379-407a-8236-b9eda7d32925 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:58:26 devstack sudo[105850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-7d21a5e2-7379-407a-8236-b9eda7d32925 Sep 22 15:58:26 devstack sudo[105850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:58:26 devstack sudo[105850]: pam_unix(sudo:session): session closed for user root Sep 22 15:58:26 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-128b9f7a-643c-4f77-be06-53ac2eb2a158 tempest-ProjectReaderTests-895612456 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-7d21a5e2-7379-407a-8236-b9eda7d32925" returned: 0 in 0.349s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:58:26 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-128b9f7a-643c-4f77-be06-53ac2eb2a158 tempest-ProjectReaderTests-895612456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-7d21a5e2-7379-407a-8236-b9eda7d32925.1d243e6a-4486-489d-ad68-54a1184b2c86 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:58:26 devstack sudo[105855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-7d21a5e2-7379-407a-8236-b9eda7d32925.1d243e6a-4486-489d-ad68-54a1184b2c86 Sep 22 15:58:26 devstack sudo[105855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:58:26 devstack sudo[105855]: pam_unix(sudo:session): session closed for user root Sep 22 15:58:26 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-128b9f7a-643c-4f77-be06-53ac2eb2a158 tempest-ProjectReaderTests-895612456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-7d21a5e2-7379-407a-8236-b9eda7d32925.1d243e6a-4486-489d-ad68-54a1184b2c86" returned: 0 in 0.328s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:58:26 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-128b9f7a-643c-4f77-be06-53ac2eb2a158 tempest-ProjectReaderTests-895612456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-7d21a5e2-7379-407a-8236-b9eda7d32925.1d243e6a-4486-489d-ad68-54a1184b2c86 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:58:27 devstack sudo[105861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-7d21a5e2-7379-407a-8236-b9eda7d32925.1d243e6a-4486-489d-ad68-54a1184b2c86 Sep 22 15:58:27 devstack sudo[105861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:58:27 devstack sudo[105861]: pam_unix(sudo:session): session closed for user root Sep 22 15:58:27 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-128b9f7a-643c-4f77-be06-53ac2eb2a158 tempest-ProjectReaderTests-895612456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-7d21a5e2-7379-407a-8236-b9eda7d32925.1d243e6a-4486-489d-ad68-54a1184b2c86" returned: 0 in 0.243s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:58:27 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-128b9f7a-643c-4f77-be06-53ac2eb2a158 tempest-ProjectReaderTests-895612456 None] Lock "cinder-quobyte-1d243e6a-4486-489d-ad68-54a1184b2c86" released by "_delete_snapshot" :: held 1.361s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:58:27 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-128b9f7a-643c-4f77-be06-53ac2eb2a158 tempest-ProjectReaderTests-895612456 None] Lock "cinder-quobyte-7d21a5e2-7379-407a-8236-b9eda7d32925" released by "delete_snapshot" :: held 1.382s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:58:27 devstack cinder-volume[86212]: DEBUG cinder.quota [None req-128b9f7a-643c-4f77-be06-53ac2eb2a158 tempest-ProjectReaderTests-895612456 None] Created reservations ['b01cd3c0-25f1-4fbd-bc0d-226be098c64c', '62b6bbb1-7977-48bc-8c0b-288ce103f2b3', '3a1f5326-469b-421e-ace2-db9083d9b529', '2149579c-2e07-416c-b387-5e532216f2bb'] {{(pid=86212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 15:58:27 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-128b9f7a-643c-4f77-be06-53ac2eb2a158 tempest-ProjectReaderTests-895612456 None] Delete snapshot completed successfully. Sep 22 15:58:27 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-128b9f7a-643c-4f77-be06-53ac2eb2a158 tempest-ProjectReaderTests-895612456 None] Lock "cinder-1d243e6a-4486-489d-ad68-54a1184b2c86-delete_snapshot" released by "delete_snapshot" :: held 1.504s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:58:27 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-30c16dba-0848-4083-a635-ec5f2078d6ba tempest-ProjectReaderTests-895612456 None] Acquiring lock "cinder-7d21a5e2-7379-407a-8236-b9eda7d32925-delete_volume" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:58:28 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-30c16dba-0848-4083-a635-ec5f2078d6ba tempest-ProjectReaderTests-895612456 None] Lock "cinder-7d21a5e2-7379-407a-8236-b9eda7d32925-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:58:28 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-30c16dba-0848-4083-a635-ec5f2078d6ba tempest-ProjectReaderTests-895612456 None] Acquiring lock "cinder-quobyte-7d21a5e2-7379-407a-8236-b9eda7d32925" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:58:28 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-30c16dba-0848-4083-a635-ec5f2078d6ba tempest-ProjectReaderTests-895612456 None] Lock "cinder-quobyte-7d21a5e2-7379-407a-8236-b9eda7d32925" acquired by "delete_volume" :: waited 0.013s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:58:28 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aeddf22-511d-4893-b017-eba4d01a75ae]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:58:28 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-30c16dba-0848-4083-a635-ec5f2078d6ba tempest-ProjectReaderTests-895612456 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-7d21a5e2-7379-407a-8236-b9eda7d32925 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:58:28 devstack sudo[105865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-7d21a5e2-7379-407a-8236-b9eda7d32925 Sep 22 15:58:28 devstack sudo[105865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:58:28 devstack sudo[105865]: pam_unix(sudo:session): session closed for user root Sep 22 15:58:28 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-30c16dba-0848-4083-a635-ec5f2078d6ba tempest-ProjectReaderTests-895612456 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-7d21a5e2-7379-407a-8236-b9eda7d32925" returned: 0 in 0.348s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:58:28 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-30c16dba-0848-4083-a635-ec5f2078d6ba tempest-ProjectReaderTests-895612456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-7d21a5e2-7379-407a-8236-b9eda7d32925 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:58:28 devstack sudo[105870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-7d21a5e2-7379-407a-8236-b9eda7d32925 Sep 22 15:58:28 devstack sudo[105870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:58:28 devstack sudo[105870]: pam_unix(sudo:session): session closed for user root Sep 22 15:58:28 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-30c16dba-0848-4083-a635-ec5f2078d6ba tempest-ProjectReaderTests-895612456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-7d21a5e2-7379-407a-8236-b9eda7d32925" returned: 0 in 0.243s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:58:28 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-30c16dba-0848-4083-a635-ec5f2078d6ba tempest-ProjectReaderTests-895612456 None] Lock "cinder-quobyte-7d21a5e2-7379-407a-8236-b9eda7d32925" released by "delete_volume" :: held 0.652s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:58:28 devstack cinder-volume[86212]: DEBUG cinder.quota [None req-30c16dba-0848-4083-a635-ec5f2078d6ba tempest-ProjectReaderTests-895612456 None] Created reservations ['759450ff-942c-4022-b184-3f948b11ba01', 'a171a39a-a32c-4168-ad80-ad92433f783b', 'a35c9b8a-ad91-40a0-a500-2edfc044f8a2', 'c8250253-7fd2-44c2-bc4a-3c3750e7fe5f'] {{(pid=86212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 15:58:28 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-30c16dba-0848-4083-a635-ec5f2078d6ba tempest-ProjectReaderTests-895612456 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:58:28 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-30c16dba-0848-4083-a635-ec5f2078d6ba tempest-ProjectReaderTests-895612456 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:58:28 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-30c16dba-0848-4083-a635-ec5f2078d6ba tempest-ProjectReaderTests-895612456 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:58:28 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-30c16dba-0848-4083-a635-ec5f2078d6ba tempest-ProjectReaderTests-895612456 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:58:28 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-30c16dba-0848-4083-a635-ec5f2078d6ba tempest-ProjectReaderTests-895612456 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:58:28 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-30c16dba-0848-4083-a635-ec5f2078d6ba tempest-ProjectReaderTests-895612456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:58:28 devstack sudo[105873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc Sep 22 15:58:28 devstack sudo[105873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:58:29 devstack sudo[105873]: pam_unix(sudo:session): session closed for user root Sep 22 15:58:29 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-30c16dba-0848-4083-a635-ec5f2078d6ba tempest-ProjectReaderTests-895612456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc" returned: 0 in 0.228s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:58:29 devstack cinder-volume[86212]: DEBUG cinder.manager [None req-30c16dba-0848-4083-a635-ec5f2078d6ba tempest-ProjectReaderTests-895612456 None] Notifying Schedulers of capabilities ... {{(pid=86212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 15:58:29 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-30c16dba-0848-4083-a635-ec5f2078d6ba tempest-ProjectReaderTests-895612456 None] Deleted volume successfully. Sep 22 15:58:29 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-30c16dba-0848-4083-a635-ec5f2078d6ba tempest-ProjectReaderTests-895612456 None] Lock "cinder-7d21a5e2-7379-407a-8236-b9eda7d32925-delete_volume" released by "delete_volume" :: held 1.061s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:58:29 devstack cinder-volume[86212]: DEBUG cinder.volume.flows.manager.create_volume [None req-0466d784-f5c7-4daa-8eb6-fa2f90d0db43 tempest-ProjectReaderTests-895612456 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 15:58:29 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-0466d784-f5c7-4daa-8eb6-fa2f90d0db43 tempest-ProjectReaderTests-895612456 None] Flow 'volume_create_manager' (3898f0b7-0da0-420f-b3e7-16dd44fce3df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:58:29 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-0466d784-f5c7-4daa-8eb6-fa2f90d0db43 tempest-ProjectReaderTests-895612456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a714e6d7-c30a-4d0b-b929-279c88673d6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:58:29 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-0466d784-f5c7-4daa-8eb6-fa2f90d0db43 tempest-ProjectReaderTests-895612456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a714e6d7-c30a-4d0b-b929-279c88673d6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:58:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-206291434',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e0d359f-c024-4c39-a929-ac9106012a6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da280e2e52fe4085be9215a2825e0715',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:58:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:58:30Z,use_quota=True,user_id='b5717331c2e5451da006c3e41b079876',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:58:29 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-0466d784-f5c7-4daa-8eb6-fa2f90d0db43 tempest-ProjectReaderTests-895612456 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec1b0d59-8491-4bd1-be85-8157a5abc0f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:58:29 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-0466d784-f5c7-4daa-8eb6-fa2f90d0db43 tempest-ProjectReaderTests-895612456 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec1b0d59-8491-4bd1-be85-8157a5abc0f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:58:29 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-0466d784-f5c7-4daa-8eb6-fa2f90d0db43 tempest-ProjectReaderTests-895612456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d705963-36bd-44d7-bca3-1c6b2d93c8cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:58:29 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-0466d784-f5c7-4daa-8eb6-fa2f90d0db43 tempest-ProjectReaderTests-895612456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d705963-36bd-44d7-bca3-1c6b2d93c8cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8e0d359f-c024-4c39-a929-ac9106012a6a', 'volume_name': 'volume-8e0d359f-c024-4c39-a929-ac9106012a6a', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:58:29 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-0466d784-f5c7-4daa-8eb6-fa2f90d0db43 tempest-ProjectReaderTests-895612456 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3f9f068-63c3-4ed2-b99c-16b7ea0614a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:58:29 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-0466d784-f5c7-4daa-8eb6-fa2f90d0db43 tempest-ProjectReaderTests-895612456 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3f9f068-63c3-4ed2-b99c-16b7ea0614a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:58:29 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-0466d784-f5c7-4daa-8eb6-fa2f90d0db43 tempest-ProjectReaderTests-895612456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c31c25a-b603-4d00-8f4f-64c51de4a672) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:58:29 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-0466d784-f5c7-4daa-8eb6-fa2f90d0db43 tempest-ProjectReaderTests-895612456 None] Volume 8e0d359f-c024-4c39-a929-ac9106012a6a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8e0d359f-c024-4c39-a929-ac9106012a6a', 'volume_size': 1} Sep 22 15:58:29 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-0466d784-f5c7-4daa-8eb6-fa2f90d0db43 tempest-ProjectReaderTests-895612456 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:58:29 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-0466d784-f5c7-4daa-8eb6-fa2f90d0db43 tempest-ProjectReaderTests-895612456 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:58:29 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-0466d784-f5c7-4daa-8eb6-fa2f90d0db43 tempest-ProjectReaderTests-895612456 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:58:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-206291434',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e0d359f-c024-4c39-a929-ac9106012a6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da280e2e52fe4085be9215a2825e0715',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:58:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:58:30Z,use_quota=True,user_id='b5717331c2e5451da006c3e41b079876',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)}" {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 15:58:29 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-0466d784-f5c7-4daa-8eb6-fa2f90d0db43 tempest-ProjectReaderTests-895612456 None] Creating volume 8e0d359f-c024-4c39-a929-ac9106012a6a {{(pid=86212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 15:58:29 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-0466d784-f5c7-4daa-8eb6-fa2f90d0db43 tempest-ProjectReaderTests-895612456 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:58:29 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-0466d784-f5c7-4daa-8eb6-fa2f90d0db43 tempest-ProjectReaderTests-895612456 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:58:29 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-0466d784-f5c7-4daa-8eb6-fa2f90d0db43 tempest-ProjectReaderTests-895612456 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:58:29 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-0466d784-f5c7-4daa-8eb6-fa2f90d0db43 tempest-ProjectReaderTests-895612456 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:58:29 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-0466d784-f5c7-4daa-8eb6-fa2f90d0db43 tempest-ProjectReaderTests-895612456 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:58:29 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-0466d784-f5c7-4daa-8eb6-fa2f90d0db43 tempest-ProjectReaderTests-895612456 None] Selected osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 as target Quobyte volume. {{(pid=86212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 15:58:29 devstack cinder-volume[86212]: INFO cinder.volume.drivers.remotefs [None req-0466d784-f5c7-4daa-8eb6-fa2f90d0db43 tempest-ProjectReaderTests-895612456 None] casted to osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 Sep 22 15:58:29 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-0466d784-f5c7-4daa-8eb6-fa2f90d0db43 tempest-ProjectReaderTests-895612456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8e0d359f-c024-4c39-a929-ac9106012a6a 1073741824 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:58:29 devstack sudo[105876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8e0d359f-c024-4c39-a929-ac9106012a6a 1073741824 Sep 22 15:58:29 devstack sudo[105876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:58:30 devstack sudo[105876]: pam_unix(sudo:session): session closed for user root Sep 22 15:58:30 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-0466d784-f5c7-4daa-8eb6-fa2f90d0db43 tempest-ProjectReaderTests-895612456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8e0d359f-c024-4c39-a929-ac9106012a6a 1073741824" returned: 0 in 0.392s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:58:30 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-0466d784-f5c7-4daa-8eb6-fa2f90d0db43 tempest-ProjectReaderTests-895612456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8e0d359f-c024-4c39-a929-ac9106012a6a {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:58:30 devstack sudo[105881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8e0d359f-c024-4c39-a929-ac9106012a6a Sep 22 15:58:30 devstack sudo[105881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:58:30 devstack sudo[105881]: pam_unix(sudo:session): session closed for user root Sep 22 15:58:30 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-0466d784-f5c7-4daa-8eb6-fa2f90d0db43 tempest-ProjectReaderTests-895612456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8e0d359f-c024-4c39-a929-ac9106012a6a" returned: 0 in 0.237s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:58:30 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-0466d784-f5c7-4daa-8eb6-fa2f90d0db43 tempest-ProjectReaderTests-895612456 None] <== create_volume: return (689ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'} {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 15:58:30 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-0466d784-f5c7-4daa-8eb6-fa2f90d0db43 tempest-ProjectReaderTests-895612456 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.692s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:58:30 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-0466d784-f5c7-4daa-8eb6-fa2f90d0db43 tempest-ProjectReaderTests-895612456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c31c25a-b603-4d00-8f4f-64c51de4a672) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e0d359f-c024-4c39-a929-ac9106012a6a', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:58:30 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-0466d784-f5c7-4daa-8eb6-fa2f90d0db43 tempest-ProjectReaderTests-895612456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fcc3bbf-74ea-4f54-a118-9568ea336735) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:58:30 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-0466d784-f5c7-4daa-8eb6-fa2f90d0db43 tempest-ProjectReaderTests-895612456 None] Volume volume-8e0d359f-c024-4c39-a929-ac9106012a6a (8e0d359f-c024-4c39-a929-ac9106012a6a): created successfully Sep 22 15:58:30 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-0466d784-f5c7-4daa-8eb6-fa2f90d0db43 tempest-ProjectReaderTests-895612456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fcc3bbf-74ea-4f54-a118-9568ea336735) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:58:30 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-0466d784-f5c7-4daa-8eb6-fa2f90d0db43 tempest-ProjectReaderTests-895612456 None] Flow 'volume_create_manager' (3898f0b7-0da0-420f-b3e7-16dd44fce3df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:58:30 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-0466d784-f5c7-4daa-8eb6-fa2f90d0db43 tempest-ProjectReaderTests-895612456 None] Created volume successfully. Sep 22 15:58:30 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-51a20da0-235b-4c13-810e-87cbcbf158b8 tempest-ProjectReaderTests-895612456 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:58:30 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-51a20da0-235b-4c13-810e-87cbcbf158b8 tempest-ProjectReaderTests-895612456 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:58:30 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-51a20da0-235b-4c13-810e-87cbcbf158b8 tempest-ProjectReaderTests-895612456 None] Creating offline snapshot 176d5348-f165-405b-a01d-4eac7b1872aa of volume 8e0d359f-c024-4c39-a929-ac9106012a6a {{(pid=86212) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 22 15:58:30 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec7abf2a-73f3-4b5a-8023-9328b09bc61c]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:58:30 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-51a20da0-235b-4c13-810e-87cbcbf158b8 tempest-ProjectReaderTests-895612456 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8e0d359f-c024-4c39-a929-ac9106012a6a {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:58:30 devstack sudo[105884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8e0d359f-c024-4c39-a929-ac9106012a6a Sep 22 15:58:30 devstack sudo[105884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:58:31 devstack sudo[105884]: pam_unix(sudo:session): session closed for user root Sep 22 15:58:31 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-51a20da0-235b-4c13-810e-87cbcbf158b8 tempest-ProjectReaderTests-895612456 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8e0d359f-c024-4c39-a929-ac9106012a6a" returned: 0 in 0.352s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:58:31 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-51a20da0-235b-4c13-810e-87cbcbf158b8 tempest-ProjectReaderTests-895612456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8e0d359f-c024-4c39-a929-ac9106012a6a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8e0d359f-c024-4c39-a929-ac9106012a6a.176d5348-f165-405b-a01d-4eac7b1872aa 1G {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:58:31 devstack sudo[105889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8e0d359f-c024-4c39-a929-ac9106012a6a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8e0d359f-c024-4c39-a929-ac9106012a6a.176d5348-f165-405b-a01d-4eac7b1872aa 1G Sep 22 15:58:31 devstack sudo[105889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:58:31 devstack sudo[105889]: pam_unix(sudo:session): session closed for user root Sep 22 15:58:31 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-51a20da0-235b-4c13-810e-87cbcbf158b8 tempest-ProjectReaderTests-895612456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8e0d359f-c024-4c39-a929-ac9106012a6a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8e0d359f-c024-4c39-a929-ac9106012a6a.176d5348-f165-405b-a01d-4eac7b1872aa 1G" returned: 0 in 0.374s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:58:31 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-51a20da0-235b-4c13-810e-87cbcbf158b8 tempest-ProjectReaderTests-895612456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8e0d359f-c024-4c39-a929-ac9106012a6a -F qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8e0d359f-c024-4c39-a929-ac9106012a6a.176d5348-f165-405b-a01d-4eac7b1872aa {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:58:31 devstack sudo[105894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8e0d359f-c024-4c39-a929-ac9106012a6a -F qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8e0d359f-c024-4c39-a929-ac9106012a6a.176d5348-f165-405b-a01d-4eac7b1872aa Sep 22 15:58:31 devstack sudo[105894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:58:31 devstack sudo[105894]: pam_unix(sudo:session): session closed for user root Sep 22 15:58:31 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-51a20da0-235b-4c13-810e-87cbcbf158b8 tempest-ProjectReaderTests-895612456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8e0d359f-c024-4c39-a929-ac9106012a6a -F qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8e0d359f-c024-4c39-a929-ac9106012a6a.176d5348-f165-405b-a01d-4eac7b1872aa" returned: 0 in 0.284s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:58:31 devstack cinder-volume[86212]: WARNING cinder.volume.drivers.remotefs [None req-51a20da0-235b-4c13-810e-87cbcbf158b8 tempest-ProjectReaderTests-895612456 None] /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8e0d359f-c024-4c39-a929-ac9106012a6a.176d5348-f165-405b-a01d-4eac7b1872aa is being set with open permissions: ugo+rw Sep 22 15:58:31 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-51a20da0-235b-4c13-810e-87cbcbf158b8 tempest-ProjectReaderTests-895612456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8e0d359f-c024-4c39-a929-ac9106012a6a.176d5348-f165-405b-a01d-4eac7b1872aa {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:58:31 devstack sudo[105900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8e0d359f-c024-4c39-a929-ac9106012a6a.176d5348-f165-405b-a01d-4eac7b1872aa Sep 22 15:58:31 devstack sudo[105900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:58:31 devstack sudo[105900]: pam_unix(sudo:session): session closed for user root Sep 22 15:58:31 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-51a20da0-235b-4c13-810e-87cbcbf158b8 tempest-ProjectReaderTests-895612456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8e0d359f-c024-4c39-a929-ac9106012a6a.176d5348-f165-405b-a01d-4eac7b1872aa" returned: 0 in 0.253s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:58:32 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-51a20da0-235b-4c13-810e-87cbcbf158b8 tempest-ProjectReaderTests-895612456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8e0d359f-c024-4c39-a929-ac9106012a6a.info {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:58:32 devstack sudo[105903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8e0d359f-c024-4c39-a929-ac9106012a6a.info Sep 22 15:58:32 devstack sudo[105903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:58:32 devstack sudo[105903]: pam_unix(sudo:session): session closed for user root Sep 22 15:58:32 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-51a20da0-235b-4c13-810e-87cbcbf158b8 tempest-ProjectReaderTests-895612456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8e0d359f-c024-4c39-a929-ac9106012a6a.info" returned: 0 in 0.248s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:58:32 devstack cinder-volume[86212]: WARNING cinder.volume.drivers.remotefs [None req-51a20da0-235b-4c13-810e-87cbcbf158b8 tempest-ProjectReaderTests-895612456 None] /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8e0d359f-c024-4c39-a929-ac9106012a6a.info is being set with open permissions: ugo+rw Sep 22 15:58:32 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-51a20da0-235b-4c13-810e-87cbcbf158b8 tempest-ProjectReaderTests-895612456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8e0d359f-c024-4c39-a929-ac9106012a6a.info {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:58:32 devstack sudo[105906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8e0d359f-c024-4c39-a929-ac9106012a6a.info Sep 22 15:58:32 devstack sudo[105906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:58:32 devstack sudo[105906]: pam_unix(sudo:session): session closed for user root Sep 22 15:58:32 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-51a20da0-235b-4c13-810e-87cbcbf158b8 tempest-ProjectReaderTests-895612456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8e0d359f-c024-4c39-a929-ac9106012a6a.info" returned: 0 in 0.262s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:58:32 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-51a20da0-235b-4c13-810e-87cbcbf158b8 tempest-ProjectReaderTests-895612456 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.851s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:58:32 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-51a20da0-235b-4c13-810e-87cbcbf158b8 tempest-ProjectReaderTests-895612456 None] Create snapshot completed successfully Sep 22 15:58:32 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-c8daa69d-85bb-4af3-8461-e5a748d03f32 tempest-ProjectReaderTests-895612456 None] Acquiring lock "cinder-176d5348-f165-405b-a01d-4eac7b1872aa-delete_snapshot" by "delete_snapshot" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:58:32 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-c8daa69d-85bb-4af3-8461-e5a748d03f32 tempest-ProjectReaderTests-895612456 None] Lock "cinder-176d5348-f165-405b-a01d-4eac7b1872aa-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:58:32 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-c8daa69d-85bb-4af3-8461-e5a748d03f32 tempest-ProjectReaderTests-895612456 None] Acquiring lock "cinder-quobyte-8e0d359f-c024-4c39-a929-ac9106012a6a" by "delete_snapshot" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:58:32 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-c8daa69d-85bb-4af3-8461-e5a748d03f32 tempest-ProjectReaderTests-895612456 None] Lock "cinder-quobyte-8e0d359f-c024-4c39-a929-ac9106012a6a" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:58:32 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-c8daa69d-85bb-4af3-8461-e5a748d03f32 tempest-ProjectReaderTests-895612456 None] Acquiring lock "cinder-quobyte-176d5348-f165-405b-a01d-4eac7b1872aa" by "_delete_snapshot" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:58:32 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-c8daa69d-85bb-4af3-8461-e5a748d03f32 tempest-ProjectReaderTests-895612456 None] Lock "cinder-quobyte-176d5348-f165-405b-a01d-4eac7b1872aa" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:58:32 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-c8daa69d-85bb-4af3-8461-e5a748d03f32 tempest-ProjectReaderTests-895612456 None] Deleting offline snapshot 176d5348-f165-405b-a01d-4eac7b1872aa of volume 8e0d359f-c024-4c39-a929-ac9106012a6a {{(pid=86212) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 22 15:58:32 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-c8daa69d-85bb-4af3-8461-e5a748d03f32 tempest-ProjectReaderTests-895612456 None] snapshot_file for this snap is: volume-8e0d359f-c024-4c39-a929-ac9106012a6a.176d5348-f165-405b-a01d-4eac7b1872aa {{(pid=86212) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 22 15:58:32 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad85394f-ce8d-414d-94f1-3e1cce49b39a]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:58:32 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-c8daa69d-85bb-4af3-8461-e5a748d03f32 tempest-ProjectReaderTests-895612456 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8e0d359f-c024-4c39-a929-ac9106012a6a.176d5348-f165-405b-a01d-4eac7b1872aa {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:58:33 devstack sudo[105909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8e0d359f-c024-4c39-a929-ac9106012a6a.176d5348-f165-405b-a01d-4eac7b1872aa Sep 22 15:58:33 devstack sudo[105909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:58:33 devstack sudo[105909]: pam_unix(sudo:session): session closed for user root Sep 22 15:58:33 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-c8daa69d-85bb-4af3-8461-e5a748d03f32 tempest-ProjectReaderTests-895612456 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8e0d359f-c024-4c39-a929-ac9106012a6a.176d5348-f165-405b-a01d-4eac7b1872aa" returned: 0 in 0.352s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:58:33 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-c8daa69d-85bb-4af3-8461-e5a748d03f32 tempest-ProjectReaderTests-895612456 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8e0d359f-c024-4c39-a929-ac9106012a6a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86212) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 22 15:58:33 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f1cee50-253e-4bcc-bd20-19a25e6947b1]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:58:33 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-c8daa69d-85bb-4af3-8461-e5a748d03f32 tempest-ProjectReaderTests-895612456 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8e0d359f-c024-4c39-a929-ac9106012a6a {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:58:33 devstack sudo[105914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8e0d359f-c024-4c39-a929-ac9106012a6a Sep 22 15:58:33 devstack sudo[105914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:58:33 devstack sudo[105914]: pam_unix(sudo:session): session closed for user root Sep 22 15:58:33 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-c8daa69d-85bb-4af3-8461-e5a748d03f32 tempest-ProjectReaderTests-895612456 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8e0d359f-c024-4c39-a929-ac9106012a6a" returned: 0 in 0.346s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:58:33 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-c8daa69d-85bb-4af3-8461-e5a748d03f32 tempest-ProjectReaderTests-895612456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8e0d359f-c024-4c39-a929-ac9106012a6a.176d5348-f165-405b-a01d-4eac7b1872aa {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:58:33 devstack sudo[105919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8e0d359f-c024-4c39-a929-ac9106012a6a.176d5348-f165-405b-a01d-4eac7b1872aa Sep 22 15:58:33 devstack sudo[105919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:58:33 devstack sudo[105919]: pam_unix(sudo:session): session closed for user root Sep 22 15:58:33 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-c8daa69d-85bb-4af3-8461-e5a748d03f32 tempest-ProjectReaderTests-895612456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8e0d359f-c024-4c39-a929-ac9106012a6a.176d5348-f165-405b-a01d-4eac7b1872aa" returned: 0 in 0.333s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:58:33 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-c8daa69d-85bb-4af3-8461-e5a748d03f32 tempest-ProjectReaderTests-895612456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8e0d359f-c024-4c39-a929-ac9106012a6a.176d5348-f165-405b-a01d-4eac7b1872aa {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:58:34 devstack sudo[105924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8e0d359f-c024-4c39-a929-ac9106012a6a.176d5348-f165-405b-a01d-4eac7b1872aa Sep 22 15:58:34 devstack sudo[105924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:58:34 devstack sudo[105924]: pam_unix(sudo:session): session closed for user root Sep 22 15:58:34 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-c8daa69d-85bb-4af3-8461-e5a748d03f32 tempest-ProjectReaderTests-895612456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8e0d359f-c024-4c39-a929-ac9106012a6a.176d5348-f165-405b-a01d-4eac7b1872aa" returned: 0 in 0.245s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:58:34 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-c8daa69d-85bb-4af3-8461-e5a748d03f32 tempest-ProjectReaderTests-895612456 None] Lock "cinder-quobyte-176d5348-f165-405b-a01d-4eac7b1872aa" released by "_delete_snapshot" :: held 1.376s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:58:34 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-c8daa69d-85bb-4af3-8461-e5a748d03f32 tempest-ProjectReaderTests-895612456 None] Lock "cinder-quobyte-8e0d359f-c024-4c39-a929-ac9106012a6a" released by "delete_snapshot" :: held 1.403s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:58:34 devstack cinder-volume[86212]: DEBUG cinder.quota [None req-c8daa69d-85bb-4af3-8461-e5a748d03f32 tempest-ProjectReaderTests-895612456 None] Created reservations ['2c3d4f58-871e-4cbd-8bff-1420e1bc9391', '80ca52a1-9279-4a02-81b4-c4cf046ef08a', '5047315a-d40d-4ed7-9925-48caa74b6282', '2e82f52b-26e7-4853-b45e-e3b9c276b942'] {{(pid=86212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 15:58:34 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-c8daa69d-85bb-4af3-8461-e5a748d03f32 tempest-ProjectReaderTests-895612456 None] Delete snapshot completed successfully. Sep 22 15:58:34 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-c8daa69d-85bb-4af3-8461-e5a748d03f32 tempest-ProjectReaderTests-895612456 None] Lock "cinder-176d5348-f165-405b-a01d-4eac7b1872aa-delete_snapshot" released by "delete_snapshot" :: held 1.538s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:58:34 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-a1bef0c6-32fa-453e-b09c-c5983959e781 tempest-ProjectReaderTests-895612456 None] Acquiring lock "cinder-8e0d359f-c024-4c39-a929-ac9106012a6a-delete_volume" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:58:35 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-a1bef0c6-32fa-453e-b09c-c5983959e781 tempest-ProjectReaderTests-895612456 None] Lock "cinder-8e0d359f-c024-4c39-a929-ac9106012a6a-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:58:35 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-a1bef0c6-32fa-453e-b09c-c5983959e781 tempest-ProjectReaderTests-895612456 None] Acquiring lock "cinder-quobyte-8e0d359f-c024-4c39-a929-ac9106012a6a" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:58:35 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-a1bef0c6-32fa-453e-b09c-c5983959e781 tempest-ProjectReaderTests-895612456 None] Lock "cinder-quobyte-8e0d359f-c024-4c39-a929-ac9106012a6a" acquired by "delete_volume" :: waited 0.017s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:58:35 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[23e38653-9da4-4449-876c-2b2766d44c46]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:58:35 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-a1bef0c6-32fa-453e-b09c-c5983959e781 tempest-ProjectReaderTests-895612456 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8e0d359f-c024-4c39-a929-ac9106012a6a {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:58:35 devstack sudo[105927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8e0d359f-c024-4c39-a929-ac9106012a6a Sep 22 15:58:35 devstack sudo[105927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:58:35 devstack sudo[105927]: pam_unix(sudo:session): session closed for user root Sep 22 15:58:35 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-a1bef0c6-32fa-453e-b09c-c5983959e781 tempest-ProjectReaderTests-895612456 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8e0d359f-c024-4c39-a929-ac9106012a6a" returned: 0 in 0.373s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:58:35 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-a1bef0c6-32fa-453e-b09c-c5983959e781 tempest-ProjectReaderTests-895612456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8e0d359f-c024-4c39-a929-ac9106012a6a {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:58:35 devstack sudo[105932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8e0d359f-c024-4c39-a929-ac9106012a6a Sep 22 15:58:35 devstack sudo[105932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:58:35 devstack sudo[105932]: pam_unix(sudo:session): session closed for user root Sep 22 15:58:35 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-a1bef0c6-32fa-453e-b09c-c5983959e781 tempest-ProjectReaderTests-895612456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8e0d359f-c024-4c39-a929-ac9106012a6a" returned: 0 in 0.258s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:58:35 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-a1bef0c6-32fa-453e-b09c-c5983959e781 tempest-ProjectReaderTests-895612456 None] Lock "cinder-quobyte-8e0d359f-c024-4c39-a929-ac9106012a6a" released by "delete_volume" :: held 0.690s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:58:35 devstack cinder-volume[86212]: DEBUG cinder.quota [None req-a1bef0c6-32fa-453e-b09c-c5983959e781 tempest-ProjectReaderTests-895612456 None] Created reservations ['375f981f-b95e-4e4e-8df7-4c2138994c40', '78632b3c-11ba-488a-906b-692e9c7e7a34', '26790340-0863-485e-90ab-2d93f3c08aff', '3a6ba069-d591-4bb2-840e-099554640e03'] {{(pid=86212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 15:58:35 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-a1bef0c6-32fa-453e-b09c-c5983959e781 tempest-ProjectReaderTests-895612456 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:58:35 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-a1bef0c6-32fa-453e-b09c-c5983959e781 tempest-ProjectReaderTests-895612456 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:58:35 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-a1bef0c6-32fa-453e-b09c-c5983959e781 tempest-ProjectReaderTests-895612456 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:58:35 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-a1bef0c6-32fa-453e-b09c-c5983959e781 tempest-ProjectReaderTests-895612456 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:58:35 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-a1bef0c6-32fa-453e-b09c-c5983959e781 tempest-ProjectReaderTests-895612456 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:58:35 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-a1bef0c6-32fa-453e-b09c-c5983959e781 tempest-ProjectReaderTests-895612456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:58:35 devstack sudo[105935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc Sep 22 15:58:35 devstack sudo[105935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:58:36 devstack sudo[105935]: pam_unix(sudo:session): session closed for user root Sep 22 15:58:36 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-a1bef0c6-32fa-453e-b09c-c5983959e781 tempest-ProjectReaderTests-895612456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc" returned: 0 in 0.267s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:58:36 devstack cinder-volume[86212]: DEBUG cinder.manager [None req-a1bef0c6-32fa-453e-b09c-c5983959e781 tempest-ProjectReaderTests-895612456 None] Notifying Schedulers of capabilities ... {{(pid=86212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 15:58:36 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-a1bef0c6-32fa-453e-b09c-c5983959e781 tempest-ProjectReaderTests-895612456 None] Deleted volume successfully. Sep 22 15:58:36 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-a1bef0c6-32fa-453e-b09c-c5983959e781 tempest-ProjectReaderTests-895612456 None] Lock "cinder-8e0d359f-c024-4c39-a929-ac9106012a6a-delete_volume" released by "delete_volume" :: held 1.163s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:58:36 devstack cinder-volume[86212]: DEBUG cinder.volume.flows.manager.create_volume [None req-fcc20bdf-e81c-4e26-aa55-18eda907ae22 tempest-ProjectReaderTests-895612456 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 15:58:36 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-fcc20bdf-e81c-4e26-aa55-18eda907ae22 tempest-ProjectReaderTests-895612456 None] Flow 'volume_create_manager' (0b9a9520-ff21-47e6-ba91-f08716c979a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:58:36 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-fcc20bdf-e81c-4e26-aa55-18eda907ae22 tempest-ProjectReaderTests-895612456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ad59a26-d837-484f-b2f0-c4696ba2047d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:58:36 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-fcc20bdf-e81c-4e26-aa55-18eda907ae22 tempest-ProjectReaderTests-895612456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ad59a26-d837-484f-b2f0-c4696ba2047d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:58:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1955345072',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90fcfb94-abf2-4302-990e-059364b97eed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da280e2e52fe4085be9215a2825e0715',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:58:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:58:37Z,use_quota=True,user_id='b5717331c2e5451da006c3e41b079876',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:58:36 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-fcc20bdf-e81c-4e26-aa55-18eda907ae22 tempest-ProjectReaderTests-895612456 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f55ae18-310a-4c64-9a16-9573913ded29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:58:36 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-fcc20bdf-e81c-4e26-aa55-18eda907ae22 tempest-ProjectReaderTests-895612456 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f55ae18-310a-4c64-9a16-9573913ded29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:58:36 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-fcc20bdf-e81c-4e26-aa55-18eda907ae22 tempest-ProjectReaderTests-895612456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc7a989d-a371-4d0e-85a9-3dbd05dcd818) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:58:36 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-fcc20bdf-e81c-4e26-aa55-18eda907ae22 tempest-ProjectReaderTests-895612456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc7a989d-a371-4d0e-85a9-3dbd05dcd818) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '90fcfb94-abf2-4302-990e-059364b97eed', 'volume_name': 'volume-90fcfb94-abf2-4302-990e-059364b97eed', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:58:36 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-fcc20bdf-e81c-4e26-aa55-18eda907ae22 tempest-ProjectReaderTests-895612456 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93f97315-60fe-4801-a94a-ebc74b2a9090) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:58:36 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-fcc20bdf-e81c-4e26-aa55-18eda907ae22 tempest-ProjectReaderTests-895612456 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93f97315-60fe-4801-a94a-ebc74b2a9090) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:58:36 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-fcc20bdf-e81c-4e26-aa55-18eda907ae22 tempest-ProjectReaderTests-895612456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9064c51c-a78d-4fc0-9df0-22e43a627d54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:58:36 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-fcc20bdf-e81c-4e26-aa55-18eda907ae22 tempest-ProjectReaderTests-895612456 None] Volume 90fcfb94-abf2-4302-990e-059364b97eed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-90fcfb94-abf2-4302-990e-059364b97eed', 'volume_size': 1} Sep 22 15:58:36 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-fcc20bdf-e81c-4e26-aa55-18eda907ae22 tempest-ProjectReaderTests-895612456 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:58:36 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-fcc20bdf-e81c-4e26-aa55-18eda907ae22 tempest-ProjectReaderTests-895612456 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:58:36 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-fcc20bdf-e81c-4e26-aa55-18eda907ae22 tempest-ProjectReaderTests-895612456 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:58:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1955345072',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90fcfb94-abf2-4302-990e-059364b97eed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da280e2e52fe4085be9215a2825e0715',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:58:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:58:37Z,use_quota=True,user_id='b5717331c2e5451da006c3e41b079876',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)}" {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 15:58:36 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-fcc20bdf-e81c-4e26-aa55-18eda907ae22 tempest-ProjectReaderTests-895612456 None] Creating volume 90fcfb94-abf2-4302-990e-059364b97eed {{(pid=86212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 15:58:36 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-fcc20bdf-e81c-4e26-aa55-18eda907ae22 tempest-ProjectReaderTests-895612456 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:58:36 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-fcc20bdf-e81c-4e26-aa55-18eda907ae22 tempest-ProjectReaderTests-895612456 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:58:36 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-fcc20bdf-e81c-4e26-aa55-18eda907ae22 tempest-ProjectReaderTests-895612456 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:58:36 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-fcc20bdf-e81c-4e26-aa55-18eda907ae22 tempest-ProjectReaderTests-895612456 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:58:36 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-fcc20bdf-e81c-4e26-aa55-18eda907ae22 tempest-ProjectReaderTests-895612456 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:58:36 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-fcc20bdf-e81c-4e26-aa55-18eda907ae22 tempest-ProjectReaderTests-895612456 None] Selected osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 as target Quobyte volume. {{(pid=86212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 15:58:36 devstack cinder-volume[86212]: INFO cinder.volume.drivers.remotefs [None req-fcc20bdf-e81c-4e26-aa55-18eda907ae22 tempest-ProjectReaderTests-895612456 None] casted to osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 Sep 22 15:58:36 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-fcc20bdf-e81c-4e26-aa55-18eda907ae22 tempest-ProjectReaderTests-895612456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-90fcfb94-abf2-4302-990e-059364b97eed 1073741824 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:58:36 devstack sudo[105938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-90fcfb94-abf2-4302-990e-059364b97eed 1073741824 Sep 22 15:58:36 devstack sudo[105938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:58:37 devstack sudo[105938]: pam_unix(sudo:session): session closed for user root Sep 22 15:58:37 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-fcc20bdf-e81c-4e26-aa55-18eda907ae22 tempest-ProjectReaderTests-895612456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-90fcfb94-abf2-4302-990e-059364b97eed 1073741824" returned: 0 in 0.396s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:58:37 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-fcc20bdf-e81c-4e26-aa55-18eda907ae22 tempest-ProjectReaderTests-895612456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-90fcfb94-abf2-4302-990e-059364b97eed {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:58:37 devstack sudo[105944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-90fcfb94-abf2-4302-990e-059364b97eed Sep 22 15:58:37 devstack sudo[105944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:58:37 devstack sudo[105944]: pam_unix(sudo:session): session closed for user root Sep 22 15:58:37 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-fcc20bdf-e81c-4e26-aa55-18eda907ae22 tempest-ProjectReaderTests-895612456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-90fcfb94-abf2-4302-990e-059364b97eed" returned: 0 in 0.243s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:58:37 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-fcc20bdf-e81c-4e26-aa55-18eda907ae22 tempest-ProjectReaderTests-895612456 None] <== create_volume: return (680ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'} {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 15:58:37 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-fcc20bdf-e81c-4e26-aa55-18eda907ae22 tempest-ProjectReaderTests-895612456 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.682s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:58:37 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-fcc20bdf-e81c-4e26-aa55-18eda907ae22 tempest-ProjectReaderTests-895612456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9064c51c-a78d-4fc0-9df0-22e43a627d54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-90fcfb94-abf2-4302-990e-059364b97eed', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:58:37 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-fcc20bdf-e81c-4e26-aa55-18eda907ae22 tempest-ProjectReaderTests-895612456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fedbf53-c44b-406c-8e8e-625ca9630bac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:58:37 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-fcc20bdf-e81c-4e26-aa55-18eda907ae22 tempest-ProjectReaderTests-895612456 None] Volume volume-90fcfb94-abf2-4302-990e-059364b97eed (90fcfb94-abf2-4302-990e-059364b97eed): created successfully Sep 22 15:58:37 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-fcc20bdf-e81c-4e26-aa55-18eda907ae22 tempest-ProjectReaderTests-895612456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fedbf53-c44b-406c-8e8e-625ca9630bac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:58:37 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-fcc20bdf-e81c-4e26-aa55-18eda907ae22 tempest-ProjectReaderTests-895612456 None] Flow 'volume_create_manager' (0b9a9520-ff21-47e6-ba91-f08716c979a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:58:37 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-fcc20bdf-e81c-4e26-aa55-18eda907ae22 tempest-ProjectReaderTests-895612456 None] Created volume successfully. Sep 22 15:58:37 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-79e008d6-5ab6-4567-8e7b-4f63d9bf5432 tempest-ProjectReaderTests-895612456 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:58:37 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-79e008d6-5ab6-4567-8e7b-4f63d9bf5432 tempest-ProjectReaderTests-895612456 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:58:37 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-79e008d6-5ab6-4567-8e7b-4f63d9bf5432 tempest-ProjectReaderTests-895612456 None] Creating offline snapshot 0d45b701-8716-4863-8c7d-0b720b99ef06 of volume 90fcfb94-abf2-4302-990e-059364b97eed {{(pid=86212) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 22 15:58:37 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[785b8cd2-c19e-4a2e-8bed-905b12cdb069]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:58:37 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-79e008d6-5ab6-4567-8e7b-4f63d9bf5432 tempest-ProjectReaderTests-895612456 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-90fcfb94-abf2-4302-990e-059364b97eed {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:58:37 devstack sudo[105947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-90fcfb94-abf2-4302-990e-059364b97eed Sep 22 15:58:37 devstack sudo[105947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:58:38 devstack sudo[105947]: pam_unix(sudo:session): session closed for user root Sep 22 15:58:38 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-79e008d6-5ab6-4567-8e7b-4f63d9bf5432 tempest-ProjectReaderTests-895612456 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-90fcfb94-abf2-4302-990e-059364b97eed" returned: 0 in 0.355s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:58:38 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-79e008d6-5ab6-4567-8e7b-4f63d9bf5432 tempest-ProjectReaderTests-895612456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-90fcfb94-abf2-4302-990e-059364b97eed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-90fcfb94-abf2-4302-990e-059364b97eed.0d45b701-8716-4863-8c7d-0b720b99ef06 1G {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:58:38 devstack sudo[105953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-90fcfb94-abf2-4302-990e-059364b97eed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-90fcfb94-abf2-4302-990e-059364b97eed.0d45b701-8716-4863-8c7d-0b720b99ef06 1G Sep 22 15:58:38 devstack sudo[105953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:58:38 devstack cinder-volume[86212]: DEBUG oslo_service.periodic_task [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86212) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 22 15:58:38 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:58:38 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:58:38 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:58:38 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:58:38 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:58:38 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:58:38 devstack sudo[105953]: pam_unix(sudo:session): session closed for user root Sep 22 15:58:38 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-79e008d6-5ab6-4567-8e7b-4f63d9bf5432 tempest-ProjectReaderTests-895612456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-90fcfb94-abf2-4302-990e-059364b97eed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-90fcfb94-abf2-4302-990e-059364b97eed.0d45b701-8716-4863-8c7d-0b720b99ef06 1G" returned: 0 in 0.375s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:58:38 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-79e008d6-5ab6-4567-8e7b-4f63d9bf5432 tempest-ProjectReaderTests-895612456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-90fcfb94-abf2-4302-990e-059364b97eed -F qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-90fcfb94-abf2-4302-990e-059364b97eed.0d45b701-8716-4863-8c7d-0b720b99ef06 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:58:38 devstack sudo[105958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc Sep 22 15:58:38 devstack sudo[105958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:58:38 devstack sudo[105959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-90fcfb94-abf2-4302-990e-059364b97eed -F qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-90fcfb94-abf2-4302-990e-059364b97eed.0d45b701-8716-4863-8c7d-0b720b99ef06 Sep 22 15:58:38 devstack sudo[105959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:58:38 devstack sudo[105958]: pam_unix(sudo:session): session closed for user root Sep 22 15:58:38 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc" returned: 0 in 0.256s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:58:38 devstack cinder-volume[86212]: DEBUG cinder.manager [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] Notifying Schedulers of capabilities ... {{(pid=86212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 15:58:38 devstack cinder-volume[86212]: DEBUG oslo_service.periodic_task [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] Running periodic task VolumeManager._thread_info {{(pid=86212) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 22 15:58:38 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] thread count: 29 {{(pid=86212) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 22 15:58:38 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] thread info: [<_MainThread(MainThread, started 136163191222400)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86212) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 22 15:58:38 devstack sudo[105959]: pam_unix(sudo:session): session closed for user root Sep 22 15:58:38 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-79e008d6-5ab6-4567-8e7b-4f63d9bf5432 tempest-ProjectReaderTests-895612456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-90fcfb94-abf2-4302-990e-059364b97eed -F qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-90fcfb94-abf2-4302-990e-059364b97eed.0d45b701-8716-4863-8c7d-0b720b99ef06" returned: 0 in 0.298s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:58:38 devstack cinder-volume[86212]: WARNING cinder.volume.drivers.remotefs [None req-79e008d6-5ab6-4567-8e7b-4f63d9bf5432 tempest-ProjectReaderTests-895612456 None] /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-90fcfb94-abf2-4302-990e-059364b97eed.0d45b701-8716-4863-8c7d-0b720b99ef06 is being set with open permissions: ugo+rw Sep 22 15:58:38 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-79e008d6-5ab6-4567-8e7b-4f63d9bf5432 tempest-ProjectReaderTests-895612456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-90fcfb94-abf2-4302-990e-059364b97eed.0d45b701-8716-4863-8c7d-0b720b99ef06 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:58:38 devstack sudo[105967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-90fcfb94-abf2-4302-990e-059364b97eed.0d45b701-8716-4863-8c7d-0b720b99ef06 Sep 22 15:58:38 devstack sudo[105967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:58:39 devstack sudo[105967]: pam_unix(sudo:session): session closed for user root Sep 22 15:58:39 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-79e008d6-5ab6-4567-8e7b-4f63d9bf5432 tempest-ProjectReaderTests-895612456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-90fcfb94-abf2-4302-990e-059364b97eed.0d45b701-8716-4863-8c7d-0b720b99ef06" returned: 0 in 0.251s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:58:39 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-79e008d6-5ab6-4567-8e7b-4f63d9bf5432 tempest-ProjectReaderTests-895612456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-90fcfb94-abf2-4302-990e-059364b97eed.info {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:58:39 devstack sudo[105970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-90fcfb94-abf2-4302-990e-059364b97eed.info Sep 22 15:58:39 devstack sudo[105970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:58:39 devstack sudo[105970]: pam_unix(sudo:session): session closed for user root Sep 22 15:58:39 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-79e008d6-5ab6-4567-8e7b-4f63d9bf5432 tempest-ProjectReaderTests-895612456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-90fcfb94-abf2-4302-990e-059364b97eed.info" returned: 0 in 0.267s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:58:39 devstack cinder-volume[86212]: WARNING cinder.volume.drivers.remotefs [None req-79e008d6-5ab6-4567-8e7b-4f63d9bf5432 tempest-ProjectReaderTests-895612456 None] /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-90fcfb94-abf2-4302-990e-059364b97eed.info is being set with open permissions: ugo+rw Sep 22 15:58:39 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-79e008d6-5ab6-4567-8e7b-4f63d9bf5432 tempest-ProjectReaderTests-895612456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-90fcfb94-abf2-4302-990e-059364b97eed.info {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:58:39 devstack sudo[105973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-90fcfb94-abf2-4302-990e-059364b97eed.info Sep 22 15:58:39 devstack sudo[105973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:58:39 devstack sudo[105973]: pam_unix(sudo:session): session closed for user root Sep 22 15:58:39 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-79e008d6-5ab6-4567-8e7b-4f63d9bf5432 tempest-ProjectReaderTests-895612456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-90fcfb94-abf2-4302-990e-059364b97eed.info" returned: 0 in 0.244s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:58:39 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-79e008d6-5ab6-4567-8e7b-4f63d9bf5432 tempest-ProjectReaderTests-895612456 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.868s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:58:39 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-79e008d6-5ab6-4567-8e7b-4f63d9bf5432 tempest-ProjectReaderTests-895612456 None] Create snapshot completed successfully Sep 22 15:58:39 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-5c7b9dd1-5250-4942-9b80-0052c058843b tempest-ProjectReaderTests-895612456 None] Acquiring lock "cinder-0d45b701-8716-4863-8c7d-0b720b99ef06-delete_snapshot" by "delete_snapshot" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:58:39 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-5c7b9dd1-5250-4942-9b80-0052c058843b tempest-ProjectReaderTests-895612456 None] Lock "cinder-0d45b701-8716-4863-8c7d-0b720b99ef06-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:58:39 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-5c7b9dd1-5250-4942-9b80-0052c058843b tempest-ProjectReaderTests-895612456 None] Acquiring lock "cinder-quobyte-90fcfb94-abf2-4302-990e-059364b97eed" by "delete_snapshot" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:58:39 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-5c7b9dd1-5250-4942-9b80-0052c058843b tempest-ProjectReaderTests-895612456 None] Lock "cinder-quobyte-90fcfb94-abf2-4302-990e-059364b97eed" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:58:39 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-5c7b9dd1-5250-4942-9b80-0052c058843b tempest-ProjectReaderTests-895612456 None] Acquiring lock "cinder-quobyte-0d45b701-8716-4863-8c7d-0b720b99ef06" by "_delete_snapshot" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:58:39 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-5c7b9dd1-5250-4942-9b80-0052c058843b tempest-ProjectReaderTests-895612456 None] Lock "cinder-quobyte-0d45b701-8716-4863-8c7d-0b720b99ef06" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:58:39 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-5c7b9dd1-5250-4942-9b80-0052c058843b tempest-ProjectReaderTests-895612456 None] Deleting offline snapshot 0d45b701-8716-4863-8c7d-0b720b99ef06 of volume 90fcfb94-abf2-4302-990e-059364b97eed {{(pid=86212) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 22 15:58:39 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-5c7b9dd1-5250-4942-9b80-0052c058843b tempest-ProjectReaderTests-895612456 None] snapshot_file for this snap is: volume-90fcfb94-abf2-4302-990e-059364b97eed.0d45b701-8716-4863-8c7d-0b720b99ef06 {{(pid=86212) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 22 15:58:39 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0bb96f8-b63a-4e23-9357-868e6a45f5f0]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:58:39 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-5c7b9dd1-5250-4942-9b80-0052c058843b tempest-ProjectReaderTests-895612456 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-90fcfb94-abf2-4302-990e-059364b97eed.0d45b701-8716-4863-8c7d-0b720b99ef06 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:58:40 devstack sudo[105976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-90fcfb94-abf2-4302-990e-059364b97eed.0d45b701-8716-4863-8c7d-0b720b99ef06 Sep 22 15:58:40 devstack sudo[105976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:58:40 devstack sudo[105976]: pam_unix(sudo:session): session closed for user root Sep 22 15:58:40 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-5c7b9dd1-5250-4942-9b80-0052c058843b tempest-ProjectReaderTests-895612456 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-90fcfb94-abf2-4302-990e-059364b97eed.0d45b701-8716-4863-8c7d-0b720b99ef06" returned: 0 in 0.354s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:58:40 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-5c7b9dd1-5250-4942-9b80-0052c058843b tempest-ProjectReaderTests-895612456 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-90fcfb94-abf2-4302-990e-059364b97eed(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86212) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 22 15:58:40 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b7da500-9d2a-4845-8634-f352bffb6e5b]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:58:40 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-5c7b9dd1-5250-4942-9b80-0052c058843b tempest-ProjectReaderTests-895612456 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-90fcfb94-abf2-4302-990e-059364b97eed {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:58:40 devstack sudo[105981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-90fcfb94-abf2-4302-990e-059364b97eed Sep 22 15:58:40 devstack sudo[105981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:58:40 devstack sudo[105981]: pam_unix(sudo:session): session closed for user root Sep 22 15:58:40 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-5c7b9dd1-5250-4942-9b80-0052c058843b tempest-ProjectReaderTests-895612456 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-90fcfb94-abf2-4302-990e-059364b97eed" returned: 0 in 0.354s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:58:40 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-5c7b9dd1-5250-4942-9b80-0052c058843b tempest-ProjectReaderTests-895612456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-90fcfb94-abf2-4302-990e-059364b97eed.0d45b701-8716-4863-8c7d-0b720b99ef06 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:58:40 devstack sudo[105986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-90fcfb94-abf2-4302-990e-059364b97eed.0d45b701-8716-4863-8c7d-0b720b99ef06 Sep 22 15:58:40 devstack sudo[105986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:58:41 devstack sudo[105986]: pam_unix(sudo:session): session closed for user root Sep 22 15:58:41 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-5c7b9dd1-5250-4942-9b80-0052c058843b tempest-ProjectReaderTests-895612456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-90fcfb94-abf2-4302-990e-059364b97eed.0d45b701-8716-4863-8c7d-0b720b99ef06" returned: 0 in 0.327s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:58:41 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-5c7b9dd1-5250-4942-9b80-0052c058843b tempest-ProjectReaderTests-895612456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-90fcfb94-abf2-4302-990e-059364b97eed.0d45b701-8716-4863-8c7d-0b720b99ef06 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:58:41 devstack sudo[105991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-90fcfb94-abf2-4302-990e-059364b97eed.0d45b701-8716-4863-8c7d-0b720b99ef06 Sep 22 15:58:41 devstack sudo[105991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:58:41 devstack sudo[105991]: pam_unix(sudo:session): session closed for user root Sep 22 15:58:41 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-5c7b9dd1-5250-4942-9b80-0052c058843b tempest-ProjectReaderTests-895612456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-90fcfb94-abf2-4302-990e-059364b97eed.0d45b701-8716-4863-8c7d-0b720b99ef06" returned: 0 in 0.238s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:58:41 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-5c7b9dd1-5250-4942-9b80-0052c058843b tempest-ProjectReaderTests-895612456 None] Lock "cinder-quobyte-0d45b701-8716-4863-8c7d-0b720b99ef06" released by "_delete_snapshot" :: held 1.365s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:58:41 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-5c7b9dd1-5250-4942-9b80-0052c058843b tempest-ProjectReaderTests-895612456 None] Lock "cinder-quobyte-90fcfb94-abf2-4302-990e-059364b97eed" released by "delete_snapshot" :: held 1.387s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:58:41 devstack cinder-volume[86212]: DEBUG cinder.quota [None req-5c7b9dd1-5250-4942-9b80-0052c058843b tempest-ProjectReaderTests-895612456 None] Created reservations ['b8d66c90-64c5-48c7-a485-30138e1f0def', '7e72c10e-592a-45b7-a0bc-06b17b3d7f48', '1b460681-3973-4095-8104-b85b01e32a36', '02320d7f-ba16-497c-ab86-7d974a467537'] {{(pid=86212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 15:58:41 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-5c7b9dd1-5250-4942-9b80-0052c058843b tempest-ProjectReaderTests-895612456 None] Delete snapshot completed successfully. Sep 22 15:58:41 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-5c7b9dd1-5250-4942-9b80-0052c058843b tempest-ProjectReaderTests-895612456 None] Lock "cinder-0d45b701-8716-4863-8c7d-0b720b99ef06-delete_snapshot" released by "delete_snapshot" :: held 1.513s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:58:42 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-75f9d96f-0029-422b-9d54-fc2d5e183090 tempest-ProjectReaderTests-895612456 None] Acquiring lock "cinder-90fcfb94-abf2-4302-990e-059364b97eed-delete_volume" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:58:42 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-75f9d96f-0029-422b-9d54-fc2d5e183090 tempest-ProjectReaderTests-895612456 None] Lock "cinder-90fcfb94-abf2-4302-990e-059364b97eed-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:58:42 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-75f9d96f-0029-422b-9d54-fc2d5e183090 tempest-ProjectReaderTests-895612456 None] Acquiring lock "cinder-quobyte-90fcfb94-abf2-4302-990e-059364b97eed" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:58:42 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-75f9d96f-0029-422b-9d54-fc2d5e183090 tempest-ProjectReaderTests-895612456 None] Lock "cinder-quobyte-90fcfb94-abf2-4302-990e-059364b97eed" acquired by "delete_volume" :: waited 0.014s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:58:42 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[317f5567-523e-4951-b124-ae41f0c17f1c]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:58:42 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-75f9d96f-0029-422b-9d54-fc2d5e183090 tempest-ProjectReaderTests-895612456 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-90fcfb94-abf2-4302-990e-059364b97eed {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:58:42 devstack sudo[105994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-90fcfb94-abf2-4302-990e-059364b97eed Sep 22 15:58:42 devstack sudo[105994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:58:42 devstack sudo[105994]: pam_unix(sudo:session): session closed for user root Sep 22 15:58:42 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-75f9d96f-0029-422b-9d54-fc2d5e183090 tempest-ProjectReaderTests-895612456 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-90fcfb94-abf2-4302-990e-059364b97eed" returned: 0 in 0.357s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:58:42 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-75f9d96f-0029-422b-9d54-fc2d5e183090 tempest-ProjectReaderTests-895612456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-90fcfb94-abf2-4302-990e-059364b97eed {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:58:42 devstack sudo[105999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-90fcfb94-abf2-4302-990e-059364b97eed Sep 22 15:58:42 devstack sudo[105999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:58:42 devstack sudo[105999]: pam_unix(sudo:session): session closed for user root Sep 22 15:58:42 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-75f9d96f-0029-422b-9d54-fc2d5e183090 tempest-ProjectReaderTests-895612456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-90fcfb94-abf2-4302-990e-059364b97eed" returned: 0 in 0.245s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:58:42 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-75f9d96f-0029-422b-9d54-fc2d5e183090 tempest-ProjectReaderTests-895612456 None] Lock "cinder-quobyte-90fcfb94-abf2-4302-990e-059364b97eed" released by "delete_volume" :: held 0.661s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:58:42 devstack cinder-volume[86212]: DEBUG cinder.quota [None req-75f9d96f-0029-422b-9d54-fc2d5e183090 tempest-ProjectReaderTests-895612456 None] Created reservations ['f808b4a5-d4cd-4a0c-a254-2899f9c06229', '30690236-17ec-475c-aac0-a25a3c808c75', '70e21437-3b34-43ca-a572-532e9dd6e88c', '2b0f480b-3106-4674-b426-f485a38d90ed'] {{(pid=86212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 15:58:42 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-75f9d96f-0029-422b-9d54-fc2d5e183090 tempest-ProjectReaderTests-895612456 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:58:42 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-75f9d96f-0029-422b-9d54-fc2d5e183090 tempest-ProjectReaderTests-895612456 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:58:42 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-75f9d96f-0029-422b-9d54-fc2d5e183090 tempest-ProjectReaderTests-895612456 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:58:42 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-75f9d96f-0029-422b-9d54-fc2d5e183090 tempest-ProjectReaderTests-895612456 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:58:42 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-75f9d96f-0029-422b-9d54-fc2d5e183090 tempest-ProjectReaderTests-895612456 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:58:42 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-75f9d96f-0029-422b-9d54-fc2d5e183090 tempest-ProjectReaderTests-895612456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:58:42 devstack sudo[106002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc Sep 22 15:58:42 devstack sudo[106002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:58:43 devstack sudo[106002]: pam_unix(sudo:session): session closed for user root Sep 22 15:58:43 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-75f9d96f-0029-422b-9d54-fc2d5e183090 tempest-ProjectReaderTests-895612456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc" returned: 0 in 0.248s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:58:43 devstack cinder-volume[86212]: DEBUG cinder.manager [None req-75f9d96f-0029-422b-9d54-fc2d5e183090 tempest-ProjectReaderTests-895612456 None] Notifying Schedulers of capabilities ... {{(pid=86212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 15:58:43 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-75f9d96f-0029-422b-9d54-fc2d5e183090 tempest-ProjectReaderTests-895612456 None] Deleted volume successfully. Sep 22 15:58:43 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-75f9d96f-0029-422b-9d54-fc2d5e183090 tempest-ProjectReaderTests-895612456 None] Lock "cinder-90fcfb94-abf2-4302-990e-059364b97eed-delete_volume" released by "delete_volume" :: held 1.102s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:58:43 devstack cinder-volume[86212]: DEBUG cinder.volume.flows.manager.create_volume [None req-873c2a7d-21c1-48da-8ae8-38248ccb2122 tempest-ProjectReaderTests-895612456 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 15:58:43 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-873c2a7d-21c1-48da-8ae8-38248ccb2122 tempest-ProjectReaderTests-895612456 None] Flow 'volume_create_manager' (4889848b-3335-4bae-b00d-e06a565f1dd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:58:43 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-873c2a7d-21c1-48da-8ae8-38248ccb2122 tempest-ProjectReaderTests-895612456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (671b731a-4b10-4258-83c9-d499e476bc3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:58:43 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-873c2a7d-21c1-48da-8ae8-38248ccb2122 tempest-ProjectReaderTests-895612456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (671b731a-4b10-4258-83c9-d499e476bc3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:58:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-961734639',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0bed38db-8dbf-45f9-bd0f-15a394a5ca02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da280e2e52fe4085be9215a2825e0715',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:58:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:58:44Z,use_quota=True,user_id='b5717331c2e5451da006c3e41b079876',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:58:43 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-873c2a7d-21c1-48da-8ae8-38248ccb2122 tempest-ProjectReaderTests-895612456 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1189a8de-8551-4d21-b228-a0b4579e7ecc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:58:43 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-873c2a7d-21c1-48da-8ae8-38248ccb2122 tempest-ProjectReaderTests-895612456 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1189a8de-8551-4d21-b228-a0b4579e7ecc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:58:43 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-873c2a7d-21c1-48da-8ae8-38248ccb2122 tempest-ProjectReaderTests-895612456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (556bfd2d-0f76-4e23-8f89-67976f476f40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:58:43 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-873c2a7d-21c1-48da-8ae8-38248ccb2122 tempest-ProjectReaderTests-895612456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (556bfd2d-0f76-4e23-8f89-67976f476f40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0bed38db-8dbf-45f9-bd0f-15a394a5ca02', 'volume_name': 'volume-0bed38db-8dbf-45f9-bd0f-15a394a5ca02', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:58:43 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-873c2a7d-21c1-48da-8ae8-38248ccb2122 tempest-ProjectReaderTests-895612456 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54b0f77d-bb63-46f3-b855-44a1373cafb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:58:43 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-873c2a7d-21c1-48da-8ae8-38248ccb2122 tempest-ProjectReaderTests-895612456 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54b0f77d-bb63-46f3-b855-44a1373cafb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:58:43 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-873c2a7d-21c1-48da-8ae8-38248ccb2122 tempest-ProjectReaderTests-895612456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fa18011-ad93-4274-8750-dbd778ab8a12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:58:43 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-873c2a7d-21c1-48da-8ae8-38248ccb2122 tempest-ProjectReaderTests-895612456 None] Volume 0bed38db-8dbf-45f9-bd0f-15a394a5ca02: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0bed38db-8dbf-45f9-bd0f-15a394a5ca02', 'volume_size': 1} Sep 22 15:58:43 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-873c2a7d-21c1-48da-8ae8-38248ccb2122 tempest-ProjectReaderTests-895612456 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:58:43 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-873c2a7d-21c1-48da-8ae8-38248ccb2122 tempest-ProjectReaderTests-895612456 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:58:43 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-873c2a7d-21c1-48da-8ae8-38248ccb2122 tempest-ProjectReaderTests-895612456 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:58:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-961734639',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0bed38db-8dbf-45f9-bd0f-15a394a5ca02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da280e2e52fe4085be9215a2825e0715',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:58:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:58:44Z,use_quota=True,user_id='b5717331c2e5451da006c3e41b079876',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)}" {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 15:58:43 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-873c2a7d-21c1-48da-8ae8-38248ccb2122 tempest-ProjectReaderTests-895612456 None] Creating volume 0bed38db-8dbf-45f9-bd0f-15a394a5ca02 {{(pid=86212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 15:58:43 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-873c2a7d-21c1-48da-8ae8-38248ccb2122 tempest-ProjectReaderTests-895612456 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:58:43 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-873c2a7d-21c1-48da-8ae8-38248ccb2122 tempest-ProjectReaderTests-895612456 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:58:43 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-873c2a7d-21c1-48da-8ae8-38248ccb2122 tempest-ProjectReaderTests-895612456 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:58:43 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-873c2a7d-21c1-48da-8ae8-38248ccb2122 tempest-ProjectReaderTests-895612456 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:58:43 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-873c2a7d-21c1-48da-8ae8-38248ccb2122 tempest-ProjectReaderTests-895612456 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:58:43 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-873c2a7d-21c1-48da-8ae8-38248ccb2122 tempest-ProjectReaderTests-895612456 None] Selected osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 as target Quobyte volume. {{(pid=86212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 15:58:43 devstack cinder-volume[86212]: INFO cinder.volume.drivers.remotefs [None req-873c2a7d-21c1-48da-8ae8-38248ccb2122 tempest-ProjectReaderTests-895612456 None] casted to osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 Sep 22 15:58:43 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-873c2a7d-21c1-48da-8ae8-38248ccb2122 tempest-ProjectReaderTests-895612456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-0bed38db-8dbf-45f9-bd0f-15a394a5ca02 1073741824 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:58:43 devstack sudo[106005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-0bed38db-8dbf-45f9-bd0f-15a394a5ca02 1073741824 Sep 22 15:58:43 devstack sudo[106005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:58:44 devstack sudo[106005]: pam_unix(sudo:session): session closed for user root Sep 22 15:58:44 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-873c2a7d-21c1-48da-8ae8-38248ccb2122 tempest-ProjectReaderTests-895612456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-0bed38db-8dbf-45f9-bd0f-15a394a5ca02 1073741824" returned: 0 in 0.402s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:58:44 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-873c2a7d-21c1-48da-8ae8-38248ccb2122 tempest-ProjectReaderTests-895612456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-0bed38db-8dbf-45f9-bd0f-15a394a5ca02 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:58:44 devstack sudo[106045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-0bed38db-8dbf-45f9-bd0f-15a394a5ca02 Sep 22 15:58:44 devstack sudo[106045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:58:44 devstack sudo[106045]: pam_unix(sudo:session): session closed for user root Sep 22 15:58:44 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-873c2a7d-21c1-48da-8ae8-38248ccb2122 tempest-ProjectReaderTests-895612456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-0bed38db-8dbf-45f9-bd0f-15a394a5ca02" returned: 0 in 0.246s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:58:44 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-873c2a7d-21c1-48da-8ae8-38248ccb2122 tempest-ProjectReaderTests-895612456 None] <== create_volume: return (698ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'} {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 15:58:44 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-873c2a7d-21c1-48da-8ae8-38248ccb2122 tempest-ProjectReaderTests-895612456 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.701s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:58:44 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-873c2a7d-21c1-48da-8ae8-38248ccb2122 tempest-ProjectReaderTests-895612456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fa18011-ad93-4274-8750-dbd778ab8a12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0bed38db-8dbf-45f9-bd0f-15a394a5ca02', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:58:44 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-873c2a7d-21c1-48da-8ae8-38248ccb2122 tempest-ProjectReaderTests-895612456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c4aec39-4959-4023-a58c-94da8ffc03f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:58:44 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-873c2a7d-21c1-48da-8ae8-38248ccb2122 tempest-ProjectReaderTests-895612456 None] Volume volume-0bed38db-8dbf-45f9-bd0f-15a394a5ca02 (0bed38db-8dbf-45f9-bd0f-15a394a5ca02): created successfully Sep 22 15:58:44 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-873c2a7d-21c1-48da-8ae8-38248ccb2122 tempest-ProjectReaderTests-895612456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c4aec39-4959-4023-a58c-94da8ffc03f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:58:44 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-873c2a7d-21c1-48da-8ae8-38248ccb2122 tempest-ProjectReaderTests-895612456 None] Flow 'volume_create_manager' (4889848b-3335-4bae-b00d-e06a565f1dd0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:58:44 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-873c2a7d-21c1-48da-8ae8-38248ccb2122 tempest-ProjectReaderTests-895612456 None] Created volume successfully. Sep 22 15:58:44 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-c75dc283-a503-498d-9858-dff508999d59 tempest-ProjectReaderTests-895612456 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:58:44 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-c75dc283-a503-498d-9858-dff508999d59 tempest-ProjectReaderTests-895612456 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:58:44 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-c75dc283-a503-498d-9858-dff508999d59 tempest-ProjectReaderTests-895612456 None] Creating offline snapshot 6da71c00-b296-469b-b14d-6aebef84db46 of volume 0bed38db-8dbf-45f9-bd0f-15a394a5ca02 {{(pid=86212) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 22 15:58:44 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[85677ac7-a866-4547-a741-02eb434c333b]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:58:44 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-c75dc283-a503-498d-9858-dff508999d59 tempest-ProjectReaderTests-895612456 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-0bed38db-8dbf-45f9-bd0f-15a394a5ca02 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:58:44 devstack sudo[106050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-0bed38db-8dbf-45f9-bd0f-15a394a5ca02 Sep 22 15:58:44 devstack sudo[106050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:58:45 devstack sudo[106050]: pam_unix(sudo:session): session closed for user root Sep 22 15:58:45 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-c75dc283-a503-498d-9858-dff508999d59 tempest-ProjectReaderTests-895612456 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-0bed38db-8dbf-45f9-bd0f-15a394a5ca02" returned: 0 in 0.368s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:58:45 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-c75dc283-a503-498d-9858-dff508999d59 tempest-ProjectReaderTests-895612456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-0bed38db-8dbf-45f9-bd0f-15a394a5ca02,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-0bed38db-8dbf-45f9-bd0f-15a394a5ca02.6da71c00-b296-469b-b14d-6aebef84db46 1G {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:58:45 devstack sudo[106055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-0bed38db-8dbf-45f9-bd0f-15a394a5ca02,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-0bed38db-8dbf-45f9-bd0f-15a394a5ca02.6da71c00-b296-469b-b14d-6aebef84db46 1G Sep 22 15:58:45 devstack sudo[106055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:58:45 devstack sudo[106055]: pam_unix(sudo:session): session closed for user root Sep 22 15:58:45 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-c75dc283-a503-498d-9858-dff508999d59 tempest-ProjectReaderTests-895612456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-0bed38db-8dbf-45f9-bd0f-15a394a5ca02,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-0bed38db-8dbf-45f9-bd0f-15a394a5ca02.6da71c00-b296-469b-b14d-6aebef84db46 1G" returned: 0 in 0.365s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:58:45 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-c75dc283-a503-498d-9858-dff508999d59 tempest-ProjectReaderTests-895612456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0bed38db-8dbf-45f9-bd0f-15a394a5ca02 -F qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-0bed38db-8dbf-45f9-bd0f-15a394a5ca02.6da71c00-b296-469b-b14d-6aebef84db46 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:58:45 devstack sudo[106060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0bed38db-8dbf-45f9-bd0f-15a394a5ca02 -F qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-0bed38db-8dbf-45f9-bd0f-15a394a5ca02.6da71c00-b296-469b-b14d-6aebef84db46 Sep 22 15:58:45 devstack sudo[106060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:58:45 devstack sudo[106060]: pam_unix(sudo:session): session closed for user root Sep 22 15:58:45 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-c75dc283-a503-498d-9858-dff508999d59 tempest-ProjectReaderTests-895612456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0bed38db-8dbf-45f9-bd0f-15a394a5ca02 -F qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-0bed38db-8dbf-45f9-bd0f-15a394a5ca02.6da71c00-b296-469b-b14d-6aebef84db46" returned: 0 in 0.306s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:58:45 devstack cinder-volume[86212]: WARNING cinder.volume.drivers.remotefs [None req-c75dc283-a503-498d-9858-dff508999d59 tempest-ProjectReaderTests-895612456 None] /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-0bed38db-8dbf-45f9-bd0f-15a394a5ca02.6da71c00-b296-469b-b14d-6aebef84db46 is being set with open permissions: ugo+rw Sep 22 15:58:45 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-c75dc283-a503-498d-9858-dff508999d59 tempest-ProjectReaderTests-895612456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-0bed38db-8dbf-45f9-bd0f-15a394a5ca02.6da71c00-b296-469b-b14d-6aebef84db46 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:58:45 devstack sudo[106065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-0bed38db-8dbf-45f9-bd0f-15a394a5ca02.6da71c00-b296-469b-b14d-6aebef84db46 Sep 22 15:58:45 devstack sudo[106065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:58:46 devstack sudo[106065]: pam_unix(sudo:session): session closed for user root Sep 22 15:58:46 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-c75dc283-a503-498d-9858-dff508999d59 tempest-ProjectReaderTests-895612456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-0bed38db-8dbf-45f9-bd0f-15a394a5ca02.6da71c00-b296-469b-b14d-6aebef84db46" returned: 0 in 0.234s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:58:46 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-c75dc283-a503-498d-9858-dff508999d59 tempest-ProjectReaderTests-895612456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-0bed38db-8dbf-45f9-bd0f-15a394a5ca02.info {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:58:46 devstack sudo[106068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-0bed38db-8dbf-45f9-bd0f-15a394a5ca02.info Sep 22 15:58:46 devstack sudo[106068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:58:46 devstack sudo[106068]: pam_unix(sudo:session): session closed for user root Sep 22 15:58:46 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-c75dc283-a503-498d-9858-dff508999d59 tempest-ProjectReaderTests-895612456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-0bed38db-8dbf-45f9-bd0f-15a394a5ca02.info" returned: 0 in 0.245s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:58:46 devstack cinder-volume[86212]: WARNING cinder.volume.drivers.remotefs [None req-c75dc283-a503-498d-9858-dff508999d59 tempest-ProjectReaderTests-895612456 None] /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-0bed38db-8dbf-45f9-bd0f-15a394a5ca02.info is being set with open permissions: ugo+rw Sep 22 15:58:46 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-c75dc283-a503-498d-9858-dff508999d59 tempest-ProjectReaderTests-895612456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-0bed38db-8dbf-45f9-bd0f-15a394a5ca02.info {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:58:46 devstack sudo[106071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-0bed38db-8dbf-45f9-bd0f-15a394a5ca02.info Sep 22 15:58:46 devstack sudo[106071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:58:46 devstack sudo[106071]: pam_unix(sudo:session): session closed for user root Sep 22 15:58:46 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-c75dc283-a503-498d-9858-dff508999d59 tempest-ProjectReaderTests-895612456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-0bed38db-8dbf-45f9-bd0f-15a394a5ca02.info" returned: 0 in 0.236s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:58:46 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-c75dc283-a503-498d-9858-dff508999d59 tempest-ProjectReaderTests-895612456 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.832s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:58:46 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-c75dc283-a503-498d-9858-dff508999d59 tempest-ProjectReaderTests-895612456 None] Create snapshot completed successfully Sep 22 15:58:46 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-110d4139-5acb-4d9a-9379-c05355047b4f tempest-ProjectReaderTests-895612456 None] Acquiring lock "cinder-6da71c00-b296-469b-b14d-6aebef84db46-delete_snapshot" by "delete_snapshot" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:58:46 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-110d4139-5acb-4d9a-9379-c05355047b4f tempest-ProjectReaderTests-895612456 None] Lock "cinder-6da71c00-b296-469b-b14d-6aebef84db46-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:58:46 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-110d4139-5acb-4d9a-9379-c05355047b4f tempest-ProjectReaderTests-895612456 None] Acquiring lock "cinder-quobyte-0bed38db-8dbf-45f9-bd0f-15a394a5ca02" by "delete_snapshot" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:58:46 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-110d4139-5acb-4d9a-9379-c05355047b4f tempest-ProjectReaderTests-895612456 None] Lock "cinder-quobyte-0bed38db-8dbf-45f9-bd0f-15a394a5ca02" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:58:46 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-110d4139-5acb-4d9a-9379-c05355047b4f tempest-ProjectReaderTests-895612456 None] Acquiring lock "cinder-quobyte-6da71c00-b296-469b-b14d-6aebef84db46" by "_delete_snapshot" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:58:46 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-110d4139-5acb-4d9a-9379-c05355047b4f tempest-ProjectReaderTests-895612456 None] Lock "cinder-quobyte-6da71c00-b296-469b-b14d-6aebef84db46" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:58:46 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-110d4139-5acb-4d9a-9379-c05355047b4f tempest-ProjectReaderTests-895612456 None] Deleting offline snapshot 6da71c00-b296-469b-b14d-6aebef84db46 of volume 0bed38db-8dbf-45f9-bd0f-15a394a5ca02 {{(pid=86212) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 22 15:58:46 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-110d4139-5acb-4d9a-9379-c05355047b4f tempest-ProjectReaderTests-895612456 None] snapshot_file for this snap is: volume-0bed38db-8dbf-45f9-bd0f-15a394a5ca02.6da71c00-b296-469b-b14d-6aebef84db46 {{(pid=86212) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 22 15:58:46 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[22479d82-501b-44c7-8010-cf520f714e47]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:58:46 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-110d4139-5acb-4d9a-9379-c05355047b4f tempest-ProjectReaderTests-895612456 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-0bed38db-8dbf-45f9-bd0f-15a394a5ca02.6da71c00-b296-469b-b14d-6aebef84db46 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:58:47 devstack sudo[106074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-0bed38db-8dbf-45f9-bd0f-15a394a5ca02.6da71c00-b296-469b-b14d-6aebef84db46 Sep 22 15:58:47 devstack sudo[106074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:58:47 devstack sudo[106074]: pam_unix(sudo:session): session closed for user root Sep 22 15:58:47 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-110d4139-5acb-4d9a-9379-c05355047b4f tempest-ProjectReaderTests-895612456 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-0bed38db-8dbf-45f9-bd0f-15a394a5ca02.6da71c00-b296-469b-b14d-6aebef84db46" returned: 0 in 0.348s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:58:47 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-110d4139-5acb-4d9a-9379-c05355047b4f tempest-ProjectReaderTests-895612456 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0bed38db-8dbf-45f9-bd0f-15a394a5ca02(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86212) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 22 15:58:47 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[09a89e98-caa5-48b8-bfb2-e4bcba2678b2]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:58:47 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-110d4139-5acb-4d9a-9379-c05355047b4f tempest-ProjectReaderTests-895612456 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-0bed38db-8dbf-45f9-bd0f-15a394a5ca02 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:58:47 devstack sudo[106079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-0bed38db-8dbf-45f9-bd0f-15a394a5ca02 Sep 22 15:58:47 devstack sudo[106079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:58:47 devstack sudo[106079]: pam_unix(sudo:session): session closed for user root Sep 22 15:58:47 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-110d4139-5acb-4d9a-9379-c05355047b4f tempest-ProjectReaderTests-895612456 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-0bed38db-8dbf-45f9-bd0f-15a394a5ca02" returned: 0 in 0.341s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:58:47 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-110d4139-5acb-4d9a-9379-c05355047b4f tempest-ProjectReaderTests-895612456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-0bed38db-8dbf-45f9-bd0f-15a394a5ca02.6da71c00-b296-469b-b14d-6aebef84db46 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:58:47 devstack sudo[106084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-0bed38db-8dbf-45f9-bd0f-15a394a5ca02.6da71c00-b296-469b-b14d-6aebef84db46 Sep 22 15:58:47 devstack sudo[106084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:58:48 devstack sudo[106084]: pam_unix(sudo:session): session closed for user root Sep 22 15:58:48 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-110d4139-5acb-4d9a-9379-c05355047b4f tempest-ProjectReaderTests-895612456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-0bed38db-8dbf-45f9-bd0f-15a394a5ca02.6da71c00-b296-469b-b14d-6aebef84db46" returned: 0 in 0.322s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:58:48 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-110d4139-5acb-4d9a-9379-c05355047b4f tempest-ProjectReaderTests-895612456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-0bed38db-8dbf-45f9-bd0f-15a394a5ca02.6da71c00-b296-469b-b14d-6aebef84db46 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:58:48 devstack sudo[106090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-0bed38db-8dbf-45f9-bd0f-15a394a5ca02.6da71c00-b296-469b-b14d-6aebef84db46 Sep 22 15:58:48 devstack sudo[106090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:58:48 devstack sudo[106090]: pam_unix(sudo:session): session closed for user root Sep 22 15:58:48 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-110d4139-5acb-4d9a-9379-c05355047b4f tempest-ProjectReaderTests-895612456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-0bed38db-8dbf-45f9-bd0f-15a394a5ca02.6da71c00-b296-469b-b14d-6aebef84db46" returned: 0 in 0.241s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:58:48 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-110d4139-5acb-4d9a-9379-c05355047b4f tempest-ProjectReaderTests-895612456 None] Lock "cinder-quobyte-6da71c00-b296-469b-b14d-6aebef84db46" released by "_delete_snapshot" :: held 1.344s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:58:48 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-110d4139-5acb-4d9a-9379-c05355047b4f tempest-ProjectReaderTests-895612456 None] Lock "cinder-quobyte-0bed38db-8dbf-45f9-bd0f-15a394a5ca02" released by "delete_snapshot" :: held 1.367s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:58:48 devstack cinder-volume[86212]: DEBUG cinder.quota [None req-110d4139-5acb-4d9a-9379-c05355047b4f tempest-ProjectReaderTests-895612456 None] Created reservations ['7e47f271-2f4b-4c58-858d-691f79217fd6', 'b6e7f819-7e72-4484-9ffa-5f29d9afb386', 'a0bdd735-eb50-4835-9b7c-6de4131af213', '5b59433c-fa4d-4fbc-bb9e-85f5c02e6d77'] {{(pid=86212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 15:58:48 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-110d4139-5acb-4d9a-9379-c05355047b4f tempest-ProjectReaderTests-895612456 None] Delete snapshot completed successfully. Sep 22 15:58:48 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-110d4139-5acb-4d9a-9379-c05355047b4f tempest-ProjectReaderTests-895612456 None] Lock "cinder-6da71c00-b296-469b-b14d-6aebef84db46-delete_snapshot" released by "delete_snapshot" :: held 1.501s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:58:49 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-4b76fd6c-0cc7-4a03-9a8a-e6a3df685cff tempest-ProjectReaderTests-895612456 None] Acquiring lock "cinder-0bed38db-8dbf-45f9-bd0f-15a394a5ca02-delete_volume" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:58:49 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-4b76fd6c-0cc7-4a03-9a8a-e6a3df685cff tempest-ProjectReaderTests-895612456 None] Lock "cinder-0bed38db-8dbf-45f9-bd0f-15a394a5ca02-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:58:49 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-4b76fd6c-0cc7-4a03-9a8a-e6a3df685cff tempest-ProjectReaderTests-895612456 None] Acquiring lock "cinder-quobyte-0bed38db-8dbf-45f9-bd0f-15a394a5ca02" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:58:49 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-4b76fd6c-0cc7-4a03-9a8a-e6a3df685cff tempest-ProjectReaderTests-895612456 None] Lock "cinder-quobyte-0bed38db-8dbf-45f9-bd0f-15a394a5ca02" acquired by "delete_volume" :: waited 0.018s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:58:49 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[44a5a97e-6ce4-4fb1-ad70-024a84b51de7]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:58:49 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-4b76fd6c-0cc7-4a03-9a8a-e6a3df685cff tempest-ProjectReaderTests-895612456 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-0bed38db-8dbf-45f9-bd0f-15a394a5ca02 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:58:49 devstack sudo[106093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-0bed38db-8dbf-45f9-bd0f-15a394a5ca02 Sep 22 15:58:49 devstack sudo[106093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:58:49 devstack sudo[106093]: pam_unix(sudo:session): session closed for user root Sep 22 15:58:49 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-4b76fd6c-0cc7-4a03-9a8a-e6a3df685cff tempest-ProjectReaderTests-895612456 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-0bed38db-8dbf-45f9-bd0f-15a394a5ca02" returned: 0 in 0.339s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:58:49 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-4b76fd6c-0cc7-4a03-9a8a-e6a3df685cff tempest-ProjectReaderTests-895612456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-0bed38db-8dbf-45f9-bd0f-15a394a5ca02 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:58:49 devstack sudo[106098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-0bed38db-8dbf-45f9-bd0f-15a394a5ca02 Sep 22 15:58:49 devstack sudo[106098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:58:49 devstack sudo[106098]: pam_unix(sudo:session): session closed for user root Sep 22 15:58:49 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-4b76fd6c-0cc7-4a03-9a8a-e6a3df685cff tempest-ProjectReaderTests-895612456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-0bed38db-8dbf-45f9-bd0f-15a394a5ca02" returned: 0 in 0.234s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:58:49 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-4b76fd6c-0cc7-4a03-9a8a-e6a3df685cff tempest-ProjectReaderTests-895612456 None] Lock "cinder-quobyte-0bed38db-8dbf-45f9-bd0f-15a394a5ca02" released by "delete_volume" :: held 0.627s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:58:49 devstack cinder-volume[86212]: DEBUG cinder.quota [None req-4b76fd6c-0cc7-4a03-9a8a-e6a3df685cff tempest-ProjectReaderTests-895612456 None] Created reservations ['28ec5fd6-dfa6-4592-8b16-ad3a7e788be7', 'bedb1d76-910a-4379-aa2a-499275fc538c', '00829797-9d09-4f13-910b-2aff0c3d800d', '8c54742b-2225-48f4-aa8b-f0f5d250308c'] {{(pid=86212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 15:58:49 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-4b76fd6c-0cc7-4a03-9a8a-e6a3df685cff tempest-ProjectReaderTests-895612456 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:58:49 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-4b76fd6c-0cc7-4a03-9a8a-e6a3df685cff tempest-ProjectReaderTests-895612456 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:58:49 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-4b76fd6c-0cc7-4a03-9a8a-e6a3df685cff tempest-ProjectReaderTests-895612456 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:58:49 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-4b76fd6c-0cc7-4a03-9a8a-e6a3df685cff tempest-ProjectReaderTests-895612456 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:58:49 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-4b76fd6c-0cc7-4a03-9a8a-e6a3df685cff tempest-ProjectReaderTests-895612456 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:58:49 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-4b76fd6c-0cc7-4a03-9a8a-e6a3df685cff tempest-ProjectReaderTests-895612456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:58:49 devstack sudo[106101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc Sep 22 15:58:49 devstack sudo[106101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:58:50 devstack sudo[106101]: pam_unix(sudo:session): session closed for user root Sep 22 15:58:50 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-4b76fd6c-0cc7-4a03-9a8a-e6a3df685cff tempest-ProjectReaderTests-895612456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc" returned: 0 in 0.234s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:58:50 devstack cinder-volume[86212]: DEBUG cinder.manager [None req-4b76fd6c-0cc7-4a03-9a8a-e6a3df685cff tempest-ProjectReaderTests-895612456 None] Notifying Schedulers of capabilities ... {{(pid=86212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 15:58:50 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-4b76fd6c-0cc7-4a03-9a8a-e6a3df685cff tempest-ProjectReaderTests-895612456 None] Deleted volume successfully. Sep 22 15:58:50 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-4b76fd6c-0cc7-4a03-9a8a-e6a3df685cff tempest-ProjectReaderTests-895612456 None] Lock "cinder-0bed38db-8dbf-45f9-bd0f-15a394a5ca02-delete_volume" released by "delete_volume" :: held 1.047s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:58:50 devstack cinder-volume[86212]: DEBUG cinder.volume.flows.manager.create_volume [None req-b790fd7e-2ad5-4487-b216-9f4c3bf2bbeb tempest-ProjectReaderTests-895612456 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 15:58:50 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-b790fd7e-2ad5-4487-b216-9f4c3bf2bbeb tempest-ProjectReaderTests-895612456 None] Flow 'volume_create_manager' (4259e44d-a247-434e-9075-d6a34f5ddb2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:58:50 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-b790fd7e-2ad5-4487-b216-9f4c3bf2bbeb tempest-ProjectReaderTests-895612456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ecb11d2-a90c-4c4b-bd18-4da1ff271b24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:58:50 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-b790fd7e-2ad5-4487-b216-9f4c3bf2bbeb tempest-ProjectReaderTests-895612456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ecb11d2-a90c-4c4b-bd18-4da1ff271b24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:58:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-959426052',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fde2da8-4ede-4c06-b69b-7b6174609b8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da280e2e52fe4085be9215a2825e0715',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:58:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:58:51Z,use_quota=True,user_id='b5717331c2e5451da006c3e41b079876',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:58:50 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-b790fd7e-2ad5-4487-b216-9f4c3bf2bbeb tempest-ProjectReaderTests-895612456 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a6aa274-3ce6-4cf4-81cd-09eff4d63955) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:58:50 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-b790fd7e-2ad5-4487-b216-9f4c3bf2bbeb tempest-ProjectReaderTests-895612456 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a6aa274-3ce6-4cf4-81cd-09eff4d63955) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:58:50 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-b790fd7e-2ad5-4487-b216-9f4c3bf2bbeb tempest-ProjectReaderTests-895612456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6cc0294-69cd-4df0-84cd-af889125dbe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:58:50 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-b790fd7e-2ad5-4487-b216-9f4c3bf2bbeb tempest-ProjectReaderTests-895612456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6cc0294-69cd-4df0-84cd-af889125dbe3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8fde2da8-4ede-4c06-b69b-7b6174609b8f', 'volume_name': 'volume-8fde2da8-4ede-4c06-b69b-7b6174609b8f', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:58:50 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-b790fd7e-2ad5-4487-b216-9f4c3bf2bbeb tempest-ProjectReaderTests-895612456 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e70dc555-85c8-45fa-b52f-ccbb83ba2504) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:58:50 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-b790fd7e-2ad5-4487-b216-9f4c3bf2bbeb tempest-ProjectReaderTests-895612456 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e70dc555-85c8-45fa-b52f-ccbb83ba2504) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:58:50 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-b790fd7e-2ad5-4487-b216-9f4c3bf2bbeb tempest-ProjectReaderTests-895612456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0935395c-dd50-43aa-88e1-c760ee8a0fbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:58:50 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-b790fd7e-2ad5-4487-b216-9f4c3bf2bbeb tempest-ProjectReaderTests-895612456 None] Volume 8fde2da8-4ede-4c06-b69b-7b6174609b8f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8fde2da8-4ede-4c06-b69b-7b6174609b8f', 'volume_size': 1} Sep 22 15:58:50 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-b790fd7e-2ad5-4487-b216-9f4c3bf2bbeb tempest-ProjectReaderTests-895612456 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:58:50 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-b790fd7e-2ad5-4487-b216-9f4c3bf2bbeb tempest-ProjectReaderTests-895612456 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:58:50 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-b790fd7e-2ad5-4487-b216-9f4c3bf2bbeb tempest-ProjectReaderTests-895612456 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:58:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-959426052',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fde2da8-4ede-4c06-b69b-7b6174609b8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da280e2e52fe4085be9215a2825e0715',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:58:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:58:51Z,use_quota=True,user_id='b5717331c2e5451da006c3e41b079876',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)}" {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 15:58:50 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-b790fd7e-2ad5-4487-b216-9f4c3bf2bbeb tempest-ProjectReaderTests-895612456 None] Creating volume 8fde2da8-4ede-4c06-b69b-7b6174609b8f {{(pid=86212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 15:58:50 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-b790fd7e-2ad5-4487-b216-9f4c3bf2bbeb tempest-ProjectReaderTests-895612456 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:58:50 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-b790fd7e-2ad5-4487-b216-9f4c3bf2bbeb tempest-ProjectReaderTests-895612456 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:58:50 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-b790fd7e-2ad5-4487-b216-9f4c3bf2bbeb tempest-ProjectReaderTests-895612456 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:58:50 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-b790fd7e-2ad5-4487-b216-9f4c3bf2bbeb tempest-ProjectReaderTests-895612456 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:58:50 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-b790fd7e-2ad5-4487-b216-9f4c3bf2bbeb tempest-ProjectReaderTests-895612456 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:58:50 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-b790fd7e-2ad5-4487-b216-9f4c3bf2bbeb tempest-ProjectReaderTests-895612456 None] Selected osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 as target Quobyte volume. {{(pid=86212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 15:58:50 devstack cinder-volume[86212]: INFO cinder.volume.drivers.remotefs [None req-b790fd7e-2ad5-4487-b216-9f4c3bf2bbeb tempest-ProjectReaderTests-895612456 None] casted to osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 Sep 22 15:58:50 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-b790fd7e-2ad5-4487-b216-9f4c3bf2bbeb tempest-ProjectReaderTests-895612456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8fde2da8-4ede-4c06-b69b-7b6174609b8f 1073741824 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:58:50 devstack sudo[106104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8fde2da8-4ede-4c06-b69b-7b6174609b8f 1073741824 Sep 22 15:58:50 devstack sudo[106104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:58:51 devstack sudo[106104]: pam_unix(sudo:session): session closed for user root Sep 22 15:58:51 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-b790fd7e-2ad5-4487-b216-9f4c3bf2bbeb tempest-ProjectReaderTests-895612456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8fde2da8-4ede-4c06-b69b-7b6174609b8f 1073741824" returned: 0 in 0.438s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:58:51 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-b790fd7e-2ad5-4487-b216-9f4c3bf2bbeb tempest-ProjectReaderTests-895612456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8fde2da8-4ede-4c06-b69b-7b6174609b8f {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:58:51 devstack sudo[106111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8fde2da8-4ede-4c06-b69b-7b6174609b8f Sep 22 15:58:51 devstack sudo[106111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:58:51 devstack sudo[106111]: pam_unix(sudo:session): session closed for user root Sep 22 15:58:51 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-b790fd7e-2ad5-4487-b216-9f4c3bf2bbeb tempest-ProjectReaderTests-895612456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8fde2da8-4ede-4c06-b69b-7b6174609b8f" returned: 0 in 0.235s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:58:51 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-b790fd7e-2ad5-4487-b216-9f4c3bf2bbeb tempest-ProjectReaderTests-895612456 None] <== create_volume: return (712ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'} {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 15:58:51 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-b790fd7e-2ad5-4487-b216-9f4c3bf2bbeb tempest-ProjectReaderTests-895612456 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.717s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:58:51 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-b790fd7e-2ad5-4487-b216-9f4c3bf2bbeb tempest-ProjectReaderTests-895612456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0935395c-dd50-43aa-88e1-c760ee8a0fbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8fde2da8-4ede-4c06-b69b-7b6174609b8f', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:58:51 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-b790fd7e-2ad5-4487-b216-9f4c3bf2bbeb tempest-ProjectReaderTests-895612456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6725945-fe80-4765-8b7f-6bf855ff2b0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:58:51 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-b790fd7e-2ad5-4487-b216-9f4c3bf2bbeb tempest-ProjectReaderTests-895612456 None] Volume volume-8fde2da8-4ede-4c06-b69b-7b6174609b8f (8fde2da8-4ede-4c06-b69b-7b6174609b8f): created successfully Sep 22 15:58:51 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-b790fd7e-2ad5-4487-b216-9f4c3bf2bbeb tempest-ProjectReaderTests-895612456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6725945-fe80-4765-8b7f-6bf855ff2b0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:58:51 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-b790fd7e-2ad5-4487-b216-9f4c3bf2bbeb tempest-ProjectReaderTests-895612456 None] Flow 'volume_create_manager' (4259e44d-a247-434e-9075-d6a34f5ddb2e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:58:51 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-b790fd7e-2ad5-4487-b216-9f4c3bf2bbeb tempest-ProjectReaderTests-895612456 None] Created volume successfully. Sep 22 15:58:51 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-db600210-8a84-49a5-9fa7-95a2bc343809 tempest-ProjectReaderTests-895612456 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:58:51 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-db600210-8a84-49a5-9fa7-95a2bc343809 tempest-ProjectReaderTests-895612456 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:58:51 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-db600210-8a84-49a5-9fa7-95a2bc343809 tempest-ProjectReaderTests-895612456 None] Creating offline snapshot 9021a3fd-dc30-40dc-91bd-a612a4ada03b of volume 8fde2da8-4ede-4c06-b69b-7b6174609b8f {{(pid=86212) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 22 15:58:51 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[792513bf-9eb1-4a5a-a87b-69dd5d99bc3d]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:58:51 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-db600210-8a84-49a5-9fa7-95a2bc343809 tempest-ProjectReaderTests-895612456 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8fde2da8-4ede-4c06-b69b-7b6174609b8f {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:58:51 devstack sudo[106114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8fde2da8-4ede-4c06-b69b-7b6174609b8f Sep 22 15:58:51 devstack sudo[106114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:58:52 devstack sudo[106114]: pam_unix(sudo:session): session closed for user root Sep 22 15:58:52 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-db600210-8a84-49a5-9fa7-95a2bc343809 tempest-ProjectReaderTests-895612456 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8fde2da8-4ede-4c06-b69b-7b6174609b8f" returned: 0 in 0.362s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:58:52 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-db600210-8a84-49a5-9fa7-95a2bc343809 tempest-ProjectReaderTests-895612456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8fde2da8-4ede-4c06-b69b-7b6174609b8f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8fde2da8-4ede-4c06-b69b-7b6174609b8f.9021a3fd-dc30-40dc-91bd-a612a4ada03b 1G {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:58:52 devstack sudo[106125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8fde2da8-4ede-4c06-b69b-7b6174609b8f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8fde2da8-4ede-4c06-b69b-7b6174609b8f.9021a3fd-dc30-40dc-91bd-a612a4ada03b 1G Sep 22 15:58:52 devstack sudo[106125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:58:52 devstack sudo[106125]: pam_unix(sudo:session): session closed for user root Sep 22 15:58:52 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-db600210-8a84-49a5-9fa7-95a2bc343809 tempest-ProjectReaderTests-895612456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8fde2da8-4ede-4c06-b69b-7b6174609b8f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8fde2da8-4ede-4c06-b69b-7b6174609b8f.9021a3fd-dc30-40dc-91bd-a612a4ada03b 1G" returned: 0 in 0.385s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:58:52 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-db600210-8a84-49a5-9fa7-95a2bc343809 tempest-ProjectReaderTests-895612456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8fde2da8-4ede-4c06-b69b-7b6174609b8f -F qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8fde2da8-4ede-4c06-b69b-7b6174609b8f.9021a3fd-dc30-40dc-91bd-a612a4ada03b {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:58:52 devstack sudo[106130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8fde2da8-4ede-4c06-b69b-7b6174609b8f -F qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8fde2da8-4ede-4c06-b69b-7b6174609b8f.9021a3fd-dc30-40dc-91bd-a612a4ada03b Sep 22 15:58:52 devstack sudo[106130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:58:52 devstack sudo[106130]: pam_unix(sudo:session): session closed for user root Sep 22 15:58:52 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-db600210-8a84-49a5-9fa7-95a2bc343809 tempest-ProjectReaderTests-895612456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8fde2da8-4ede-4c06-b69b-7b6174609b8f -F qcow2 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8fde2da8-4ede-4c06-b69b-7b6174609b8f.9021a3fd-dc30-40dc-91bd-a612a4ada03b" returned: 0 in 0.284s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:58:52 devstack cinder-volume[86212]: WARNING cinder.volume.drivers.remotefs [None req-db600210-8a84-49a5-9fa7-95a2bc343809 tempest-ProjectReaderTests-895612456 None] /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8fde2da8-4ede-4c06-b69b-7b6174609b8f.9021a3fd-dc30-40dc-91bd-a612a4ada03b is being set with open permissions: ugo+rw Sep 22 15:58:52 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-db600210-8a84-49a5-9fa7-95a2bc343809 tempest-ProjectReaderTests-895612456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8fde2da8-4ede-4c06-b69b-7b6174609b8f.9021a3fd-dc30-40dc-91bd-a612a4ada03b {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:58:52 devstack sudo[106135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8fde2da8-4ede-4c06-b69b-7b6174609b8f.9021a3fd-dc30-40dc-91bd-a612a4ada03b Sep 22 15:58:52 devstack sudo[106135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:58:53 devstack sudo[106135]: pam_unix(sudo:session): session closed for user root Sep 22 15:58:53 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-db600210-8a84-49a5-9fa7-95a2bc343809 tempest-ProjectReaderTests-895612456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8fde2da8-4ede-4c06-b69b-7b6174609b8f.9021a3fd-dc30-40dc-91bd-a612a4ada03b" returned: 0 in 0.230s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:58:53 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-db600210-8a84-49a5-9fa7-95a2bc343809 tempest-ProjectReaderTests-895612456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8fde2da8-4ede-4c06-b69b-7b6174609b8f.info {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:58:53 devstack sudo[106138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8fde2da8-4ede-4c06-b69b-7b6174609b8f.info Sep 22 15:58:53 devstack sudo[106138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:58:53 devstack sudo[106138]: pam_unix(sudo:session): session closed for user root Sep 22 15:58:53 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-db600210-8a84-49a5-9fa7-95a2bc343809 tempest-ProjectReaderTests-895612456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8fde2da8-4ede-4c06-b69b-7b6174609b8f.info" returned: 0 in 0.259s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:58:53 devstack cinder-volume[86212]: WARNING cinder.volume.drivers.remotefs [None req-db600210-8a84-49a5-9fa7-95a2bc343809 tempest-ProjectReaderTests-895612456 None] /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8fde2da8-4ede-4c06-b69b-7b6174609b8f.info is being set with open permissions: ugo+rw Sep 22 15:58:53 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-db600210-8a84-49a5-9fa7-95a2bc343809 tempest-ProjectReaderTests-895612456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8fde2da8-4ede-4c06-b69b-7b6174609b8f.info {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:58:53 devstack sudo[106141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8fde2da8-4ede-4c06-b69b-7b6174609b8f.info Sep 22 15:58:53 devstack sudo[106141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:58:53 devstack sudo[106141]: pam_unix(sudo:session): session closed for user root Sep 22 15:58:53 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-db600210-8a84-49a5-9fa7-95a2bc343809 tempest-ProjectReaderTests-895612456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8fde2da8-4ede-4c06-b69b-7b6174609b8f.info" returned: 0 in 0.243s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:58:53 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-db600210-8a84-49a5-9fa7-95a2bc343809 tempest-ProjectReaderTests-895612456 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.845s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:58:53 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-db600210-8a84-49a5-9fa7-95a2bc343809 tempest-ProjectReaderTests-895612456 None] Create snapshot completed successfully Sep 22 15:58:53 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-62604234-67d0-4430-8280-708db8c17b32 tempest-ProjectReaderTests-895612456 None] Acquiring lock "cinder-9021a3fd-dc30-40dc-91bd-a612a4ada03b-delete_snapshot" by "delete_snapshot" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:58:53 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-62604234-67d0-4430-8280-708db8c17b32 tempest-ProjectReaderTests-895612456 None] Lock "cinder-9021a3fd-dc30-40dc-91bd-a612a4ada03b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:58:53 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-62604234-67d0-4430-8280-708db8c17b32 tempest-ProjectReaderTests-895612456 None] Acquiring lock "cinder-quobyte-8fde2da8-4ede-4c06-b69b-7b6174609b8f" by "delete_snapshot" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:58:53 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-62604234-67d0-4430-8280-708db8c17b32 tempest-ProjectReaderTests-895612456 None] Lock "cinder-quobyte-8fde2da8-4ede-4c06-b69b-7b6174609b8f" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:58:53 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-62604234-67d0-4430-8280-708db8c17b32 tempest-ProjectReaderTests-895612456 None] Acquiring lock "cinder-quobyte-9021a3fd-dc30-40dc-91bd-a612a4ada03b" by "_delete_snapshot" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:58:53 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-62604234-67d0-4430-8280-708db8c17b32 tempest-ProjectReaderTests-895612456 None] Lock "cinder-quobyte-9021a3fd-dc30-40dc-91bd-a612a4ada03b" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:58:53 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-62604234-67d0-4430-8280-708db8c17b32 tempest-ProjectReaderTests-895612456 None] Deleting offline snapshot 9021a3fd-dc30-40dc-91bd-a612a4ada03b of volume 8fde2da8-4ede-4c06-b69b-7b6174609b8f {{(pid=86212) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 22 15:58:53 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-62604234-67d0-4430-8280-708db8c17b32 tempest-ProjectReaderTests-895612456 None] snapshot_file for this snap is: volume-8fde2da8-4ede-4c06-b69b-7b6174609b8f.9021a3fd-dc30-40dc-91bd-a612a4ada03b {{(pid=86212) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 22 15:58:54 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ca6ac6d-9a2d-4634-8895-fe10d1774fad]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:58:54 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-62604234-67d0-4430-8280-708db8c17b32 tempest-ProjectReaderTests-895612456 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8fde2da8-4ede-4c06-b69b-7b6174609b8f.9021a3fd-dc30-40dc-91bd-a612a4ada03b {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:58:54 devstack sudo[106144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8fde2da8-4ede-4c06-b69b-7b6174609b8f.9021a3fd-dc30-40dc-91bd-a612a4ada03b Sep 22 15:58:54 devstack sudo[106144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:58:54 devstack sudo[106144]: pam_unix(sudo:session): session closed for user root Sep 22 15:58:54 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-62604234-67d0-4430-8280-708db8c17b32 tempest-ProjectReaderTests-895612456 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8fde2da8-4ede-4c06-b69b-7b6174609b8f.9021a3fd-dc30-40dc-91bd-a612a4ada03b" returned: 0 in 0.342s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:58:54 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-62604234-67d0-4430-8280-708db8c17b32 tempest-ProjectReaderTests-895612456 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8fde2da8-4ede-4c06-b69b-7b6174609b8f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86212) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 22 15:58:54 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d6f41ad-a48b-426d-9de0-178772905197]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:58:54 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-62604234-67d0-4430-8280-708db8c17b32 tempest-ProjectReaderTests-895612456 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8fde2da8-4ede-4c06-b69b-7b6174609b8f {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:58:54 devstack sudo[106149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8fde2da8-4ede-4c06-b69b-7b6174609b8f Sep 22 15:58:54 devstack sudo[106149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:58:54 devstack sudo[106149]: pam_unix(sudo:session): session closed for user root Sep 22 15:58:54 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-62604234-67d0-4430-8280-708db8c17b32 tempest-ProjectReaderTests-895612456 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8fde2da8-4ede-4c06-b69b-7b6174609b8f" returned: 0 in 0.341s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:58:54 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-62604234-67d0-4430-8280-708db8c17b32 tempest-ProjectReaderTests-895612456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8fde2da8-4ede-4c06-b69b-7b6174609b8f.9021a3fd-dc30-40dc-91bd-a612a4ada03b {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:58:54 devstack sudo[106154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8fde2da8-4ede-4c06-b69b-7b6174609b8f.9021a3fd-dc30-40dc-91bd-a612a4ada03b Sep 22 15:58:54 devstack sudo[106154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:58:55 devstack sudo[106154]: pam_unix(sudo:session): session closed for user root Sep 22 15:58:55 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-62604234-67d0-4430-8280-708db8c17b32 tempest-ProjectReaderTests-895612456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8fde2da8-4ede-4c06-b69b-7b6174609b8f.9021a3fd-dc30-40dc-91bd-a612a4ada03b" returned: 0 in 0.324s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:58:55 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-62604234-67d0-4430-8280-708db8c17b32 tempest-ProjectReaderTests-895612456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8fde2da8-4ede-4c06-b69b-7b6174609b8f.9021a3fd-dc30-40dc-91bd-a612a4ada03b {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:58:55 devstack sudo[106159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8fde2da8-4ede-4c06-b69b-7b6174609b8f.9021a3fd-dc30-40dc-91bd-a612a4ada03b Sep 22 15:58:55 devstack sudo[106159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:58:55 devstack sudo[106159]: pam_unix(sudo:session): session closed for user root Sep 22 15:58:55 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-62604234-67d0-4430-8280-708db8c17b32 tempest-ProjectReaderTests-895612456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8fde2da8-4ede-4c06-b69b-7b6174609b8f.9021a3fd-dc30-40dc-91bd-a612a4ada03b" returned: 0 in 0.247s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:58:55 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-62604234-67d0-4430-8280-708db8c17b32 tempest-ProjectReaderTests-895612456 None] Lock "cinder-quobyte-9021a3fd-dc30-40dc-91bd-a612a4ada03b" released by "_delete_snapshot" :: held 1.343s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:58:55 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-62604234-67d0-4430-8280-708db8c17b32 tempest-ProjectReaderTests-895612456 None] Lock "cinder-quobyte-8fde2da8-4ede-4c06-b69b-7b6174609b8f" released by "delete_snapshot" :: held 1.366s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:58:55 devstack cinder-volume[86212]: DEBUG cinder.quota [None req-62604234-67d0-4430-8280-708db8c17b32 tempest-ProjectReaderTests-895612456 None] Created reservations ['ebe1aff0-79ee-4510-9e91-717e12c93a06', '27fd93f4-f6a9-4a9f-9ea2-d2f9f08bfa4d', '590abbe2-9432-4a4c-964e-76800d3f2ccc', '0f120a72-e9f1-4e30-8c32-d057c7c8ed33'] {{(pid=86212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 15:58:55 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-62604234-67d0-4430-8280-708db8c17b32 tempest-ProjectReaderTests-895612456 None] Delete snapshot completed successfully. Sep 22 15:58:55 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-62604234-67d0-4430-8280-708db8c17b32 tempest-ProjectReaderTests-895612456 None] Lock "cinder-9021a3fd-dc30-40dc-91bd-a612a4ada03b-delete_snapshot" released by "delete_snapshot" :: held 1.497s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:58:56 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-fe7c9fb7-b530-41cd-b519-d27372b01150 tempest-ProjectReaderTests-895612456 None] Acquiring lock "cinder-8fde2da8-4ede-4c06-b69b-7b6174609b8f-delete_volume" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:58:56 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-fe7c9fb7-b530-41cd-b519-d27372b01150 tempest-ProjectReaderTests-895612456 None] Lock "cinder-8fde2da8-4ede-4c06-b69b-7b6174609b8f-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:58:56 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-fe7c9fb7-b530-41cd-b519-d27372b01150 tempest-ProjectReaderTests-895612456 None] Acquiring lock "cinder-quobyte-8fde2da8-4ede-4c06-b69b-7b6174609b8f" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:58:56 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-fe7c9fb7-b530-41cd-b519-d27372b01150 tempest-ProjectReaderTests-895612456 None] Lock "cinder-quobyte-8fde2da8-4ede-4c06-b69b-7b6174609b8f" acquired by "delete_volume" :: waited 0.013s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:58:56 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[45138f51-897a-4eb7-88e0-cb1ff185b388]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:58:56 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-fe7c9fb7-b530-41cd-b519-d27372b01150 tempest-ProjectReaderTests-895612456 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8fde2da8-4ede-4c06-b69b-7b6174609b8f {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:58:56 devstack sudo[106162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8fde2da8-4ede-4c06-b69b-7b6174609b8f Sep 22 15:58:56 devstack sudo[106162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:58:56 devstack sudo[106162]: pam_unix(sudo:session): session closed for user root Sep 22 15:58:56 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-fe7c9fb7-b530-41cd-b519-d27372b01150 tempest-ProjectReaderTests-895612456 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8fde2da8-4ede-4c06-b69b-7b6174609b8f" returned: 0 in 0.336s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:58:56 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-fe7c9fb7-b530-41cd-b519-d27372b01150 tempest-ProjectReaderTests-895612456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8fde2da8-4ede-4c06-b69b-7b6174609b8f {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:58:56 devstack sudo[106167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8fde2da8-4ede-4c06-b69b-7b6174609b8f Sep 22 15:58:56 devstack sudo[106167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:58:56 devstack sudo[106167]: pam_unix(sudo:session): session closed for user root Sep 22 15:58:56 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-fe7c9fb7-b530-41cd-b519-d27372b01150 tempest-ProjectReaderTests-895612456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-8fde2da8-4ede-4c06-b69b-7b6174609b8f" returned: 0 in 0.234s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:58:56 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-fe7c9fb7-b530-41cd-b519-d27372b01150 tempest-ProjectReaderTests-895612456 None] Lock "cinder-quobyte-8fde2da8-4ede-4c06-b69b-7b6174609b8f" released by "delete_volume" :: held 0.630s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:58:56 devstack cinder-volume[86212]: DEBUG cinder.quota [None req-fe7c9fb7-b530-41cd-b519-d27372b01150 tempest-ProjectReaderTests-895612456 None] Created reservations ['eaa83cf1-75a6-4da3-8af7-41285c993abd', '20cf8745-d236-419c-a66a-cbbc5b6a6723', 'cb8c4693-9c9a-4fe4-bd00-814d59f6a497', '1eb7d9a3-e6af-45f5-84a9-83dac1db1a7d'] {{(pid=86212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 15:58:56 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-fe7c9fb7-b530-41cd-b519-d27372b01150 tempest-ProjectReaderTests-895612456 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:58:56 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-fe7c9fb7-b530-41cd-b519-d27372b01150 tempest-ProjectReaderTests-895612456 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:58:56 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-fe7c9fb7-b530-41cd-b519-d27372b01150 tempest-ProjectReaderTests-895612456 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:58:56 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-fe7c9fb7-b530-41cd-b519-d27372b01150 tempest-ProjectReaderTests-895612456 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:58:56 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-fe7c9fb7-b530-41cd-b519-d27372b01150 tempest-ProjectReaderTests-895612456 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:58:56 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-fe7c9fb7-b530-41cd-b519-d27372b01150 tempest-ProjectReaderTests-895612456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:58:56 devstack sudo[106170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc Sep 22 15:58:56 devstack sudo[106170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:58:57 devstack sudo[106170]: pam_unix(sudo:session): session closed for user root Sep 22 15:58:57 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-fe7c9fb7-b530-41cd-b519-d27372b01150 tempest-ProjectReaderTests-895612456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc" returned: 0 in 0.233s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:58:57 devstack cinder-volume[86212]: DEBUG cinder.manager [None req-fe7c9fb7-b530-41cd-b519-d27372b01150 tempest-ProjectReaderTests-895612456 None] Notifying Schedulers of capabilities ... {{(pid=86212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 15:58:57 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-fe7c9fb7-b530-41cd-b519-d27372b01150 tempest-ProjectReaderTests-895612456 None] Deleted volume successfully. Sep 22 15:58:57 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-fe7c9fb7-b530-41cd-b519-d27372b01150 tempest-ProjectReaderTests-895612456 None] Lock "cinder-8fde2da8-4ede-4c06-b69b-7b6174609b8f-delete_volume" released by "delete_volume" :: held 1.038s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:59:00 devstack cinder-volume[86212]: DEBUG dbcounter [-] [86212] Writing DB stats cinder:SELECT=117,cinder:INSERT=38,cinder:UPDATE=134,cinder:DELETE=9 {{(pid=86212) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 22 15:59:00 devstack cinder-volume[86212]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ca325fb-258b-4fbc-a080-66ab0bb1b146 tempest-ProjectReaderTests-653964704 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 15:59:00 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-5ca325fb-258b-4fbc-a080-66ab0bb1b146 tempest-ProjectReaderTests-653964704 None] Flow 'volume_create_manager' (0fe08fa0-b069-4f40-b603-f42423a43990) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:59:00 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-5ca325fb-258b-4fbc-a080-66ab0bb1b146 tempest-ProjectReaderTests-653964704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2c7c92e-71a5-42b5-8b1e-1d17cb5e9abc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:59:00 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-5ca325fb-258b-4fbc-a080-66ab0bb1b146 tempest-ProjectReaderTests-653964704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2c7c92e-71a5-42b5-8b1e-1d17cb5e9abc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:59:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-595302269',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14c38ef5-f2e8-45b3-a8cf-5a2d487d719d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e18a0616fb44f5e8d03fefefded839c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:59:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:59:01Z,use_quota=True,user_id='9617c40f49a0460a9eb326477a08b24f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:59:00 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-5ca325fb-258b-4fbc-a080-66ab0bb1b146 tempest-ProjectReaderTests-653964704 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e3e5618-9895-41bd-9820-0addcc76b4b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:59:00 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-5ca325fb-258b-4fbc-a080-66ab0bb1b146 tempest-ProjectReaderTests-653964704 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e3e5618-9895-41bd-9820-0addcc76b4b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:59:00 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-5ca325fb-258b-4fbc-a080-66ab0bb1b146 tempest-ProjectReaderTests-653964704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5581e99-448c-4da9-87ad-baad6d466a33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:59:00 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-5ca325fb-258b-4fbc-a080-66ab0bb1b146 tempest-ProjectReaderTests-653964704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5581e99-448c-4da9-87ad-baad6d466a33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '14c38ef5-f2e8-45b3-a8cf-5a2d487d719d', 'volume_name': 'volume-14c38ef5-f2e8-45b3-a8cf-5a2d487d719d', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:59:00 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-5ca325fb-258b-4fbc-a080-66ab0bb1b146 tempest-ProjectReaderTests-653964704 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8297074-32b2-45f4-885a-b8ed5cddbab5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:59:00 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-5ca325fb-258b-4fbc-a080-66ab0bb1b146 tempest-ProjectReaderTests-653964704 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8297074-32b2-45f4-885a-b8ed5cddbab5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:59:00 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-5ca325fb-258b-4fbc-a080-66ab0bb1b146 tempest-ProjectReaderTests-653964704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e96e354f-de92-49cd-a2fd-3d6fc8329026) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:59:00 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-5ca325fb-258b-4fbc-a080-66ab0bb1b146 tempest-ProjectReaderTests-653964704 None] Volume 14c38ef5-f2e8-45b3-a8cf-5a2d487d719d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-14c38ef5-f2e8-45b3-a8cf-5a2d487d719d', 'volume_size': 1} Sep 22 15:59:00 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-5ca325fb-258b-4fbc-a080-66ab0bb1b146 tempest-ProjectReaderTests-653964704 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:59:00 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-5ca325fb-258b-4fbc-a080-66ab0bb1b146 tempest-ProjectReaderTests-653964704 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:59:00 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-5ca325fb-258b-4fbc-a080-66ab0bb1b146 tempest-ProjectReaderTests-653964704 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:59:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-595302269',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14c38ef5-f2e8-45b3-a8cf-5a2d487d719d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e18a0616fb44f5e8d03fefefded839c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:59:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:59:01Z,use_quota=True,user_id='9617c40f49a0460a9eb326477a08b24f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)}" {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 15:59:00 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-5ca325fb-258b-4fbc-a080-66ab0bb1b146 tempest-ProjectReaderTests-653964704 None] Creating volume 14c38ef5-f2e8-45b3-a8cf-5a2d487d719d {{(pid=86212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 15:59:00 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-5ca325fb-258b-4fbc-a080-66ab0bb1b146 tempest-ProjectReaderTests-653964704 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:59:00 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-5ca325fb-258b-4fbc-a080-66ab0bb1b146 tempest-ProjectReaderTests-653964704 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:59:00 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-5ca325fb-258b-4fbc-a080-66ab0bb1b146 tempest-ProjectReaderTests-653964704 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:59:00 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-5ca325fb-258b-4fbc-a080-66ab0bb1b146 tempest-ProjectReaderTests-653964704 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:59:00 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-5ca325fb-258b-4fbc-a080-66ab0bb1b146 tempest-ProjectReaderTests-653964704 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:59:00 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-5ca325fb-258b-4fbc-a080-66ab0bb1b146 tempest-ProjectReaderTests-653964704 None] Selected osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 as target Quobyte volume. {{(pid=86212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 15:59:00 devstack cinder-volume[86212]: INFO cinder.volume.drivers.remotefs [None req-5ca325fb-258b-4fbc-a080-66ab0bb1b146 tempest-ProjectReaderTests-653964704 None] casted to osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 Sep 22 15:59:00 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-5ca325fb-258b-4fbc-a080-66ab0bb1b146 tempest-ProjectReaderTests-653964704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-14c38ef5-f2e8-45b3-a8cf-5a2d487d719d 1073741824 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:59:00 devstack sudo[106175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-14c38ef5-f2e8-45b3-a8cf-5a2d487d719d 1073741824 Sep 22 15:59:00 devstack sudo[106175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:59:01 devstack sudo[106175]: pam_unix(sudo:session): session closed for user root Sep 22 15:59:01 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-5ca325fb-258b-4fbc-a080-66ab0bb1b146 tempest-ProjectReaderTests-653964704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-14c38ef5-f2e8-45b3-a8cf-5a2d487d719d 1073741824" returned: 0 in 0.392s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:59:01 devstack cinder-volume[86212]: DEBUG dbcounter [-] [86212] Writing DB stats cinder:SELECT=104,cinder:DELETE=14,cinder:INSERT=41,cinder:UPDATE=147 {{(pid=86212) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 22 15:59:01 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-5ca325fb-258b-4fbc-a080-66ab0bb1b146 tempest-ProjectReaderTests-653964704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-14c38ef5-f2e8-45b3-a8cf-5a2d487d719d {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:59:01 devstack sudo[106180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-14c38ef5-f2e8-45b3-a8cf-5a2d487d719d Sep 22 15:59:01 devstack sudo[106180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:59:01 devstack sudo[106180]: pam_unix(sudo:session): session closed for user root Sep 22 15:59:01 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-5ca325fb-258b-4fbc-a080-66ab0bb1b146 tempest-ProjectReaderTests-653964704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-14c38ef5-f2e8-45b3-a8cf-5a2d487d719d" returned: 0 in 0.235s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:59:01 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-5ca325fb-258b-4fbc-a080-66ab0bb1b146 tempest-ProjectReaderTests-653964704 None] <== create_volume: return (669ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'} {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 15:59:01 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-5ca325fb-258b-4fbc-a080-66ab0bb1b146 tempest-ProjectReaderTests-653964704 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.672s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:59:01 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-5ca325fb-258b-4fbc-a080-66ab0bb1b146 tempest-ProjectReaderTests-653964704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e96e354f-de92-49cd-a2fd-3d6fc8329026) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-14c38ef5-f2e8-45b3-a8cf-5a2d487d719d', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:59:01 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-5ca325fb-258b-4fbc-a080-66ab0bb1b146 tempest-ProjectReaderTests-653964704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4025f61-f739-4947-b704-8c21434aa61c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:59:01 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-5ca325fb-258b-4fbc-a080-66ab0bb1b146 tempest-ProjectReaderTests-653964704 None] Volume volume-14c38ef5-f2e8-45b3-a8cf-5a2d487d719d (14c38ef5-f2e8-45b3-a8cf-5a2d487d719d): created successfully Sep 22 15:59:01 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-5ca325fb-258b-4fbc-a080-66ab0bb1b146 tempest-ProjectReaderTests-653964704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4025f61-f739-4947-b704-8c21434aa61c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:59:01 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-5ca325fb-258b-4fbc-a080-66ab0bb1b146 tempest-ProjectReaderTests-653964704 None] Flow 'volume_create_manager' (0fe08fa0-b069-4f40-b603-f42423a43990) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:59:01 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-5ca325fb-258b-4fbc-a080-66ab0bb1b146 tempest-ProjectReaderTests-653964704 None] Created volume successfully. Sep 22 15:59:01 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-2e5c02de-8714-4d1c-8a82-5c79f65c410e tempest-ProjectReaderTests-653964704 None] Acquiring lock "cinder-14c38ef5-f2e8-45b3-a8cf-5a2d487d719d-delete_volume" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:59:01 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-2e5c02de-8714-4d1c-8a82-5c79f65c410e tempest-ProjectReaderTests-653964704 None] Lock "cinder-14c38ef5-f2e8-45b3-a8cf-5a2d487d719d-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:59:01 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-2e5c02de-8714-4d1c-8a82-5c79f65c410e tempest-ProjectReaderTests-653964704 None] Acquiring lock "cinder-quobyte-14c38ef5-f2e8-45b3-a8cf-5a2d487d719d" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:59:01 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-2e5c02de-8714-4d1c-8a82-5c79f65c410e tempest-ProjectReaderTests-653964704 None] Lock "cinder-quobyte-14c38ef5-f2e8-45b3-a8cf-5a2d487d719d" acquired by "delete_volume" :: waited 0.017s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:59:01 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f9891d5-b304-4a64-be68-048a7ff60336]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:59:01 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-2e5c02de-8714-4d1c-8a82-5c79f65c410e tempest-ProjectReaderTests-653964704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-14c38ef5-f2e8-45b3-a8cf-5a2d487d719d {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:59:01 devstack sudo[106183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-14c38ef5-f2e8-45b3-a8cf-5a2d487d719d Sep 22 15:59:01 devstack sudo[106183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:59:02 devstack sudo[106183]: pam_unix(sudo:session): session closed for user root Sep 22 15:59:02 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-2e5c02de-8714-4d1c-8a82-5c79f65c410e tempest-ProjectReaderTests-653964704 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-14c38ef5-f2e8-45b3-a8cf-5a2d487d719d" returned: 0 in 0.349s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:59:02 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-2e5c02de-8714-4d1c-8a82-5c79f65c410e tempest-ProjectReaderTests-653964704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-14c38ef5-f2e8-45b3-a8cf-5a2d487d719d {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:59:02 devstack sudo[106188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-14c38ef5-f2e8-45b3-a8cf-5a2d487d719d Sep 22 15:59:02 devstack sudo[106188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:59:02 devstack sudo[106188]: pam_unix(sudo:session): session closed for user root Sep 22 15:59:02 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-2e5c02de-8714-4d1c-8a82-5c79f65c410e tempest-ProjectReaderTests-653964704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-14c38ef5-f2e8-45b3-a8cf-5a2d487d719d" returned: 0 in 0.244s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:59:02 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-2e5c02de-8714-4d1c-8a82-5c79f65c410e tempest-ProjectReaderTests-653964704 None] Lock "cinder-quobyte-14c38ef5-f2e8-45b3-a8cf-5a2d487d719d" released by "delete_volume" :: held 0.632s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:59:02 devstack cinder-volume[86212]: DEBUG cinder.quota [None req-2e5c02de-8714-4d1c-8a82-5c79f65c410e tempest-ProjectReaderTests-653964704 None] Created reservations ['0c81959e-0936-4245-90eb-334f479b30c8', '8fcaeae5-3363-4fa9-aa1f-d37d68778d90', '81ac763f-3c1f-4efb-bef8-0160e44f3057', 'a1b0990a-5cbf-4ae6-9ba6-e156bfc89cbf'] {{(pid=86212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 15:59:02 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-2e5c02de-8714-4d1c-8a82-5c79f65c410e tempest-ProjectReaderTests-653964704 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:59:02 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-2e5c02de-8714-4d1c-8a82-5c79f65c410e tempest-ProjectReaderTests-653964704 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:59:02 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-2e5c02de-8714-4d1c-8a82-5c79f65c410e tempest-ProjectReaderTests-653964704 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:59:02 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-2e5c02de-8714-4d1c-8a82-5c79f65c410e tempest-ProjectReaderTests-653964704 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:59:02 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-2e5c02de-8714-4d1c-8a82-5c79f65c410e tempest-ProjectReaderTests-653964704 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:59:02 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-2e5c02de-8714-4d1c-8a82-5c79f65c410e tempest-ProjectReaderTests-653964704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:59:02 devstack sudo[106191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc Sep 22 15:59:02 devstack sudo[106191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:59:02 devstack sudo[106191]: pam_unix(sudo:session): session closed for user root Sep 22 15:59:02 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-2e5c02de-8714-4d1c-8a82-5c79f65c410e tempest-ProjectReaderTests-653964704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc" returned: 0 in 0.238s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:59:02 devstack cinder-volume[86212]: DEBUG cinder.manager [None req-2e5c02de-8714-4d1c-8a82-5c79f65c410e tempest-ProjectReaderTests-653964704 None] Notifying Schedulers of capabilities ... {{(pid=86212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 15:59:02 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-2e5c02de-8714-4d1c-8a82-5c79f65c410e tempest-ProjectReaderTests-653964704 None] Deleted volume successfully. Sep 22 15:59:02 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-2e5c02de-8714-4d1c-8a82-5c79f65c410e tempest-ProjectReaderTests-653964704 None] Lock "cinder-14c38ef5-f2e8-45b3-a8cf-5a2d487d719d-delete_volume" released by "delete_volume" :: held 1.068s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:59:03 devstack cinder-volume[86212]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c0ea8c1-e081-4a36-9b35-9a9b58c915b6 tempest-ProjectReaderTests-653964704 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 15:59:03 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-8c0ea8c1-e081-4a36-9b35-9a9b58c915b6 tempest-ProjectReaderTests-653964704 None] Flow 'volume_create_manager' (4447456b-1ba7-4f05-8402-84a21f4d4252) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:59:03 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-8c0ea8c1-e081-4a36-9b35-9a9b58c915b6 tempest-ProjectReaderTests-653964704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ec37c25-c065-4845-bcab-f57563683b9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:59:03 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-8c0ea8c1-e081-4a36-9b35-9a9b58c915b6 tempest-ProjectReaderTests-653964704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ec37c25-c065-4845-bcab-f57563683b9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:59:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1083645751',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=459dc59e-f4cf-41ab-8e73-b2338bbc9e28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e18a0616fb44f5e8d03fefefded839c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:59:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:59:03Z,use_quota=True,user_id='9617c40f49a0460a9eb326477a08b24f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:59:03 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-8c0ea8c1-e081-4a36-9b35-9a9b58c915b6 tempest-ProjectReaderTests-653964704 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7506b8ab-b7ff-44d7-9726-40c55339034c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:59:03 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-8c0ea8c1-e081-4a36-9b35-9a9b58c915b6 tempest-ProjectReaderTests-653964704 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7506b8ab-b7ff-44d7-9726-40c55339034c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:59:03 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-8c0ea8c1-e081-4a36-9b35-9a9b58c915b6 tempest-ProjectReaderTests-653964704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab4b7ef7-cc4b-48ba-a9b5-20d71f8bb253) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:59:03 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-8c0ea8c1-e081-4a36-9b35-9a9b58c915b6 tempest-ProjectReaderTests-653964704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab4b7ef7-cc4b-48ba-a9b5-20d71f8bb253) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '459dc59e-f4cf-41ab-8e73-b2338bbc9e28', 'volume_name': 'volume-459dc59e-f4cf-41ab-8e73-b2338bbc9e28', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:59:03 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-8c0ea8c1-e081-4a36-9b35-9a9b58c915b6 tempest-ProjectReaderTests-653964704 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (810a892d-15bc-44d0-84f7-fbe90d8fbcde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:59:03 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-8c0ea8c1-e081-4a36-9b35-9a9b58c915b6 tempest-ProjectReaderTests-653964704 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (810a892d-15bc-44d0-84f7-fbe90d8fbcde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:59:03 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-8c0ea8c1-e081-4a36-9b35-9a9b58c915b6 tempest-ProjectReaderTests-653964704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dcd10cd1-c9ee-4c2b-a93e-1c586461e56d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:59:03 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-8c0ea8c1-e081-4a36-9b35-9a9b58c915b6 tempest-ProjectReaderTests-653964704 None] Volume 459dc59e-f4cf-41ab-8e73-b2338bbc9e28: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-459dc59e-f4cf-41ab-8e73-b2338bbc9e28', 'volume_size': 1} Sep 22 15:59:03 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-8c0ea8c1-e081-4a36-9b35-9a9b58c915b6 tempest-ProjectReaderTests-653964704 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:59:03 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-8c0ea8c1-e081-4a36-9b35-9a9b58c915b6 tempest-ProjectReaderTests-653964704 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:59:03 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-8c0ea8c1-e081-4a36-9b35-9a9b58c915b6 tempest-ProjectReaderTests-653964704 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:59:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1083645751',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=459dc59e-f4cf-41ab-8e73-b2338bbc9e28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e18a0616fb44f5e8d03fefefded839c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:59:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:59:03Z,use_quota=True,user_id='9617c40f49a0460a9eb326477a08b24f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)}" {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 15:59:03 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-8c0ea8c1-e081-4a36-9b35-9a9b58c915b6 tempest-ProjectReaderTests-653964704 None] Creating volume 459dc59e-f4cf-41ab-8e73-b2338bbc9e28 {{(pid=86212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 15:59:03 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-8c0ea8c1-e081-4a36-9b35-9a9b58c915b6 tempest-ProjectReaderTests-653964704 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:59:03 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-8c0ea8c1-e081-4a36-9b35-9a9b58c915b6 tempest-ProjectReaderTests-653964704 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:59:03 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-8c0ea8c1-e081-4a36-9b35-9a9b58c915b6 tempest-ProjectReaderTests-653964704 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:59:03 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-8c0ea8c1-e081-4a36-9b35-9a9b58c915b6 tempest-ProjectReaderTests-653964704 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:59:03 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-8c0ea8c1-e081-4a36-9b35-9a9b58c915b6 tempest-ProjectReaderTests-653964704 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:59:03 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-8c0ea8c1-e081-4a36-9b35-9a9b58c915b6 tempest-ProjectReaderTests-653964704 None] Selected osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 as target Quobyte volume. {{(pid=86212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 15:59:03 devstack cinder-volume[86212]: INFO cinder.volume.drivers.remotefs [None req-8c0ea8c1-e081-4a36-9b35-9a9b58c915b6 tempest-ProjectReaderTests-653964704 None] casted to osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 Sep 22 15:59:03 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-8c0ea8c1-e081-4a36-9b35-9a9b58c915b6 tempest-ProjectReaderTests-653964704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-459dc59e-f4cf-41ab-8e73-b2338bbc9e28 1073741824 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:59:03 devstack sudo[106194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-459dc59e-f4cf-41ab-8e73-b2338bbc9e28 1073741824 Sep 22 15:59:03 devstack sudo[106194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:59:03 devstack sudo[106194]: pam_unix(sudo:session): session closed for user root Sep 22 15:59:03 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-8c0ea8c1-e081-4a36-9b35-9a9b58c915b6 tempest-ProjectReaderTests-653964704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-459dc59e-f4cf-41ab-8e73-b2338bbc9e28 1073741824" returned: 0 in 0.432s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:59:03 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-8c0ea8c1-e081-4a36-9b35-9a9b58c915b6 tempest-ProjectReaderTests-653964704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-459dc59e-f4cf-41ab-8e73-b2338bbc9e28 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:59:03 devstack sudo[106200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-459dc59e-f4cf-41ab-8e73-b2338bbc9e28 Sep 22 15:59:03 devstack sudo[106200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:59:04 devstack sudo[106200]: pam_unix(sudo:session): session closed for user root Sep 22 15:59:04 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-8c0ea8c1-e081-4a36-9b35-9a9b58c915b6 tempest-ProjectReaderTests-653964704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-459dc59e-f4cf-41ab-8e73-b2338bbc9e28" returned: 0 in 0.241s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:59:04 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-8c0ea8c1-e081-4a36-9b35-9a9b58c915b6 tempest-ProjectReaderTests-653964704 None] <== create_volume: return (714ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'} {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 15:59:04 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-8c0ea8c1-e081-4a36-9b35-9a9b58c915b6 tempest-ProjectReaderTests-653964704 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.716s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:59:04 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-8c0ea8c1-e081-4a36-9b35-9a9b58c915b6 tempest-ProjectReaderTests-653964704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dcd10cd1-c9ee-4c2b-a93e-1c586461e56d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-459dc59e-f4cf-41ab-8e73-b2338bbc9e28', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:59:04 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-8c0ea8c1-e081-4a36-9b35-9a9b58c915b6 tempest-ProjectReaderTests-653964704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4649937-7e36-4755-a644-2628e53bfe23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:59:04 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-8c0ea8c1-e081-4a36-9b35-9a9b58c915b6 tempest-ProjectReaderTests-653964704 None] Volume volume-459dc59e-f4cf-41ab-8e73-b2338bbc9e28 (459dc59e-f4cf-41ab-8e73-b2338bbc9e28): created successfully Sep 22 15:59:04 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-8c0ea8c1-e081-4a36-9b35-9a9b58c915b6 tempest-ProjectReaderTests-653964704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4649937-7e36-4755-a644-2628e53bfe23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:59:04 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-8c0ea8c1-e081-4a36-9b35-9a9b58c915b6 tempest-ProjectReaderTests-653964704 None] Flow 'volume_create_manager' (4447456b-1ba7-4f05-8402-84a21f4d4252) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:59:04 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-8c0ea8c1-e081-4a36-9b35-9a9b58c915b6 tempest-ProjectReaderTests-653964704 None] Created volume successfully. Sep 22 15:59:04 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-4ae03fe5-645c-4099-a963-76e91eb2fcb1 tempest-ProjectReaderTests-653964704 None] Acquiring lock "cinder-459dc59e-f4cf-41ab-8e73-b2338bbc9e28-delete_volume" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:59:04 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-4ae03fe5-645c-4099-a963-76e91eb2fcb1 tempest-ProjectReaderTests-653964704 None] Lock "cinder-459dc59e-f4cf-41ab-8e73-b2338bbc9e28-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:59:04 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-4ae03fe5-645c-4099-a963-76e91eb2fcb1 tempest-ProjectReaderTests-653964704 None] Acquiring lock "cinder-quobyte-459dc59e-f4cf-41ab-8e73-b2338bbc9e28" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:59:04 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-4ae03fe5-645c-4099-a963-76e91eb2fcb1 tempest-ProjectReaderTests-653964704 None] Lock "cinder-quobyte-459dc59e-f4cf-41ab-8e73-b2338bbc9e28" acquired by "delete_volume" :: waited 0.016s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:59:04 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6aff6b9-0b4e-4aab-a74e-800b9b4af05f]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:59:04 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-4ae03fe5-645c-4099-a963-76e91eb2fcb1 tempest-ProjectReaderTests-653964704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-459dc59e-f4cf-41ab-8e73-b2338bbc9e28 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:59:04 devstack sudo[106203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-459dc59e-f4cf-41ab-8e73-b2338bbc9e28 Sep 22 15:59:04 devstack sudo[106203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:59:04 devstack sudo[106203]: pam_unix(sudo:session): session closed for user root Sep 22 15:59:04 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-4ae03fe5-645c-4099-a963-76e91eb2fcb1 tempest-ProjectReaderTests-653964704 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-459dc59e-f4cf-41ab-8e73-b2338bbc9e28" returned: 0 in 0.361s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:59:04 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-4ae03fe5-645c-4099-a963-76e91eb2fcb1 tempest-ProjectReaderTests-653964704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-459dc59e-f4cf-41ab-8e73-b2338bbc9e28 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:59:04 devstack sudo[106208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-459dc59e-f4cf-41ab-8e73-b2338bbc9e28 Sep 22 15:59:04 devstack sudo[106208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:59:05 devstack sudo[106208]: pam_unix(sudo:session): session closed for user root Sep 22 15:59:05 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-4ae03fe5-645c-4099-a963-76e91eb2fcb1 tempest-ProjectReaderTests-653964704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-459dc59e-f4cf-41ab-8e73-b2338bbc9e28" returned: 0 in 0.237s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:59:05 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-4ae03fe5-645c-4099-a963-76e91eb2fcb1 tempest-ProjectReaderTests-653964704 None] Lock "cinder-quobyte-459dc59e-f4cf-41ab-8e73-b2338bbc9e28" released by "delete_volume" :: held 0.641s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:59:05 devstack cinder-volume[86212]: DEBUG cinder.quota [None req-4ae03fe5-645c-4099-a963-76e91eb2fcb1 tempest-ProjectReaderTests-653964704 None] Created reservations ['06922d7b-bced-41a4-bbb3-4e5a1eeeeb88', 'bc09151a-5f87-414b-bafc-e2258f03e42e', '5695a49e-34a0-4b82-9184-8a14115d4237', 'a941bbbd-9ee2-48f9-9c03-c54ec4bc417b'] {{(pid=86212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 15:59:05 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-4ae03fe5-645c-4099-a963-76e91eb2fcb1 tempest-ProjectReaderTests-653964704 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:59:05 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-4ae03fe5-645c-4099-a963-76e91eb2fcb1 tempest-ProjectReaderTests-653964704 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:59:05 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-4ae03fe5-645c-4099-a963-76e91eb2fcb1 tempest-ProjectReaderTests-653964704 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:59:05 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-4ae03fe5-645c-4099-a963-76e91eb2fcb1 tempest-ProjectReaderTests-653964704 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:59:05 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-4ae03fe5-645c-4099-a963-76e91eb2fcb1 tempest-ProjectReaderTests-653964704 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:59:05 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-4ae03fe5-645c-4099-a963-76e91eb2fcb1 tempest-ProjectReaderTests-653964704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:59:05 devstack sudo[106211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc Sep 22 15:59:05 devstack sudo[106211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:59:05 devstack sudo[106211]: pam_unix(sudo:session): session closed for user root Sep 22 15:59:05 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-4ae03fe5-645c-4099-a963-76e91eb2fcb1 tempest-ProjectReaderTests-653964704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc" returned: 0 in 0.237s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:59:05 devstack cinder-volume[86212]: DEBUG cinder.manager [None req-4ae03fe5-645c-4099-a963-76e91eb2fcb1 tempest-ProjectReaderTests-653964704 None] Notifying Schedulers of capabilities ... {{(pid=86212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 15:59:05 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-4ae03fe5-645c-4099-a963-76e91eb2fcb1 tempest-ProjectReaderTests-653964704 None] Deleted volume successfully. Sep 22 15:59:05 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-4ae03fe5-645c-4099-a963-76e91eb2fcb1 tempest-ProjectReaderTests-653964704 None] Lock "cinder-459dc59e-f4cf-41ab-8e73-b2338bbc9e28-delete_volume" released by "delete_volume" :: held 1.068s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:59:06 devstack cinder-volume[86212]: DEBUG cinder.volume.flows.manager.create_volume [None req-820e12c3-6f91-4b43-a82e-51e66cbb3eb9 tempest-ProjectReaderTests-653964704 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 15:59:06 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-820e12c3-6f91-4b43-a82e-51e66cbb3eb9 tempest-ProjectReaderTests-653964704 None] Flow 'volume_create_manager' (9f910b99-629b-4f6d-8443-6541a2e2f2b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:59:06 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-820e12c3-6f91-4b43-a82e-51e66cbb3eb9 tempest-ProjectReaderTests-653964704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac214172-9b61-4d6f-9422-134d4cccf215) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:59:06 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-820e12c3-6f91-4b43-a82e-51e66cbb3eb9 tempest-ProjectReaderTests-653964704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac214172-9b61-4d6f-9422-134d4cccf215) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:59:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-714949689',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cae8f076-1fc0-401a-8050-7c02ca892b4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e18a0616fb44f5e8d03fefefded839c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:59:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:59:06Z,use_quota=True,user_id='9617c40f49a0460a9eb326477a08b24f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:59:06 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-820e12c3-6f91-4b43-a82e-51e66cbb3eb9 tempest-ProjectReaderTests-653964704 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4d27a16-19b3-4728-8886-a2c6f75a5f3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:59:06 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-820e12c3-6f91-4b43-a82e-51e66cbb3eb9 tempest-ProjectReaderTests-653964704 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4d27a16-19b3-4728-8886-a2c6f75a5f3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:59:06 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-820e12c3-6f91-4b43-a82e-51e66cbb3eb9 tempest-ProjectReaderTests-653964704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae76960a-8a8f-4835-b834-c11f2e94d41b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:59:06 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-820e12c3-6f91-4b43-a82e-51e66cbb3eb9 tempest-ProjectReaderTests-653964704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae76960a-8a8f-4835-b834-c11f2e94d41b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cae8f076-1fc0-401a-8050-7c02ca892b4a', 'volume_name': 'volume-cae8f076-1fc0-401a-8050-7c02ca892b4a', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:59:06 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-820e12c3-6f91-4b43-a82e-51e66cbb3eb9 tempest-ProjectReaderTests-653964704 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a888c0f-37f2-42b7-80fd-abafc0a6c886) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:59:06 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-820e12c3-6f91-4b43-a82e-51e66cbb3eb9 tempest-ProjectReaderTests-653964704 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a888c0f-37f2-42b7-80fd-abafc0a6c886) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:59:06 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-820e12c3-6f91-4b43-a82e-51e66cbb3eb9 tempest-ProjectReaderTests-653964704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef72a4b4-3f1d-4b0f-8bd6-69ef4c1f541f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:59:06 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-820e12c3-6f91-4b43-a82e-51e66cbb3eb9 tempest-ProjectReaderTests-653964704 None] Volume cae8f076-1fc0-401a-8050-7c02ca892b4a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cae8f076-1fc0-401a-8050-7c02ca892b4a', 'volume_size': 1} Sep 22 15:59:06 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-820e12c3-6f91-4b43-a82e-51e66cbb3eb9 tempest-ProjectReaderTests-653964704 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:59:06 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-820e12c3-6f91-4b43-a82e-51e66cbb3eb9 tempest-ProjectReaderTests-653964704 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:59:06 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-820e12c3-6f91-4b43-a82e-51e66cbb3eb9 tempest-ProjectReaderTests-653964704 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:59:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-714949689',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cae8f076-1fc0-401a-8050-7c02ca892b4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e18a0616fb44f5e8d03fefefded839c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:59:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:59:06Z,use_quota=True,user_id='9617c40f49a0460a9eb326477a08b24f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)}" {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 15:59:06 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-820e12c3-6f91-4b43-a82e-51e66cbb3eb9 tempest-ProjectReaderTests-653964704 None] Creating volume cae8f076-1fc0-401a-8050-7c02ca892b4a {{(pid=86212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 15:59:06 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-820e12c3-6f91-4b43-a82e-51e66cbb3eb9 tempest-ProjectReaderTests-653964704 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:59:06 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-820e12c3-6f91-4b43-a82e-51e66cbb3eb9 tempest-ProjectReaderTests-653964704 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:59:06 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-820e12c3-6f91-4b43-a82e-51e66cbb3eb9 tempest-ProjectReaderTests-653964704 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:59:06 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-820e12c3-6f91-4b43-a82e-51e66cbb3eb9 tempest-ProjectReaderTests-653964704 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:59:06 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-820e12c3-6f91-4b43-a82e-51e66cbb3eb9 tempest-ProjectReaderTests-653964704 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:59:06 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-820e12c3-6f91-4b43-a82e-51e66cbb3eb9 tempest-ProjectReaderTests-653964704 None] Selected osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 as target Quobyte volume. {{(pid=86212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 15:59:06 devstack cinder-volume[86212]: INFO cinder.volume.drivers.remotefs [None req-820e12c3-6f91-4b43-a82e-51e66cbb3eb9 tempest-ProjectReaderTests-653964704 None] casted to osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 Sep 22 15:59:06 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-820e12c3-6f91-4b43-a82e-51e66cbb3eb9 tempest-ProjectReaderTests-653964704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-cae8f076-1fc0-401a-8050-7c02ca892b4a 1073741824 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:59:06 devstack sudo[106214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-cae8f076-1fc0-401a-8050-7c02ca892b4a 1073741824 Sep 22 15:59:06 devstack sudo[106214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:59:06 devstack sudo[106214]: pam_unix(sudo:session): session closed for user root Sep 22 15:59:06 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-820e12c3-6f91-4b43-a82e-51e66cbb3eb9 tempest-ProjectReaderTests-653964704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-cae8f076-1fc0-401a-8050-7c02ca892b4a 1073741824" returned: 0 in 0.407s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:59:06 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-820e12c3-6f91-4b43-a82e-51e66cbb3eb9 tempest-ProjectReaderTests-653964704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-cae8f076-1fc0-401a-8050-7c02ca892b4a {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:59:06 devstack sudo[106219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-cae8f076-1fc0-401a-8050-7c02ca892b4a Sep 22 15:59:06 devstack sudo[106219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:59:06 devstack sudo[106219]: pam_unix(sudo:session): session closed for user root Sep 22 15:59:06 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-820e12c3-6f91-4b43-a82e-51e66cbb3eb9 tempest-ProjectReaderTests-653964704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-cae8f076-1fc0-401a-8050-7c02ca892b4a" returned: 0 in 0.233s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:59:06 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-820e12c3-6f91-4b43-a82e-51e66cbb3eb9 tempest-ProjectReaderTests-653964704 None] <== create_volume: return (685ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'} {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 15:59:06 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-820e12c3-6f91-4b43-a82e-51e66cbb3eb9 tempest-ProjectReaderTests-653964704 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.688s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:59:06 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-820e12c3-6f91-4b43-a82e-51e66cbb3eb9 tempest-ProjectReaderTests-653964704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef72a4b4-3f1d-4b0f-8bd6-69ef4c1f541f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cae8f076-1fc0-401a-8050-7c02ca892b4a', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:59:06 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-820e12c3-6f91-4b43-a82e-51e66cbb3eb9 tempest-ProjectReaderTests-653964704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91c45dd7-9f42-4801-9596-cfc1e9fb47b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:59:06 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-820e12c3-6f91-4b43-a82e-51e66cbb3eb9 tempest-ProjectReaderTests-653964704 None] Volume volume-cae8f076-1fc0-401a-8050-7c02ca892b4a (cae8f076-1fc0-401a-8050-7c02ca892b4a): created successfully Sep 22 15:59:06 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-820e12c3-6f91-4b43-a82e-51e66cbb3eb9 tempest-ProjectReaderTests-653964704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91c45dd7-9f42-4801-9596-cfc1e9fb47b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:59:06 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-820e12c3-6f91-4b43-a82e-51e66cbb3eb9 tempest-ProjectReaderTests-653964704 None] Flow 'volume_create_manager' (9f910b99-629b-4f6d-8443-6541a2e2f2b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:59:06 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-820e12c3-6f91-4b43-a82e-51e66cbb3eb9 tempest-ProjectReaderTests-653964704 None] Created volume successfully. Sep 22 15:59:07 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-36ed450f-f81b-402d-8986-d5ca81504b0c tempest-ProjectReaderTests-653964704 None] Acquiring lock "cinder-cae8f076-1fc0-401a-8050-7c02ca892b4a-delete_volume" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:59:07 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-36ed450f-f81b-402d-8986-d5ca81504b0c tempest-ProjectReaderTests-653964704 None] Lock "cinder-cae8f076-1fc0-401a-8050-7c02ca892b4a-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:59:07 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-36ed450f-f81b-402d-8986-d5ca81504b0c tempest-ProjectReaderTests-653964704 None] Acquiring lock "cinder-quobyte-cae8f076-1fc0-401a-8050-7c02ca892b4a" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:59:07 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-36ed450f-f81b-402d-8986-d5ca81504b0c tempest-ProjectReaderTests-653964704 None] Lock "cinder-quobyte-cae8f076-1fc0-401a-8050-7c02ca892b4a" acquired by "delete_volume" :: waited 0.016s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:59:07 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[074d9fb8-aa0f-475c-b479-aa2ac53a2e43]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:59:07 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-36ed450f-f81b-402d-8986-d5ca81504b0c tempest-ProjectReaderTests-653964704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-cae8f076-1fc0-401a-8050-7c02ca892b4a {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:59:07 devstack sudo[106222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-cae8f076-1fc0-401a-8050-7c02ca892b4a Sep 22 15:59:07 devstack sudo[106222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:59:07 devstack sudo[106222]: pam_unix(sudo:session): session closed for user root Sep 22 15:59:07 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-36ed450f-f81b-402d-8986-d5ca81504b0c tempest-ProjectReaderTests-653964704 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-cae8f076-1fc0-401a-8050-7c02ca892b4a" returned: 0 in 0.335s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:59:07 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-36ed450f-f81b-402d-8986-d5ca81504b0c tempest-ProjectReaderTests-653964704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-cae8f076-1fc0-401a-8050-7c02ca892b4a {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:59:07 devstack sudo[106227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-cae8f076-1fc0-401a-8050-7c02ca892b4a Sep 22 15:59:07 devstack sudo[106227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:59:07 devstack sudo[106227]: pam_unix(sudo:session): session closed for user root Sep 22 15:59:07 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-36ed450f-f81b-402d-8986-d5ca81504b0c tempest-ProjectReaderTests-653964704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-cae8f076-1fc0-401a-8050-7c02ca892b4a" returned: 0 in 0.235s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:59:07 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-36ed450f-f81b-402d-8986-d5ca81504b0c tempest-ProjectReaderTests-653964704 None] Lock "cinder-quobyte-cae8f076-1fc0-401a-8050-7c02ca892b4a" released by "delete_volume" :: held 0.608s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:59:07 devstack cinder-volume[86212]: DEBUG cinder.quota [None req-36ed450f-f81b-402d-8986-d5ca81504b0c tempest-ProjectReaderTests-653964704 None] Created reservations ['33e1acb7-fb16-4c88-bad0-6fdd6caa2735', '4acf4a35-c188-4bf7-bd83-4b860f06088f', '8684fc6d-21e9-4d2e-bf15-760584983435', 'c7933111-42aa-4558-ae69-392cbbeb155a'] {{(pid=86212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 15:59:07 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-36ed450f-f81b-402d-8986-d5ca81504b0c tempest-ProjectReaderTests-653964704 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:59:07 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-36ed450f-f81b-402d-8986-d5ca81504b0c tempest-ProjectReaderTests-653964704 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:59:07 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-36ed450f-f81b-402d-8986-d5ca81504b0c tempest-ProjectReaderTests-653964704 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:59:07 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-36ed450f-f81b-402d-8986-d5ca81504b0c tempest-ProjectReaderTests-653964704 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:59:07 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-36ed450f-f81b-402d-8986-d5ca81504b0c tempest-ProjectReaderTests-653964704 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:59:07 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-36ed450f-f81b-402d-8986-d5ca81504b0c tempest-ProjectReaderTests-653964704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:59:07 devstack sudo[106230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc Sep 22 15:59:07 devstack sudo[106230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:59:08 devstack sudo[106230]: pam_unix(sudo:session): session closed for user root Sep 22 15:59:08 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-36ed450f-f81b-402d-8986-d5ca81504b0c tempest-ProjectReaderTests-653964704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc" returned: 0 in 0.230s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:59:08 devstack cinder-volume[86212]: DEBUG cinder.manager [None req-36ed450f-f81b-402d-8986-d5ca81504b0c tempest-ProjectReaderTests-653964704 None] Notifying Schedulers of capabilities ... {{(pid=86212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 15:59:08 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-36ed450f-f81b-402d-8986-d5ca81504b0c tempest-ProjectReaderTests-653964704 None] Deleted volume successfully. Sep 22 15:59:08 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-36ed450f-f81b-402d-8986-d5ca81504b0c tempest-ProjectReaderTests-653964704 None] Lock "cinder-cae8f076-1fc0-401a-8050-7c02ca892b4a-delete_volume" released by "delete_volume" :: held 1.022s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:59:08 devstack cinder-volume[86212]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2285f03-2f34-43ca-a54a-c8518f75ca78 tempest-ProjectReaderTests-653964704 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 15:59:08 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-a2285f03-2f34-43ca-a54a-c8518f75ca78 tempest-ProjectReaderTests-653964704 None] Flow 'volume_create_manager' (cb352ecb-a7a7-4dd8-afb8-e36ba1ccedbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:59:08 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-a2285f03-2f34-43ca-a54a-c8518f75ca78 tempest-ProjectReaderTests-653964704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2185ba27-4ba6-4681-8503-86d368ca5e6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:59:08 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-a2285f03-2f34-43ca-a54a-c8518f75ca78 tempest-ProjectReaderTests-653964704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2185ba27-4ba6-4681-8503-86d368ca5e6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:59:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2030128805',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67473435-d9b6-4405-8aed-87f87519956b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e18a0616fb44f5e8d03fefefded839c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:59:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:59:09Z,use_quota=True,user_id='9617c40f49a0460a9eb326477a08b24f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:59:08 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-a2285f03-2f34-43ca-a54a-c8518f75ca78 tempest-ProjectReaderTests-653964704 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4167030-f5e3-477c-abca-c9492f7db124) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:59:08 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-a2285f03-2f34-43ca-a54a-c8518f75ca78 tempest-ProjectReaderTests-653964704 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4167030-f5e3-477c-abca-c9492f7db124) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:59:08 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-a2285f03-2f34-43ca-a54a-c8518f75ca78 tempest-ProjectReaderTests-653964704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a848018a-a0f7-4903-9f01-6c2f42d8526a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:59:08 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-a2285f03-2f34-43ca-a54a-c8518f75ca78 tempest-ProjectReaderTests-653964704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a848018a-a0f7-4903-9f01-6c2f42d8526a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '67473435-d9b6-4405-8aed-87f87519956b', 'volume_name': 'volume-67473435-d9b6-4405-8aed-87f87519956b', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:59:08 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-a2285f03-2f34-43ca-a54a-c8518f75ca78 tempest-ProjectReaderTests-653964704 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b0a5227-70ea-4c11-915d-59f4712e412e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:59:08 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-a2285f03-2f34-43ca-a54a-c8518f75ca78 tempest-ProjectReaderTests-653964704 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b0a5227-70ea-4c11-915d-59f4712e412e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:59:08 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-a2285f03-2f34-43ca-a54a-c8518f75ca78 tempest-ProjectReaderTests-653964704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db4f6dbf-4270-40c3-966e-e29ed0a9470d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:59:08 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-a2285f03-2f34-43ca-a54a-c8518f75ca78 tempest-ProjectReaderTests-653964704 None] Volume 67473435-d9b6-4405-8aed-87f87519956b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-67473435-d9b6-4405-8aed-87f87519956b', 'volume_size': 1} Sep 22 15:59:08 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-a2285f03-2f34-43ca-a54a-c8518f75ca78 tempest-ProjectReaderTests-653964704 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:59:08 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-a2285f03-2f34-43ca-a54a-c8518f75ca78 tempest-ProjectReaderTests-653964704 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:59:08 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-a2285f03-2f34-43ca-a54a-c8518f75ca78 tempest-ProjectReaderTests-653964704 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T13:59:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2030128805',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67473435-d9b6-4405-8aed-87f87519956b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e18a0616fb44f5e8d03fefefded839c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:59:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:59:09Z,use_quota=True,user_id='9617c40f49a0460a9eb326477a08b24f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24c31a91-3caf-42b3-b29c-8a1e577e82ac),volume_type_id=24c31a91-3caf-42b3-b29c-8a1e577e82ac)}" {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 15:59:08 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.remotefs [None req-a2285f03-2f34-43ca-a54a-c8518f75ca78 tempest-ProjectReaderTests-653964704 None] Creating volume 67473435-d9b6-4405-8aed-87f87519956b {{(pid=86212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 15:59:08 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-a2285f03-2f34-43ca-a54a-c8518f75ca78 tempest-ProjectReaderTests-653964704 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:59:08 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-a2285f03-2f34-43ca-a54a-c8518f75ca78 tempest-ProjectReaderTests-653964704 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:59:08 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-a2285f03-2f34-43ca-a54a-c8518f75ca78 tempest-ProjectReaderTests-653964704 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:59:08 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-a2285f03-2f34-43ca-a54a-c8518f75ca78 tempest-ProjectReaderTests-653964704 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:59:08 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-a2285f03-2f34-43ca-a54a-c8518f75ca78 tempest-ProjectReaderTests-653964704 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:59:08 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-a2285f03-2f34-43ca-a54a-c8518f75ca78 tempest-ProjectReaderTests-653964704 None] Selected osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 as target Quobyte volume. {{(pid=86212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 15:59:08 devstack cinder-volume[86212]: INFO cinder.volume.drivers.remotefs [None req-a2285f03-2f34-43ca-a54a-c8518f75ca78 tempest-ProjectReaderTests-653964704 None] casted to osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31 Sep 22 15:59:08 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-a2285f03-2f34-43ca-a54a-c8518f75ca78 tempest-ProjectReaderTests-653964704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-67473435-d9b6-4405-8aed-87f87519956b 1073741824 {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:59:08 devstack sudo[106234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-67473435-d9b6-4405-8aed-87f87519956b 1073741824 Sep 22 15:59:08 devstack sudo[106234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:59:09 devstack sudo[106234]: pam_unix(sudo:session): session closed for user root Sep 22 15:59:09 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-a2285f03-2f34-43ca-a54a-c8518f75ca78 tempest-ProjectReaderTests-653964704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-67473435-d9b6-4405-8aed-87f87519956b 1073741824" returned: 0 in 0.385s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:59:09 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-a2285f03-2f34-43ca-a54a-c8518f75ca78 tempest-ProjectReaderTests-653964704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-67473435-d9b6-4405-8aed-87f87519956b {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:59:09 devstack sudo[106239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-67473435-d9b6-4405-8aed-87f87519956b Sep 22 15:59:09 devstack sudo[106239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:59:09 devstack sudo[106239]: pam_unix(sudo:session): session closed for user root Sep 22 15:59:09 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-a2285f03-2f34-43ca-a54a-c8518f75ca78 tempest-ProjectReaderTests-653964704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-67473435-d9b6-4405-8aed-87f87519956b" returned: 0 in 0.236s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:59:09 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-a2285f03-2f34-43ca-a54a-c8518f75ca78 tempest-ProjectReaderTests-653964704 None] <== create_volume: return (661ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'} {{(pid=86212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 15:59:09 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-a2285f03-2f34-43ca-a54a-c8518f75ca78 tempest-ProjectReaderTests-653964704 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.664s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:59:09 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-a2285f03-2f34-43ca-a54a-c8518f75ca78 tempest-ProjectReaderTests-653964704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db4f6dbf-4270-40c3-966e-e29ed0a9470d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-67473435-d9b6-4405-8aed-87f87519956b', 'volume_size': 1}' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:59:09 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-a2285f03-2f34-43ca-a54a-c8518f75ca78 tempest-ProjectReaderTests-653964704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2f61576-e8fb-4993-a8c7-e3654eb06ae3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 15:59:09 devstack cinder-volume[86212]: INFO cinder.volume.flows.manager.create_volume [None req-a2285f03-2f34-43ca-a54a-c8518f75ca78 tempest-ProjectReaderTests-653964704 None] Volume volume-67473435-d9b6-4405-8aed-87f87519956b (67473435-d9b6-4405-8aed-87f87519956b): created successfully Sep 22 15:59:09 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-a2285f03-2f34-43ca-a54a-c8518f75ca78 tempest-ProjectReaderTests-653964704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2f61576-e8fb-4993-a8c7-e3654eb06ae3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 15:59:09 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-a2285f03-2f34-43ca-a54a-c8518f75ca78 tempest-ProjectReaderTests-653964704 None] Flow 'volume_create_manager' (cb352ecb-a7a7-4dd8-afb8-e36ba1ccedbe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 15:59:09 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-a2285f03-2f34-43ca-a54a-c8518f75ca78 tempest-ProjectReaderTests-653964704 None] Created volume successfully. Sep 22 15:59:09 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-ab4eddd9-ee11-4f9a-8a02-0673f49756b5 tempest-ProjectReaderTests-653964704 None] Acquiring lock "cinder-67473435-d9b6-4405-8aed-87f87519956b-delete_volume" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:59:09 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-ab4eddd9-ee11-4f9a-8a02-0673f49756b5 tempest-ProjectReaderTests-653964704 None] Lock "cinder-67473435-d9b6-4405-8aed-87f87519956b-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:59:09 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-ab4eddd9-ee11-4f9a-8a02-0673f49756b5 tempest-ProjectReaderTests-653964704 None] Acquiring lock "cinder-quobyte-67473435-d9b6-4405-8aed-87f87519956b" by "delete_volume" {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 15:59:09 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-ab4eddd9-ee11-4f9a-8a02-0673f49756b5 tempest-ProjectReaderTests-653964704 None] Lock "cinder-quobyte-67473435-d9b6-4405-8aed-87f87519956b" acquired by "delete_volume" :: waited 0.014s {{(pid=86212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 15:59:09 devstack cinder-volume[86212]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e554fc6-650a-4ded-9719-ddb891098c70]: (4, 'qcow2') {{(pid=87530) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 15:59:09 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-ab4eddd9-ee11-4f9a-8a02-0673f49756b5 tempest-ProjectReaderTests-653964704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-67473435-d9b6-4405-8aed-87f87519956b {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:59:09 devstack sudo[106242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-67473435-d9b6-4405-8aed-87f87519956b Sep 22 15:59:09 devstack sudo[106242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:59:10 devstack sudo[106242]: pam_unix(sudo:session): session closed for user root Sep 22 15:59:10 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-ab4eddd9-ee11-4f9a-8a02-0673f49756b5 tempest-ProjectReaderTests-653964704 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-67473435-d9b6-4405-8aed-87f87519956b" returned: 0 in 0.338s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:59:10 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-ab4eddd9-ee11-4f9a-8a02-0673f49756b5 tempest-ProjectReaderTests-653964704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-67473435-d9b6-4405-8aed-87f87519956b {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:59:10 devstack sudo[106247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-67473435-d9b6-4405-8aed-87f87519956b Sep 22 15:59:10 devstack sudo[106247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:59:10 devstack sudo[106247]: pam_unix(sudo:session): session closed for user root Sep 22 15:59:10 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-ab4eddd9-ee11-4f9a-8a02-0673f49756b5 tempest-ProjectReaderTests-653964704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc/volume-67473435-d9b6-4405-8aed-87f87519956b" returned: 0 in 0.235s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:59:10 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-ab4eddd9-ee11-4f9a-8a02-0673f49756b5 tempest-ProjectReaderTests-653964704 None] Lock "cinder-quobyte-67473435-d9b6-4405-8aed-87f87519956b" released by "delete_volume" :: held 0.612s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:59:10 devstack cinder-volume[86212]: DEBUG cinder.quota [None req-ab4eddd9-ee11-4f9a-8a02-0673f49756b5 tempest-ProjectReaderTests-653964704 None] Created reservations ['8b50c09f-ab5d-487a-a906-6671b05b11cc', '1d8c4d0e-393d-467b-a25a-4a8be6566b72', 'f95e87e4-7d08-455d-a8ab-e589b77ceb09', '9d00997b-2675-4b71-b635-3a575e4594d2'] {{(pid=86212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 15:59:10 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-ab4eddd9-ee11-4f9a-8a02-0673f49756b5 tempest-ProjectReaderTests-653964704 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:59:10 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-ab4eddd9-ee11-4f9a-8a02-0673f49756b5 tempest-ProjectReaderTests-653964704 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:59:10 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-ab4eddd9-ee11-4f9a-8a02-0673f49756b5 tempest-ProjectReaderTests-653964704 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:59:10 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-ab4eddd9-ee11-4f9a-8a02-0673f49756b5 tempest-ProjectReaderTests-653964704 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:59:10 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-ab4eddd9-ee11-4f9a-8a02-0673f49756b5 tempest-ProjectReaderTests-653964704 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:59:10 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-ab4eddd9-ee11-4f9a-8a02-0673f49756b5 tempest-ProjectReaderTests-653964704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:59:10 devstack sudo[106250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc Sep 22 15:59:10 devstack sudo[106250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:59:10 devstack sudo[106250]: pam_unix(sudo:session): session closed for user root Sep 22 15:59:10 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-ab4eddd9-ee11-4f9a-8a02-0673f49756b5 tempest-ProjectReaderTests-653964704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc" returned: 0 in 0.241s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:59:10 devstack cinder-volume[86212]: DEBUG cinder.manager [None req-ab4eddd9-ee11-4f9a-8a02-0673f49756b5 tempest-ProjectReaderTests-653964704 None] Notifying Schedulers of capabilities ... {{(pid=86212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 15:59:10 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-ab4eddd9-ee11-4f9a-8a02-0673f49756b5 tempest-ProjectReaderTests-653964704 None] Deleted volume successfully. Sep 22 15:59:10 devstack cinder-volume[86212]: DEBUG cinder.coordination [None req-ab4eddd9-ee11-4f9a-8a02-0673f49756b5 tempest-ProjectReaderTests-653964704 None] Lock "cinder-67473435-d9b6-4405-8aed-87f87519956b-delete_volume" released by "delete_volume" :: held 1.030s {{(pid=86212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 15:59:20 devstack cinder-volume[86212]: DEBUG dbcounter [-] [86212] Writing DB stats cinder:UPDATE=40,cinder:SELECT=26,cinder:INSERT=13,cinder:DELETE=3 {{(pid=86212) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 22 15:59:20 devstack cinder-volume[86212]: DEBUG dbcounter [-] [86212] Writing DB stats cinder:UPDATE=47,cinder:DELETE=5,cinder:SELECT=27,cinder:INSERT=7 {{(pid=86212) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 22 15:59:38 devstack cinder-volume[86212]: DEBUG oslo_service.periodic_task [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86212) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 22 15:59:38 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 15:59:38 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 15:59:38 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31': None} {{(pid=86212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 15:59:38 devstack cinder-volume[86212]: DEBUG cinder.volume.drivers.quobyte [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2df652c0-7031-49c7-985f-8d9528110c31'] {{(pid=86212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 15:59:38 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 15:59:38 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 15:59:38 devstack sudo[106532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc Sep 22 15:59:38 devstack sudo[106532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 15:59:38 devstack sudo[106532]: pam_unix(sudo:session): session closed for user root Sep 22 15:59:38 devstack cinder-volume[86212]: DEBUG oslo_concurrency.processutils [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13c3e8bc731bb64f16f611f9f0b948cc" returned: 0 in 0.247s {{(pid=86212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 15:59:38 devstack cinder-volume[86212]: DEBUG cinder.manager [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] Notifying Schedulers of capabilities ... {{(pid=86212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 15:59:38 devstack cinder-volume[86212]: DEBUG oslo_service.periodic_task [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] Running periodic task VolumeManager._thread_info {{(pid=86212) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 22 15:59:38 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] thread count: 29 {{(pid=86212) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 22 15:59:38 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-0ae4c7b8-bd3f-434e-9110-db18ee4c6401 None None] thread info: [<_MainThread(MainThread, started 136163191222400)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86212) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}